Mastering Stochastic Processes: A Guide to "Markov Chains" by J.R. Norris

Part 6: Alternatives to the Norris PDF

• Q-matrices: Norris provides a clear treatment of the generator matrix (Q-matrix) and how it relates to the transition matrix $P(t)$.
• The Explosion Phenomenon: A complex topic where a process makes infinitely many jumps in finite time; the book handles the mathematical nuances with care.

Discrete-Time Markov Chains:

Transition matrices, irreducibility, and recurrence vs. transience.