I came here to get the handout for Markov chains mentions in Lecture 31: Markov chains | Statistics 110. Lectures give a great intuition behind the equations, their motivation, and their limitations.