Markov Chains

The Markov property and transition matrices, Chapman-Kolmogorov, classification of states, stationary distributions and convergence, reversibility, absorption and hitting times.0/13 mastered

1 / 13

For the weather chain

P = \begin{bmatrix} 0.7 & 0.2 & 0.1 \\ 0.3 & 0.6 & 0.1 \\ 0.3 & 0.1 & 0.6 \end{bmatrix}

(states ordered Sunny, Cloudy, Rainy), compute

p^{(2)}_{11}

Review the explanation for this topic →

Your answer

#6593

All topicsAll Probability topics