Markov Chains

The Markov property and transition matrices, Chapman-Kolmogorov, classification of states, stationary distributions and convergence, reversibility, absorption and hitting times.0/13 mastered

1 / 13

For the weather chain

P = \begin{bmatrix} 0.7 & 0.2 & 0.1 \\ 0.3 & 0.6 & 0.1 \\ 0.3 & 0.1 & 0.6 \end{bmatrix}

(states ordered Sunny, Cloudy, Rainy), the stationary distribution is

\pi=(0.5,0.3,0.2)

. What is

\pi_{\text{Rainy}}

Review the explanation for this topic →

Your answer

#6670

All topicsAll Probability topics