Markov Chains

The Markov property and transition matrices, Chapman-Kolmogorov, classification of states, stationary distributions and convergence, reversibility, absorption and hitting times.0/13 mastered

1 / 13

For the weather chain

P = \begin{bmatrix} 0.7 & 0.2 & 0.1 \\ 0.3 & 0.6 & 0.1 \\ 0.3 & 0.1 & 0.6 \end{bmatrix}

(states ordered Sunny, Cloudy, Rainy) with

\pi=(0.5,0.3,0.2)

, what is the mean return time to Sunny?

Review the explanation for this topic →

Your answer

#6631

All topicsAll Probability topics