The Markov property and transition matrices, Chapman-Kolmogorov, classification of states, stationary distributions and convergence, reversibility, absorption and hitting times.0/14 mastered
1 / 14
For the weather chain P=0.70.30.30.20.60.10.10.10.6 (states ordered Sunny, Cloudy, Rainy), what is p12, the probability of moving from Sunny to Cloudy in one step?