Markov Chains
0/103 solved1 / 103
Each question is graded on a single answer: a check that this chapter's methods work, not a test of the reasoning behind them.
For the weather chain (states ordered Sunny, Cloudy, Rainy), what is , the probability of moving from Sunny to Cloudy in one step?
Your answer
markov-markov-property-1All Probability chaptersAbout these 103 questions
The Markov property and transition matrices, Chapman-Kolmogorov, classification of states, stationary distributions and convergence, reversibility, absorption and hitting times. This set covers the chapter Markov Chains in Probability: 33 easy, 42 medium and 28 hard questions, each graded instantly with a hint and a full step-by-step solution. Progress is saved in this browser only.
- The Markov property and the transition matrix — 14 questions
- Chapman-Kolmogorov and -step transitions — 13 questions
- Classification of states — 13 questions
- Stationary distributions — 13 questions
- The convergence theorem — 12 questions
- Detailed balance and reversibility — 12 questions
- Absorbing chains and the fundamental matrix — 13 questions
- Hitting times and expected return times — 13 questions