CalcPath
ProgressProblem setsFeedback
← Question sheet

Probability · Solutions

Random Variables and Discrete Distributions

12 questions · about 105 minutes

Work this sheet on paper, showing every step — the method is what is being tested, and the solutions are written so you can check your route rather than just your answer. Name every result you use (“by linearity of expectation”, “by memorylessness”, “by the BINS checklist”) and say whether it needs independence. No calculator is needed anywhere: leave answers as exact fractions, binomial coefficients and powers of e. Full worked solutions are on a separate page; each question also has its own reveal, so you can check one answer without seeing the rest.

  1. 1.Computation

    A random variable X has probability mass function

    p(k)=k(k+1)c​,k=1,2,3,…,

    and p(x)=0 for every other x.

    1. (a)Find the value of c, stating both conditions a pmf must satisfy and showing which one determines c.
    2. (b)Show that P(X>n)=n+11​ for every integer n≥0, and hence write down the cumulative distribution function F(n) at each integer n≥1.
    3. (c)Compute P(X≤3), P(2≤X≤4), F(3.5), P(X<3) and P(X≤3). Explain in one sentence why the last two differ, and why F(3.5)=F(3).

    Solution

    (a) The two conditions. A pmf must be non-negative and must sum to 1 over its support. Non-negativity only forces c≥0; the total mass fixes c. Split the summand by partial fractions:

    k(k+1)1​=k1​−k+11​.

    The partial sums telescope: ∑k=1n​(k1​−k+11​)=1−n+11​→1. So ∑k≥1​p(k)=c⋅1, and this equals 1 exactly when c=1.

    (b) The tail telescopes too. For n≥0,

    P(X>n)=k=n+1∑∞​(k1​−k+11​)=N→∞lim​(n+11​−N+11​)=n+11​.

    Taking n=0 recovers the total mass 1, a check on (a). By the complement rule, at each integer n≥1,

    F(n)=P(X≤n)=1−n+11​=n+1n​.

    (c) Reading probabilities off the tail. P(X≤3)=F(3)=43​.

    P(2≤X≤4)=F(4)−F(1)=54​−21​=103​. Check by adding the three terms directly: 61​+121​+201​=6010+5+3​=6018​=103​ ✓.

    F(3.5)=P(X≤3.5)=P(X≤3)=43​, because X takes no value in (3,3.5], so the running total does not move between 3 and 3.5 — the cdf is flat between support points.

    P(X<3)=P(X≤2)=F(2)=32​, whereas P(X≤3)=43​. They differ by exactly p(3)=121​: for a discrete variable the point 3 itself carries mass, so a strict and a non-strict inequality are different events.

  2. 2.Sketch

    Two fair four-sided dice, with faces 1,2,3,4, are rolled independently. Let M be the larger of the two numbers shown (if they tie, M is the common value).

    1. (a)Explain why P(M≤k)=(4k​)2 for k=1,2,3,4, naming the property of the dice you use. Then obtain the pmf of M from the cdf, and check that it sums to 1.
    2. (b)Sketch y=FM​(x) for −1≤x≤6. Mark the height of every flat piece, and draw each jump with a filled dot and an open dot placed so that the graph shows which value FM​ actually takes at the jump.
    3. (c)Read P(M<3), P(M≥3) and P(1.5<M≤3.2) off your sketch, saying for each which heights you are subtracting. Confirm the last one from the pmf.

    Solution

    (a) Go through the cdf, not the pmf. The event {M≤k} says the larger die is at most k, which happens exactly when both dice are at most k. Each die shows a value in {1,…,k} with probability 4k​, and the dice are independent, so the two conditions multiply:

    FM​(k)=P(M≤k)=4k​⋅4k​=16k2​,k=1,2,3,4.

    The pmf is the size of each jump of the cdf: pM​(k)=FM​(k)−FM​(k−1), with FM​(0)=0. Hence

    pM​(k)=16k2−(k−1)2​=162k−1​,

    which gives pM​(1)=161​, pM​(2)=163​, pM​(3)=165​, pM​(4)=167​. These sum to 161+3+5+7​=1616​=1 ✓. (The counting check: of the 16 equally likely ordered pairs, exactly 2k−1 have maximum k — the pair (k,k) plus the k−1 pairs (k,j) and the k−1 pairs (j,k) with j<k.)

    (b) The staircase. The graph is a staircase with four steps and five flat pieces.

    For x<1 the height is 0: no value of M is below 1. On [1,2) the height is 161​; on [2,3) it is 164​=41​; on [3,4) it is 169​; and for x≥4 it is 1, since M can never exceed 4.

    At each of x=1,2,3,4 the graph jumps upward by 161​,163​,165​,167​ respectively — the jump sizes are the pmf, and they grow because larger maxima are more common. At each jump put the filled dot at the top of the step, on the right-hand piece, and the open dot at the bottom on the left-hand piece: FM​(x)=P(M≤x) includes the value x itself, so at x=2 the function already equals 164​, not 161​. That is right-continuity, and the dots are how a sketch records it.

    Draw the flat pieces as horizontal segments, the jumps as gaps (not vertical lines), and label the five heights 0,161​,164​,169​,1 on the y-axis.

    (c) Reading the sketch. P(M<3)=P(M≤2)=FM​(2), the height of the piece on [2,3), which is 164​=41​. It is not the height at 3, because the strict inequality excludes the jump at 3.

    P(M≥3)=1−P(M<3)=1−41​=43​: the total height minus the height just to the left of 3.

    P(1.5<M≤3.2)=FM​(3.2)−FM​(1.5). Neither 1.5 nor 3.2 is a support point, so read the flat pieces they sit on: FM​(3.2)=FM​(3)=169​ and FM​(1.5)=FM​(1)=161​, giving 169​−161​=168​=21​. From the pmf, the only support points in (1.5,3.2] are 2 and 3, and pM​(2)+pM​(3)=163​+165​=21​ ✓.

  3. 3.Computation

    Let X be the number shown by a single fair six-sided die. Work with exact fractions throughout.

    1. (a)Compute E(X), E(X2) and Var(X), stating which formula you use for the variance.
    2. (b)Compute E[(X−3)2] in two ways: directly from the pmf using the law of the unconscious statistician, and by expanding the square and using linearity together with your answers to (a). Compare the result with Var(X) and comment on the difference.
    3. (c)Now let X1​ and X2​ be two independent fair dice. Compare Y=2X1​ (one die, doubled) with S=X1​+X2​ (two dice, added). Find the mean and variance of each, name the theorem each step uses, and say which of those theorems needed independence.

    Solution

    (a) Mean and variance from the definition. Each value 1,…,6 has probability 61​, so

    E(X)=61+2+3+4+5+6​=621​=27​,E(X2)=61+4+9+16+25+36​=691​.

    By the computational formula Var(X)=E(X2)−[E(X)]2,

    Var(X)=691​−449​=12182​−12147​=1235​.

    (b) Two routes to the same number. Directly, by the law of the unconscious statistician with g(x)=(x−3)2, weight each g(x) by 61​: the values of (x−3)2 for x=1,…,6 are 4,1,0,1,4,9, so

    E[(X−3)2]=64+1+0+1+4+9​=619​.

    By expansion, (X−3)2=X2−6X+9, and linearity of expectation gives

    E[(X−3)2]=E(X2)−6E(X)+9=691​−21+9=691​−672​=619​.

    The two agree ✓. Note that 619​=1238​ exceeds Var(X)=1235​ by exactly 123​=41​=(27​−3)2. That is no accident: the mean squared distance from any point c is the variance plus the squared offset of c from the mean, so the variance is the smallest mean squared distance, attained only at c=μ.

    (c) Doubling one die is not rolling two. Means first. By linearity, E(Y)=2E(X1​)=7 and E(S)=E(X1​)+E(X2​)=7. Linearity needs no independence, so the second computation would be valid even if the dice were glued together.

    Variances. For Y=2X1​ use the scale rule Var(aX+b)=a2Var(X), which holds unconditionally:

    Var(Y)=4⋅1235​=335​.

    For S use the theorem that variances of independent variables add — and here the independence of the two dice is exactly what licenses it:

    Var(S)=1235​+1235​=635​.

    So Y and S share a mean but Var(Y)=2Var(S). The reason is visible without any formula: Y can only be even and is 2 or 12 a sixth of the time each, whereas S piles up near 7 because the two dice can offset each other. A second independent source of randomness spreads a total out less than repeating one source twice does. The only step that used independence was the variance of S; every other step was linearity or the scale rule.

  4. 4.Proof

    Let X be a discrete random variable with E(X2)<∞, mean μ=E(X) and variance σ2=Var(X).

    1. (a)Prove that for every real constant c,

      E[(X−c)2]=σ2+(μ−c)2.

      Name each theorem you invoke, and point out where the hypothesis E(X2)<∞ is used.
    2. (b)Deduce that c=μ is the unique value of c minimising E[(X−c)2], and deduce also that E(X2)≥[E(X)]2.
    3. (c)Verify the identity in (a) numerically for X the number of heads in two independent fair coin flips and c=2, computing both sides separately.

    Solution

    (a) Add and subtract the mean. Write X−c=(X−μ)+(μ−c) and expand the square:

    (X−c)2=(X−μ)2+2(μ−c)(X−μ)+(μ−c)2.

    The hypothesis E(X2)<∞ guarantees that E(X) and E[(X−μ)2] both exist, so every expectation below is a finite number and linearity may be applied. Taking expectations term by term — this is linearity of expectation, with μ−c and (μ−c)2 treated as the constants they are —

    E[(X−c)2]=E[(X−μ)2]+2(μ−c)E(X−μ)+(μ−c)2.

    The first term is σ2 by the definition of variance. For the middle term, linearity again gives E(X−μ)=E(X)−μ=0, so the cross term vanishes. What remains is σ2+(μ−c)2. ■

    (b) Two consequences. The right-hand side is σ2 plus a square. A square is ≥0 and equals 0 only when μ−c=0, so E[(X−c)2]≥σ2 for every c, with equality if and only if c=μ. That is the uniqueness of the minimiser: the mean is the point about which the mean squared deviation is smallest.

    For the inequality, take c=0: E(X2)=σ2+μ2≥μ2, since σ2≥0 as the expectation of a non-negative quantity. (Rearranged, this is the computational formula σ2=E(X2)−μ2, which the identity therefore contains as the special case c=0.)

    (c) A numerical check. Two fair flips give P(X=0)=41​, P(X=1)=21​, P(X=2)=41​, so μ=0⋅41​+1⋅21​+2⋅41​=1 and E(X2)=0+21​+1=23​, hence σ2=23​−1=21​.

    Right-hand side with c=2: σ2+(μ−c)2=21​+(1−2)2=23​.

    Left-hand side, by the law of the unconscious statistician: (X−2)2 takes the values 4,1,0 with probabilities 41​,21​,41​, so E[(X−2)2]=4⋅41​+1⋅21​+0⋅41​=23​ ✓.

  5. 5.Computation

    A spinner lands in the shaded sector with probability 31​ on each spin, independently. It is spun four times and X is the number of shaded results, so X∼B(4,31​).

    1. (a)Write out the complete pmf of X as exact fractions over a common denominator, and check that the five values sum to 1.
    2. (b)Find P(X≥2) and P(X<2). Write the complement you use out in full before substituting numbers.
    3. (c)State E(X) and Var(X) from the binomial formulas, and then verify E(X) by summing kP(X=k) directly from your table in (a).
    4. (d)Show that for any X∼B(n,p) the consecutive probabilities satisfy

      P(X=k)P(X=k+1)​=k+1n−k​⋅1−pp​,

      and use this ratio, not the table, to find the most likely value of X when n=4, p=31​.

    Solution

    (a) The pmf. With n=4, p=31​, 1−p=32​ and denominator 34=81:

    P(X=0)=(04​)(32​)4=8116​,P(X=1)=(14​)31​(32​)3=814⋅8​=8132​,P(X=2)=(24​)(31​)2(32​)2=816⋅4​=8124​,

    P(X=3)=(34​)(31​)332​=814⋅2​=818​,P(X=4)=(31​)4=811​.

    Sum: 16+32+24+8+1=81, so the total is 8181​=1 ✓ (this is the binomial theorem for (31​+32​)4 written out).

    (b) Get the boundary right. “At least 2” excludes exactly the values 0 and 1:

    P(X≥2)=1−P(X≤1)=1−P(X=0)−P(X=1)=1−8116​−8132​=8133​=2711​.

    And P(X<2)=P(X≤1)=8148​=2716​, the complement, as it must be. Cross-check from the table: 24+8+1=33 ✓.

    (c) Moments. E(X)=np=34​ and Var(X)=np(1−p)=4⋅31​⋅32​=98​. Directly,

    E(X)=810⋅16+1⋅32+2⋅24+3⋅8+4⋅1​=8132+48+24+4​=81108​=34​ ✓.

    (If you also check the variance: E(X2)=8132+96+72+16​=81216​=38​, and 38​−916​=924−16​=98​ ✓.)

    (d) The ratio of neighbours. From the pmf,

    P(X=k)P(X=k+1)​=(kn​)(k+1n​)​⋅pk(1−p)n−kpk+1(1−p)n−k−1​=k+1n−k​⋅1−pp​,

    using (k+1n​)/(kn​)=(k+1)!(n−k−1)!n!​⋅n!k!(n−k)!​=k+1n−k​. The pmf rises while this ratio exceeds 1 and falls once it drops below 1, so the mode is the first k at which the ratio falls below 1 — unless the ratio equals 1 exactly, in which case two neighbouring values tie.

    With n=4 and 1−pp​=2/31/3​=21​, the ratio is 2(k+1)4−k​: for k=0 it is 24​=2>1, so P(X=1)>P(X=0); for k=1 it is 43​<1, so P(X=2)<P(X=1), and the ratio only shrinks after that. The most likely value is therefore X=1. The table agrees — 8132​ is the largest entry — and the mode sits just below the mean 34​, as it should for a right-skewed binomial with p<21​.

  6. 6.Critique

    A test has 20 multiple-choice questions, each with 4 options and each worth 5 marks. A student who has not studied guesses uniformly at random on every question, independently. Let X be the number of correct guesses and Y=5X the mark. Asked for P(X≥3) and the standard deviation of Y, the student submits the following.

    Step 1. Each question is a Bernoulli trial with p=41​, so X∼B(20,41​) and E(X)=20⋅41​=5.

    Step 2. Each single question has standard deviation p(1−p)​=43​​. The questions are independent, so the standard deviations add: SD(X)=20⋅43​​=53​.

    Step 3. “At least 3” is the complement of “at most 3”, so

    P(X≥3)=1−k=0∑3​(k20​)(41​)k(43​)20−k.

    Step 4. Since Y=5X, SD(Y)=52SD(X)=25⋅53​=1253​.

    One of the four steps is entirely correct.

    1. (a)Identify every flaw. For each one, name the rule that is being misapplied and state what the rule actually says.
    2. (b)Give the correct SD(X) and SD(Y), and a one-line sanity check that exposes the student's values as impossible.
    3. (c)Give the correct value of P(X≥3) as a single exact expression, simplified as far as (43​)18 times a rational number.

    Solution

    (a) Three flaws; Step 1 is sound. Step 1 checks BINS correctly — binary outcomes, independent questions, n=20 fixed in advance, constant p=41​ — and E(X)=np=5 by linearity of expectation.

    Step 2 adds standard deviations. The rule is that for independent variables the variances add, Var(X)=∑i​Var(Xi​); standard deviations never do, because a+b​=a​+b​. Independence is genuinely available here, but it licenses adding 20 copies of p(1−p)=163​, not 20 copies of 43​​.

    Step 3 misplaces the boundary. For an integer-valued variable the complement of {X≥3} is {X≤2}, not {X≤3}. The written sum subtracts P(X=3) from both sides of the fence, so the student's expression equals P(X≥4). The correct form is P(X≥k)=1−P(X≤k−1).

    Step 4 squares the wrong quantity. The scale rule is Var(aX)=a2Var(X), and therefore SD(aX)=∣a∣SD(X). The square belongs to the variance; taking the square root undoes it. Multiplying a standard deviation by a2 inflates it by a spurious factor of ∣a∣.

    (b) The correct spreads. Var(X)=np(1−p)=20⋅41​⋅43​=415​, so

    SD(X)=215​​,SD(Y)=5⋅215​​=2515​​.

    Sanity check: X lives on {0,…,20} with mean 5. The student's SD(X)=53​>8 would put one standard deviation below the mean at a negative number of correct answers; and 1253​>216 is a standard deviation larger than the maximum possible mark of 100. A spread cannot exceed the range of the variable. The true values, roughly 1.9 answers and 9.7 marks, are of the right size.

    (c) The correct probability. With the boundary fixed,

    P(X≥3)=1−P(X=0)−P(X=1)−P(X=2).

    The three terms are (43​)20, 20⋅41​(43​)19 and (220​)(41​)2(43​)18=190⋅161​(43​)18. Pull out the common factor (43​)18:

    P(X≤2)=(43​)18[169​+20⋅41​⋅43​+16190​]=(43​)18⋅169+60+190​=16259​(43​)18.

    Therefore

    P(X≥3)=1−16259​(43​)18=1−420259⋅318​.

    For scale, 16259​(43​)18 is a little over 0.09, so P(X≥3) is roughly 0.91 — with 5 correct expected, scoring at least 3 should indeed be very likely, which the student's misplaced boundary would have understated.

  7. 7.Computation

    Orders arrive at a small bakery's website at an average rate of 2 per hour, and the Poisson assumptions (constant rate, independence across disjoint windows, no simultaneous orders) are taken to hold. Leave every answer in terms of powers of e.

    1. (a)Find the probability of exactly 2 orders in a given hour, and the probability of at least 2 orders in that hour.
    2. (b)Find the probability of no orders at all in a 90-minute window. Then confirm your answer a second way, by splitting the window into an hour and a half-hour and using the rule for sums of independent Poisson variables.
    3. (c)For the hourly count, compute the ratio P(X=k)P(X=k+1)​ and use it to find every most likely value of X.
    4. (d)Which is more likely: exactly 2 orders in one hour, or exactly 4 orders in two hours? Decide without a calculator, giving an inequality on e that settles it, and explain in a sentence why the answer makes sense.

    Solution

    (a) One hour, λ=2. With X∼Poisson(2),

    P(X=2)=2!e−222​=2e−2.

    “At least 2” has infinitely many terms, so use the complement, which excludes exactly the values 0 and 1:

    P(X≥2)=1−P(X=0)−P(X=1)=1−e−2−2e−2=1−3e−2.

    (b) Rescale λ to the window first. Ninety minutes is 23​ hours, so the count in that window is Poisson with parameter 2⋅23​=3, and

    P(no orders in 90 min)=0!e−330​=e−3.

    Second way: the window is an hour followed by a disjoint half-hour, whose counts are independent Poisson variables with parameters 2 and 1. The whole window is empty exactly when both pieces are empty, so the probability is e−2⋅e−1=e−3 ✓. (This is the sum rule in action: the total count is Poisson(2+1), whose zero-term is e−3.)

    (c) The ratio of neighbours. For a Poisson(λ) variable,

    P(X=k)P(X=k+1)​=e−λλk/k!e−λλk+1/(k+1)!​=k+1λ​.

    With λ=2 this is k+12​: it equals 2 at k=0, exactly 1 at k=1, and 32​<1 at k=2, shrinking thereafter. So P(X=0)<P(X=1)=P(X=2)>P(X=3)>⋯, and there are two most likely values, 1 and 2, each with probability 2e−2. (Whenever λ is a positive integer, λ−1 and λ tie.)

    (d) Two hours, λ=4. The two-hour count is Poisson(4), so

    P(exactly 4 in 2 h)=4!e−444​=24256​e−4=332​e−4.

    Compare with 2e−2 by dividing:

    332​e−42e−2​=326​e2=163e2​.

    This exceeds 1 exactly when e2>316​. Since e>2.7, e2>7.29>316​, so the ratio is greater than 1 and exactly 2 orders in one hour is the more likely event.

    Why this is reasonable: both events ask for the count to land exactly on its mean, but the two-hour count has variance 4 rather than 2, so its mass is spread over more values and each individual value — including the mean — gets less of it. Note also that “4 in two hours” is not the same as “2 in each hour”: the latter has probability (2e−2)2=4e−4, only one of the five ways (0+4,1+3,2+2,3+1,4+0) of reaching a total of 4.

  8. 8.Computation

    Items coming off a production line are defective independently with probability 51​. An inspector tests them one at a time, and X is the position of the first defective item found, so X is geometric with p=51​ on {1,2,3,…}.

    1. (a)Compute P(X=4), P(X>4) and P(X≤4) as exact fractions, and explain the tail probability by an argument about the first four items rather than by summing a series.
    2. (b)State E(X), Var(X) and SD(X).
    3. (c)The first six items have all passed. Find the probability that the first defective is item 8 or later, first by quoting memorylessness and then by computing the conditional probability directly from the tail formula.
    4. (d)Find the median of X: the smallest integer n with P(X≤n)≥21​. Compare it with the mean and explain the direction of the difference.

    Solution

    (a) Read the pmf off the experiment. For the first defective to be the fourth item, items 1–3 must pass and item 4 must fail:

    P(X=4)=(54​)3⋅51​=12564​⋅51​=62564​.

    The event {X>4} says simply that the first four items all passed, which by independence has probability (54​)4=625256​ — no summation needed. Then P(X≤4)=1−625256​=625369​.

    (b) Moments. E(X)=p1​=5, Var(X)=p21−p​=1/254/5​=20, and SD(X)=20​=25​, roughly 4.5 — nearly as large as the mean, as geometric waiting times usually are.

    (c) Memorylessness, then the check. By memorylessness, P(X>m+n∣X>m)=P(X>n). Here m=6 and “item 8 or later” is X>7=6+1, so

    P(X>7∣X>6)=P(X>1)=54​.

    Directly: {X>7}⊆{X>6}, so the intersection is {X>7} and

    P(X>7∣X>6)=P(X>6)P(X>7)​=(4/5)6(4/5)7​=54​ ✓.

    Six passes in a row have taught the inspector nothing about item 7: it fails with probability 51​, exactly as item 1 did.

    (d) The median. P(X≤n)=1−(54​)n≥21​ exactly when (54​)n≤21​. Now (54​)3=12564​>12562.5​=21​, while (54​)4=625256​<625312.5​=21​. So the smallest such n is 4: the median is 4, with P(X≤3)=12561​ just under a half and P(X≤4)=625369​ just over.

    The median 4 is below the mean 5. The geometric pmf is right-skewed — it is largest at k=1 and decays geometrically — so a minority of very long waits drags the mean above the point that splits the probability in half. Half of all inspections find a defective within 4 items, but the average wait is 5.

  9. 9.Proof

    Let X∼Poisson(λ). You may quote E(X)=λ and E[X(X−1)]=λ2, and the exponential series et=∑k≥0​tk/k! for every real t.

    1. (a)Prove that P(X is even)=21+e−2λ​. Deduce that an even count is always strictly more likely than an odd one, and describe what happens as λ→∞.
    2. (b)Prove that E[X(X−1)(X−2)]=λ3, and deduce that E(X3)=λ3+3λ2+λ.
    3. (c)Let Y∼Poisson(μ) be independent of X. Prove that, conditional on X+Y=n, the variable X is binomial:

      P(X=j∣X+Y=n)=(jn​)(λ+μλ​)j(λ+μμ​)n−j,j=0,1,…,n.

    Solution

    (a) Alternate the signs. Consider the difference between the even and the odd mass:

    P(X even)−P(X odd)=k=0∑∞​(−1)kk!e−λλk​=e−λk=0∑∞​k!(−λ)k​=e−λe−λ=e−2λ,

    by the exponential series at t=−λ. We also know P(X even)+P(X odd)=1, since the pmf sums to 1. Adding the two equations and halving,

    P(X even)=21+e−2λ​.■

    Since e−2λ>0 for every λ>0, this exceeds 21​ strictly, so even counts always win — the edge comes entirely from the k=0 term, which is even and has no odd partner of comparable size. As λ→∞, e−2λ→0 and the probability tends to 21​: for a large rate, parity is a coin flip.

    (b) Cancel three factors of the factorial. The terms k=0,1,2 vanish because k(k−1)(k−2)=0 there. For k≥3, k!k(k−1)(k−2)​=(k−3)!1​, so

    E[X(X−1)(X−2)]=k=3∑∞​(k−3)!e−λλk​=λ3e−λj=0∑∞​j!λj​=λ3e−λeλ=λ3,

    after substituting j=k−3. (The law of the unconscious statistician is what lets us write the expectation as this sum.)

    For the cube, expand the falling factorials: X(X−1)(X−2)=X3−3X2+2X and X(X−1)=X2−X. Hence

    X3=X(X−1)(X−2)+3X(X−1)+X,

    which you can confirm by expanding the right side: X3−3X2+2X+3X2−3X+X=X3 ✓. Taking expectations by linearity,

    E(X3)=λ3+3λ2+λ.■

    Check at λ=1: E(X3)=5, which is the right size — it must exceed E(X2)=λ2+λ=2 because X3≥X2 on the support.

    (c) Condition on the total. By the definition of conditional probability, and because {X=j}∩{X+Y=n}={X=j}∩{Y=n−j},

    P(X=j∣X+Y=n)=P(X+Y=n)P(X=j,Y=n−j)​=P(X+Y=n)P(X=j)P(Y=n−j)​,

    the factorisation in the numerator being independence. The denominator is known: independent Poissons add, so X+Y∼Poisson(λ+μ). Substituting all three pmfs,

    P(X=j∣X+Y=n)=n!e−(λ+μ)(λ+μ)n​j!e−λλj​⋅(n−j)!e−μμn−j​​=j!(n−j)!n!​⋅(λ+μ)nλjμn−j​.

    The exponentials cancel exactly, the factorials assemble into (jn​), and splitting (λ+μ)n=(λ+μ)j(λ+μ)n−j gives

    (jn​)(λ+μλ​)j(λ+μμ​)n−j,

    which is the B(n,λ+μλ​) pmf. ■

    The interpretation: once you know n events occurred in total, each one was independently an “X-type” event with probability proportional to its rate. Note that λ and μ can be any positive numbers, but the binomial parameter λ+μλ​ is a genuine probability in (0,1), exactly as it must be.

  10. 10.Computation

    Two unrelated situations, one waiting time and one draw from a finite pool.

    Situation A. A basketball player makes each free throw independently with probability 32​. Let X be the number of the shot on which she records her second make.

    Situation B. A committee of 4 is chosen uniformly at random from a group of 6 women and 4 men. Let W be the number of women on the committee.

    1. (a)Name the distribution of X and its parameters. Compute P(X=2), P(X=3) and P(X=4) as fractions with denominator 81, and hence P(X>4). Then verify P(X>4) independently by an argument about the first four shots alone.
    2. (b)Find E(X) and Var(X), and explain why X is a sum of two independent geometric variables — say what each one counts and which theorem makes their variances add.
    3. (c)Name the distribution of W and its parameters. Compute P(W=2), E(W) and Var(W) exactly.
    4. (d)A student models W as B(4,53​) instead. Compute that model's P(W=2) and variance, decide whether the approximation is acceptable by the usual rule of thumb, and explain in terms of the finite population correction why the true variance is the smaller of the two.

    Solution

    (a) Negative binomial, r=2, p=32​. For the second make to land on shot k, shot k must be a make and exactly one of the first k−1 shots must be a make:

    P(X=k)=(1k−1​)(32​)2(31​)k−2=(k−1)⋅94​⋅(31​)k−2,k=2,3,…

    So P(X=2)=94​=8136​, P(X=3)=2⋅94​⋅31​=278​=8124​, P(X=4)=3⋅94​⋅91​=8112​.

    Adding, P(X≤4)=8136+24+12​=8172​=98​, hence P(X>4)=91​.

    Independent check: {X>4} says the second make has not arrived by shot 4, i.e. the first four shots contain at most one make. The number of makes in four shots is B(4,32​), so

    P(X>4)=(31​)4+(14​)32​(31​)3=811​+818​=819​=91​ ✓.

    (b) Two geometric stages. Let W1​ be the number of shots up to and including the first make, and W2​ the number of further shots from there up to and including the second make. Then X=W1​+W2​ exactly. Each Wi​ is geometric(32​): after the first make the sequence of independent shots simply restarts, which is memorylessness. The two stages depend on disjoint blocks of shots, so they are independent.

    Linearity gives E(X)=2⋅p1​=2⋅23​=3. Because the stages are independent, the variance-of-a-sum theorem applies and

    Var(X)=2⋅p21−p​=2⋅4/91/3​=2⋅43​=23​.

    Sanity check against (a): the mean 3 sits between the two most likely values 2 and 3, and P(X≤4)=98​ says the distribution is tight, consistent with a standard deviation of about 1.2.

    (c) Hypergeometric, N=10, K=6, n=4. The committee is a sample without replacement from a finite pool, so

    P(W=2)=(410​)(26​)(24​)​=21015⋅6​=21090​=73​.

    With p=NK​=53​: E(W)=np=4⋅53​=512​, and

    Var(W)=np(1−p)⋅N−1N−n​=4⋅53​⋅52​⋅96​=2524​⋅32​=2516​.

    (d) The binomial is the wrong model here. Under B(4,53​),

    P(W=2)=(24​)(53​)2(52​)2=6⋅259​⋅254​=625216​,Var(W)=4⋅53​⋅52​=2524​.

    Compare 625216​ (about 0.35) with the true 73​ (about 0.43): the binomial is off by nearly 0.08 on a single probability. The rule of thumb allows the binomial when the sample is at most 10% of the population; here n/N=104​=40%, far outside it, so the approximation is not acceptable. The mean, 512​, is the same under both models — linearity does not care about dependence — but the binomial variance 2524​ overstates the true 2516​ by the factor N−nN−1​=69​.

    The reason is the finite population correction N−1N−n​=32​. Each woman chosen leaves fewer women in the pool, so the draws push the count back toward its mean: the dependence is negative, and it shrinks the spread. Sampling with replacement would waste draws on people already chosen and could not exert this pull, which is why it has the larger variance.

  11. 11.Proof

    Throughout, “geometric with parameter p” means the distribution P(X=k)=(1−p)k−1p on k=1,2,3,… with 0<p≤1, and you may quote its tail P(X>n)=(1−p)n.

    1. (a)Let X and Y be independent, geometric with parameters p and q respectively, and let M=min(X,Y). Prove that M is geometric with parameter r=1−(1−p)(1−q). Give a one-sentence interpretation of r in terms of the two trial sequences run side by side.
    2. (b)Prove that P(X is odd)=2−p1​, and deduce that this is strictly greater than 21​ for every p∈(0,1].
    3. (c)Two players, A and B, take turns flipping a coin that shows heads with probability p; A flips first, and the first player to flip heads wins. Let a=P(A wins). Without using (b), set up an equation for a by conditioning on A's first flip and invoking memorylessness, solve it, and confirm it agrees with (b).

    Solution

    (a) Work with tails, which multiply. The minimum exceeds n exactly when both variables do, and by independence

    P(M>n)=P(X>n,Y>n)=P(X>n)P(Y>n)=(1−p)n(1−q)n=((1−p)(1−q))n=(1−r)n,

    where r=1−(1−p)(1−q). Since 0<p≤1 forces 0≤1−p<1, and likewise for q, the product (1−p)(1−q) lies in [0,1), so 0<r≤1 is a legitimate parameter.

    A distribution on {1,2,…} is determined by its tail, because the pmf is the sequence of tail differences. For k≥1,

    P(M=k)=P(M>k−1)−P(M>k)=(1−r)k−1−(1−r)k=(1−r)k−1(1−(1−r))=(1−r)k−1r,

    which is exactly the geometric(r) pmf. ■

    Interpretation: run both sequences of trials in parallel and call round k a “success” if either sequence succeeds on its kth trial. Rounds are independent and each succeeds with probability 1−(1−p)(1−q)=r — one minus the chance that both fail — so M, the first successful round, is the waiting time for a Bernoulli(r) process. (For p=q=21​, r=43​ and E(M)=34​.)

    (b) Sum over the odd support. The odd values are k=2j+1 for j=0,1,2,…, so

    P(X odd)=j=0∑∞​(1−p)2jp=pj=0∑∞​((1−p)2)j=1−(1−p)2p​,

    a geometric series with ratio (1−p)2<1, convergent because p>0. The denominator is 1−(1−2p+p2)=2p−p2=p(2−p), and cancelling the p (legitimate since p>0) gives

    P(X odd)=2−p1​.■

    For 0<p≤1 we have 1≤2−p<2, so 2−p1​>21​. The first trial is odd-numbered and carries the single largest lump of probability, p; every later odd trial is paired with the even trial before it, which is likelier, but the unpaired first trial tips the balance. At p=1 the probability is 1 (the first trial always succeeds), and as p→0 it falls toward 21​.

    (c) Condition on the first flip. Either A's first flip is heads, with probability p, and A wins at once; or it is tails, with probability 1−p, and the game continues with B flipping first. Because the coin has no memory, that continuation is a fresh copy of the original game with the roles swapped, so B now wins it with probability a and A with probability 1−a. Hence

    a=p⋅1+(1−p)(1−a).

    Solve: a=p+1−p−(1−p)a, so a+(1−p)a=1, i.e. a(2−p)=1 and

    a=2−p1​.

    This agrees with (b), as it must: A wins exactly when the first head appears on an odd-numbered flip, and the number of the first head is geometric(p). For a fair coin A wins with probability 32​ — moving first is worth a full extra third.

  12. 12.Computation

    A clinic recruits for a study. Each person screened qualifies independently with probability 101​. For every part below, first name the distribution and its parameters and quote the tell in the wording that identifies it, then do the calculation. Leave every answer exact.

    1. (a)Thirty people are screened on Monday and X is the number who qualify. Find E(X) and Var(X). Write down the exact P(X=0) and the Poisson approximation to it, and prove which of the two numbers is larger by using the inequality 1−x<e−x for x>0 (justify that inequality in one line).
    2. (b)Screening continues one person at a time until 3 people have qualified, and T is the number of people screened. Find E(T), Var(T) and SD(T), and write P(T=30) as an exact expression.
    3. (c)Separately, the clinic has a list of 12 past volunteers, of whom exactly 3 have condition Z. Four names are drawn at random without replacement and Z is the number drawn who have the condition. Find P(Z=0) and E(Z).
    4. (d)Outside referrals arrive at the clinic at a rate of 21​ per working day, under Poisson assumptions. Let F be the number of referral-free days in a 5-day week and D the number of the first referral-free day. Identify the distribution of each — one of them needs a probability that a Poisson calculation must supply first — and find E(F), P(F=5) and E(D). Check P(F=5) a second way by treating the whole week as one window.

    Solution

    (a) Binomial: fixed n, count of successes. Thirty independent screenings with constant p, and X counts successes, so X∼B(30,101​) — the tell is “thirty people are screened … how many qualify”. E(X)=np=3 and Var(X)=np(1−p)=30⋅101​⋅109​=1027​.

    Exactly, P(X=0)=(109​)30. With n large and p small, the Poisson(λ) approximation with λ=np=3 gives P(X=0)≈e−3.

    Which is larger? The inequality 1−x<e−x for x>0 holds because f(x)=e−x−(1−x) satisfies f(0)=0 and f′(x)=1−e−x>0 for x>0, so f is strictly positive there. Apply it with x=101​ and raise both (positive) sides to the 30th power:

    (109​)30=(1−101​)30<(e−1/10)30=e−3.

    So the Poisson approximation overstates the exact probability of zero qualifiers. (The two are close — the error of the Poisson limit is of order λ2/n=103​ relative to unity in the exponent, i.e. a few percent here.)

    (b) Negative binomial: count of trials until the rth success. The number of trials is random and the number of successes is fixed at 3 — “continue until 3 have qualified” — so T is negative binomial with r=3, p=101​, on {3,4,5,…}. As a sum of three independent geometric(101​) waits,

    E(T)=pr​=30,Var(T)=p2r(1−p)​=1001​3⋅109​​=270,SD(T)=270​=330​.

    The standard deviation, a little over 16, is more than half the mean: the recruiter should not plan on “about 30”.

    For T=30, person 30 must qualify and exactly 2 of the first 29 must qualify:

    P(T=30)=(229​)(101​)3(109​)27=1030406⋅927​.

    (The coefficient is (229​)=229⋅28​=406, not (330​): the last trial is not free.)

    (c) Hypergeometric: without replacement from a small pool. Four names from a list of 12 with 3 marked, drawn without replacement — “drawn at random without replacement” from a fixed finite list is the tell — so Z is hypergeometric with N=12, K=3, n=4. Choosing no one with the condition means all four names come from the 9 unmarked:

    P(Z=0)=(412​)(03​)(49​)​=495126​=5514​.

    E(Z)=nNK​=4⋅123​=1 — by linearity over the four indicator variables, dependence notwithstanding. The binomial would not do here: n/N=31​ is far above 10%.

    (d) A Poisson feeds a binomial and a geometric. Referrals in a single day are Poisson with λ=21​ (a rate over a window, no list of trials), so a given day is referral-free with probability

    π=P(Poisson(21​)=0)=e−1/2.

    Under the Poisson assumptions, counts in disjoint days are independent, so the five days are independent Bernoulli(π) trials.

    F counts successes among a fixed n=5 of them: F∼B(5,e−1/2), with E(F)=5e−1/2 and

    P(F=5)=π5=e−5/2.

    Second way: the whole week is a single window of 5 days, so its referral count is Poisson(5⋅21​)=Poisson(25​), and “no referrals all week” is its zero term, e−5/2 ✓ — the sum rule for independent Poissons and the binomial product agree, as they must.

    D counts trials (days) up to and including the first success (a free day), so D is geometric with parameter π=e−1/2 on {1,2,…}, and

    E(D)=π1​=e1/2.

    This is a little under 2: with only half a referral expected per day, a quiet day comes quickly. The two-step reading is the point of the part — a Poisson calculation supplies the p that a binomial and a geometric then consume.

← Back to the question sheet

CalcPath·Free university mathematics

SubjectsProblem setsProgressFeedbackAbout