Skip to content
Tutorials Center
My learning

Topics

Lesson 13 of 57 ยท Probability Foundations

Probability Rules

Master the core probability rules: complement, addition (including overlapping events), multiplication for independent events, and how to solve at-least-one problems step by step.

With a sample space and events in hand, you now need rules for combining probabilities. There are only a few, and they handle a huge range of problems: the complement rule, the addition rule, and the multiplication rule. This lesson explains each one, shows where people go wrong, and checks every rule by computer.

The complement rule

The complement of event A is "A does not happen". Since A and its complement cover the whole sample space without overlap:

P(not A) = 1 - P(A)

This is the most useful shortcut in probability. Whenever "at least one" or "not all" appears, consider the complement.

If the chance of rain is 0.3, the chance of no rain is 0.7.

The addition rule

For mutually exclusive events (they cannot both occur), probabilities simply add:

P(A or B) = P(A) + P(B)

For a die, P(1 or 6) = 1/6 + 1/6 = 1/3.

For events that can overlap, adding double-counts the overlap, so subtract it once:

P(A or B) = P(A) + P(B) - P(A and B)

Draw one card from a standard deck. Let A = "heart" (13 cards) and B = "face card" (J, Q, K: 12 cards). Three cards are both (J, Q, K of hearts). So P(A or B) = 13/52 + 12/52 - 3/52 = 22/52 โ‰ˆ 0.423. Without the subtraction you would count those three cards twice.

flowchart LR
    A["P(A)"] --> U["P(A or B)"]
    B["P(B)"] --> U
    I["minus P(A and B)<br/>overlap counted twice"] --> U

Add the two events, then remove the overlap that was counted twice.

Python Check the addition rule on a deck

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The multiplication rule and independence

To find the probability that two events both occur:

P(A and B) = P(A) * P(B given A)

(The conditional term is explained in conditional probability.) For independent events, where knowing one happened tells you nothing about the other, this simplifies to

P(A and B) = P(A) * P(B)

Two coin flips are independent: P(two heads) = 0.5 * 0.5 = 0.25. Rolling a six on each of three dice: (1/6)^3 = 1/216.

Beware of mutually exclusive versus independent. They are different, and in fact opposite in a sense: if A and B are mutually exclusive and both have positive probability, then they are dependent, since A happening guarantees B does not.

Dependent events: drawing without replacement

Draw two cards from a deck without replacing the first. The chance both are aces is 4/52 * 3/51 = 12/2652 โ‰ˆ 0.0045. The second factor changed because the first draw changed the deck. With replacement the draws would be independent and the answer (4/52)^2 โ‰ˆ 0.0059.

Python With and without replacement

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The "at least one" trick

"What is the chance of at least one six in four rolls?" Counting all the ways is messy, but the complement is easy: no sixes at all.

P(at least one six) = 1 - (5/6)^4 โ‰ˆ 1 - 0.4823 = 0.5177

General recipe: P(at least one) = 1 - P(none).

Python At least one success

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The famous birthday problem uses the same trick: in a group of just 23 people, the chance that at least two share a birthday exceeds 50%, because 1 - (365/365 * 364/365 * ... * 343/365) is about 0.507.

Python The birthday problem

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

Summary of the rules

Situation Rule
Not A 1 - P(A)
A or B, mutually exclusive P(A) + P(B)
A or B, general P(A) + P(B) - P(A and B)
A and B, independent P(A) * P(B)
A and B, general P(A) * P(B given A)
At least one 1 - P(none)

Common mistakes

  • Adding probabilities of overlapping events without subtracting the overlap.
  • Multiplying probabilities of dependent events as if they were independent.
  • Confusing "mutually exclusive" with "independent".
  • Believing in the gambler's fallacy: after five heads in a row, the next fair-coin flip is still 50-50.

Check your understanding

Quick check ยท 5 questions

of 5 answered You scored / 5 ยท perfect!

  1. 1. P(rain) = 0.35. What is P(no rain)?

    The complement rule: 1 - 0.35 = 0.65.
  2. 2. P(A) = 0.5, P(B) = 0.4, P(A and B) = 0.2. What is P(A or B)?

    0.5 + 0.4 - 0.2 = 0.7.
  3. 3. Three fair coin flips: P(all heads) is...

    The flips are independent: (1/2)^3 = 1/8.
  4. 4. Two events with positive probabilities are mutually exclusive. Are they independent?

    If one occurs, the other cannot, so knowing one changes the probability of the other to zero.
  5. 5. What is the probability of at least one head in 3 fair flips?

    1 - P(no heads) = 1 - 1/8 = 7/8.

Summary

  • The complement rule: P(not A) = 1 - P(A).
  • Addition: add probabilities, and subtract the overlap if events can occur together.
  • Multiplication: multiply for independent events; use conditional probability for dependent ones.
  • "At least one" problems are usually easiest as 1 - P(none).
  • Mutually exclusive and independent are different ideas.

Next: Counting: Permutations and Combinations