What is Probability?
Probability is the branch of mathematics that quantifies uncertainty. Every day, you make intuitive probability judgments: "It's likely to rain," "I probably won't catch my bus," "This lottery ticket might win." Probability gives these intuitions a rigorous mathematical foundation.
At its simplest, probability measures how likely an event is to occur, expressed as a number between 0 and 1. A probability of 0 means the event is impossible; a probability of 1 means it is certain. Everything in between represents varying degrees of likelihood. For any event A: 0 ≤ P(A) ≤ 1.
The complement of an event A, written A' or Aᶜ, is the event that A does not occur. Since either A happens or it doesn't, we always have P(A) + P(A') = 1, which means P(A') = 1 - P(A). This simple relationship is incredibly useful in probability calculations.
Classical Probability
When all outcomes in a sample space are equally likely, calculating probability is straightforward. If there are n equally likely outcomes and m of them favor event A, then P(A) = m/n. This is called classical or theoretical probability.
Example 1: Rolling a Die
What is the probability of rolling an even number on a fair six-sided die?
Sample space S = {1, 2, 3, 4, 5, 6}, so n = 6 equally likely outcomes. Favorable outcomes: {2, 4, 6}, so m = 3. Therefore P(even) = 3/6 = 1/2 = 0.5 = 50%.
Example 2: Drawing a Card
What is the probability of drawing a King from a standard 52-card deck?
Sample space: 52 cards (n = 52). Favorable outcomes: 4 Kings. Therefore P(King) = 4/52 = 1/13 ≈ 7.7%.
Addition Rule
When we want the probability that either event A or event B occurs, we use the addition rule. The key question is whether the events can happen simultaneously—are they mutually exclusive?
For mutually exclusive events (A ∩ B = ∅): P(A or B) = P(A) + P(B). For non-mutually exclusive events: P(A or B) = P(A) + P(B) - P(A and B). We subtract P(A and B) because those outcomes were counted twice.
Example 3: Mutually Exclusive Events
In a single roll of a die, what is P(2 or 3)? Events {2} and {3} cannot happen together, so they are mutually exclusive. P(2 or 3) = P(2) + P(3) = 1/6 + 1/6 = 2/6 = 1/3.
Example 4: Non-Mutually Exclusive Events
In a single draw from a 52-card deck, what is P(King or Heart)? These are not mutually exclusive because there is a King of Hearts. P(King) = 4/52, P(Heart) = 13/52, P(King and Heart) = 1/52. So P(King or Heart) = 4/52 + 13/52 - 1/52 = 16/52 = 4/13.
Multiplication Rule
For the probability that both events A and B occur, we need the multiplication rule. This requires understanding whether the events are independent or dependent. Independent events occur when one event does not affect the probability of the other: P(A and B) = P(A) × P(B).
Dependent events occur when the outcome of one affects the probability of the other: P(A and B) = P(A) × P(B|A), where P(B|A) is the conditional probability of B given that A occurred.
Example 5: Independent Events - Two Coin Flips
What is P(Heads then Tails) with a fair coin? Each flip is independent: P(H) = 0.5, P(T) = 0.5. Therefore P(H then T) = 0.5 × 0.5 = 0.25 = 1/4.
Example 6: Dependent Events - Drawing Cards
Two cards are drawn without replacement. What is P(both are Aces)? First draw: P(Ace) = 4/52. Second draw (given first was Ace): P(Ace) = 3/51. So P(both Aces) = 4/52 × 3/51 = 12/2652 = 1/221 ≈ 0.45%.
Conditional Probability
Conditional probability finds the probability of an event given that another event has already occurred. Written as P(A|B), it reads "the probability of A given B." The formula is: P(A|B) = P(A and B) / P(B), provided P(B) > 0.
Example 7: Conditional Probability in a Class
In a class of 30 students, 18 play sports and 12 play music. Eight students do both. What is the probability that a student plays sports, given that they play music? Given: P(Sports and Music) = 8/30, P(Music) = 12/30. So P(Sports | Music) = (8/30) / (12/30) = 8/12 = 2/3. Given that a student plays music, there is a 2/3 (67%) chance they also play sports.
Permutations and Combinations
Counting outcomes is essential for probability. When order matters, we use permutations: P(n, r) = n! / (n - r)!. When order doesn't matter, we use combinations: C(n, r) = n! / (r!(n - r)!).
Example 8: Permutations
How many ways can 3 students be selected from 10 to serve as president, vice-president, and treasurer (order matters)? P(10, 3) = 10! / 7! = 10 × 9 × 8 = 720 ways.
Example 9: Combinations
How many ways can 3 students be selected from 10 to form a committee (order doesn't matter)? C(10, 3) = 10! / (3! × 7!) = (10 × 9 × 8) / (3 × 2 × 1) = 720/6 = 120 ways.
Expected Value
Expected value (EV) is the long-term average of a random variable. If you repeat an experiment many times, the expected value is what you expect the average outcome to be. For a discrete random variable: EV = Σ x · P(x).
Example 10: Expected Value in a Game
A game costs $5 to play. You roll two dice and win $20 if the sum is 7, otherwise you win nothing. Should you play? P(sum = 7) = 6/36 = 1/6. EV of winnings = ($20 × 1/6) + ($0 × 5/6) = $20/6 ≈ $3.33. Since EV ($3.33) < cost ($5), you lose on average $1.67 per game.
Bayes' Theorem
Bayes' Theorem is one of the most powerful results in probability. It allows us to update probabilities based on new evidence: P(A|B) = P(B|A) × P(A) / P(B).
Example 11: Bayes' Theorem in Medical Testing
A test for a disease is 99% accurate (both sensitivity and specificity are 99%). The disease affects 1% of the population. If you test positive, what is the probability you actually have the disease? Let D = disease, + = positive test. P(D|+) = P(+|D) × P(D) / P(+) = (0.99 × 0.01) / (0.99 × 0.01 + 0.01 × 0.99) = 0.0099/0.0198 ≈ 50%. Despite the test being 99% accurate, a positive result only gives a 50% chance of having the disease due to the low base rate.
Real-World Applications
Probability is used everywhere: insurance companies use it to set premiums, doctors use it to interpret test results, sports analysts use it to predict game outcomes, and investors use it to evaluate risk. Understanding probability helps you make better decisions under uncertainty.
In genetics, Punnett squares use probability to predict offspring traits. In weather forecasting, probabilities express the likelihood of precipitation. In quality control, manufacturers use probability to estimate defect rates. The applications are virtually unlimited.