From bars to curves
In the discrete world, every outcome has its own probability. Roll a die: P(3) = 1/6. Count heads: P(X = 5) is a number you can write down. But what if outcomes are real numbers — like measuring the exact time a bus arrives, or the precise length of a phone call?
In the continuous world, the probability of any exact value is zero. Instead, probabilities live in intervals.
Probability density functions
For discrete random variables, we listed probabilities with a PMF. For continuous random variables, we describe how probability is "smeared" across the number line using a density function.
A continuous random variable has a probability density function satisfying:
- for all
- For any interval :
The PDF is not a probability itself — it's a density. The height of the curve tells you how concentrated probability is near that value. Actual probability only comes from the area under the curve over an interval.
Drag the interval endpoints around. The shaded area is the probability.
Discrete vs. continuous: a side-by-side
| Feature | Discrete | Continuous |
|---|---|---|
| Outcomes | Countable (integers, categories) | Uncountable (real numbers) |
| Distribution | PMF: | PDF: |
| Probabilities from | Summing: | Integrating: |
| P(X = exact value) | Can be positive | Always 0 |
| Total |
Because P(X = a) = 0 for continuous RVs, it doesn't matter whether intervals are open or closed: .
The cumulative distribution function
Just like in the discrete case, the CDF accumulates probability from the left:
The PDF and CDF are related by differentiation: wherever is differentiable.
Properties of the CDF (same as in the discrete case):
- is non-decreasing
- as
- as
Explore the connection between PDF and CDF — drag a point and watch area accumulate, or compute interval probabilities:
Is it discrete or continuous?
Can you list all possible values? If yes, it's discrete. If the values form a continuous range, it's continuous.
Number of emails you receive today
Expectation and variance
The formulas from the discrete case carry over — just replace sums with integrals:
All the rules you learned still hold:
- Linearity:
- Variance scaling:
- Independence: If , then and
Summary
| Concept | Key Idea |
|---|---|
| Density function; height ≠ probability | |
| Probability | Area under the curve over an interval |
| P(X = exact value) | Always 0 for continuous RVs |
| CDF | |
| Expectation | Replace with |
Mental shift: In the continuous world, stop asking "what's the probability of this value" and start asking "what's the probability of this region."
What's next
Now that we know what continuous distributions look like, let's meet the simplest one: the Uniform distribution — where every interval of the same length is equally likely.