Probability
Limit Theorems
Markov's Inequality

Markov's Inequality

Markov's inequality is a distribution-free tail bound. It says that if a random variable is non-negative, then its mean controls how large it can be.

📏

Markov's is the "simplest" of all probability bounds. It requires nothing but a Mean (E[X]E[X]) and a non-negative variable. Because it uses so little information, it is often very conservative (loose), but it provides a guaranteed safety net.

Statement

If X0X \ge 0 and a>0a>0:

P(Xa)E[X]a.P(X \ge a) \le \frac{E[X]}{a}.

Intuition: The Weight of the Average

If the average age of people in a room is 20, how many people can be 80 or older? Markov says: P(Age80)2080=25%P(\text{Age} \ge 80) \le \frac{20}{80} = 25\%.

If more than 25% of the room were 80, the average would have to be higher than 20. Therefore, the average acts as an "anchor" that prevents too much of the probability mass from drifting too far to the right.


The Master Key: Building Chebyshev's

Markov's Inequality is the "Master Key" used to prove many other famous bounds.

The most important example is Chebyshev's Inequality. By applying Markov's Inequality to the squared distance from the mean (Xμ)2(X-\mu)^2, we can derive a much more powerful bound that uses the Variance.

Why it can be loose

Markov can be conservative because it uses only the mean. If the distribution has heavy tails or lots of mass near 0, the bound may be far from the true probability.

Test Your Knowledge

Example: Using Markov's inequality

A factory produces lightbulbs with an average lifespan of 1000 hours. The distribution is unknown, but lifespan must be non-negative. Use Markov's Inequality to find an upper bound on the probability that a lightbulb lasts at least 4000 hours.

View Step-by-Step Solution

Markov's formula: P(Xa)E[X]aP(X \ge a) \le \frac{E[X]}{a}.

  • E[X]=1000E[X] = 1000
  • a=4000a = 4000

P(X4000)10004000=0.25P(X \ge 4000) \le \frac{1000}{4000} = 0.25.

Without knowing anything else about the distribution, we guarantee that at most 25% of the lightbulbs will last 4000 hours or more.