Key Metrics: The "Shape" of a Distribution

1. Expected Value (The Mean)

The Expected Value, denoted as $E[X]$ or $\mu$ (mu), is the theoretical long-run average of the random variable. It represents the "center of mass" or the balancing point of the distribution.

• For Discrete variables: Multiply every possible outcome by its probability, and sum them up. $E[X] = \sum x \cdot p(x)$
• For Continuous variables: Multiply every value by its probability density, and integrate across the entire range. $E[X] = \int x \cdot f(x) dx$

2. Variance and Standard Deviation (The Spread)

While the mean tells you where the center is, the Variance ($\sigma^2$) tells you how spread out or clustered the data is around that center.

Variance is the average of the squared differences from the Mean. We square the differences so that negative errors don't cancel out positive errors.

Because variance is measured in squared units (e.g., "squared dollars" or "squared inches"), it is mathematically awkward to interpret. Therefore, we almost always take the square root to get the Standard Deviation ($\sigma$), which brings the spread back into the original units.

3. Skewness (The Lean)

Skewness measures the asymmetry of a distribution.

• Zero Skew: The distribution is perfectly symmetrical (like the Normal distribution). The mean and median are perfectly identical.
• Positive (Right) Skew: The distribution has a long "tail" stretching off to the right. The mass of the data is concentrated on the left. (e.g., Human income—most people earn an average amount, but a few billionaires stretch the tail infinitely to the right). Mean $>$ Median.
• Negative (Left) Skew: The distribution has a long tail stretching to the left. (e.g., Human lifespan—most people live to old age, with a tail stretching down towards zero). Mean $<$ Median.

Interactive Visualization: Skewness vs The Mean

Notice how the tail of a skewed distribution physically "drags" the Mean away from the Median!

4. Kurtosis (The Tails)

Kurtosis measures the "tailedness" of a distribution relative to a standard Normal distribution. It tells you about the frequency of extreme outliers.

• Mesokurtic (Kurtosis $\approx$ 3): Standard Normal distribution tails.
• Leptokurtic (High Kurtosis): "Fat tails." The distribution produces extreme outliers far more frequently than a Normal distribution. Financial market returns are famously leptokurtic.
• Platykurtic (Low Kurtosis): "Thin tails." The distribution produces fewer outliers. A Uniform distribution is highly platykurtic because it has absolutely zero probability of an outlier beyond its bounds.

Test Your Knowledge