Probability
1. Foundations
Core Concepts

Core Concepts

💡

Before we can analyze the beautiful curves and formulas of advanced statistics, we must establish the foundational language of probability.

1. What is Probability?

At its core, probability is the mathematical study of uncertainty and randomness. We define it using three terms:

  • Experiment (or Trial): Any procedure that can be infinitely repeated and has a well-defined set of possible outcomes. (e.g., Flipping a coin, rolling a die, measuring the lifespan of a battery.)
  • Sample Space (Ω\Omega): The set of all uniquely possible outcomes of an experiment. (e.g., For a single coin flip, Ω={Heads,Tails}\Omega = \{\text{Heads}, \text{Tails}\}.)
  • Event (EE): A specific subset of the sample space that we actually care about. (e.g., Rolling an even number on a die, E={2,4,6}E = \{2, 4, 6\}.)
📏

The Golden Rule: The probability of an event P(E)P(E) is always a number between 00 (impossible) and 11 (absolutely certain).


2. Random Variables

🤔

A "Random Variable" is a terrible name for what is actually a very simple concept. It is neither random, nor is it a variable in the traditional algebraic sense!

A Random Variable (XX) is simply a function that translates a real-world outcome into a number.

Math prefers numbers over words. We can't do calculus on the word "Heads," so we use a random variable to assign "Heads" to the number 11, and "Tails" to 00.

There are two distinct families of random variables, and identifying which one you are working with is the first step in any statistical analysis.

A. Discrete Random Variables

Discrete variables represent data that you count. They can only take on distinct, separated values. There are "gaps" between the possible values.

  • Examples: The number of heads in 10 coin flips (0,1,2,,100, 1, 2, \dots, 10). The number of cars in a parking lot. The number of students in a class.
  • Visualization: Discrete data is visualized using Bar Charts, where each bar stands alone.

B. Continuous Random Variables

Continuous variables represent data that you measure. They can take on literally any value within a given range, including infinite decimals.

  • Examples: The exact time it takes to run a marathon (e.g., 14,532.44314,532.443\dots seconds). The exact weight of an apple. The exact temperature outside.
  • Visualization: Continuous data is visualized using smooth Density Curves (like the famous Bell Curve). You don't look at individual points; you look at the area under the curve.

Test Your Knowledge

Example: Sample Space & Events

You roll a fair 6-sided die and then flip a fair coin.

  1. How many outcomes are in the sample space Ω\Omega?
  2. What is the probability of the event EE: "Rolling an even number AND flipping Heads"?
View Step-by-Step Solution

1. Sample Space: By the fundamental counting principle, 6 (die faces)×2 (coin sides)=126 \text{ (die faces)} \times 2 \text{ (coin sides)} = 12 total outcomes.

2. Probability: The even numbers are 6, which is 3 possibilities. The coin must be Heads, which is 1 possibility. So, E=3×1=3|E| = 3 \times 1 = 3.

P(E)=312=14=25%P(E) = \frac{3}{12} = \frac{1}{4} = 25\%