Core Concept
The variance of a random variable measures the spread or dispersion of its values around the expected value (mean).
Definition
For a random variable X with expected value μ=E(X):
Var(X)=E[(X−μ)2]=E(X2)−(E(X))2
Notation
- Var(X) or V(X) - Variance of X
- σ2 (sigma squared) - Common symbol for variance
- D(X) - Alternative notation (used in Chinese textbooks)
Two Formulas
Formula 1: Definition
Var(X)=E[(X−μ)2]=∑i=1n(xi−μ)2⋅pi
Formula 2: Computational (more practical)
Var(X)=E(X2)−(E(X))2
Memory aid: "Mean of squares minus square of mean"
Properties of Variance
1. Non-negativity
Var(X)≥0
Equality holds only when X is constant.
2. Constant Factor
Var(aX)=a2⋅Var(X)
Note: The factor is squared.
3. Adding a Constant
Var(X+b)=Var(X)
Adding a constant doesn't change the spread.
4. Combined Linear Transformation
Var(aX+b)=a2⋅Var(X)
5. Sum of Independent Variables
If X and Y are independent:
Var(X+Y)=Var(X)+Var(Y)
Warning: This does NOT hold for dependent variables!
6. Variance of a Constant
Var(c)=0
Common Distributions
| Distribution | Variance |
|---|
| Bernoulli(p) | p(1−p) |
| Binomial(n,p) | np(1−p) |
| Uniform({1,...,n}) | 12n2−1 |
CSCA Practice Problems
💡 Note: The following practice problems are designed based on the CSCA exam syllabus.
Example 1: Basic (Difficulty ★★☆☆☆)
A random variable X has the distribution:
Find Var(X).
Solution:
First, find E(X):
E(X)=0(0.3)+1(0.5)+2(0.2)=0+0.5+0.4=0.9
Find E(X2):
E(X2)=02(0.3)+12(0.5)+22(0.2)=0+0.5+0.8=1.3
Apply formula:
Var(X)=E(X2)−(E(X))2=1.3−0.81=0.49
Answer: Var(X)=0.49
Example 2: Intermediate (Difficulty ★★★☆☆)
If Var(X)=4, find Var(3X+2).
Solution:
Using the property Var(aX+b)=a2⋅Var(X):
Var(3X+2)=32⋅Var(X)=9×4=36
Answer: 36
Example 3: Intermediate (Difficulty ★★★☆☆)
A fair coin is tossed 100 times. Let X be the number of heads. Find Var(X).
Solution:
X follows Binomial(n=100, p=0.5).
Var(X)=np(1−p)=100×0.5×0.5=25
Answer: Var(X)=25
Example 4: Advanced (Difficulty ★★★★☆)
If E(X)=2 and E(X2)=8, find Var(2X−3).
Solution:
First, find Var(X):
Var(X)=E(X2)−(E(X))2=8−4=4
Then:
Var(2X−3)=22⋅Var(X)=4×4=16
Answer: 16
Example 5: Advanced (Difficulty ★★★★★)
If X and Y are independent with Var(X)=2 and Var(Y)=3, find Var(2X−3Y+1).
Solution:
Using properties:
Var(2X−3Y+1)=Var(2X−3Y)
=Var(2X)+Var(−3Y) (independence)
=4Var(X)+9Var(Y)
=4(2)+9(3)=8+27=35
Answer: 35
Standard Deviation
The standard deviation is the square root of variance:
σ=Var(X)
Standard deviation has the same units as X, making it more interpretable.
Variance vs. Expected Value
| Property | Expected Value E(X) | Variance Var(X) |
|---|
| Measures | Center (location) | Spread (dispersion) |
| Linear transform | E(aX+b)=aE(X)+b | Var(aX+b)=a2Var(X) |
| Sum | Always additive | Additive only if independent |
Common Mistakes
❌ Mistake 1: Forgetting to Square the Coefficient
Wrong: Var(3X)=3⋅Var(X) ✗
Correct: Var(3X)=9⋅Var(X) ✓
❌ Mistake 2: Adding Variances of Dependent Variables
Wrong: If X and Y are dependent, Var(X+Y)=Var(X)+Var(Y) ✗
Correct: This only works for independent variables ✓
❌ Mistake 3: Confusing Variance with Standard Deviation
Wrong: Standard deviation of Binomial(n,p) is np(1−p) ✗
Correct: Variance is np(1−p); standard deviation is np(1−p) ✓
Study Tips
- ✅ Use computational formula: E(X2)−(E(X))2 is usually easier
- ✅ Remember coefficient is squared: Var(aX)=a2Var(X)
- ✅ Check independence: Variance of sum only adds for independent variables
- ✅ Know binomial variance: np(1−p) is frequently tested
💡 Exam Tip: When computing variance, always find E(X) and E(X2) separately first. The computational formula is less error-prone than the definition!