M1-004M1: Mathematics & Statistics FundamentalsProbability FoundationsMedium
⚡Flashcard Drill➔Mastery:
Explain Linearity of Expectation and Additivity of Variance, Highlighting Necessary Preconditions
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Expectation is universally linear without any independence assumptions; variance additivity strictly requires zero pairwise covariance (uncorrelatedness).
📌 Key Takeaways
- •Linearity of expectation holds universally across any arbitrary joint distribution, even under complete mutual dependence.
- •Variance additivity requires .
- •CUPED variance reduction in online experimentation fundamentally exploits non-zero covariance to cancel noise.
📐 Mathematical Derivations
By definition of discrete or continuous integration, . No independence or distributional constraints are needed. For variance, . Hence, additivity holds if and only if . If and are negatively correlated, the variance of their sum is strictly smaller than the sum of variances.
🏭 Production Trade-offs
In A/B testing and metric evaluation: (1) Sample means reliably estimate population means regardless of internal user interactions because expectation is unconditionally linear. (2) For ratio metrics like Click-Through Rate , numerator and denominator are strongly correlated across user clusters, so standard variance formulas fail and delta method or bootstrap must be used. (3) CUPED constructs with optimal , reducing variance to .
⚠️ Common Interview Pitfalls
- ✕Assuming variance is linear or additive when variables are correlated.
- ✕Confusing 'uncorrelated' () with 'statistically independent' (only equivalent for joint Gaussian distributions).
🎯 Interviewer Follow-up Inquiries
- ?How does the Delta Method approximate the expectation and variance of non-linear transformations ?
- ?Why does cluster randomization require hierarchical variance estimation instead of simple i.i.d. variance additivity?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚