M1-083M1: Mathematics & Statistics Fundamentals实验设计 (A/B)Medium
⚡Flashcard Drill➔Mastery:
Explain Stratified Randomization in Experimental Design and When It Is Strictly Required
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Stratified randomization divides the population into homogeneous strata based on key covariates (e.g. Operating system, spend tier) and randomizes within each stratum, guaranteeing perfect covariate balance and reducing treatment effect variance.
📌 Key Takeaways
- •Core Mechanism: Partitions population into mutually exclusive strata ; within each stratum, exactly of units are allocated to Treatment and to Control.
- •Guaranteed Balance: Eliminates the possibility of accidental pre-experiment covariate imbalance (e.g. 60% iOS in treatment vs 40% in control).
- •Variance Reduction: Removes between-strata variance from the standard error of treatment effect: .
📐 Mathematical Derivations
By the Law of Total Variance, population metric variance decomposes into: , where is stratum weight and is within-stratum variance. Under simple random assignment, variance of estimated treatment effect is . Under stratified randomization, because each stratum is balanced exactly, the between-strata component is completely purged from estimation noise: .
🏭 Production Trade-offs
When stratified randomization is mandatory: (1) Small sample experiments (, such as enterprise B2B A/B tests or hospital trials) where simple random sampling frequently produces bad imbalances. (2) Presence of heavy whales: In gaming or ad monetization, stratified bucketing based on historical spend tiers prevents top-spending 'whales' from clustering by chance into one bucket. In large-scale consumer apps (), simple randomization achieves balance by the Law of Large Numbers, making post-experiment CUPED adjustment mathematically equivalent and operationally simpler.
⚠️ Common Interview Pitfalls
- ✕Stratifying on post-treatment variables (must strictly stratify on pre-treatment baseline covariates).
- ✕Over-stratifying across too many crossed variables, leading to empty or single-unit strata.
🎯 Interviewer Follow-up Inquiries
- ?Why is post-stratification (or CUPED ANCOVA) asymptotically equivalent to pre-experiment stratified randomization in large samples?
- ?How does re-randomization (Morgan & Rubin, 2012) reject unbalanced assignments before deploying treatments?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚