M1-076M1: Mathematics & Statistics FundamentalsHypothesis TestingEasy
⚡Flashcard Drill➔Mastery:
Explain the Decision Criteria Between Two-Sample t-Test and z-Test
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Use a z-test when population variance is known or sample size is very large () by CLT; use a t-test when variance is unknown and estimated via sample variance in small-to-moderate samples.
📌 Key Takeaways
- •z-test: Assumes known variance or invokes CLT for large samples; statistic .
- •t-test: Accounts for additional variance from estimating ; statistic .
- •Heavier tails: Student's t-distribution has fatter tails than Gaussian, producing more conservative critical values for small .
📐 Mathematical Derivations
Derivation of Student's t-distribution: Let . Then , and , with and statistically independent by Cochran's theorem. A Student's t-variable is defined as the ratio of a standard normal to the square root of an independent normalized chi-square variable: . As degrees of freedom , by Slutsky's theorem.
🏭 Production Trade-offs
In industrial A/B testing where sample size is in the millions per variant, the -distribution and normal distribution are numerically indistinguishable (). However, Welch's t-test (which relaxes the equal variance assumption: with Satterthwaite degrees of freedom) is the industry standard default because equal group variance is rarely guaranteed.
⚠️ Common Interview Pitfalls
- ✕Using Student's t-test with pooled variance when group variances are unequal (violates homoscedasticity; Welch's t-test must be used).
- ✕Assuming t-tests are fully robust to extreme outliers in small sample sizes ().
🎯 Interviewer Follow-up Inquiries
- ?How does Welch's t-test approximate degrees of freedom via the Welch-Satterthwaite equation?
- ?Why is Welch's t-test preferred over Student's pooled t-test even when sample sizes are equal?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚