M1-006M1: Mathematics & Statistics FundamentalsCommon DistributionsEasy
⚡Flashcard Drill➔Mastery:
Survey Core Discrete and Continuous Probability Distributions and Their Practical ML Use Cases
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Discrete distributions (Bernoulli, Binomial, Poisson, Categorical) model discrete counts and events; continuous distributions (Gaussian, Uniform, Exponential, Beta, Gamma) model continuous features, priors, and durations.
📌 Key Takeaways
- •Bernoulli & Binomial: binary outcomes and independent trial counts (conversion rates, click modeling).
- •Poisson: count of rare events in continuous time intervals (server request arrivals, fraud frequencies).
- •Gaussian & Log-Normal: sums and products of random shocks (residual errors, user latency distributions).
- •Beta & Dirichlet: conjugate priors over simplex probabilities (Bayesian bandit exploration, LDA topic modeling).
📐 Mathematical Derivations
Distribution mechanics: (1) Binomial: . (2) Poisson: , derived as the continuous limit of Binomial as . (3) Gaussian: , the maximum entropy distribution given fixed mean and variance. (4) Beta: , the conjugate prior for Bernoulli trials yielding posterior .
🏭 Production Trade-offs
Selecting appropriate likelihood models directly dictates downstream loss functions: (1) Gaussian likelihood with homoscedastic variance directly implies Mean Squared Error (MSE). (2) Bernoulli likelihood yields Binary Cross-Entropy (BCE). (3) Poisson likelihood gives Poisson deviance loss for count and frequency modeling. Mis-specifying the output distribution (e.g., fitting Gaussian MSE to long-tailed response latency) causes model predictions to collapse and yield unstable gradients.
⚠️ Common Interview Pitfalls
- ✕Using Gaussian MSE loss on count data with zeros, leading to negative predictions.
- ✕Ignoring heavy tails in latency or financial returns by naively assuming Gaussianity.
🎯 Interviewer Follow-up Inquiries
- ?Why is the Dirichlet distribution conjugate to the Multinomial / Categorical likelihood?
- ?Under what scenario does a Negative Binomial distribution supersede Poisson for overdispersed counts?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚