M8-069M8: ML Systems, Engineering & ResearchModel Governance & Risk ManagementEasy
⚡Flashcard Drill➔Mastery:
Explain Primary Algorithmic Fairness Formulations and the Impossibility Theorem of Machine Learning Fairness
🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
📐 Mathematical Definition
⚡ One-Sentence Core Answer
Mathematical definitions of fairness—Demographic Parity, Equal Opportunity, Equalized Odds, and Predictive Rate Parity—cannot be simultaneously satisfied in the presence of unequal base rates (the Impossibility Theorem), requiring domain-specific objective selection and explicit trade-off governance.
📌 Key Takeaways
- •Statistical definitions: Demographic Parity (), Equal Opportunity (equal true positive rates across groups), Equalized Odds (equal TPR and FPR across groups), and Calibration within Groups (equal positive predictive value).
- •The Impossibility Theorem (Kleinberg, Chouldechova): If the base rates , then a non-trivial predictor cannot simultaneously achieve equalized odds and calibration within groups.
- •Regulatory & domain alignment: Selecting metrics based on legal doctrine (e.g., EEOC 80% four-fifths rule for disparate impact vs. Equal Credit Opportunity Act) and documenting irreducible Pareto trade-offs.
📐 Mathematical Derivations
Mathematical Formalisms & The Impossibility Proof:
(1) Core Fairness Formulations:
Let be a binary protected attribute, the ground-truth label, and the model prediction ( the predicted probability).
- 1. Demographic Parity (Statistical Parity):
Acceptance rate is invariant to group membership. Completely ignores ground-truth .
- 2. Equal Opportunity (Hardt et al.):
- 3. Equalized Odds:
Equivalently, prediction is conditionally independent of protected attribute given true label : .
- 4. Predictive Rate Parity (Calibration by Group):
(2) The Impossibility Theorem (Kleinberg et al., Chouldechova 2017):
- Theorem: If the underlying base rates differ between groups, i.e., , and predictions are imperfect (AUC ), then Calibration within Groups and Equalized Odds are mathematically incompatible.
- Algebraic Mechanism: By Bayes' rule, the False Positive Rate can be expressed via positive predictive value (PPV ) and base rate :
If PPV () is calibrated across groups and TPR is equalized, then whenever , the term forces , directly violating Equalized Odds.
(1) Core Fairness Formulations:
Let be a binary protected attribute, the ground-truth label, and the model prediction ( the predicted probability).
- 1. Demographic Parity (Statistical Parity):
Acceptance rate is invariant to group membership. Completely ignores ground-truth .
- 2. Equal Opportunity (Hardt et al.):
- 3. Equalized Odds:
Equivalently, prediction is conditionally independent of protected attribute given true label : .
- 4. Predictive Rate Parity (Calibration by Group):
(2) The Impossibility Theorem (Kleinberg et al., Chouldechova 2017):
- Theorem: If the underlying base rates differ between groups, i.e., , and predictions are imperfect (AUC ), then Calibration within Groups and Equalized Odds are mathematically incompatible.
- Algebraic Mechanism: By Bayes' rule, the False Positive Rate can be expressed via positive predictive value (PPV ) and base rate :
If PPV () is calibrated across groups and TPR is equalized, then whenever , the term forces , directly violating Equalized Odds.
🏭 Production Trade-offs
In-Depth Analysis & Engineering Trade-offs: ① The Impossibility Theorem proves there is no universally fair model—attempting to satisfy all definitions simultaneously is mathematically impossible whenever underlying historical base rates diverge; teams must make an explicit, documented choice. ② Demographic Parity penalizes qualification-based selection when base rates differ—if group base rates differ, forcing equal positive rates forces either accepting lower-qualified candidates from one group or rejecting qualified candidates from another. ③ Calibration is essential for risk scoring, Equal Opportunity is essential for opportunity access—underwriting requires well-calibrated probabilities for pricing interest rates; employment screening prioritizes equal chance of selection for qualified applicants (Equal Opportunity). ④ Post-processing thresholds trade off global utility—setting group-specific thresholds to enforce Equal Opportunity reduces global classification accuracy and may face legal restrictions under anti-discrimination statutes against explicit race/gender scoring. ⑤ Fairness interventions span three tiers—Pre-processing (re-weighting/re-sampling data), In-processing (adversarial debiasing loss penalties), and Post-processing (threshold tuning). ⑥ Interview takeaway—write down the mathematical definitions of DP, EO, and Calibration, sketch the algebraic proof of why forces incompatibility, and explain how domain context dictates the optimal Pareto compromise.
⚠️ Common Interview Pitfalls
- ✕Claiming a model satisfies all algorithmic fairness metrics simultaneously, displaying complete ignorance of Kleinberg's Impossibility Theorem.
- ✕Enforcing Demographic Parity indiscriminately in high-stakes risk prediction where true base rates differ, distorting probability calibration and downstream utility.
- ✕Applying group-specific post-processing thresholds in production environments without verifying whether disparate treatment statutes prohibit explicit group-conditioned decision rules.
🎯 Interviewer Follow-up Inquiries
- ?Why does enforcing Equalized Odds via group-specific thresholding often reduce global overall accuracy?
- ?How does the U.S. EEOC 80% (four-fifths) rule translate into an empirical Demographic Parity threshold?
- ?Under what conditions can individual fairness (treating similar individuals similarly) be aligned with group fairness metrics?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
📚