M8-069M8: ML Systems, Engineering & ResearchModel Governance & Risk ManagementEasy
⚡Flashcard Drill➔Mastery:

Explain Primary Algorithmic Fairness Formulations and the Impossibility Theorem of Machine Learning Fairness

🎯 Active Recall Self-Check (Draft First, Verify After)
Login-free practice tracker: recall core answer, audit pitfalls, and log review status.
Step 1 · Draft your concise answer & assumptions
Step 2 · Check Pitfalls & Follow-up Inquiries
Next: M8-070 →
📐 Mathematical Definition
DP: Pr⁡[Y^=1∣A=0]=Pr⁡[Y^=1∣A=1];EO: Pr⁡[Y^=1∣Y,A]=Pr⁡[Y^=1∣Y,A′]\text{DP}:\ \Pr[\hat Y{=}1\mid A{=}0]=\Pr[\hat Y{=}1\mid A{=}1];\quad \text{EO}:\ \Pr[\hat Y{=}1\mid Y,A]=\Pr[\hat Y{=}1\mid Y,A']
⚡ One-Sentence Core Answer
Mathematical definitions of fairness—Demographic Parity, Equal Opportunity, Equalized Odds, and Predictive Rate Parity—cannot be simultaneously satisfied in the presence of unequal base rates (the Impossibility Theorem), requiring domain-specific objective selection and explicit trade-off governance.

📌 Key Takeaways

  • •
    Statistical definitions: Demographic Parity (P(Y^=1∣A=0)=P(Y^=1∣A=1)P(\hat{Y}=1 \mid A=0) = P(\hat{Y}=1 \mid A=1)), Equal Opportunity (equal true positive rates across groups), Equalized Odds (equal TPR and FPR across groups), and Calibration within Groups (equal positive predictive value).
  • •
    The Impossibility Theorem (Kleinberg, Chouldechova): If the base rates P(Y=1∣A=0)≠P(Y=1∣A=1)P(Y=1 \mid A=0) \ne P(Y=1 \mid A=1), then a non-trivial predictor cannot simultaneously achieve equalized odds and calibration within groups.
  • •
    Regulatory & domain alignment: Selecting metrics based on legal doctrine (e.g., EEOC 80% four-fifths rule for disparate impact vs. Equal Credit Opportunity Act) and documenting irreducible Pareto trade-offs.

📐 Mathematical Derivations

Mathematical Formalisms & The Impossibility Proof:

(1) Core Fairness Formulations:
Let A∈{0,1}A \in \{0, 1\} be a binary protected attribute, Y∈{0,1}Y \in \{0, 1\} the ground-truth label, and Y^∈{0,1}\hat{Y} \in \{0, 1\} the model prediction (R∈[0,1]R \in [0, 1] the predicted probability).
- 1. Demographic Parity (Statistical Parity):
P(Y^=1∣A=0)=P(Y^=1∣A=1)P(\hat{Y}=1 \mid A=0) = P(\hat{Y}=1 \mid A=1)
Acceptance rate is invariant to group membership. Completely ignores ground-truth YY.
- 2. Equal Opportunity (Hardt et al.):
P(Y^=1∣Y=1,A=0)=P(Y^=1∣Y=1,A=1)(Equal TPR / Recall)P(\hat{Y}=1 \mid Y=1, A=0) = P(\hat{Y}=1 \mid Y=1, A=1) \quad (\text{Equal TPR / Recall})
- 3. Equalized Odds:
∀y∈{0,1}:P(Y^=1∣Y=y,A=0)=P(Y^=1∣Y=y,A=1)(Equal TPR and FPR)\forall y \in \{0, 1\}: \quad P(\hat{Y}=1 \mid Y=y, A=0) = P(\hat{Y}=1 \mid Y=y, A=1) \quad (\text{Equal TPR and FPR})
Equivalently, prediction Y^\hat{Y} is conditionally independent of protected attribute AA given true label YY: Y^⊥A∣Y\hat{Y} \perp A \mid Y.
- 4. Predictive Rate Parity (Calibration by Group):
P(Y=1∣R=r,A=0)=P(Y=1∣R=r,A=1)=r∀r∈[0,1]P(Y=1 \mid R=r, A=0) = P(Y=1 \mid R=r, A=1) = r \quad \forall r \in [0, 1]

(2) The Impossibility Theorem (Kleinberg et al., Chouldechova 2017):
- Theorem: If the underlying base rates differ between groups, i.e., p0=P(Y=1∣A=0)≠P(Y=1∣A=1)=p1p_0 = P(Y=1 \mid A=0) \ne P(Y=1 \mid A=1) = p_1, and predictions are imperfect (AUC <1.0< 1.0), then Calibration within Groups and Equalized Odds are mathematically incompatible.
- Algebraic Mechanism: By Bayes' rule, the False Positive Rate can be expressed via positive predictive value (PPV vv) and base rate pp:
FPR=p1−p⋅1−vv⋅TPR\text{FPR} = \frac{p}{1-p} \cdot \frac{1-v}{v} \cdot \text{TPR}
If PPV (vv) is calibrated across groups and TPR is equalized, then whenever p0≠p1p_0 \ne p_1, the term p1−p\frac{p}{1-p} forces FPR0≠FPR1\text{FPR}_0 \ne \text{FPR}_1, directly violating Equalized Odds.

🏭 Production Trade-offs

In-Depth Analysis & Engineering Trade-offs: ① The Impossibility Theorem proves there is no universally fair model—attempting to satisfy all definitions simultaneously is mathematically impossible whenever underlying historical base rates diverge; teams must make an explicit, documented choice. ② Demographic Parity penalizes qualification-based selection when base rates differ—if group base rates differ, forcing equal positive rates forces either accepting lower-qualified candidates from one group or rejecting qualified candidates from another. ③ Calibration is essential for risk scoring, Equal Opportunity is essential for opportunity access—underwriting requires well-calibrated probabilities for pricing interest rates; employment screening prioritizes equal chance of selection for qualified applicants (Equal Opportunity). ④ Post-processing thresholds trade off global utility—setting group-specific thresholds τ0≠τ1\tau_0 \ne \tau_1 to enforce Equal Opportunity reduces global classification accuracy and may face legal restrictions under anti-discrimination statutes against explicit race/gender scoring. ⑤ Fairness interventions span three tiers—Pre-processing (re-weighting/re-sampling data), In-processing (adversarial debiasing loss penalties), and Post-processing (threshold tuning). ⑥ Interview takeaway—write down the mathematical definitions of DP, EO, and Calibration, sketch the algebraic proof of why p0≠p1p_0 \ne p_1 forces incompatibility, and explain how domain context dictates the optimal Pareto compromise.
⚠️ Common Interview Pitfalls
  • ✕
    Claiming a model satisfies all algorithmic fairness metrics simultaneously, displaying complete ignorance of Kleinberg's Impossibility Theorem.
  • ✕
    Enforcing Demographic Parity indiscriminately in high-stakes risk prediction where true base rates differ, distorting probability calibration and downstream utility.
  • ✕
    Applying group-specific post-processing thresholds in production environments without verifying whether disparate treatment statutes prohibit explicit group-conditioned decision rules.
🎯 Interviewer Follow-up Inquiries
  • ?
    Why does enforcing Equalized Odds via group-specific thresholding often reduce global overall accuracy?
  • ?
    How does the U.S. EEOC 80% (four-fifths) rule translate into an empirical Demographic Parity threshold?
  • ?
    Under what conditions can individual fairness (treating similar individuals similarly) be aligned with group fairness metrics?
⚡
Test muscle memory on this topic via 3-Layer Flashcards
Active Recall: Mentally formulate Prompt ➔ Math Derivation ➔ Benchmark Implementation in 3 minutes.
🎯 Drill This Card Now➔
📚

Associated Knowledge Base Guides & Mindmaps

← PreviousM8-068: Explain the Purpose, Structural Architecture, and Governance Utility of Model Cards in Machine Learning📋 Back to BankNext →M8-070: Explain the Lifecycle Taxonomy of Machine Learning Bias and the Three-Tier Mitigation Hierarchy