You Cannot Have All Three: The Fairness Impossibility Theorem

For an imperfect binary classifier with unequal group base rates, predictive parity and equal false positive and false negative rates cannot all hold simultaneously. This is not an engineering failure. It is a theorem. Choosing which criterion to prioritise is a normative decision, not one made by mathematics alone.

8 March 2024 · 13 min · Sebastian Spicker