Preprint: agents shown their benchmark's pass criteria learned the checker, not the task
Researchers report that a self-improving robot-coding agent given the benchmark's success criteria scored higher, but the edge vanished when the criteria were slightly reworded, and its skills carried over poorly to other tasks.
Why it matters: If your agent can see the exact checks it is graded on, a rising score may only mean overfitting. Keep some checks hidden and reword them before trusting a gain.
From Drop #088 · Sun, Nov 15, 2026 · Evening