Preprint: agents that act poorly can still judge and teach well after the run
Researchers report six models acting in ALFWorld were pulled off a required first subgoal by an easier one, yet credited those steps when judging the full run. As a teacher, JEV lifted a small policy from 72.8% to 82.9% on ALFWorld.
Why it matters: Grading an agent's steps after the run may catch what it misses while acting. The authors found asking whether each action helped worked better than asking whether the task would succeed.
From Drop #086 · Sat, Nov 14, 2026 · Evening