Preprint: more thinking made shopping agents more confident, not more often right
Researchers tested ten frontier models on three product-choice benchmarks. Raising thinking effort did not meaningfully improve picks but lifted stated confidence; most models were poorly calibrated, and many erred on the same tasks.
Why it matters: Don't treat an agent's stated confidence or a higher effort setting as grounds to let it buy unchecked; keep a person's confirmation step for purchases.
From Drop #095 · Thu, Nov 19, 2026 · Morning