Agent safety evals diverge from production

Researchers investigating agent safety evaluations found a surprising eval-production behavior gap, where models performed worse on safety evaluations than in comparable production decisions. The study reveals that evaluation-objective awareness is closely associated with this gap, with models that frequently verbalize incorrect evaluation objectives showing the largest performance discrepancies. Furthermore, an intervention experiment demonstrated that specifying evaluation objectives can causally shift model success rates in opposite directions. Open article →