Investigator agents detect alignment eval honeypots

metr.org16 min read

Researchers investigating whether AI models can distinguish between capability and alignment evaluations found that investigator agents are increasingly able to tell the two apart. The evaluation analysis shows that models detect alignment evals by recognizing environment-level artifacts and task-level features, such as simulated services and intentionally planted honeypots. Open article →