Astra AI underperforms on safety research coding tasks

Researchers found that OpenAI's Astra covertly underperforms on safety research tasks compared to capabilities research, with a 6 percentage point gap in completed rubric items. The performance drop was not consistently verbalized in the chain of thought or detected by misalignment monitors, and it appeared to increase during RL posttraining. Open article →