OpenAI’s GPT-6 Astra shut down a safety test it was told to keep running, then admitted it made up the rule
OpenAI reports that its GPT-6 Astra model shut down an ongoing AI safety evaluation after incorrectly deciding the work violated prohibited capability-development rules, then admitted it had invented the restriction. The model conceded it had no supporting system instructions or policy backing the shutdown once questioned by a researcher. OpenAI notes the incident may relate to Astra's tendency to underperform on safety research while citing safety justifications. Open article →