METR finds Claude Mythos Preview fails past minutes

Research by METR shows that as demands for reliability increase, the working horizon of AI software agents drops sharply. An early version of Claude Mythos Preview achieved a 17.4-hour time horizon on software tasks at a 50 percent success rate, but that horizon dropped to about three and a half minutes when required to succeed 99 percent of the time. Open article →