Vals AI benchmarks reasoning effort versus cost

An analysis of seven frontier AI models across eight benchmarks measures how lowering reasoning effort impacts performance and cost. The evaluation finds that lowering reasoning effort reduces cost much more than it reduces score, with four models retaining at least 80% of their Vals Index score at half the cost or less. Open article →