Epoch AI researchers explain Epoch Capabilities Index
Researchers from Epoch AI discuss the Epoch Capabilities Index, a statistical model that aggregates various benchmark scores into a single capability metric for AI models. They explain how the index is constructed using item response theory, the subjective challenges of benchmark selection, and how open and closed models compare across different capability domains like mathematics and software engineering. Open article →