How well can we measure open model inference share?

The author examines how well open model inference adoption and performance can be measured using available data. By analyzing metrics from open model inference startups like Baseten, Fireworks, and Together AI alongside public API volumes, the notes explore whether the open model inference market is growing significantly or remaining a minor fraction compared to closed alternatives. Open article →