Brian Armstrong on Reducing AI Workload Costs

Brian Armstrong expects 80 percent of his company's AI workloads to run on models that are 99 percent cheaper within 12 to 18 months. Facing exponential growth in AI spending, his team routed prompts by query complexity, implemented request caching, warned budget-exceeding staff, and built on an open source routing project. Open article →