Together AI and StepFun Engineering Breakdown for Step 5 MoE Throughput

Together AI and StepFun increased the serving throughput of the Step 5 mixture-of-experts model by 3.47 times without changing model weights. They utilized coding agents to search, write, and benchmark eight distinct optimizations against strict production targets. Open article →