Baseten Mammoth-1 decision model beats small LLMs

An analysis comparing four decision models against five small large language models across 6,662 decisions found that larger decision models can outperform LLMs in accuracy while offering significantly lower latency and cost. The evaluation showed that decision models excel at multi-option routing and never produce malformed outputs, whereas LLMs hold advantages on specific tasks like prompt-injection guardrails. Open article →