How parallel agent requests can slow down an entire Ollama session | Tensward

tensward.com7 min read

Tensward investigated why parallel coding agent sessions running against Ollama experience severe slowdowns, finding that shared request slots cause recurrent history displacement and massive prompt repetition. The authors discovered that giving each session its own slot and optimizing state checkpoint boundaries drastically reduced median response wait times and prompt token processing. Open article →

More on this topic