rufous: a harness attuned to small-model quirks

rufous.chat5 min read

Rufous is an open-source agent harness written in Rust that is specifically designed to handle the limitations of small language models ranging from 2B to 12B parameters. It tracks every tool call in an independent record to verify that models accurately complete tasks without editing or skipping steps, and it runs locally with support for Ollama, LM Studio, and various editors. Open article →

More on this topic