Introducing Kinference

Buoyant has launched Kinference, a new open-source project designed to serve as a control plane for building scalable LLM inference platforms on Kubernetes. The software provides token rate limiting, usage tracking, intelligent load balancing, and a policy-driven routing layer that incorporates KV-cache awareness to optimize performance and reduce latency. Open article →