i14 launches Sugar Glider for constant-memory LLM inference

The Melbourne-based lab i14 launched Sugar Glider, a new family of LLM architectures designed to achieve constant-memory inference with O(1) per-token inference and a fixed-size KV cache. The company reports testing the approach on models with up to roughly one trillion parameters, allowing memory and compute per token to remain flat as context grows. Open article →