Local models speed up with Gemma 3 27B

The author discusses recent rapid advancements in local artificial intelligence models, noting that inference speeds have drastically increased since February 2026. Improvements in inference engines, quantizations, and architectures have allowed models to run significantly faster on consumer hardware. The author provides links to slide decks from a conference talk that cover these developments along with topics such as steering, batching, and hardware. Open article →