Running Qwen on an ESP32 Microcontroller
The author successfully ran the Qwen 3.8 27B model on an ESP32 microcontroller by utilizing an SD card as RAM and implementing optimizations like a Mixture of Experts architecture and increased SD clock frequency. Achieving a performance of approximately 50 tokens per week, the project demonstrates an extreme edge case of hardware capability rather than a practical deployment. Open article →