Running Qwen on an ESP32 Microcontroller

luvsheth.com1 min read

The author successfully ran the Qwen 3.8 27B model on an ESP32 microcontroller by utilizing an SD card as RAM and implementing optimizations like a Mixture of Experts architecture and increased SD clock frequency. Achieving a performance of approximately 50 tokens per week, the project demonstrates an extreme edge case of hardware capability rather than a practical deployment. Open article →

More on this topic