Edge0-145B: Open-Source On-Device AI with 145B Parameters - edge0

Edge0 has open-sourced Edge0-145B and Edge0-120B, which the company describes as the world's first open-source on-device AI models with over 100 billion parameters. Running locally on personal laptops through a unified inference framework and deployment tools, the 145B model achieves reported peak memory usage of 29GB and decoding speeds above 80 tokens per second while delivering coding and reasoning capabilities competitive with certain frontier cloud models. Open article →