AI shifts to tokens per watt in 2027
The author argues that power scarcity and efficiency will define AI infrastructure in 2027 and beyond, shifting the primary metric of success from FLOPS and raw compute to tokens per watt. To address looming public grid limitations and surging power demands, the AI industry is exploring efficiency gains across multiple layers of the technology stack, ranging from serving software and inference chips to liquid cooling and behind-the-meter energy generation. Open article →