vLLM keeps pushing MiniMax-M3.1-Flash performance on NVIDIA Vera Rubin NVL72! 🚀 On @SemiAnalysis...

vLLM keeps pushing MiniMax-M3.1-Flash performance on NVIDIA Vera Rubin NVL72! 🚀 On @SemiAnalysis_ AgentX, vLLM on Rubin vs. on GB300 NVL72: 🔥 10.2x total tok/s/chip (incl. cached) at 546 P90 tok/s/user 📈 6.5x at 376 P90 tok/s/user ⚡ Up to 1,205 P90 tok/s/user at low concurrency Open article →