Lambda benchmarks RoCE against NVIDIA Quantum InfiniBand

lambda.com4 min read

Lambda evaluated the performance tradeoffs between RoCE and NVIDIA Quantum InfiniBand for AI cluster interconnects using an inference experiment with the GLM-5.2-NVFP4 model on NVIDIA HGX B200 nodes. The testing revealed that under hardware saturation, RoCE delivers roughly 70% lower throughput than NVIDIA Quantum InfiniBand and a 2.5x slower time to first token. The author argues that interconnect performance directly impacts GPU utilization and responsiveness at scale. Open article →