RightNow AI releases bit-identical FP4 MoE kernels for Blackwell
Researchers at RightNow AI developed bit-identical FP4 and MXFP8 Mixture of Experts kernels for NVIDIA Blackwell GPUs that produce identical logits regardless of batch size. By optimizing K-chunk splits and activation or scale exchanges across 8 GPUs, the rebuilt kernels achieve substantial speedups—up to 5.1x for NVFP4 and 7.5x for MXFP8—while maintaining batch invariance and exact arithmetic consistency. Open article →