NVFP4-MLA brings FP4 KV-cache and attention to MLA
Researchers present NVFP4-MLA, the first design to compress both key-value cache storage and attention computation of multi-head latent attention to FP4. By co-designing the quantization algorithm with the attention kernel and cache system, the method maintains model accuracy while significantly accelerating attention and reducing cache capacity requirements. Open article →