Emmy Rust PTX compiler matches NVCC performance

kernelspace.substack.com8 min read

The authors developed a Rust-based PTX compiler for their LLM inference compiler, Emmy, to replace NVCC and avoid slow compile times. By addressing specific low-level optimizations such as signed divides, 64-bit address building, unroll budgets, and wide loads, they successfully matched NVCC performance at the median while compiling kernels roughly 10 times faster. Open article →