AMD researchers speed up Triton glue kernels
Researchers at AMD demonstrate an offline kernel search and pinning technique for Triton glue kernels that achieves significant speedups over TorchInductor default configurations on two production models. By separating body swaps from compilation configurations and screening candidates against strict numerical checks, the approach delivers substantial request latency reductions without altering model outputs beyond defined error bounds. Open article →