DetLLM replaces LLM floats with integer arithmetic

The author introduces DetLLM, an experimental project that eliminates nondeterminism in LLM inference by replacing all floating-point arithmetic with exact integer-only operations. Tested across various hardware configurations and batch sizes, the integer-only pipeline yields bit-identical outputs while maintaining perplexity comparable to fp16 baselines. Open article →