burner22/numbat: Leaked pretraining checkpoint for Anthropic's numbat model
An unreleased mid-pretraining checkpoint for Anthropic's next Mythos-class model, codenamed numbat, has been leaked on Hugging Face. The ~14T parameter model features a hybrid Gated DeltaNet and Multi-head Latent Attention architecture with 1,224 Mixture-of-Experts layers and is quantized in NVFP4. The repository includes a complete reference implementation and 772 safetensors shards totaling approximately 7.72 terabytes of tensor data. Open article →