p-e-w/heretic: Training-free language model modification tool

github.com8 min read

Heretic is a training-free language model modification tool that allows users to alter behavior such as removing censorship, suppressing slop, and reducing sycophancy on their own hardware. The software combines pluggable model modifiers, including Arbitrary-Rank Ablation and directional ablation, with a TPE-based hyperparameter optimizer. Additionally, it supports creating and sharing lightweight reproducibility manifests via Hugging Face to enable exact recreation of processed models. Open article →

More on this topic