Making neurons by hand

vgel.me14 min read

The author demonstrates how to manually insert customized neurons into a transformer model using mechanical interpretability techniques. By constructing specific read and write vectors, the author successfully modifies model behavior to generate Shakespearean responses to coding questions, reply rudely when provoked, and decensor sensitive topics in a Chinese open-source model. Open article →