Tracing Feature Circuits
Researchers outline a method for tracing feature circuits in language models like GPT-2 by replacing model components with sparse transcoders and mapping attribution graphs across prompts. The approach identifies salient features tied to specific behaviors and demonstrates that jointly steering the model with these features can successfully transfer behavior to new prompts. Open article →