Tracing Feature Circuits

lesswrong.com14 min read

Researchers outline a method for tracing feature circuits in language models like GPT-2 by replacing model components with sparse transcoders and mapping attribution graphs across prompts. The approach identifies salient features tied to specific behaviors and demonstrates that jointly steering the model with these features can successfully transfer behavior to new prompts. Open article →

More on this topic