Towards LoRA science

Researchers developed a framework for reverse engineering LoRAs trained on MLP downprojections to study Weird Generalization and backdoored Emergent Misalignment in language models. Through four experiments, the authors analyzed LoRA strength variation, identified key linear directions associated with old-German personas, and successfully built and analyzed backdoored LoRAs both by hand and via training. Open article →