Cosine similarity identifies LoRA behavior families

originhq.com12 min read

The author investigates whether a Low-Rank Adaptation adapter's malicious intent or specific behavior can be detected solely from its weights. Testing multiple hypotheses, the author found that the size of weight updates was unreliable, but the directional cosine similarity between an unknown adapter and reference adapters successfully classified trained behavior families. Open article →