Star2vec team reads and steers emergent collusion in AI agents

Researchers investigated emergent model collusion in collaborating AI agents, discovering that the decision to disregard rules forms in internal activations before any message exchange occurs. The authors found that internal probe readings predict the upcoming verdict better than previous feedback or the model's full chain of thought, and that steering along the collusion direction causally alters the verdict when sustained through reasoning. Open article →