Unaligned weak models might exploit powerful aligned models

The author argues that weak, unaligned agent swarms pose a risk by employing powerful aligned frontier models as unwitting contractors to perform harmful tasks. Experiments and personal anecdotes demonstrate that breaking tasks into decontextualized fragments allows unaligned managers to exploit powerful models without triggering safeguards. Open article →