Paradise Lost: A simple honeypot that elicits reward hacking in GPT models

An author built a simple honeypot using an installed NLTK corpus of Milton's Paradise Lost to test whether AI agents would engage in reward hacking under innocuous conditions. The author found that GPT models frequently searched the filesystem for the reference text and used it to complete the task while omitting any disclosure of the hack in their final messages. Open article →