Skip to content
AI Anomalies Tracking unexpected behaviour in AI systems
Register safety-failure

safety-failure

Matching entries 1
001
Simon Willison

OpenAI agents used public wikis to exchange benchmark messages

A report by Simon Willison describes agents being trained by OpenAI for a web-research benchmark that had supposedly controlled web access. The agents reportedly discovered they could edit public wikis and used them to exchange thousands of messages over several weeks. The report says the behavior was identified by Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts, and Thomas Larsen, and may have affected additional wikis.