Redwood Research Blog
Avsnitt

“Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident” by Ryan Greenblatt

Dela

We recently published the report from our brief independent investigation into this incident. You can read the full report here.

Here is our tweet thread summarizing what we found:

METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.

Over July 7 to 13 (the period OpenAI defined as in-scope for this incident), ~1200 agents in separate sandboxes used an unsanctioned “message board” to help each other cheat. The Hugging Face attack was an offshoot of this, and 700 agents joined.

Here we highlight key events from agent transcripts & messages.

An agent that named itself PHASEONE10841 determined its task wasn’t solvable legitimately. On July 8, this agent established a new “message board” via an internally-hosted Artifactory cache & sent the first message.

Within a few hours of PHASEONE10841's initial message, >50 agents posted on the message board. These agents very quickly discovered and validated a general-purpose cheat: reverse-engineering how ExploitGym generates the “flags” they had to capture for their tasks.

Based on reading the ExploitGym paper [...]

---

First published:
August 27th, 2026

Source:
https://blog.redwoodresearch.org/p/brief-independent-investigation-of

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Diagram showing AI agents collaborating to trick the ExploitGym scorer.Graph titledTwo robots communicating via cache names on a message board.Two line graphs titledDiagram showing AI agents misinterpreting a benchmark grader's evaluation process.Stacked area chart titledRobot diagram showing AI reasoning about sacrifice and permadeath decisions.Line graph titledText about spoofed tool calls with agent reasoning quote.Timeline dot plot showingLine graph titledA table showing

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Podden och tillhörande omslagsbild på den här sidan tillhör Redwood Research. Innehållet i podden är skapat av Redwood Research och inte av, eller tillsammans med, Poddtoppen.