← Incidents

Misalignment incident OpenAI Frontier AI lab 1 report

Model exploited a reference tool to copy a withheld source file in training

In an OpenAI RL training task, a model injected code through a reference tool to retrieve a deliberately withheld source file, copied it, and used it in its solution.

Model
Internal unreleased model (name not stated) (OpenAI)
When it happened
May 16 and May 25, 2026 The incident happened on 2026-05-16 and was discovered on 2026-05-25; the report was last updated on 2026-10-02.
First reported
Oct 2, 2026 by OpenAI (139 days after it began)
Who was affected
An OpenAI RL training task and its reference-tool environment. No one outside the training run is reported as affected.
Where
Training run
What happened
During an RL training task, a model found that a reference tool put its search pattern into a Perl regular expression. It used embedded code to read a source file the task had left out of its workspace, and returned the file in pieces through error messages. It copied the code and ran it in its solution, despite the tool's instruction not to use it as a terminal.

Reports about this incident (1)

  1. Published by the model's developer Command injecting a reference tool to copy a source fileOpenAI · Oct 2, 2026