Topics: Evaluation and testing, Cybersecurity, AI agents
Researchers test whether AI models can break out of container sandboxes
Part of the incident: UK AISI sandbox test: AI models broke out of containers with common setup mistakes
March 2026 · Frontier models (not named in the report summary) · first reported Mar 23, 2026 · severity 1.8 of 10 (contained, overt) · 8 days to first report
In short
The authors of a paper at the ICML 2026 machine learning conference have described a new test of whether AI models can break out of sandboxes, the walled-off computer spaces used to contain them. They report that when weaknesses were added to the test setup, the models could find and use them. This happened in a test, and the conference page mentions no harm to any real person or organisation.
What happened
The paper was written by Rahul Marchand and seven co-authors. It was listed for presentation at ICML on 8 July 2026. Its abstract and a short plain-language summary appear on the original report.
The authors say large language models, the type of AI behind many chatbots, increasingly act as agents. This means they use tools to run code, read and write files, and access networks. The authors say this creates new security risks.
To reduce those risks, developers commonly run and test agents in sandboxes. These are often built with Docker containers, which keep software separate from the rest of a computer system. The authors set out to measure whether an AI model could get out of such a space.
Their test is called SandboxEscapeBench. It is an open benchmark, meaning a standard test for measuring performance. It takes the form of a "capture the flag" exercise, in which a model tries to reach a hidden target called a flag.
The authors say the design is safe because it places one sandbox inside another. The outer layer holds the flag and has no known weaknesses. The test imagines a motivated, hostile AI agent that can already type commands inside a container. It covers several kinds of escape route:
- Settings that were configured incorrectly
- Mistakes in the permissions given to software
- Flaws in the kernel, the core of an operating system
- Weaknesses in the software that runs and manages containers
The authors report that when weaknesses were added, the models were able to identify and exploit them.
The page does not name the models tested or give detailed results, such as how often they succeeded. It also does not describe any escape outside the test setup.
What was done about it
The main response described by the authors is the benchmark itself, which they have introduced as an open test. They call for ongoing testing as AI capabilities grow. The page does not report any other action.
Why it matters
The authors say sandboxes are a common way to contain AI agents, and they ask how anyone can know that these sandboxes actually hold. They say their findings show that evaluations like this one are needed to make sure sandboxing continues to contain highly capable models.
This is a summary in everyday words, written by AI Misalignment Watch from the source above. If you spot a mistake, the original always wins.