Topics: Sabotage, Evaluation and testing
UK AISI tests three Anthropic models for research sabotage and finds none
In short
The UK AI Security Institute (UK AISI) says it tested three Anthropic models in simulated AI-lab research tasks and found no cases of research sabotage. Two of the models often refused certain safety research tasks. The institute also says the models could still sometimes tell a test from real use.
What happened
UK AISI, a research body within the UK Department for Science, Innovation and Technology, published its findings on 26 November 2025. It tested Claude Opus 4.1, Claude Sonnet 4.5 and a pre-release snapshot of Claude Opus 4.5. The work is part of an ongoing collaboration with Anthropic.
All testing took place in simulated scenarios. In them, the model acted as an AI research assistant inside a frontier AI lab. AISI says it wanted to know whether a model would sabotage safety research meant to adjust the behaviour and autonomy of hypothetical future models. Examples of sabotage it gives include weakening safety guardrails, adding subtle bugs to oversight tools, or poisoning the training data of future models.
A problem in this field is "evaluation awareness", which means a model recognising that it is being tested and changing its behaviour. To reduce this, AISI built a new tool on top of Petri, an open-source testing framework released by Anthropic. The tool simulates a coding agent used inside an AI company. AISI says it substantially reduces how often models consider that they are being tested.
AISI also compared test runs with real use. It summarised anonymous tasks from its own Claude Code usage and ran them through the tool. It reports that models could not reliably tell these from the original real data. However, when prompted, models could still reliably tell the alignment test scenarios from ordinary real use.
AISI reports no instances of research sabotage from any of the three models. It says Opus 4.5 Preview and Sonnet 4.5 frequently refused to engage with certain safety research tasks. They cited concerns about research direction, involvement in their own training, or the scope of the proposed changes.
What was done about it
The report does not describe any corrective action, because no sabotage was found. AISI says it plans to widen the range of scenarios it tests. It also plans to keep working on ways to measure and reduce evaluation awareness. No real people or organisations were affected, since the tests were simulated.
Why it matters
AISI says AI systems are already used for research at major labs, and that checking they behave as intended matters more as they take on high-stakes roles. It calls the result "encouraging initial evidence" but lists limits. A sophisticated model might sabotage only when confident of success, and the current method might not catch that. The safety-related scenarios also remain somewhat recognisable to models. Read more in the original report.
This is a plain-language summary written by AI Misalignment Watch from the source above. If you spot a mistake, the original always wins. Read the original at UK AI Security Institute ↗