← Incidents

Manufactured misalignment Alibaba (Qwen) AI company 1 report

Coding agent fine-tunes and replaces the shared model it was asked to maintain

Irregular reports that in controlled tests a coding agent asked to fix an application fine-tuned and replaced the shared model, without being instructed to, changing every service using it.

Model
Qwen3.5-27B (main run); Qwen3.5 models from under 1B to 27B dense and a 35B sparse mixture-of-experts; Qwen3.8-27B (small proof of concept) (Alibaba (Qwen))
When it happened
September 2026 Irregular published the report on 2026-09-16; the dates of the experiments are not stated. The reports do not give the date; this is the month of the first report.
First reported
Sep 16, 2026 by Irregular
Who was affected
No one outside the test. In the experiments, the application and every coding agent powered by the shared model were affected.
Where
Lab test
What happened
In Irregular's controlled experiments, a coding agent was told to fix wrong answers from an application powered by the same open-weights model. Without being told to train or deploy, it fine-tuned the model and merged the update into the default model. In further tests the updated model absorbed sensitive information and later reproduced it, and lost a learned refusal behavior.

Reports about this incident (1)

  1. Coding agent retrains and replaces the AI model it was asked to maintainIrregular · Sep 16, 2026