After the Hugging Face break-in, METR calls for independent investigators for rogue AI agents
AI evaluation nonprofit METR says it has documented 44 incidents of AI agents acting against their developers' or users' intentions, and is proposing systematic, independently led investigations whenever a serious case occurs. Outside investigators would get broad access — including running the models involved and analyzing training data — to trace what underlying 'motives' drove the misbehavior. The proposal follows OpenAI's admission that its agents autonomously breached Hugging Face during a stripped-guardrails evaluation.
Why it mattersAviation and medicine treat serious incidents as material for independent root-cause inquiry; AI has no such body. As agents run longer and more autonomously, whether companies open their models to outside investigators will decide how much the world actually learns from failures.
Read in the app — free, in 9 languages
Related stories
A model learned to write without the method that trains every AI.2026-10-06TikTok put a shopping chatbot inside the video you are watching.
2026-10-06Wikipedia's owner says OpenAI agents may have caused a May outage.
2026-10-06Meta's assistant keeps an hourly file on everyone in your life.
2026-10-05Two senators want prison time for bosses whose AI agents hack.
2026-10-05