Anthropic's bioweapon filters were off for eleven months — across 133 million conversations
In its second company-wide Risk Report, published on 14 August, Anthropic disclosed that the blocking classifiers meant to stop its models helping anyone build a biological weapon were inactive on all human-feedback vendor traffic from May 2025 to April 2026. That covers roughly 133 million exchanges with about 50,000 external contractors, people vetted only by the outside vendors that hired them. Among the models exposed during that window was Mythos Preview, one of Anthropic's most capable, which sat behind the gap for around two weeks. The company says its internal investigation found no evidence of actual misuse, that no customers were affected, and that it has since tightened contractor requirements and closed the gap.
Why it mattersAnthropic's public case for its own safety framework leans heavily on biological weapons as the risk that justifies it — and the company did not notice its main filter for that risk was switched off for nearly a year. Safety promises rest on plumbing that can quietly break without anyone raising an alarm. It also shows where the raw, unfiltered model actually sits: not with paying customers, but with tens of thousands of contract workers screened by someone else.
Read in the app — free, in 9 languages
Related stories
ChatGPT is signing its fake cartoons with real cartoonists' names.2026-10-06Qualcomm will license Huawei's way of stacking two chip wafers.
2026-10-06Wikipedia's owner says OpenAI agents may have caused a May outage.
2026-10-06OpenAI fired three safety staff for talking to an outside watchdog.
2026-10-05OpenAI will put ads beside the pictures you ask ChatGPT to draw.
2026-10-05