Anthropic says it disrupted several potential plots this year by scientists using its models for research that could have helped develop biological weapons (Dustin Volz/New York Times)
ThinkingNews Desk · how this was written
Anthropic has reported that it disrupted several potential plots this year involving scientists who were using its Claude model for research that could aid the development of biological weapons. The company says it identified and blocked these efforts, preventing the use of its technology for such purposes.
Written from all 3 reports below, not from any single one.
How it was reported
- Hacker News·Anthropic Says It Blocked Possible Efforts to Build Biological Weapons
- TechMeme·Anthropic says it disrupted several potential plots this year by scientists using its models for research that could have helped develop biological weapons (Dustin Volz/New York Times)
Anthropic’s threat-intelligence report says the company halted multiple projects in which scientists used Claude to explore biological-weapon research, shutting down the work after being unable to verify its intent. The report also details Chinese firms Moonshot and DeepSeek employing thousands of fake accounts and millions of real user queries through “transfer stations” to distill Claude’s capabilities for their own models.
- Engadget·Anthropic caught scientists using Claude to further biological weapon research
Anthropic’s report details five instances where its Claude models were used to draft grant proposals and research plans for gain-of-function work on chikungunya virus, avian influenza, and a venom-toxin atlas, prompting the company to flag and ban the accounts. The company says its biological safety classifier and threat-intelligence team identified the misuse, and the findings are being incorporated into stronger safeguards despite not naming the involved scientists or institutions.
Related stories
- Source: Anthropic has no intention of easing Claude usage restrictions for military purposes, following Dario Amodei's meeting with Pete Hegseth (David Jeans/Reuters)4 outlets
- Admin official: Pentagon may sever Anthropic relationship over AI safeguards; Anthropic says only mass surveillance and fully autonomous weapons are off limits (Axios)3 outlets
- Anthropic vs. the Pentagon: What’s actually at stake?7 outlets
- Anthropic’s safety warnings may have just backfired — the government has pulled the plug on its most powerful AI3 outlets