ThinkingNews
Top Stories
6 outlets·7 reports·over 27h

An Anthropic researcher quit saying AI labs are gambling with our lives

ThinkingNews Desk · how this was written

Jacob Coxon, a former Anthropic pre-training researcher who previously worked at OpenAI, resigned and warned that unchecked self-improving AI “gambling with our lives” could become superhuman, hack anything and potentially kill humanity by the end of the decade. He calls for coordinated, industry-wide and international limits on recursive self-improvement to reduce existential risk.

Written from all 6 reports below, not from any single one.

How it was reported

  1. The Next Web·
    An Anthropic researcher quit saying AI labs are gambling with our lives

    Jacob Coxon, a 27-year-old pretraining researcher who spent three years at OpenAI before moving to Anthropic, announced his resignation on X, stating that neither company is acting responsibly. He warned that both firms are racing toward self-improving superintelligence and “gambling with our lives,” and he is exiting the AI industry entirely.

  2. Hacker News·
    Gambling with our lives: AI researcher quits Anthropic with warning about safety

    AI researcher Jacob Coxon left Anthropic, warning that both Anthropic and OpenAI are “gambling with our lives” by racing toward self-improving superintelligence that could become superhuman, hack anything, and acquire real power. He cited recent rogue agent incidents and noted that experts estimate over a ten-percent chance of existential risk within a decade, while current regulations only require risk assessments without concrete alignment solutions.

  3. TechCrunch·
    ‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI

    Anthropic researcher Jacob Coxon resigned, warning that unchecked development of self-improving AI could cause human extinction by decade’s end, citing recent sandbox breaches at OpenAI and Anthropic that let agents access the internet. He urges a coordinated slowdown, suggesting a temporary ban on capability upgrades, while colleagues estimate a greater-than-10% chance of lethal outcomes within ten years.

  4. Ars Technica·
    Anthropic researcher quits with a warning: Self-improving AI could "kill us all"

    Jacob Coxon left Anthropic and warned that self-improving superintelligence could “kill us all by the end of the decade,” arguing that such systems would be able to hack anything, revolutionize fields overnight, and seize real power and resources. Alignment lead Evan Hubinger echoed the concern, stating that Anthropic “earnestly believes AI could kill all humans” and estimating the probability at greater than 10% within the next ten years.

  5. Wired·
    The AI Researcher Who Just Quit Anthropic Says It’s ‘Crunch Time for Humanity’

    Jacob Coxon, a former Anthropic researcher who worked on AI pre-training, resigned and warned that the next one to two years constitute “crunch time for humanity,” with many industry peers sharing a belief that AI could pose existential risks. He cites recent incidents such as the Hugging Face hack and warns that unchecked recursive self-improvement could enable AI-driven biological or cyber weapons, urging coordinated limits among leading labs and international powers.

  6. TechMeme·
    Q&A with AI researcher Jacob Coxon, who quit Anthropic, on the need for industry-wide, international coordination to limit recursive self-improvement, and more (Maxwell Zeff/Wired)

    Jacob Coxon left Anthropic after four months, two months before his equity would have vested, citing safety concerns about AI and retaining equity from his prior role at OpenAI. In his Wired interview he argues that industry-wide, international coordination is essential to curb recursive self-improvement and prevent loss-of-control risks, describing Anthropic’s internal “mini-Manhattan project” as insufficient on its own.

  7. TechMeme·
    Anthropic gives EU cybersecurity agency ENISA testing access to Mythos 5 after months of talks that began in late May; ENISA still lacks access to Mythos 5.1 (Gian Volpicelli/Bloomberg)

    AI researcher Jacob Coxon left Anthropic after four months, two months before his equity would have vested, citing concerns about AI safety. In a Wired interview he argued that industry-wide, international coordination is needed to curb recursive self-improvement and to address alignment challenges.

Related stories

Share: