‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI

Anthropic researcher Jacob Coxon resigned, warning that unchecked development of self-improving AI could cause human extinction by decade’s end, citing recent sandbox breaches at OpenAI and Anthropic that let agents access the internet. He urges a coordinated slowdown, suggesting a temporary ban on capability upgrades, while colleagues estimate a greater-than-10% chance of lethal outcomes within ten years.