← Back to Tech & Science

Anthropic Researcher Resigns Over Imminent AI Extinction Risk

Tech & ScienceAI-Generated & Algorithmically Scored·

AI-generated from multiple sources. Verify before acting on this reporting.

SAN FRANCISCO — Jacob Coxon, a senior artificial intelligence researcher at Anthropic, resigned from the company on Wednesday, citing urgent concerns that the reckless development of self-improving super-intelligence poses an existential threat to humanity within the next decade.

Coxon's departure marks a significant internal fracture at one of the United States' leading AI laboratories. In a statement released shortly after his resignation became public, Coxon argued that the current trajectory of the technology sector prioritizes speed and capability over critical safety protocols. He warned that without immediate global intervention, the creation of systems capable of recursive self-improvement could lead to human extinction before 2036.

"The window for preventing a catastrophic outcome is closing rapidly," Coxon stated. "The industry's current approach treats AI safety as an afterthought rather than a prerequisite for deployment. We are racing toward a point of no return where control over these systems will be impossible to maintain."

Anthropic, founded by former OpenAI executives and backed by major technology investors, has positioned itself as a leader in developing safe and beneficial AI. The company has invested heavily in safety research and alignment techniques. However, Coxon's resignation suggests that even within organizations dedicated to responsible AI, deep disagreements persist regarding the pace of development and the sufficiency of current safeguards.

In response to the departure, an Anthropic spokesperson emphasized the company's continued commitment to rigorous safety standards. The statement noted that while individual researchers may hold differing views on risk timelines, the organization maintains that its protocols are robust enough to manage emerging challenges. The company declined to comment further on Coxon's specific technical objections or the internal discussions that preceded his exit.

The resignation comes at a time of heightened global scrutiny regarding artificial intelligence. Governments and international bodies have been racing to establish regulatory frameworks, yet the rapid advancement of models has often outpaced legislative efforts. Critics of the current development model argue that the competitive pressure among major tech firms creates an environment where safety concerns are systematically deprioritized in favor of market dominance.

Coxon's warning adds weight to a growing chorus of voices within the scientific community calling for a pause or significant slowdown in the training of advanced AI systems. He specifically highlighted the risk of "self-improving" architectures, which could theoretically iterate on their own code faster than human researchers can audit them, leading to an intelligence explosion that bypasses human control mechanisms.

As the debate intensifies, questions remain regarding whether current safety measures are sufficient to address the specific risks Coxon identified. Industry leaders have yet to announce any changes to their development roadmaps in light of his resignation, leaving the timeline for potential regulatory intervention uncertain. The situation underscores the growing tension between the drive for technological advancement and the imperative to ensure long-term human survival.

Discussion

0 / 2000