Multiple current and former Anthropic employees warned โย and admitted โ on Tuesday that the researchers building new AI models believe the technology could lead to humanityโs destruction by the end of the decade, reflecting the industryโs frenzy over reining in rapid development.
Jacob Coxon, a former AI researcher at Anthropic, wrote on X that he resigned from the company on Tuesday because he believed the Dario Amodei-led company and OpenAI, his former employer, were โgambling with our livesโย in how they improved the technology.
โThe people building AI earnestly believe that it could kill us all by the end of the decade,โย Coxon wrote. โThis is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible โ but I hear the same people express fear privately. No other human activity poses this level of danger.โ
Anthropic did not respond to an immediate request for comment, but Coxonโs warnings were surprisingly affirmed by Evan Hubinger, Anthropicโs alignment scene lead, and Samuel Marks, who runs the companyโs scalable oversight division.
Hubinger wrote the company did โearnestly believe AI could kill all humansโย and that he thought it was a greater than 10% risk โwithin the next desk.โ
โI believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to,โย he wrote on X.
Marksโ own X post, which he said he wrote in his personal capacity, said that AI researchers continue building the technology despite the risk of โhuman extinctionโย because of a financial incentive and the fear the technology would be developed by AI developers who may abuse its capabilities.
โMany AI developer staff desperately want to slow down to figure out how to build AI more safely,โย he wrote. โI work on safety research at Anthropic because I hope my work will reduce the chance of these extinction-level bad outcomes.โ
The comments from Anthropic employees reflect a broader public tonal shift among AI companies, many of which entered the market touting the transformative potential of AI models but now warn that those models risk escaping human control. Anthropic as a company has called for a development slowdown since June, while OpenAI paired its debut of GPT-6 Astra last week, which it claimed pushed the world into an era of artificial general intelligence, with several warnings by company leaders and researchers that a slowdown was needed to improve safety conditions.
โNo one is prepared for the consequences of a continued rapid rise in machine intelligence,โย wrote Jakub Pachocki, OpenAIโs chief scientist, in a blog post on Sunday that was later reposted by OpenAI CEO Sam Altman on X.
Still, the industry sentiment has received pushback from the Trump administration, which has argued that slowing down development risks ceding the AI arms race to a rapidly evolving China.
โThere is no day after tomorrow if China wins at this,โย Treasury Secretary Scott Bessent told Breitbart on Tuesday. โLike everything, a trillion-and-a-half-dollar defense budget, the Iron Dome. If they were to pull ahead of us on AI, then nothing else matters.โ