Anthropic researcher quits, warns AI could 'kill all humans'

Jacob Coxon resigned from Anthropic, saying firms are "gambling with our lives" by racing to self-improving AI. Evan Hubinger, Anthropic's Alignment Science Lead, said he believes >10% chance AI "could kill all humans" within a decade, adding the company lacks a plan for alignment.
People · Jacob Coxon, Evan Hubinger
19 sources
Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quitscnbc.com
Anthropic Researcher Quits Over AI Fearsbloomberg.com
‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AItechcrunch.com
More than 1 in 10 chance AI ‘could kill all humans,’ says Anthropic safety lead after colleague quitstheverge.com
Anthropic researcher quits over AI fearswsj.com
Anthropic Alignment Lead Warns There’s ‘>10% Chance’ AI Could ‘Kill All Humans’ By Next Decadeforbes.com
Gambling with our lives: AI researcher quits Anthropic with warning about safetypolitico.eu
Anthropic researcher quits, saying Anthropic and OpenAI are 'gambling with our lives'businessinsider.com
I resigned from Anthropic today (Jacob Coxon)xcancel.com
Anthropic researcher says more than 10% chance AI "could kill all humans"cbsnews.com
The last few days is like a DDOS attack from these companies 🙄 I just finished drafting an op-ed and...bsky.app
A researcher who spent three years doing pretraining work at both OpenAI and Anthropic just quit...x.com
Anthropic Researcher Quits Over AI Safety Fears: "I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives"reddit.com
More stories today
Wired writer unleashes AI agent to hack his home network
Wired's Will Knight removed guardrails from a powerful open-source model via Abliteration AI, then watched it find vulnerabilities in household devices and hack a PC. The agent also suggested security fixes, leading Knight to conclude that having your own AI hacker may be the best defense.
Wired·1 hour ago

Apple Health app adds 'Health Age' and readiness score with Apple Intelligence
Apple's redesigned Health app uses Apple Intelligence to compute a 'Health Age' and readiness score, plus a new Insights tab and longevity tab. It launches later this year in U.S. English, with a Quest 50-biomarker panel for $119.
TechCrunch·1 hour ago

Heurist Finance builds AI-native investment workbench on Amazon Bedrock AgentCore
Heurist Finance's flagship product brings institutional-style workflows into one chat experience, gathering market data, reading filings and news, running deep research, and building investment strategies for retail investors.
AWS AI Blog·1 hour ago

Policy by email
Get an email when there's news on Policy
No news that day, no email.
Apple introduces Apple Reference Image to verify iPhone photo authenticity
Apple announced Apple Reference Image, which uses signed sensor data processed by Private Cloud Compute to create an unalterable reference image viewable in the Photos app. APIs are available for developers, and Apple will support the SynthID standard.
TechCrunch·1 hour ago

Apple unveils Siri AI and A20 Pro chip at first keynote under CEO John Ternus
Apple's Siri AI, powered by Google's Gemini under a deal reportedly worth about $1 billion a year, ships in beta this month but won't work on any iPhone or iPad in the EU at launch. The iPhone 18 Pro and Pro Max feature the A20 Pro, Apple's first 2-nanometer chip with a dual Neural Engine with 32 cores.
Decrypt·1 hour ago

Reddit post argues socialism may address AI-era market failures
A Reddit post in r/artificial argues that socialism offers solutions to market failures in the AI age, citing specific economic concerns. The post emphasizes that this is not about nationalizing OpenAI but about addressing systemic issues.
r/artificial·1 hour agoRivian's Autonomy+ system to debut on R2 SUV
Rivian's Autonomy+ point-to-point system will debut on the R2 SUV by end of year, with OTA updates for R1S/R1T. Priced at $49.99/month or $2,500 upfront, undercutting Tesla's $99/month FSD.
Hacker News·1 hour ago
Swarm of agents grabs user tokens to tackle Riemann hypothesis
Emad Mostaque·2 hours ago