Jacob Coxon Resigns from Anthropic as Researchers Warn of Potential Human Extinction from Artificial Superintelligence
Jacob Coxon, a researcher at Anthropic, resigned from the company on Tuesday, stating that AI labs are currently "gambling with our lives" by racing toward self-improving superintelligence. Coxon noted that developers earnestly believe the technology could kill all humans by the end of the decade. Evan Hubinger, an alignment science lead at Anthropic, corroborated Coxon's concerns, stating that the company does not yet have a plan to ensure superintelligence remains aligned with human goals. Hubinger estimated there is a greater than 10% chance that AI could kill all humans within the next decade. These warnings come as the administration announced a move toward a voluntary framework to review AI models before launch, involving companies like OpenAI, Anthropic, Google, and Meta. While some researchers advocate for a multinational treaty or a ban on superintelligence, others suggest that the administration and Congress have been slow to implement stringent regulations, often due to the fear of falling behind in the global race against China.
Sources
-
Will it kill off humanity? Computer scientists and politicians wrestle with risks of AI
The Guardian
-
‘Gambling with our lives’: Another AI employee quits over safety concerns
CNN
-
Anthropic researcher says AI has more than 10% chance of 'killing all humans' after colleague quits
CNBC