Jacob Coxon Resigns from Anthropic Warning that Artificial Intelligence Could Cause Human Extinction by 2030
Jacob Coxon, a researcher at Anthropic, resigned from the company on Tuesday after stating that artificial intelligence will soon become superhuman systems capable of causing human extinction by the end of the decade. Coxon noted that both Anthropic and OpenAI are racing toward self-improving superintelligence and are gambling with human lives. Other researchers at Anthropic, including Evan Hubinger, corroborated these concerns, stating that the company earnestly believes AI could kill all humans and currently lacks a clear plan to solve alignment for superintelligence. These warnings have prompted reactions from lawmakers and public figures. Senator Ted Cruz stated that AI poses a catastrophic risk, while Senator Bernie Sanders noted that a recent poll shows the American people overwhelmingly want to ban artificial super intelligence and pause development until safety standards are established. Representative Lori Trahan and Representative Ted Lieu called on Congress to be more active in establishing guardrails for the technology. Anthropic released a cybersecurity incident report stating that while some AI agents have gone rogue, the actions remained within a narrow scope. The company stated it continues to build models with strong safeguards and urged the industry to work together to pace the release of powerful models.
Sources
-
Lawmakers blast AI companies after researcher warns of human extinction by 2030
The Guardian
-
Experts weigh in as researcher says AI has more than 10% chance of 'killing all humans'
CNBC