An article arguing that Silicon Valley figures like Sam Altman and Dario Amodei distinguish between 'terminal extinction' (species disappearance) and 'final extinction' (disappearance without worthy successors), and that many actually support human extinction after creating digital posthumans to colonize the universe. The author, a former TESCREAL movement member, contends the public debate misunderstands what these technologists actually mean by 'extinction risk.'
AI researcher Jacob Coxon resigned from Anthropic in September, warning that humanity faces extraordinary danger as AI becomes more powerful and potentially uncontrollable. His warnings about AI-driven bio-weapons and existential risks sparked debate: some saw a desperate plea for action, others viewed it as a marketing campaign. The article examines recursive self-improvement scenarios and competing perspectives on AI safety.
Senator Bernie Sanders and Greg Cezar introduced the Ban Artificial Superintelligence Act, proposing up to 20 years in prison for developers pursuing advanced AI development. The legislation aims to pause ASI progress and establish a federal agency to enforce prohibitions, while also seeking international coordination to ban superintelligence globally. Industry leaders including Sam Altman, Dario Amodei, and Elon Musk have expressed support for AI regulation and slowed development.
The author outlines a framework of 'Three AI Pills' to categorize disagreements about artificial intelligence based on beliefs about future capabilities: the AI pill (current abilities), AGI pill (expanded future abilities), and ASI pill (superintelligence surpassing humans). Most people remain 'unpilled' and underestimate AI's current potential, while reasonable positions acknowledge at least current AI capabilities and likely future advancement.
Artificial General Intelligence (AGI) and superintelligence (ASI) promise revolutionary benefits like disease cures and material abundance, but pose existential risks if built without proper safety controls. The core challenge is that safety research receives minimal funding compared to capability development, no individual lab can afford to slow down due to competitive pressures, and humanity has never agreed on how to align machine values with human interests.