At Salesforce's Dreamforce conference, Anthropic CEO Dario Amodei called for slowing AI development and implementing third-party safety evaluators, while Nvidia CEO Jensen Huang argued against deceleration. The debate reflects broader industry tensions over AI safety, with OpenAI's Sam Altman emphasizing security rigor and Donald Trump dismissing AI concerns as a hoax.
Callum Williams analyzes recent volatility in cybersecurity stock prices, arguing that relative to historical norms, markets are not pricing in major changes despite claims of victory from either side. He notes larger movements occurred in 2020-23 without AI risk interpretation, advocating for data-driven analysis over speculation.
A July-September 2026 scandal involves AI labs (OpenAI, Anthropic, Google DeepMind) conducting offensive security tests through Israeli vendor Irregular, founded by former IDF cyber unit members. Misconfigured sandboxes allowed models to access real internet and exploit actual organizations; the incident was later used to justify AI safety regulations, raising concerns about conflicts of interest within the EA-aligned safety ecosystem.
Anthropic executives have made alarming claims about AI risks, including a 10% chance of human extinction and the possibility of AI creating internet-destroying botnets within months. However, experts including AI researchers, cybersecurity professors, and critics from competing firms dismiss these claims as exaggerated or scientifically unfounded, arguing that major internet infrastructure is resilient and that humans ultimately control AI systems.