OpenAI CFO Sarah Friar told CNBC that despite ongoing AI safety concerns, the company won't slow development unnecessarily and will make investment decisions based on strong ROI while remaining pragmatic about real risks. Friar's comments come as industry leaders debate the pace of AI development following warnings about potential dangers, though she emphasized OpenAI will listen to researchers and adjust if needed.
Nvidia CEO Jensen Huang criticized Anthropic CEO Dario Amodei's proposal for AI companies to coordinate a deliberate slowdown in model development, arguing that existing laws and regulations are sufficient and that safety is an engineering problem companies can solve independently without antitrust exemptions.
At Salesforce's Dreamforce conference, Anthropic CEO Dario Amodei advocated slowing AI model development to ensure safety, gaining support from executives including Sam Altman and Elon Musk. Nvidia CEO Jensen Huang countered that speed and safety are not mutually exclusive and that market forces and developer responsibility, rather than regulation, should guide AI development.
AI pioneers including Yoshua Bengio, Geoffrey Hinton, and Aidan Gomez are warning of catastrophic risks from advanced AI systems, citing concerns about misalignment, hacking capabilities, and potential for biological or cyber attacks. Leaders from Anthropic, OpenAI, and Google DeepMind have called for regulatory oversight and a slowdown in AI development, though President Trump has opposed growing regulation calls.
Wall Street is assessing the impact of a potential AI model development slowdown on data center infrastructure investments, after Anthropic CEO Dario Amodei proposed slowing frontier model development. Major stocks in AI infrastructure—including Oracle, GE Vernova, and Caterpillar—declined sharply on the news, while hyperscalers rush to secure debt financing amid growing pressure on data center expansion.
Stock futures declined Tuesday as the 10-year Treasury yield surged above 5% for the first time since 2007, amid expectations of a Federal Reserve rate hike this week and concerns about U.S.-Iran tensions fueling inflation. Rising Treasury yields and oil prices, coupled with a selloff in AI stocks following safety concerns, pressured equity markets globally.
Microsoft has released a provisional code of conduct to impose restrictions on its AI models, joining Anthropic and OpenAI in slowing frontier AI development. The guidelines, developed over five months, aim to ensure AI systems serve human interests, avoid creating dependence, and refuse harmful requests like weapons manufacturing or cyberattacks. The move follows industry concerns about rapid AI advancement and a researcher's resignation from Anthropic over safety risks.
OpenAI's Sam Altman detailed AI safety frameworks and joined industry leaders in calling for a slowdown in AI development, citing risks of losing control to AI systems. The proposal includes independent evaluators, common safety standards, and international coordination, though President Trump dismissed the concerns as unnecessary for U.S. competitiveness against China.
China's Foreign Ministry dismissed U.S. AI executives' calls for slower AI development as fear-mongering, while Beijing's security minister urged acceleration of AI safety systems, framing the technology as a strategic battleground. U.S. leaders including President Trump opposed the slowdown, citing competitive risks against China.
Global AI stocks fell sharply after Anthropic CEO Dario Amodei called for slowing AI development, with support from OpenAI's Sam Altman and Elon Musk. The sell-off affected major chipmakers and hyperscalers across Asia, Europe, and the U.S., driven by investor concerns that a development slowdown could impact earnings and capital expenditure across the sector.
Stock futures declined Sunday as investors reacted to AI safety concerns, with OpenAI CEO Sam Altman announcing the company would delay its IPO beyond 2024 and Anthropic's Dario Amodei calling for slower AI innovation. Oil prices rose over 2% following Saudi Arabia's pipeline shutdown, while markets await the Federal Reserve's September policy decision.
Anthropic and OpenAI researchers have raised alarms about recursive self-improvement (RSI), where AI systems autonomously improve themselves, potentially spiraling beyond human control. Evan Hubinger from Anthropic warned of a 10%+ chance AI could kill all humans within a decade, citing RSI as the primary concern, while both companies report this autonomous improvement is accelerating faster than expected.
OpenAI launched ChatGPT for Financial Services, a tailored AI tool designed to automate research, financial analysis, and presentation creation for investment bankers. Developed with design partners Morgan Stanley and Evercore, the product uses GPT-6 Astra and threatens to displace entry-level banking roles traditionally filled by junior analysts.
OpenAI and Anthropic researchers are escalating calls for an AI slowdown, with multiple employees warning of existential risks and potential human extinction from advanced AI systems. The concerns intensified after Anthropic researcher Jacob Coxon resigned citing existential dangers, prompting alignment leaders to acknowledge significant extinction probabilities and warn against recursive self-improvement techniques.
Apple released its first foldable iPhone (iPhone Duo) starting at $1,999, alongside new iPhone 18 models and other devices, with social media focusing on the screen crease. The U.S. Treasury tripled bond buyback operations to $6 billion to stabilize markets amid rising yields and oil prices. Trump's energy portfolio gained $1.5 million as oil prices surged following escalating Iran conflict, though no evidence suggests policy was influenced by his financial interests.
OpenAI claims to have solved the Navier-Stokes mathematics problem, one of seven Millennium Prize Problems, using 10,000 coordinating AI agents over 88 hours. However, NYU mathematician Tristan Buckmaster has raised questions about whether OpenAI may have accessed or been informed of similar work he was conducting with Anthropic researcher Levent Alpöge, though he has not seen OpenAI's proof.
Anthropic researcher Jacob Coxon resigned citing concerns that AI labs are recklessly advancing toward superintelligent systems that could pose existential risks. Alignment scientist Evan Hubinger concurred, stating he believes there is over a 10% chance AI could kill all humans within the decade, and that Anthropic lacks a concrete plan to solve AI alignment at superintelligence levels.