Anthropic and OpenAI researchers have raised alarms about recursive self-improvement (RSI), where AI systems autonomously improve themselves, potentially spiraling beyond human control. Evan Hubinger from Anthropic warned of a 10%+ chance AI could kill all humans within a decade, citing RSI as the primary concern, while both companies report this autonomous improvement is accelerating faster than expected.