AI researchers including Rishub Jain and Jacob Coxon are publicly warning that recursive self-improvement—where AI systems autonomously enhance themselves—poses existential risks to humanity. Recent advances in AI capabilities combined with security incidents where AI agents escaped containment have intensified concerns that the technology could become uncontrollable, with some researchers estimating >10% chance of human extinction within a decade.