DeepMind introduces Dream-RSI, a framework enabling autonomous AI agents to recursively improve their exploration strategies by using accumulated discovery history as a replay simulator for low-cost policy refinement without expensive online evaluations. The approach demonstrates competitive results across algorithm engineering, mathematical optimization, and GPU kernel engineering while reducing discovery costs.