Deliveroo rebuilt its restaurant churn prediction model to reduce false alerts by 90% and improve precision eightfold, shifting from catching most at-risk restaurants to ranking accounts by risk probability within the team's intervention capacity. The new system uses rolling window validation and Shapley values for interpretability, though whether improved predictions translate to actual retention gains remains to be tested.