Cloudflare reduced memory usage of its Pingora Backend Router service by optimizing the consistent hashing algorithm used for load balancing, reclaiming over 100TB of RAM globally. The optimization involved mathematical improvements to the pingora-ketama library, which handles distributing tasks across servers without requiring major changes when servers are added or removed.