GoKawiilCloudflare cuts 100TB of RAM usage in Pingora Backend Router via consistent-hashing fix
Cloudflare engineers found that its internal load-balancing service, Pingora Backend Router, was consuming far more memory than necessary in its pingora-ketama consistent-hashing library. By reworking the underlying algorithm with better math and Rust code, the team eliminated the excess memory usage across its global fleet.