
Thundering Herd Problem and addressing it with randomnessWhen a user makes an API call to the backend and encounters a network issue causing the call to fail, one common solution is to retry the call assuming that the APIs are idempotent. However, when multiple clients simultaneously retry their calls, it can cause a "Thundering Herd…

Arpit’s Newsletter
🔥 Weekly essays on real-world system design, distributed systems, or a deep dive into some super-clever algorithm.
By registering you agree to Substack's Terms of Service, our Privacy Policy, and our Information Collection Notice