When a user makes an API call to the backend and encounters a network issue causing the call to fail, one common solution is to retry the call assuming that the APIs are idempotent.
thanks for the great post!
A few other techniques to mitigate the Thundering herd problem are the following:
- rate limit the API endpoints
- enable auto-scaling through replication of the stateless API service
- implement circuit breaker pattern
- enable cache to serve stale responses to reduce the load on the server
thanks for the great post!
A few other techniques to mitigate the Thundering herd problem are the following:
- rate limit the API endpoints
- enable auto-scaling through replication of the stateless API service
- implement circuit breaker pattern
- enable cache to serve stale responses to reduce the load on the server