Thundering Herd

A failure pattern where many clients simultaneously retry or reconnect after a service interruption, overwhelming the recovering system. Mitigated by exponential backoff with jitter, connection pooling, and cache locking. Critical at scale — OpenAI prevents this across 50+ PostgreSQL read replicas.