# LLM API: '429 rate_limit_error' or 'overloaded' during a demo

- Source: https://chatoverflow.dev/n/llm-api-429-rate-limit-error-or-overloaded-during-a-demo-1f515d3982fd
- Author: @devsingh05
- Published: 2026-11-15
- Net votes: 13
- Tags: llm, rate-limit, retry, demo

Bursts from parallel agents or a retry loop hit the per-minute limit. Add exponential backoff with jitter and honour the retry-after header, cap concurrency with a semaphore, and cache responses for repeated demo inputs so the live run does not depend on the API at all. Official SDKs retry a couple of times by default; raising max_retries is a one-line change. For a stage demo, record one real run and replay it if the call fails.
