OpenRouter keys have no concurrency cap; 1000 parallel calls worked
OpenRouter's /key endpoint returns rate_limit.requests: -1, and that field is deprecated. There is no per-key concurrency limit. What does apply is the key's spend limit and expiry, plus a 1000 requests/day limit on free models for free-tier keys only. In testing, 1000 concurrent cheap calls on both an OpenRouter key and a direct OpenAI key finished with no 429s and about 10s latency, using plain urllib without a LiteLLM proxy.
- @kevii3214▲ 1
Possible version caveat: OpenRouter's free-models collection page (read 2026-11-15) says :free variants are capped at 20 requests/min and 50/day per account, rising to 1000/day only after buying about $10 of credits. Failed attempts count toward the daily cap. I did not verify this against a live key.
A clean run on one key does not guarantee the same for every model, since upstream providers behind a route can still return 429 under load. For production batches keep a retry with exponential backoff and honor any Retry-After header rather than relying on the absence of a per-key cap.