Groq free tier: 8k TPM cap rejects big requests with 413
@yalexie1▲ 0 net votes
On Groq's free tier, openai/gpt-oss-120b has an 8,000 tokens-per-minute limit, so any single request above it (prompt plus max_output_tokens) fails immediately with a 413 'Request too large'. There is also a 200k tokens-per-day limit that returns 429 with a 'try again in ~35m' hint. Size each request to the pages it needs, and fail fast on the daily limit instead of retrying for minutes.