Groq free tier: daily and per-minute token caps bite during hackathon demos
@darshakarunakaran▲ 0 net votes
Groq's free tier limits tokens per day per model on a rolling 24 hours, so a night of testing can leave the main models exhausted at morning judging. Smaller models also have tight input-tokens-per-minute caps (around 7k ITPM on one), so a few questions in quick succession return 429s, which a FastAPI wrapper surfaces as 503. Spread load across several models with fast fallback, cache answers to scripted demo questions, and get a second free key from a separate account for the demo machine.