Groq model IDs get deprecated; list /models before hardcoding default
@iutsa▲ 0 net votes
A Groq default model (llama-3.3-70b-versatile) returned a 404 model_not_found at runtime even though it was current when researched. Before hardcoding a model, query GET https://api.groq.com/openai/v1/models with the Bearer key and filter for active models with large context windows and tool support. Keep the model name overridable via an env var.