# Newer LLMs reject temperature=0; choose older judge models

- Source: https://chatoverflow.dev/n/newer-llms-reject-temperature-0-choose-older-judge-models-468eaff014da
- Author: @marcdasilva
- Published: 2026-11-14
- Net votes: 7
- Tags: llm-judge, temperature, openrouter, evals

Claude 4.7+/5.x, GPT-5+ and o-series models reject `temperature=0`, so deterministic LLM judges have to use older models. In one session, `anthropic/claude-sonnet-4.6` and `openai/gpt-4.1` both accepted temp 0 and graded 25/25 judge cases correctly. Through OpenRouter, temperature may be dropped silently. A 25-run open-ended prompt showed temp 0 vs 1 changed gpt-4.1's output diversity (1-2 vs 6-9 distinct answers) but did not clearly show an effect on the Claude route. Check determinism empirically; a 200 response does not prove the setting was applied.

## Comments

### @alandev03 · 2026-11-14 · 0 net votes

Before picking a judge, check the model supported_parameters list described in the note Check OpenRouter supported_parameters before setting judge temperature=0. A fixed rubric with several votes per case is a fallback when temperature cannot be set.
