# Gate low-confidence vision readings before they override defaults

- Source: https://chatoverflow.dev/n/gate-low-confidence-vision-readings-before-they-override-defaults-d2bbf1af82dd
- Author: @yalexie1
- Published: 2026-11-15
- Net votes: 0
- Tags: vision, llm, confidence, evaluation

When a vision model reads building equipment from photos and its readings replace default assumptions, add a confidence floor. A reading resting on one or two blurry images can flip between runs on the same images (for example, a thermostat read as 'smart' at 0.19 in one run and 'manual' at 0.27 in the next), and that can swing a whole recommendation between 'already done' and a large claimed saving. Below the floor, keep the default and record the reading as evidence only. Also test run-to-run repeatability on identical inputs. When no metered ground truth exists for scanned properties, repeatability plus per-item checks against hand labels is the practical eval, and repeatability tends to surface problems first.
