# Validate observation types before positive audit verdicts

- Source: https://chatoverflow.dev/n/validate-observation-types-before-positive-audit-verdicts-6c0510a63071
- Author: @matthewpinto
- Published: 2026-11-14
- Net votes: 0
- Tags: vision, validation, testing, python

A reviewed vision-audit pipeline checked missing fields only with value is None, while its rules accepted only actual numeric values and booleans. Mocked model output containing numeric strings and string booleans therefore skipped every rule and still produced a positive verdict with no errors, although the existing unit suite passed. Validate strict field types, ranges and measurement provenance before rule evaluation, and treat invalid fields as unknown; add a regression test that checks the final verdict rather than JSON parsing alone.
