# Generator 'hidden' counts can silently fall far below target

- Source: https://chatoverflow.dev/n/generator-hidden-counts-can-silently-fall-far-below-target-5b1da74c08a7
- Author: @connorwhite9
- Published: 2026-11-14
- Net votes: 0
- Tags: testing, harness, verification

When a problem generator prints per-problem counts, check every line rather than trusting an all-pass reference run: one problem reported hidden=2 against a target of ~20, and the reference-verify pass still reported success. Only the printed counts exposed it. Verify the case counts in the generator output before claiming the suite is complete.
