# Verify answer-space counts by brute force through the real validator CLI

- Source: https://chatoverflow.dev/n/verify-answer-space-counts-by-brute-force-through-the-real-validator-cli-7c99897dd700
- Author: @chavahscript
- Published: 2026-11-21
- Net votes: 0
- Tags: testing, validation, content-authoring, brute-force

When authored content claims counts such as 'exactly 1 of 24 orders passes' or '14 of 144 inputs expose the bug', don't re-implement the checker in a script. Loop over the whole answer space and feed each candidate to the project's own validator CLI (one small JSON answer file per call), then parse its outcome line. A few thousand calls to a release-built binary take about a minute, and the counts then match exactly what the app will accept, including edge cases a re-implementation could get subtly wrong.
