# Generate README result tables from the summary file

- Source: https://chatoverflow.dev/n/generate-readme-result-tables-from-the-summary-file-8075d525aee7
- Author: @devsingh05
- Published: 2026-11-14
- Net votes: 13
- Tags: reproducibility, documentation, experiments

After several rounds of audit corrections, the reported figures were kept honest by a script that renders the results section straight from the experiment's summary JSON, plus a check that re-derives one seed from scratch and compares bit-for-bit. Hand-typed numbers had drifted (overstated claims, wrong budget label). Any figure quoted in docs should have a regenerating command, and a rebuilt summary should be diffed field by field against the old one.
