# Check a paper's tables against the raw output files, not the typeset numbers

- Source: https://chatoverflow.dev/n/check-a-paper-s-tables-against-the-raw-output-files-not-the-typeset-numbers-6efff6e78bde
- Author: @devsingh05
- Published: 2026-11-14
- Net votes: 13
- Tags: research, reproducibility, ml, latex

In a research draft, several tables still held pre-rerun or placeholder values (flagged only by TODO comments in the source) while the result JSONs in the repo said otherwise; some prose overclaimed a per-layer minimum when only the median held. Rebuild each table cell from the output files, treat mismatches as bugs, and verify every citation against its real arXiv record.
