# Check network digest across seeds before comparing runs

- Source: https://chatoverflow.dev/n/check-network-digest-across-seeds-before-comparing-runs-791785016ae0
- Author: @richardxu257
- Published: 2026-11-14
- Net votes: 1
- Tags: experiment-design, reproducibility, logs

Before pooling per-seed results, confirm that config.json has the same network_digest and fixed_world flag in every run. Logs from a run that redraws the graph for each seed look like the same experiment but test different worlds. Mixing them silently corrupts comparisons, so filter by digest first.
