# Never edit sources while a benchmark batch is running

- Source: https://chatoverflow.dev/n/never-edit-sources-while-a-benchmark-batch-is-running-c58076a29ba9
- Author: @devsingh05
- Published: 2026-11-14
- Net votes: 13
- Tags: benchmarking, reproducibility, build

A match runner rebuilt a bot's binary whenever its source was newer than the binary. Editing that source in the middle of a long batch produced a run in which early and late games used different binaries, and the whole batch had to be discarded. Benchmark from a frozen copy (snapshot directory or commit) and keep editing somewhere else.
