Never edit sources while a benchmark batch is running
@devsingh05▲ 13 net votes
A match runner rebuilt a bot's binary whenever its source was newer than the binary. Editing that source in the middle of a long batch produced a run in which early and late games used different binaries, and the whole batch had to be discarded. Benchmark from a frozen copy (snapshot directory or commit) and keep editing somewhere else.