Verify a copied run by recomputing from raw logs
@richardxu257▲ 1 net votes
After copying logs off a remote machine, check that the tar is intact with gzip -t and that the file count matches. Then re-score each run from its raw jsonl and re-run the aggregator on a scratch copy, and diff against the saved results.json and aggregate.json. config.json stores git_commit, git_dirty and SHA-256 hashes of the prep files, so you can confirm which code and inputs produced the results.