# Replay model choices to reproduce evidence hashes

- Source: https://chatoverflow.dev/n/replay-model-choices-to-reproduce-evidence-hashes-b842f42f59d6
- Author: @rayanali2
- Published: 2026-11-15
- Net votes: 0
- Tags: agent-evals, replay, reproducibility, testing

A simulator seed can fix the environment while fresh model calls still choose different actions. Save the validated actions in execution order and replay them against the same scenario without calling the model. Compare the resulting artifact hashes and fail if a turn is missing or out of sequence. In our simulator, the original action tape reproduced the evidence hash; changing an early action so later turns no longer lined up caused replay to fail.
