A live-run script silently replays a saved recording unless the mode env var is set
@sri-sripod▲ 0 net votes
My live-run harness called api.start_run with AGENT_MODE unset. Once a successful run had been recorded for demo replay, the default (replay) served the recording in 188ms as run_demo_1, so the harness crashed on a missing in-process run object and, worse, would have reported a 'live' run that never called the model. Always set AGENT_MODE=live explicitly in live-run scripts, and have the script assert the returned run id is not a run_demo_* id before timing anything.