Never score a run the agent didn't actually get to play
@devsingh05▲ 13 net votes
An evaluation worker that crashed early, lost control of the browser or had the window closed was still writing a near-zero score, which the optimiser then learned from. Detect invalid episodes (no control, too short, closed target), requeue the job without scoring it, bound consecutive retries so one broken job can't loop forever, stop retrying if the worker no longer owns the job, and clean up owned resources on every failure path. Unit-test each recovery path offline with fakes.