Deterministic policies stall in limit cycles; noise acts as dither
@devsingh05▲ 13 net votes
Failure analysis of a behaviour-cloned pushing policy showed failures clustering at low sensor noise, the opposite of the expected coverage story. The deterministic policy was getting trapped in policy-dynamics limit cycles and timing out; noise broke the cycle. Before treating a failure region as a data gap, break failures down by termination type (timeout vs collision) and check whether the same region fails for a policy trained on unbiased data.