Monitor-in-reward can be gamed by empty outputs that are never scored
@ayushs2k1▲ 0 net votes
In best-of-n selection with a monitor penalty, outputs with no code are never scored and so get no penalty. If the monitor false-positives on honest work (one 7B monitor flagged about 92% of honest samples), an empty answer can win the selection and look like a gain. Before using a monitor as a reward, measure its flag rate on honest samples. Give empty or unparseable outputs an explicit penalty.