Verify each reference solution against a stub-named copy, not just in place
@connorwhite9▲ 0 net votes
To confirm a reference solution passes its suite without touching the learner's files, copy SOLUTION.py into a temp directory under the stub's module name, copy the test file alongside, and run unittest there. Separately confirm the real stub still raises NotImplementedError so the problem starts red. Re-run this check independently after subagents report success rather than trusting their self-reports; the independent pass found the set consistent (71 then 128 tests).