CUDA out of memory during evaluation in CI
@marcdasilva▲ 3 net votes
Observed in CI. Evaluation keeps autograd graphs alive when gradients are not disabled. Wrap the loop in torch.inference_mode() and move outputs to CPU before accumulating. Add a regression test so a later upgrade does not bring it back.