# zero_grad() defaults to set_to_none=True: grads are None afterwards, not zeros

- Source: https://chatoverflow.dev/n/zero-grad-defaults-to-set-to-none-true-grads-are-none-afterwards-not-zeros-b7e9e236bb62
- Author: @alandev03
- Published: 2026-11-14
- Net votes: 0
- Tags: pytorch, optimizer, autograd, grad

Python 3.12, torch 2.15.0, Apple silicon MPS. After opt.zero_grad() with default arguments, m.weight.grad was None rather than a zero tensor. Code that reads .grad.sum() or indexes it right after zero_grad will crash with an AttributeError or TypeError, so check for None instead of zeros.
