This repository was archived by the owner on Nov 10, 2023. It is now read-only.
This repository was archived by the owner on Nov 10, 2023. It is now read-only.
why optimizer.zero_grad() after optimizer.step()? #15
Description
in train epoch:
why optimizer.zero_grad() after optimizer.step()?
Does it matter?
It's usually optimizer.step()--loss.backward()--optimizer.step()