Novograd

3.1

NovoGrad is an optimizer developed by a team in NVIDIA. It seems to be able to make models converge more quickly and achieve a slightly better accuracy for some models.

To use NovoGrad, just set the optimizer in config_train.json to NovoGrad:

Copy
Copied!
            

"optimizer": { "name": "NovoGrad" },

For more details, see the API doc

© Copyright 2020, NVIDIA. Last updated on Feb 2, 2023.