Show HN: AdaBound, an optimizer that trains as fast as Adam and as good as SGD(github.com)
github.com
Show HN: AdaBound, an optimizer that trains as fast as Adam and as good as SGD
https://github.com/Luolc/AdaBound
6 comments
Are algos like Adam being used besides deep learning? I always come across Levenberg-Marquardt and Gauss-Newton, but never Adam.
Reddit thread by author : https://www.reddit.com/r/MachineLearning/comments/auvj3q/r_a...
Is there a nice resource where I can read about all these different optimizers, their details, as well as a comparison between them?
Sebastian does not disappoint! Thanks!
Looks like a nice incremental improvement. Still waiting on TensorFlow though.