Are We Entering a First-Order Optimizer Renaissance?(lukemerrick.com)

https://lukemerrick.com/posts/first_order_optimization.html