antoine-levitt·9 months ago·discussYou can easily test a gradient using only the forward pass by doing f(x+h) ~ f(x) + dot(g, h) for a random h