ML Foundations: Understanding the Math Behind Backpropagation(jordancoblin.github.io)
jordancoblin.github.io
ML Foundations: Understanding the Math Behind Backpropagation
https://jordancoblin.github.io/posts/understanding-the-math-behind-backpropagation/
2 comments
Well done. I'd change a few things to make things technically more precise. In a few places you use words like "learnable" parameter but I think this tends to confuse people more than help them understand what is going on. People can learn but parameters can only be modified according to some rule that minimizes or maximizes some objective function of those parameters. People who understand the technical details tend to use words/phrases like "learning" as shorthand but in an introductory post like this it is useful to be technically precise and not use anthropomorphisms that can confuse beginners.
That's a great point. I tend to take for granted the intuition required for some of the terminology - best to keep it precise, as you suggest.