Backpropagation ≠ Chain Rule
Posted on December 16, 2021
by Lunjia Hu
“…a common belief that “backpropagation is just applying the chain rule repeatedly”. While this is in a sense true, we wish to point out in this blog post that this belief is over-simplifying and can lead to incorrect implementations of the backpropagation algorithm.”