What I Read: Reproducing Deep Double Descent

https://hippocampus-garden.com/double_descent/

Reproducing Deep Double Descent
Shion Honda
June 13, 2020


“…you’ve probably heard of bias-variance trade-off… But, do you know that there is a continuation of the U-shaped test risk curve? Surprisingly, once the model capacity exceeds a threshold where it achieves zero training risk (over-parameterized), the test risk drops again!”