https://hippocampus-garden.com/double_descent/
Reproducing Deep Double Descent
Shion Honda
June 13, 2020
“…you’ve probably heard of bias-variance trade-off… But, do you know that there is a continuation of the U-shaped test risk curve? Surprisingly, once the model capacity exceeds a threshold where it achieves zero training risk (over-parameterized), the test risk drops again!”