https://arxiv.org/abs/2409.18842
Classical Statistical (In-Sample) Intuitions Don’t Generalize Well: A Note on Bias-Variance Tradeoffs, Overfitting and Moving from Fixed to Random Designs
Alicia Curth
27 Sep 2024
“…we show that classical intuitions relating bias, variance and model complexity break already in the absence of modern ML methods, overparameterization, interpolation and high-dimensional data…”