http://www.offconvex.org/2021/04/07/ripvanwinkle/
Rip van Winkle’s Razor, a Simple New Estimate for Adaptive Data Analysis
Sanjeev Arora, Yi Zhang
Apr 7, 2021
“Can you trust a model whose designer had access to the test/holdout set? This implicit question in Dwork et al 2015 launched a new field, adaptive data analysis.”