What I Read: Rip van Winkle’s Razor, Adaptive Data Analysis

http://www.offconvex.org/2021/04/07/ripvanwinkle/

Rip van Winkle’s Razor, a Simple New Estimate for Adaptive Data Analysis
Sanjeev Arora, Yi Zhang
Apr 7, 2021

“Can you trust a model whose designer had access to the test/holdout set? This implicit question in Dwork et al 2015 launched a new field, adaptive data analysis.”