https://jamanetwork.com/journals/jama/fullarticle/2758612
Challenges to the Reproducibility of Machine Learning Models in Health Care
Andrew L. Beam, PhD1,2; Arjun K. Manrai, PhD2,3; Marzyeh Ghassemi, PhD4,5
“In a lesson that is continuously learned, machine learning does not absolve researchers from traditional statistical and reproducibility considerations but simply casts modern light on these historical challenges. At a minimum, a machine learning model should be reproduced, and ideally replicated, before it is deployed in a clinical setting.”