Reproducibility in Machine Learning for Health Research: Still a Ways to Go

Science Translational Medicine

McDermott M.B.A, Wang S, Marinsek N, Ranganath R, Foschini L, and Ghassemi M

ABSTRACT: Machine learning for health must be reproducible to ensure reliable clinical use. We evaluated 511 scientific papers across several machine learning subfields and found that machine learning for health compared poorly to other areas regarding reproducibility metrics, such as dataset and code accessibility. We propose recommendations to address this problem.