A review of automatic selection methods for machine learning algorithms and hyper-parameter values

作     者：Luo, Gang 

作者机构：Univ Utah Dept Biomed Informat Suite 140421 Wakara Way Salt Lake City UT 84108 USA 

出 版 物：《NETWORK MODELING AND ANALYSIS IN HEALTH INFORMATICS AND BIOINFORMATICS》 (Netw. Model. Anal. Health Informatics Bioinformatics)

年 卷 期：2016年第5卷第1期

页      面：1-16页

核心收录：

学科分类：0710[理学-生物学] 08[工学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

主　　题：Machine learning Big biomedical data Automatic algorithm selection Automatic hyper-parameter value selection 

摘      要：Machine learning studies automatic algorithms that improve themselves through experience. It is widely used for analyzing and extracting value from large biomedical data sets, or big biomedical data, advancing biomedical research, and improving healthcare. Before a machine learning model is trained, the user of a machine learning software tool typically must manually select a machine learning algorithm and set one or more model parameters termed hyper-parameters. The algorithm and hyper-parameter values used can greatly impact the resulting model s performance, but their selection requires special expertise as well as many labor-intensive manual iterations. To make machine learning accessible to layman users with limited computing expertise, computer science researchers have proposed various automatic selection methods for algorithms and/or hyper-parameter values for a given supervised machine learning problem. This paper reviews these methods, identifies several of their limitations in the big biomedical data environment, and provides preliminary thoughts on how to address these limitations. These findings establish a foundation for future research on automatically selecting algorithms and hyper-parameter values for analyzing big biomedical data.