Performance analysis of the simultaneous perturbation stochastic approximation algorithm on the noisy sphere model

作     者：Finck, Steffen Beyer, Hans-Georg 

作者机构：FH Vorarlberg Univ Appl Sci A-6850 Dornbirn Austria 

出 版 物：《THEORETICAL COMPUTER SCIENCE》 (理论计算机科学)

年 卷 期：2012年第419卷第C期

页      面：50-72页

核心收录：

学科分类：08[工学] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：Austrian Science Fund (FWF) [P19069-N18] Austrian Science Fund (FWF) [P19069] Funding Source: Austrian Science Fund (FWF) 

主　　题：Algorithm comparison Stochastic gradient approximation Evolution strategy Noisy optimization 

摘      要：To theoretically compare the behavior of different algorithms, compatible performance measures are necessary. Thus in the first part, an analysis approach, developed for evolution strategies, was applied to simultaneous perturbation stochastic approximation on the noisy sphere model. A considerable advantage of this approach is that convergence results for non-noisy and noisy optimization can be obtained simultaneously. Next to the convergence rates, optimal step sizes and convergence criteria for 3 different noise models were derived. These results were validated by simulation experiments. Afterward, the results were used for a comparison with evolution strategies on the sphere model in combination with the 3 noise models. It was shown that both strategies perform similarly, with a slight advantage for SPSA if optimal settings are used and the noise strength is not too large. (C) 2011 Elsevier B.V. All rights reserved.