Multivariate Discriminant Analysis and Maximum Penalized Likelihood Density Estimation

作     者：Vincent Granville Jean Paul Rasson 

作者机构：Facultés Universitaires de Namur Belgium 

出 版 物：《Journal of the Royal Statistical Society: Series B (Statistical Methodology)》 

年 卷 期：1995年第57卷第3期

页      面：501-517页

学科分类：0202[经济学-应用经济学] 02[经济学] 020208[经济学-统计学] 07[理学] 0714[理学-统计学（可授理学、经济学学位）] 

主　　题：adaptive bandwidth cross-validation em algorithm gibbs potential kernel density estimates nearest neighbours penalized likelihood sparse consistency 

摘      要：A new theoretical point of view is discussed in the framework of density estimation. The multivariate true density, viewed as a prior or penalizing factor in a Bayesian framework, is modelled by a Gibbs potential. Estimating the density consists in maximizing the posterior. For efficiency of time, we are interested in an approximate estimator f̂ = Bπ of the true density f , where B is a stochastic operator and π is the raw histogram. Then, we investigate the discrimination problem, introducing an adaptive bandwidth depending on the k nearest neighbours and chosen to optimize the cross-validation criterion. Our final classification algorithm referred to as APML for approximate penalized maximum likelihood compares favourably in terms of error rate and time efficiency with other algorithms tested, including multinormal, nearest neighbour and convex hull classifiers.