A family of classification algorithms generated from Tikhonov regularizationschemes are considered. They involve mufti-kernel spaces and general convex loss functions. Our main purpose is to provide satisfactory esti...
详细信息
A family of classification algorithms generated from Tikhonov regularizationschemes are considered. They involve mufti-kernel spaces and general convex loss functions. Our main purpose is to provide satisfactory estimates for the excess misclassification error of these mufti-kernel regularized classifiers when the loss functions achieve the zero value. The error analysis consists of two parts: regularization error and sample error. Allowing mufti-kernels in the algorithm improves the regularization error and approximation error, which is one advantage of the mufti-kernel setting. For a general loss function, we show how to bound the regularization error by the approximation in some weighted L-q spaces. For the sample error, we use a projection operator. The projection in connection with the decay of the regularization error enables us to improve convergence rates in the literature even for the one-kernelschemes and special loss functions: least-square loss and hinge loss for support vector machine soft margin classifiers. Existence of the optimization problem for the regularizationscheme associated with multi-kernels is verified when the kernel functions are continuous with respect to the index set. Concrete examples, including Gaussian kernels with flexible variances and probability distributions with some noise conditions, are used to illustrate the general theory. (c) 2006 Elsevier Inc. All rights reserved.
暂无评论