The generalization ability of an MLP network has been shown to be related to both the number and magnitudes of the network weights. Thus, there exists a tension between employing networks with few weights that have re...
详细信息
The generalization ability of an MLP network has been shown to be related to both the number and magnitudes of the network weights. Thus, there exists a tension between employing networks with few weights that have relatively large magnitudes, and networks with a greater number of weights with relatively small magnitudes. The analysis presented in this paper indicates that large magnitudes for network weights potentially increase the propensity of a network to interpolate poorly. Experimental results indicate that when bounds are imposed on network weights, the backpropagation algorithm is capable of discovering networks with small weight magnitudes that retain their expressive power and exhibit good generalization.
Classification of EEG signals extracted during mental tasks is a technique for designing brain computer interfaces (BCI). In this paper, we classify EEG signals that were extracted during mental tasks using fixed auto...
详细信息
Classification of EEG signals extracted during mental tasks is a technique for designing brain computer interfaces (BCI). In this paper, we classify EEG signals that were extracted during mental tasks using fixed autoregressive (FAR) and adaptive AR (AAR) models. Five different mental tasks from 4 subjects were used in the experimental study and combinations of 2 different mental tasks are studied for each subject. Four different feature extraction methods were used to extract features from these EEG signals: FAR coefficients computed with Burg's algorithm using 125 data points, without segmentation and with segmentation of 25 data points, AAR coefficients computed with least-mean-square (LMS) algorithm using 125 data points, without segmentation and with segmentation of 25 data points. Multilayer perceptron (MLP) neural network (NN) trained by the backpropagation (BP) algorithm is used to classify these features into the different categories representing the mental tasks. The best results for FAR was 92.70% while for AAR was only 81.80%. The results obtained here indicated that FAR using 125 data points without segmentation gave better classification performance as compared to AAR, with all other parameters constant
A template-based technique for automatic recognition of birdsong syllables is presented. This technique combines time delay neural networks (TDNNs) with an autoregressive (AR) version of the backpropagation algorithm ...
详细信息
A template-based technique for automatic recognition of birdsong syllables is presented. This technique combines time delay neural networks (TDNNs) with an autoregressive (AR) version of the backpropagation algorithm in order to improve the accuracy of bird species identification. The proposed neural network structure (AR-TDNN) has the advantage of dealing with a pattern classification of syllable alphabet and also of capturing the temporal structure of birdsong. We choose to carry out trials on song patterns obtained from sixteen species living in New Brunswick province of Canada. The results show that the proposed AR-TDNN system achieves a highly recognition rate compared to the baseline backpropagation-based system
A new fast training algorithm for the multilayer perceptron (MLP) is proposed. This new algorithm is based on the optimization of a mixed least square (LS) and a least fourth (LF) criterion producing a modified form o...
详细信息
A new fast training algorithm for the multilayer perceptron (MLP) is proposed. This new algorithm is based on the optimization of a mixed least square (LS) and a least fourth (LF) criterion producing a modified form of the standard back propagation algorithm (SBP). To determine the updating rules in the hidden layers, an analogous back propagation strategy used in the conventional learning algorithms is developed. This permits the application of the learning procedure to all the layers. Experimental results on benchmark applications and a real medical problem are obtained which indicates significant reduction in the total number of iterations, the convergence time, and the generalization capacity when compared to those of the SBP algorithm.
Linear or non-linear models are used in brain machine interfaces (BIMIs) to map the neural activity to the associated behavior, typically the primate's hand position. Linear models assume a linear relationship bet...
详细信息
Linear or non-linear models are used in brain machine interfaces (BIMIs) to map the neural activity to the associated behavior, typically the primate's hand position. Linear models assume a linear relationship between neural activity and hand position that may not be the case. A solution would be time-delay neural network (TDNN) that provides effectively a nonlinear combination of linear models. However, this model results in a drastic increase of free parameters and slow convergence when trained by an error backpropagation learning rule. We propose to train the TDNN by scaled conjugate gradient, which avoids time-consuming linear search, coupled with weight decay to reduce the free parameters number and produce generally faster convergence.
In this paper, we introduce a novel method of relevance learning by a multi-layer perceptron. The relevance learning is regarded as learning from the relationship among two or more outputs of the network. The learning...
详细信息
In this paper, we introduce a novel method of relevance learning by a multi-layer perceptron. The relevance learning is regarded as learning from the relationship among two or more outputs of the network. The learning network architecture is based on a simple multi-layer perceptron with a modified back-propagation learning algorithm. Unlike the conventional multi-layer perceptron that learns from a set of an input feature vector and the target output, the proposed network can obtain a nonlinear mapping between a set of two or more vector inputs and the desired relevance. For instance, the desired relevance represents the dissimilarity among given objects. We show the performance of the proposed network with some experiments with four artificially generated data set. We then discuss the theoretical and mathematical background underlying the network learning with some related works. We evaluate the obtained arrangement of objects in comparison with the result of principle component analysis (PCA) and multidimensional scaling method (MDS). This work also contributes to the measurement of human subjective evaluation for multidimensional perceptual scaling. Some experimental results on the low-dimensional representation of color hue data set and emotional facial images were presented.
An adaptive learning method for recurrent fuzzy systems is proposed. The method modifies the SARPROP algorithm, originally developed for static neural models, in order to be applied to dynamic models. A comparative an...
详细信息
An adaptive learning method for recurrent fuzzy systems is proposed. The method modifies the SARPROP algorithm, originally developed for static neural models, in order to be applied to dynamic models. A comparative analysis with dynamic RPROP and back propagation through time is given, indicating the enhanced learning capabilities of the proposed algorithm
This paper presents two variants of genetic programming (GP) approaches for intelligent online performance monitoring of electronic circuits and systems. Reliability modeling of electronic circuits can be best perform...
详细信息
This paper presents two variants of genetic programming (GP) approaches for intelligent online performance monitoring of electronic circuits and systems. Reliability modeling of electronic circuits can be best performed by the stressor - susceptibility interaction model. A circuit or a system is deemed to be failed once the stressor has exceeded the susceptibility limits. For on-line prediction, validated stressor vectors may be obtained by direct measurements or sensors, which after preprocessing and standardization are fed into the GP models. Empirical results are compared with artificial neural networks trained using backpropagation algorithm. The performance of the proposed method is evaluated by comparing the experiment results with the actual failure model values. The developed model reveals that GP could play an important role for future fault monitoring systems.
暂无评论