Principal Component Analysis (PCA) and Principal Subspace Analysis (PSA) are classic techniques in statistical data analysis, feature extraction and data compression. Given a set of multivariate measurements, PCA and ...
详细信息
Principal Component Analysis (PCA) and Principal Subspace Analysis (PSA) are classic techniques in statistical data analysis, feature extraction and data compression. Given a set of multivariate measurements, PCA and PSA provide a smaller set of "basis vectors" with less redundancy, and a subspace spanned by them, respectively. Artificial neurons and neural networks have been shown to perform PSA and PCA when gradient ascent (descent) learning rules are used, which is related to the constrained maximization (minimization) of statistical objective functions. Due to their low complexity, such algorithms and their implementation in neural networks are potentially useful in cases of tracking slow changes of correlations in the input data or in updating eigenvectors with new samples. In this paper we propose PCA learning algorithm that is fully homogeneous with respect to neurons. The algorithm is obtained by modification of one of the most famous PSA learning algorithms--Subspace learning algorithm (SLA). Modification of the algorithm is based on Time-Oriented Hierarchical Method (TOHM). The method uses two distinct time scales. On a faster time scale PSA algorithm is responsible for the "behavior" of all output neurons. On a slower scale, output neurons will compete for fulfillment of their "own interests". On this scale, basis vectors in the principal subspace are rotated toward the principal eigenvectors. At the end of the paper it will be briefly analyzed how (or why) time-oriented hierarchical method can be used for transformation of any of the existing neural network PSA method, into PCA method.
A new model of multiresolution process neural network (MRPNN) which incorporates the characteristics of hierarchical, multiresolution and local learning capability is proposed based on the multiresolution analysis the...
详细信息
ISBN:
(纸本)9781538611074
A new model of multiresolution process neural network (MRPNN) which incorporates the characteristics of hierarchical, multiresolution and local learning capability is proposed based on the multiresolution analysis theory and process neural network model. This type of neural network facilitates in tackling with continuous input signals, which makes it possible to forecast time series problem. In addition, in order to approximate the nonlinear system, the hidden layer is used to deal with the nonlinear and complexity problems. A novel learning algorithm is given to expand the input functions and network weight functions based on the expansion of the orthogonal basis functions, subsequently The learning algorithm then builds the network by locating high error regions and adding nodes that get its activation function from the higher resolution space of the current local node, and its support falls within the high error region. Finally, the network is used to forecast the medium-term load of power system. Simulation results show that the network has good convergence and high accuracy. This method provides an effective solution to medium-term load forecasting in power system.
Stroke is a major cause of disability in worldwide and also one of the causes of death after coronary heart disease. Many devices had been designed for hand motor function rehabilitation that a stroke survivor can use...
详细信息
Stroke is a major cause of disability in worldwide and also one of the causes of death after coronary heart disease. Many devices had been designed for hand motor function rehabilitation that a stroke survivor can use for bilateral movement practice. This paper presents an arm motor function rehabilitation device where it is designed to predict the position angle for the robotic arm. MATLAB software is used for real-time positioning that can be developed by SIMULINK block diagram and proof by the simulator in program code in order for devising to operate under the position demand. All the angular motions or feedback to the simulation mode from the attached optical encoders via the Data Acquisition Card (DAQ). The learning algorithm can directly determine the position of its joint and can therefore completely eliminate the need for any system modelling. The robotic arm shows a successful implementation of the learning algorithm in predicting the behavior for arm exoskeleton. (C) 2014 The Authors. Published by Elsevier B.V.
This paper presents the preliminary results of the work on a control algorithm for a two-finger gripper equipped with an electronic skin (e-skin). The e-skin measures the magnitude and location of the pressure applied...
详细信息
This paper presents the preliminary results of the work on a control algorithm for a two-finger gripper equipped with an electronic skin (e-skin). The e-skin measures the magnitude and location of the pressure applied to it. Contact localization allowed the development of a reliable control algorithm for robotic grasping. The main contribution of this work is the learning algorithm that adjusts the pose of the gripper during the pre-grasp approach step based on contact information. The algorithm was tested on different objects and showed comparable grasping reliability to the vision-based approach. The developed tactile sensor-rich gripper with a dedicated control algorithm may find applications in various fields, from industrial robotics to advanced interactive robots.
Traffic light recognition (TLR) is an integral part of any intelligent vehicle, which must function in the existing infrastructure. Pedestrian and sign detection have recently seen great improvements due to the introd...
详细信息
ISBN:
(纸本)9781467365963
Traffic light recognition (TLR) is an integral part of any intelligent vehicle, which must function in the existing infrastructure. Pedestrian and sign detection have recently seen great improvements due to the introduction of learning based detectors using integral channel features. A similar push have not yet been seen for the detection sub-problem of TLR, where detection is dominated by methods based on heuristic models. Evaluation of existing systems is currently limited primarily to small local datasets. In order to provide a common basis for comparing future TLR research an extensive public database is collected based on footage from US roads. The database consists of both test and training data, totaling 46,418 frames and 112,971 annotated traffic lights, captured in continuous sequences under a varying light and weather conditions. The learning based detector achieves an AUC of 0.4 and 0.32 for day sequence 1 and 2, respectively, which is more than an order of magnitude better than the two heuristic model-based detectors.
作者:
Wu, YTongji Univ
Dept Comp Sci & Engn Shanghai 200092 Peoples R China
The links from hidden layer to output layer are expanded for improving the learning performance of neural network. Based on this, a new neural network structure is proposed, and a learning algorithm is derived on it. ...
详细信息
ISBN:
(纸本)7121002159
The links from hidden layer to output layer are expanded for improving the learning performance of neural network. Based on this, a new neural network structure is proposed, and a learning algorithm is derived on it. And then, several n-parity, function approximation and pattern classification problem simulations are made to verify the effectiveness of the proposed method. The experimental results show that the proposed method has the dual merits of quick training speed and good generalization capability. It proves to be a very effective method.
In this paper, we elaborate on what we did to implement our self-structuring data learning algorithm. To recap, we are working to develop a data learning algorithm that will eventually be capable of goal driven patter...
详细信息
ISBN:
(纸本)9781510600676
In this paper, we elaborate on what we did to implement our self-structuring data learning algorithm. To recap, we are working to develop a data learning algorithm that will eventually be capable of goal driven pattern learning and extrapolation of more complex patterns from less complex ones. At this point we have developed a conceptual framework for the algorithm, but have yet to discuss our actual implementation and the consideration and shortcuts we needed to take to create said implementation. We will elaborate on our initial setup of the algorithm and the scenarios we used to test our early stage algorithm. While we want this to be a general algorithm, it is necessary to start with a simple scenario or two to provide a viable development and testing environment. To that end, our discussion will be geared toward what we include in our initial implementation and why, as well as what concerns we may have. In the future, we expect to be able to apply our algorithm to a more general approach, but to do so within a reasonable time, we needed to pick a place to start.
This paper proposes a novel learning algorithm of Binary Feedforward Neural Networks (BFNNs) by combining the self-adaptations of both architecture and *** to the learning algorithm of Extreme learning Machine (ELM), ...
详细信息
ISBN:
(纸本)9781467372206
This paper proposes a novel learning algorithm of Binary Feedforward Neural Networks (BFNNs) by combining the self-adaptations of both architecture and *** to the learning algorithm of Extreme learning Machine (ELM), our algorithm only adapts the number of hidden neurons and output weights to effectively train BFNNs with a single hidden layer for classification problems. The algorithm consists of two steps including the expanding and pruning phases. During the expandingphase, the algorithm increases the hidden neurons and also searches the weight of the output neuronusing the Perceptron learning Rule to increase the learning accuracy. In the pruning phase, the least relevant hidden neurons measured by a proposed binary neuron's sensitivity are pruned to reduce the complexity of the modeland increase the generalization ability. Experimental results confirmed the feasibility and effectiveness of the proposed algorithm.
In this paper, we research the real-time object tracking technology. The object tracking algorithm discussed in this paper is developed based on the Tracking-learning-Detection(TLD) and the Centroid Neural Network(CNN...
详细信息
ISBN:
(纸本)9781467380133
In this paper, we research the real-time object tracking technology. The object tracking algorithm discussed in this paper is developed based on the Tracking-learning-Detection(TLD) and the Centroid Neural Network(CNN). The object is unknown ahead of tracking;the model of the object is composed of objects transformed geometrically immediately after tracking. The TLD framework is useful for long-term object tracking in a video stream because the TLD framework applies a novel learning algorithm called P-N learning. We propose a method that applies the CNN algorithm to the TLD framework. The CNN algorithm is an unsupervised learning algorithm that provides a stable result, regardless of initial values of learning coefficients and neurons. The object tracking algorithm discussed in this paper has a higher accuracy than that of TLD in terms of detection. Additionally, it exhibits better processing performance than that of TLD.
We propose a novel adaptive fast learning (AFL) algorithm for two-dimensional principal component analysis (2DPCA) in this paper. As opposite to conventional PCA which is based on 1D data vectors, 2DPCA is based on 2D...
详细信息
ISBN:
(纸本)9783037856727
We propose a novel adaptive fast learning (AFL) algorithm for two-dimensional principal component analysis (2DPCA) in this paper. As opposite to conventional PCA which is based on 1D data vectors, 2DPCA is based on 2D image matrices and thus has higher accuracy than conventional PCA when applied to applications such as face recognition, facial expression recognition, palmprint recognition, etc. Our proposed AFL algorithm simultaneously estimates both eigenvectors and corresponding eigenvalues, and then adaptively sets the learning rate parameters of neurons to ensure all neurons learning with almost the same fast speed. Requiring no image covariance matrix evaluation, the desired multiple eigenvectors of 2DPCA can thus be learned effectively in the form of weight vectors of neurons. The proposed AFL algorithm can also be applied to learning for T-2DPCA. Simulation experiments performed on face database such as the YaleB database clearly demonstrate that the proposed AFL algorithm performs very well and thus is a very effective computational tool for both 2DPCA and T-2DPCA.
暂无评论