Relationships between the learning rate /spl eta/ and the slopes /spl beta/ in the tanh activation function for a feedforward neural network (NN) are provided. The analysis establishes the equivalence in the static an...
详细信息
ISBN:
(纸本)0780355121
Relationships between the learning rate /spl eta/ and the slopes /spl beta/ in the tanh activation function for a feedforward neural network (NN) are provided. The analysis establishes the equivalence in the static and dynamic sense between a referent and an arbitrary feedforward NN which helps to reduce the number of degrees of freedom in learning algorithms for NNs.
A new compression filter for binary coded wideband digital signals with sidelobe reduction capabilities using a feedforward time-delay neural network is considered. This filter uses powers-of-two synaptic weights and ...
详细信息
A new compression filter for binary coded wideband digital signals with sidelobe reduction capabilities using a feedforward time-delay neural network is considered. This filter uses powers-of-two synaptic weights and the backpropagation learning algorithm. Using digital hardware implementation of such a filter for pulse compression is easier owing to elimination of multipliers. The simulation results showed that the time sidelobes of the output signal can be reduced up to about 60 dB. The quantization of the filter weights causes additional losses of about 6-14 dB depending on the input signal to noise ratio.
Recognition method of human face using statistical analysis feature extraction and a neural network algorithm is proposed. In the preprocessing step we detect the edges of the face image by using the Sobel algorithm. ...
详细信息
Recognition method of human face using statistical analysis feature extraction and a neural network algorithm is proposed. In the preprocessing step we detect the edges of the face image by using the Sobel algorithm. Then we propose a new method to transform the two-dimension black and white image to a one-dimension vector. Finally, based on the statistical analysis, we extract seven features. In the recognition step we use the fast backpropagation (FBP) algorithm. Computer simulation results with 100 test images of 10 persons (the images of each person in a various pauses, facial expression, and facial details) show that the proposed method yields a high recognition rate.
This paper applies a parallel scheme for adaptive control that uses only one neural network to a CSTR (continuous stirred tank reactor). Convergence of the identification error is investigated by Lyapunov's second...
详细信息
This paper applies a parallel scheme for adaptive control that uses only one neural network to a CSTR (continuous stirred tank reactor). Convergence of the identification error is investigated by Lyapunov's second method. The training process of the neural network is carried out by using two different techniques: backpropagation and extended Kalman filter algorithm.
backpropagation based supervised feedforward artificial neural networks (ANNs) have been developed for many applications (e.g. Rumelhart et al., 1986; Hinton, 1989; Werbos, 1990; and Riedmiller, 1994) but no detailed ...
详细信息
backpropagation based supervised feedforward artificial neural networks (ANNs) have been developed for many applications (e.g. Rumelhart et al., 1986; Hinton, 1989; Werbos, 1990; and Riedmiller, 1994) but no detailed study of the measurement of the quality characteristics (e.g complexity and efficiency) of the network system has been made. Without an appropriate measurement, it is difficult to tell how the network performs on given applications. In addition, it is difficult to provide a measure of the algorithmic complexity of any given application. The paper proposes a new set of software metrics, named neural metrics, which provide indicative measures of the quality characteristics of ANNs. Neural metrics that are non-primitive in nature are defined mathematically as neural metrics functions.
The main purpose of the paper is to compare the support vector machine (SVM) developed by Cortes and Vapnik (1995) with other techniques such as backpropagation and radial basis function (RBF) networks for financial f...
详细信息
The main purpose of the paper is to compare the support vector machine (SVM) developed by Cortes and Vapnik (1995) with other techniques such as backpropagation and radial basis function (RBF) networks for financial forecasting applications. The theory of the SVM algorithm is based on statistical learning theory. Training of SVMs leads to a quadratic programming (QP) problem. Preliminary computational results for stock price prediction are also presented.
Introduces the entropy concept to a backpropagation neural network in order to improve its performance of classifying similar samples. Then, based on the neural network, we propose a thinning model for Chinese charact...
详细信息
Introduces the entropy concept to a backpropagation neural network in order to improve its performance of classifying similar samples. Then, based on the neural network, we propose a thinning model for Chinese characters, and state its preprocessing methods, neural network architecture, learning algorithm and working algorithm. At the same time, we reform the conventional thinning process for Chinese characters in order to improve speed of processing. Finally, combining the nonlinear shape normalization methods and the reformed thinning process, an experiment on handwritten Chinese character preprocessing has been done to test the model, and obtain satisfactory results.
Forecasts are the basis for planning and decision making. The more accurate the organization's forecasts, the better prepared it will be to take advantage of future opportunities and to reduce potential risks. Thu...
详细信息
Forecasts are the basis for planning and decision making. The more accurate the organization's forecasts, the better prepared it will be to take advantage of future opportunities and to reduce potential risks. Thus, it should come as no surprise that there is a tremendous number of statistical prediction algorithms already in existence. However, most of them are useful only when the time series exhibit little trend or seasonal variations but a great deal of irregular or random variation. Therefore, the objective of this paper is to propose a new intelligent forecasting technique which is constructed by combining n-trained neural-based network together. The experimental results based on simulated data show a significant improvement in forecasting accuracy.
作者:
Matson, CLLiu, HLUSAF
Res Lab Adv Opt & Imaging Div Kirtland AFB NM 87117 USA Univ Texas
Dept Biomed Engn Arlington TX 76019 USA
We extend the backpropagation algorithm of standard diffraction tomography to backpropagation in turbid media. We analyze the behavior of the backpropagation algorithm both for a single-view geometry, as is common in ...
详细信息
We extend the backpropagation algorithm of standard diffraction tomography to backpropagation in turbid media. We analyze the behavior of the backpropagation algorithm both for a single-view geometry, as is common in mammography, and for multiple views. The most general form of the algorithm permits arbitrary placement of sources and detectors in the background medium. In addition, we specialize the algorithm for the case of a planar array of detectors, which permits the backpropagation algorithm to be implemented with fast-Fourier-domain noniterative algebraic methods. In this case the algorithm can be used to reconstruct three-dimensional images in a minute or less, depending on the number of views. We demonstrate the theoretical results with computer simulations. (C) 1999 Optical Society of America [S0740-3232(99)02806-9].
This article focuses on gradient-based backpropagation algorithms that use either a common adaptive learning rate for all weights or an individual adaptive learning rate for each weight and apply the Goldstein/Armijo ...
详细信息
This article focuses on gradient-based backpropagation algorithms that use either a common adaptive learning rate for all weights or an individual adaptive learning rate for each weight and apply the Goldstein/Armijo line search. The learning-rate adaptation is based on descent techniques and estimates of the local Lipschitz constant that are obtained without additional error function and gradient evaluations. The proposed algorithms improve the backpropagation training in terms of both convergence rate and convergence characteristics, such as stable learning and robustness to oscillations. Simulations are conducted to compare and evaluate the convergence behavior of these gradient-based training algorithms with several popular training methods.
暂无评论