We analyze the dynamical behaviors of semi-supervised learning in the framework of on-line learning by using the statistical-mechanical method. A student uses several correlated input vectors in each update. The stude...
详细信息
ISBN:
(纸本)9783319466729;9783319466712
We analyze the dynamical behaviors of semi-supervised learning in the framework of on-line learning by using the statistical-mechanical method. A student uses several correlated input vectors in each update. The student is given a desired output for only one input vector out of these correlated input vectors. In this model, we derive simultaneous differential equations with deterministic forms that describe the dynamical behaviors of order parameters using the self-averaging property in the thermodynamic limit. We treat the Hebbian and Perceptron learning rules. As a result, it is shown that using unlabeled data is effective in the early stages for both of the two learning rules. In addition, we show that the two learning rules have qualitatively different dynamical behaviors. Furthermore, we propose a new algorithm that improves the generalization performance by switching the number of input vectors used in an update as the time step proceeds.
A theory that predicts the behaviors of the Filtered-X LMS algorithm was derived by using a statistical-mechanical method. In this paper, the theory is generalized to explain the system behaviors in the case of an act...
详细信息
The Volterra filter is one of the digital filters that can describe nonlinearity. In this paper, we analyze the dynamic behaviors of an adaptive signal processing system with the Volterra filter for nonwhite input sig...
详细信息
The Volterra filter is one of the digital filters that can describe nonlinearity. In this paper, we analyze the dynamic behaviors of an adaptive signal processing system with the Volterra filter for nonwhite input signals by a statistical -mechanicalmethod. Assuming the self -averaging property with an infinitely long tapped -delay line, we derive simultaneous differential equations that describe the behaviors of macroscopic variables in a deterministic and closed form. We analytically solve the derived equations to reveal the effect of the nonwhiteness of the input signal on the adaptation process. The results for the second -order Volterra filter show that the nonwhiteness decreases the mean -square error (MSE) in the early stages of the adaptation process and increases the MSE in the later stages.
A theory that predicts the behaviors of the Filtered-X LMS algorithm was derived by using a statistical-mechanical method. In this paper, the theory is generalized to explain the system behaviors in the case of an act...
详细信息
ISBN:
(纸本)9781467369985
A theory that predicts the behaviors of the Filtered-X LMS algorithm was derived by using a statistical-mechanical method. In this paper, the theory is generalized to explain the system behaviors in the case of an actual primary path. In the theory, cross-correlations between the element of a primary path and that of an adaptive filter and autocorrelations of the elements of the adaptive filter are treated as macroscopic variables. Simultaneous differential equations that describe the dynamical behaviors of the macroscopic variables are obtained under conditions in which the tapped-delay line is sufficiently long. The equations are analytically solved to obtain the correlations and finally compute the mean-square error. In order to generalize the theory to the case of an actual primary path, the correlations of the elements of the primary path are absorbed. The generalized theory quantitatively predict the behaviors in the case of an actual primary path.
暂无评论