A new method for feature subset selection in machine learning, FSS-MGSA (Feature Subset Selection by Modified Gravitational Search algorithm), is presented. FSS-MGSA is an evolutionary, stochastic search algorithm bas...
详细信息
A new method for feature subset selection in machine learning, FSS-MGSA (Feature Subset Selection by Modified Gravitational Search algorithm), is presented. FSS-MGSA is an evolutionary, stochastic search algorithm based on the law of gravity and mass interactions, and it can be executed when domain knowledge is not available. A wrapper approach, over Naive-Bayes, ID3, K-Nearest Neighbor and Support Vector Machine learning algorithms, is used to evaluate the goodness of each visited solution. The key to the success of the MGSA is to utilize the piecewise linear chaotic map for increasing its diversity of species, and to use sequential quadratic programming for accelerating local exploitation. Promising results are achieved in a variety of tasks where domain knowledge is not available. The experimental results show that the proposed method has the ability of selecting the discriminating input features correctly and can achieve high accuracy of classification, which is comparable to or better than well-known similar classifier systems. Furthermore, the MGSA is tested on ten functions provided by CEC 2005 special session and compared with various modified Gravitational Search algorithm, Particle Swarm Optimization, and Genetic algorithm. The obtained results confirm the high performance of the MGSA in solving various problems in optimization. (C) 2014 Elsevier Inc. All rights reserved.
A type of directly self-tuning PID controller based on neural network is proposed in this paper. Its main characteristic is that it no longer includes independent PID controller and put neural network and the law of P...
详细信息
ISBN:
(纸本)9781510819085
A type of directly self-tuning PID controller based on neural network is proposed in this paper. Its main characteristic is that it no longer includes independent PID controller and put neural network and the law of PID controller together. Showing the learning algorithm of this neural network controller and analyzing the stability of this control system. The simulated results prove that this kind of control system is more adaptive and robust.
The problem of training feedforward neural networks is considered. To solve it, new algorithms are proposed. They are based on the asymptotic analysis of the extended Kalman filter (EKF) and on a separable network str...
详细信息
The problem of training feedforward neural networks is considered. To solve it, new algorithms are proposed. They are based on the asymptotic analysis of the extended Kalman filter (EKF) and on a separable network structure. Linear weights are interpreted as diffusion random variables with zero expectation and a covariance matrix proportional to an arbitrarily large parameter lambda. Asymptotic expressions for the EKF are derived as lambda -> infinity. They are called diffusion learning algorithms (DLAs). It is shown that they are robust with respect to the accumulation of rounding errors in contrast to their prototype EKF with a large but finite lambda and that, under certain simplifying assumptions, an extreme learning machine (ELM) algorithm can be obtained from a DLA. A numerical example shows that the accuracy of a DLA may be higher than that of an ELM algorithm.
A significant problem facing researchers in reinforcement learning, and particularly in multi-objective learning, is the dearth of good benchmarks. In this paper, we present a method and software tool enabling the cre...
详细信息
ISBN:
(纸本)9781479945528
A significant problem facing researchers in reinforcement learning, and particularly in multi-objective learning, is the dearth of good benchmarks. In this paper, we present a method and software tool enabling the creation of random problem instances, including multi-objective learning problems, with specific structural properties. This tool, called Merlin (for Multi-objective Environments for Reinforcement learning), provides the ability to control these features in predictable ways, thus allowing researchers to begin to build a more detailed understanding about what features of a problem interact with a given learning algorithm to improve or degrade the algorithm's performance. We present this method and tool, and briefly discuss the controls provided by the generator, its supported options, and their implications on the generated benchmark instances.
In this paper, a learning algorithm considering derivative information is proposed for neural networks. Based on backpropagation (BP) algorithm, this algorithm takes the derivative information of the samples into acco...
详细信息
Deep learning proposed by Hinton et al is a new learning algorithm of multi-layer neural network, and it is also a new study field in machine learning. This paper describes the structures and advantages to shallow lea...
详细信息
ISBN:
(纸本)9781479972081
Deep learning proposed by Hinton et al is a new learning algorithm of multi-layer neural network, and it is also a new study field in machine learning. This paper describes the structures and advantages to shallow learning of deep learning, and analyzes current popular learning algorithm in detail. Finally, this paper analyzes research directions and future prospects of deep learning.
Data fusion is widely used in biometric, multi-media signal and image processing, and wireless sensor networks. Optimal fusion techniques are developed to perform fusion under noisy environments. However, the statisti...
详细信息
Data fusion is widely used in biometric, multi-media signal and image processing, and wireless sensor networks. Optimal fusion techniques are developed to perform fusion under noisy environments. However, the statistical analysis carried out to evaluate the relative merits of these optimal methods is very less. The aim of this paper is to fill this gap by evaluating four statistical optimal data fusion methods namely, the linearly constrained least squares (LCLS) fusion method, the covariance intersection (Cl) fusion method, the linearly constrained least absolute deviation (CLAD) fusion method, and the constrained least square (CLS) fusion method. The CLS fusion method presented here is an improved version of the CLAD fusion method. We further analyze the performances of these four methods in terms of optimality, unbiased estimation, robustness, and complexity. Simulations are used to validate the performance of these fusion algorithms. (C) 2014 Elsevier Inc. All rights reserved.
Artificial neural networks (ANNs) have a large appeal to many researchers due to their feature to simulate and solve different kinds of problems that do not have algorithmic solutions. The outlined in this paper is an...
详细信息
Artificial neural networks (ANNs) have a large appeal to many researchers due to their feature to simulate and solve different kinds of problems that do not have algorithmic solutions. The outlined in this paper is an efficient and robust collocation method based on the ANNs and Bernstein polynomials intended for the fuzzy Abel integral equation problem. To do this, first truncated Bernstein-series polynomial of the solution function is substituted in parametric form of the given fuzzy problem. Then an architecture of ANNs namely the feed-back neural nets is designed to determine values for the unknown coefficients. Eventually, the proposed method is implemented on some numerical examples, and also is compared with an usual and classical technique.
Two important challenges facing 5G are energy efficiency and mobile users' mobility in heterogeneous wireless networks (HetNets). One of the important techniques for improving energy efficiency is base station (BS...
详细信息
ISBN:
(纸本)9781479959532
Two important challenges facing 5G are energy efficiency and mobile users' mobility in heterogeneous wireless networks (HetNets). One of the important techniques for improving energy efficiency is base station (BS)'s switching between ON and OFF modes which allows the BS to turn off some its components in lower load situations. In this paper, we address user's seamless mobility problem and propose a handoff (HO) algorithm based on BS's estimated load. The proposed HO algorithm based on estimated load (PHA-EL) balances load by imposing HOs from highly loaded BSs to lightly loaded BSs. When a BS is overloaded, the user's quality of service (QoS) will degrade and therefore the PHA-EL is used to improve system throughput. The PHA-EL algorithm is combined with BSs which are able to switch between ON and OFF modes (PHA-EL/ON-OFF switching) in order to improve the energy efficiency of the system. Therefore, this algorithm achieves both energy- and spectral- efficiency. Simulation results indicate that the proposed algorithm yields better performance in terms of average number of HOs, average load per BS and average payoff per BS, compared to baseline algorithm.
In this paper, the problem of learning the functional dependency between input and output variables from scattered data using fractional polynomial models (FPM) is investigated. The estimation error bounds are obtaine...
详细信息
In this paper, the problem of learning the functional dependency between input and output variables from scattered data using fractional polynomial models (FPM) is investigated. The estimation error bounds are obtained by calculating the pseudo-dimension of FPM, which is shown to be equal to that of sparse polynomial models (SPM). A linear decay of the approximation error is obtained for a class of target functions which are dense in the space of continuous functions. We derive a structural risk analogous to the Schwartz Criterion and demonstrate theoretically that the model minimizing this structural risk can achieve a favorable balance between estimation and approximation errors. An empirical model selection comparison is also performed to justify the usage of this structural risk in selecting the optimal complexity index from the data. We show that the construction of FPM can be efficiently addressed by the variable projection method. Furthermore, our empirical study implies that FPM could attain better generalization performance when compared with SPM and cubic splines. (C) 2013 Elsevier Ltd. All rights reserved.
暂无评论