Twin support vector machine with two nonparallel classifying hyperplanes and its extensions have attracted much attention in machine learning and data mining. However, the prediction accuracy may be highly influenced ...
详细信息
Twin support vector machine with two nonparallel classifying hyperplanes and its extensions have attracted much attention in machine learning and data mining. However, the prediction accuracy may be highly influenced when noise is involved. In particular, for the least squares case, the intractable computational burden may be incurred for large scale data. To address the above problems, we propose the double-weighted least squares twin bounded support vector machines and develop the online learning algorithms. By introducing the double-weighted mechanism, the linear and nonlinear double-weighted learning models are proposed to reduce the influence of noise. The online learning algorithms for solving the two models are developed, which can avoid computing the inverse of the large scale matrices. Furthermore, a new pruning mechanism which can avoid updating the kernel matrices in every iteration step for solving nonlinear model is also developed. Simulation results on three UCI data with noise demonstrate that the onlinelearning algorithm for the linear double-weighted learning model can get least computation time as well considerable classification accuracy. Simulation results on UCI data and two-moons data with noise demonstrate that the nonlinear double-weighted learning model can be effectively solved by the onlinelearning algorithm with the pruning mechanism.
The well known back-propagation algorithm has revolutionized machine learning and artificial intelligence, particularly in neural network applications. Although gradient descent-based algorithms are utilized in contro...
详细信息
The well known back-propagation algorithm has revolutionized machine learning and artificial intelligence, particularly in neural network applications. Although gradient descent-based algorithms are utilized in control applications, they are not as prevalent as in neural network applications. This discrepancy can be attributed to the successful development of various adaptation laws which ensure system stability while meeting the required design criteria. Many of these laws can be found in model reference adaptive control (MRAC) and adaptive sliding mode control (ASMC). This paper investigates the applicability of the Brandt-Lin (B-L) learning algorithm, mathematically equivalent to the back-propagation algorithm, in adaptive control applications. We find that combining the B-L learning algorithm with SMC yields a robust controller suitable for model reference adaptive sliding mode control (MRA-SMC). The controller is applicable to linear and a class of nonlinear dynamic systems and is suitable for efficient implementation. We derive the stability criteria for this controller and conduct simulations to study the adaptation's impact on chattering. Our work exemplifies one approach to adopt the back-propagation algorithm in control applications.
In this paper, an online approach was proposed for twin support vector machine motivated by online learning algorithms for double-weighted least squares twin bounded support vector machines. In many applications for t...
详细信息
In this paper, an online approach was proposed for twin support vector machine motivated by online learning algorithms for double-weighted least squares twin bounded support vector machines. In many applications for training, data are available online, and batch training methods are not suitable because of space and time requirements. For the online method proposed in this paper, the onlinelearning method was created by recursive relation of twin support vector machine in two linear and nonlinear cases, which avoids calculating inverse matrices in every repetition step. Thus, only the inverse matrix in the initial step must be calculated, and every repetition step is calculated recursively from the previous step, which causes the training time to decrease without losing accuracy. Moreover, for studying the effectiveness of the proposed approach, this online approach was used for sparse pinball twin support vector machine, and simulation results indicated this online approach not only did not reduce accuracy but also, for some datasets, increased accuracy for online cases.
Federated learning (FL) is a distributed machine learning technique that enables model development on user equipments (UEs) locally, without violating their data privacy requirements. Conventional FL adopts a single p...
详细信息
Federated learning (FL) is a distributed machine learning technique that enables model development on user equipments (UEs) locally, without violating their data privacy requirements. Conventional FL adopts a single parameter server to aggregate local models from UEs, and can suffer from efficiency and reliability issues - especially when multiple users issue concurrent FL requests. Hierarchical FL consisting of a master aggregator and multiple worker aggregators to collectively combine trained local models from UEs is emerging as a solution to efficient and reliable FL. The placement of worker aggregators and assignment of UEs to worker aggregators plays a vital role in minimizing the cost of implementing FL requests in a Mobile Edge Computing (MEC) network. Cost minimization associated with joint worker aggregator placement and UE assignment problem in an MEC network is investigated in this work. An optimization framework for FL and an approximation algorithm with an approximation ratio for a single FL request is proposed. online worker aggregator placements and UE assignments for dynamic FL request admissions with uncertain neural network models, where FL requests arrive one by one without the knowledge of future arrivals, is also investigated by proposing an onlinelearning algorithm with a bounded regret. The performance of the proposed algorithms is evaluated using both simulations and experiments in a real testbed with its hardware consisting of server edge servers and devices and software built upon an open source hierarchical FedML (HierFedML) environment. Simulation results show that the performance of the proposed algorithms outperform their benchmark counterparts, by reducing the implementation cost by at least 15% per FL request. Experimental results in the testbed demonstrate the performance gain using the proposed algorithms using real datasets for image identification and text recognition applications.
The primary focus of this dissertation is to develop adaptive optimization and learning models and algorithms for decision-making problems under uncertainty arising in service systems. Thanks to the accessibility and ...
详细信息
The primary focus of this dissertation is to develop adaptive optimization and learning models and algorithms for decision-making problems under uncertainty arising in service systems. Thanks to the accessibility and analyzability of voluminous data, the uncertainties can be better controlled by adaptively incorporating real-time information. The common theme of the problems in different chapters of this thesis embraces the structures of (i) making adaptive decisions for accomplishing a learning task and (ii) learning the nature of the uncertainty for adaptively optimizing future decisions. Specifically, we apply and innovate machine learning and reinforcement learning techniques, including support vector machines (SVM), deep neural networks (DNN), and multi-armed bandits (MAB), to solve problems that arise in modern service systems, such as transportation, resource sharing/rental services. A well-designed and reliable route planner is central to a wide range of modern transportation applications. We consider two cases, providing route recommendations to several travel requests or a single request. Providing route recommendations to a fleet of vehicles under uncertainty always results in large-scale stochastic programs, of which the solving process is time-consuming even with sophisticated decomposition algorithms. Therefore, in Chapter 2, we propose a learning-enhanced Benders decomposition (LearnBD) algorithm to reduce the solving time for two-stage stochastic programs. This algorithm can also be used for solving general two-stage stochastic programs. In Chapter 3, we design and implement an approach for providing route recommendations to one origin-destination pair via a combination of the weighted shortest path problem and deep learning with real-world transportation data. Revenue management with reusable resources finds a wide range of service systems in today's economy, such as cloud computing services, ride-hailing services, and car/bicycle rental services. T
Unmanned aerial vehicle (UAV) base station has been proposed as a promising solution in emergency communication and supplementary communication for terrestrial networks due to its flexible layout and good mobility sup...
详细信息
ISBN:
(数字)9789811619670
ISBN:
(纸本)9789811619663;9789811619670
Unmanned aerial vehicle (UAV) base station has been proposed as a promising solution in emergency communication and supplementary communication for terrestrial networks due to its flexible layout and good mobility support. However, the dense deployment of UAV base station and ground base station brings great challenges in the configuration of neighbor cell list (NCL) during handover process. This paper presents a Cascading Bandits based Mobility Management (CBMM) algorithm for NCL configuration in the low altitude heterogeneous networks, where onlinelearning is used to exploiting the historical handover information. In addition to the received signal strength, the cell load of each base station is also considered in the handover procedure. We aim at optimizing the configuration of NCL, so as to improve handover performance by increasing the probability of selecting the best target base station while at the same time reducing the selection delay. It is proved that the signaling overhead can be effectively reduced, since the proposed CBMM algorithm can significantly cut down the number of candidate base stations in NCL. Moreover, by ranking the candidate base stations according to their historical performance, the number of measured base stations in handover preparation phase can be effectively reduced to avoid extra delay. The simulation results of the proposed algorithm and other two existing solutions are presented to illustrate that the CBMM algorithm can achieve efficient handover management.
We propose the first learning algorithm for single-product, periodic-review, backlogging inventory systems with random production capacity. Different than the existing literature on this class of problems, we assume t...
详细信息
We propose the first learning algorithm for single-product, periodic-review, backlogging inventory systems with random production capacity. Different than the existing literature on this class of problems, we assume that the firm has neither prior information about the demand distribution nor the capacity distribution, and only has access to past demand and supply realizations. The supply realizations are censored capacity realizations in periods where the policy need not produce full capacity to reach its target inventory levels. If both the demand and capacity distributions were known at the beginning of the planning horizon, the well-known target interval policies would be optimal, and the corresponding optimal cost is referred to as the clairvoyant optimal cost. When such distributional information is not available a priori to the firm, we propose a cyclic stochastic gradient descent type of algorithm whose running average cost asymptotically converges to the clairvoyant optimal cost. We prove that the rate of convergence guarantee of our algorithm is O(1/T), which is provably tight for this class of problems. We also conduct numerical experiments to demonstrate the effectiveness of our proposed algorithms.
Machine learning models have been widely adopted for passenger flow prediction in urban metros;however, the authors find machine learning models may underperform under anomalous large passenger flow conditions. In thi...
详细信息
Machine learning models have been widely adopted for passenger flow prediction in urban metros;however, the authors find machine learning models may underperform under anomalous large passenger flow conditions. In this study, they develop a prediction framework that combines the advantage of complex network models in capturing the collective behaviour of passengers and the advantage of online learning algorithms in characterising rapid changes in real-time data. The proposed method considerably improves the accuracy of passenger flow prediction under anomalous conditions. This study can also serve as an exploration of interdisciplinary methods for transportation research.
Reinforcement learning offers a multitude of algorithms allowing to learn a nonlinear controller by interacting with the system without the need for a model of the plant. In this paper we investigate the suitability o...
详细信息
An intelligent wind power smoothing control using recurrent fuzzy neural network (RFNN) is proposed in this study. First, the modeling of wind power generator and the designed battery energy storage system (BESS) are ...
详细信息
An intelligent wind power smoothing control using recurrent fuzzy neural network (RFNN) is proposed in this study. First, the modeling of wind power generator and the designed battery energy storage system (BESS) are introduced. The BESS is consisted of a bidirectional interleaved DC/DC converter and a 3-arm 3-level inverter. Then, the network structure of the RFNN and its online learning algorithms are described in detail. Moreover, actual wind data is adopted as the input to the designed wind power generator model. Furthermore, the three-phase output currents of the wind power generator are converted to dq-axis current components. The resulted q-axis current is the input of the RFNN power smoothing control and the output is a gentle wind power curve to achieve the effect of wind power smoothing. The difference of the actual wind power and smoothed power is supplied by the BESS. The minimum energy capacity of the BESS with a small fluctuation of the grid power can be achieved by the RFNN power smoothing control. A digital signal processor (DSP) based BESS is built using two TMS320F28335. From the experimental results of various wind variation sceneries, the effectiveness of the proposed intelligent wind power smoothing control is verified.
暂无评论