The conventional Q-learning algorithm is described by a finite number of discretized states and discretized actions. When the system is represented in continuous domain, this may cause an abrupt transition of action a...
详细信息
ISBN:
(纸本)9781424448081
The conventional Q-learning algorithm is described by a finite number of discretized states and discretized actions. When the system is represented in continuous domain, this may cause an abrupt transition of action as the state rapidly changes. To avoid this abrupt transition of action, the learning system requires fine-tuned states. However, the learning time significantly increases and the system becomes computationally expensive as the number of states increases. To solve this problem, this paper proposes a novel Q-learning algorithm, which uses fuzzified states and weighted actions to update its state-action value. By applying the concept of fuzzy set to the states of Q-learning and using the weighted actions, the agent efficiently responds to the rapid changes of the states. The proposed algorithm is applied to omni-directional mobile robot and the results demonstrate the effectiveness of the proposed approach.
In this paper we propose a learning mechanism for mobile agent navigation. The agent is controlled by a dynamic set of fuzzy rules, where the rule set is learned using genetic algorithms. The rules are adjusted during...
详细信息
Proportional integral derivative (PID) controller tuning is an area of interest for researchers in many disciplines of science and engineering. This paper presents a new algorithm for PID controller tuning based on a ...
详细信息
ISBN:
(纸本)9781424448081
Proportional integral derivative (PID) controller tuning is an area of interest for researchers in many disciplines of science and engineering. This paper presents a new algorithm for PID controller tuning based on a combination of the foraging behavior of E coli bacteria foraging and Particle Swarm Optimization (PSO). The E colt algorithm depends on random search directions which may lead to delay in reaching the global solution. The PSO algorithm may lead to possible entrapment in local minimum solutions. This paper proposed a new algorithm Bacteria Foraging oriented by PSO (BF-PSO). The new algorithm is proposed to combines both algorithms' advantages in order to get better optimization values. The proposed algorithm is applied to the problem of PID controller tuning and is compared with conveniently Bacterial Foraging algorithm and Particle swarm optimization.
The potential of flexible-manufacturing workcells (FMCs) to produce a family of parts in many possible orders of operations and choices of different machines is advantageous. Despite intensive research on the theoreti...
详细信息
The potential of flexible-manufacturing workcells (FMCs) to produce a family of parts in many possible orders of operations and choices of different machines is advantageous. Despite intensive research on the theoretical control of discrete-event systems (DESs), however, current techniques can still only be used for the supervisory control of simple cells. In this paper, a novel modeling and control synthesis technique is presented for FMCs that allow part-routing flexibility. Our proposed methodology combines Extended Moore Automata (EMA) and controlled-Automata theories to synthesize supervisors for such FMCs.
The continuous deflection and pitch of the welding wire can assure continuous electrical contact, smooth arc characteristic and coherently penetrative welding, and serve wire on the automation welding equipment contin...
详细信息
ISBN:
(纸本)9780769533117
The continuous deflection and pitch of the welding wire can assure continuous electrical contact, smooth arc characteristic and coherently penetrative welding, and serve wire on the automation welding equipment continuously. The arranging wire based on angle and the constant tension intertwine are key. On the basis of the thorough analysis of the structure, characteristic and the factors that effect the tension of the welding wire in the intertwine process, the models of tension system were established in the engineering view. Floating pulley block's position feedback control scheme based-on the adaptive-self line speed was proposed;Considering the variation of the paying-off winding-diameter, a control strategy based on fuzzy multiple models was presented, and a multiple models controller using fuzzy winding-diameter switching regulation was designed. The simulation results show that the expected control performances are achieved.
As a specialisation of Ho ionic agent-based distributed manufacturing control, intelligent product-driven manufacturing control paradigm has recently emerged as one of the most promising paradigms for the development ...
详细信息
ISBN:
(纸本)9781424442201
As a specialisation of Ho ionic agent-based distributed manufacturing control, intelligent product-driven manufacturing control paradigm has recently emerged as one of the most promising paradigms for the development of next generation manufacturing intelligent control systems. But major issue to be solved to make this paradigm effective in real world industrial environment is related to the lack of efficiency of agent-based local decision-making approaches employed. The research work presented in this paper focuses on this pending issue and proposes and formalizes the combination of main capabilities of agent-based intelligent product-driven manufacturing control paradigm and computationalintelligence genetic algorithm optimisation tool for the development of effective and efficient intelligent product driven agent-based distributed dynamic scheduling and control strategy. This challenging combination is achieved by neural network-based machine learning technique and enables enhancing manufacturing system reactivity, flexibility and fault tolerance, as well as maintaining behavioural stability and optimality.
Recently, DNA computers attract attention as computers of next generation taking over the present electronic computers. Computation can be realized by chemical reaction of DNA. This paper presents an optimal trajector...
详细信息
ISBN:
(纸本)0780372034
Recently, DNA computers attract attention as computers of next generation taking over the present electronic computers. Computation can be realized by chemical reaction of DNA. This paper presents an optimal trajectory planning method of mobile robots using DNA computing. In this method, a working area of a mobile robot is divided into many sections. Then the shortest trajectory avoiding obstacles in the work area is calculated with DNA computing. The location of the obstacles is supposed to be known in advance. In the process of DNA computing, Watson-Crick pairing is performed to find the shortest trajectory in the working area. The DNA sequences representing the locations of the obstacles are removed in this process. The obtained shortest DNA molecule that begins with the start section and terminates with the goal section represents the shortest trajectory avoiding the obstacles in the work area of the mobile robot. The proposed algorithm is especially effective a DNA molecular computer.
The paper focuses on the design of a platoon control system with a diverse vehicle formation. After a brief summary of the vehicle model and the control criteria, the paper demonstrates methods for eliminating the lon...
详细信息
The main contribution of this work is the application of delay-dependent adaptive control techniques to control nonlinear continuous stirred tank reactor (CSTR) model with state delay. The delay-dependent adaptive con...
详细信息
The main contribution of this work is the application of delay-dependent adaptive control techniques to control nonlinear continuous stirred tank reactor (CSTR) model with state delay. The delay-dependent adaptive control problem is first formulated and stabilizing adaptive control algorithms are developed and then applied to the CSTR process model. The CSTR model includes a nonlinear perturbation which is assumed to have a norm that is bounded by a scaled norm of the state vector. Here, we consider two cases where the weight of the state norm is assumed to be known and unknown. Simulation results show the efficacy of the delay-dependent adaptive control schemes in controlling the CSTR nonlinear process model.
Before handing over command of arrival flights to terminal controller, en route air traffic controller should adjust arrival flight queue as an appropriate sequence since air traffic flows aggregate at the entrance of...
详细信息
ISBN:
(纸本)0780378660
Before handing over command of arrival flights to terminal controller, en route air traffic controller should adjust arrival flight queue as an appropriate sequence since air traffic flows aggregate at the entrance of air-corridor near airports. A good adjustment needs to consider such target as ensuring safe separation of adjacent flights by issuing adjustment commands as less as possible. This paper introduces a concept of approach adjustment and presents the mathematical description of the problem of approach sequence adjustment, which integrates both human experience and precise computing model. An intelligent sequence-adjusting algorithm is also discussed, which is based on general satisfaction function consisting of three factors: safety, capacity and equilibrium. Tested on practical data, the algorithm has good effectiveness.
暂无评论