In this paper, a model-free and effective approach is proposed to solve infinite horizon optimal control problem for affine nonlinear systems based on adaptive dynamic programming technique. The developed approach, re...
详细信息
In this paper, a model-free and effective approach is proposed to solve infinite horizon optimal control problem for affine nonlinear systems based on adaptive dynamic programming technique. The developed approach, referred to as the actor-critic structure, employs two multilayer perceptron neural networks to approximate the state-action value function and the control policy, respectively. It uses data collected arbitrarily from any reasonable sampling distribution for policy iteration. In the policy evaluation phase, a novel objective function is defined for updating the critic network, and thus makes the critic network converge to the Bellman equation directly rather than iteratively. In the policy improvement phase, the action network is updated to minimize the outputs of the critic network. The two phases alternate until no more improvement of the control policy is observed, such that the optimal control policy is achieved. Two simulation examples are provided to show the effectiveness of the approach.
Ground-based cloud classification is challenging due to extreme variations in the appearance of clouds under different atmospheric conditions. Texture classification techniques have recently been introduced to deal wi...
详细信息
Ground-based cloud classification is challenging due to extreme variations in the appearance of clouds under different atmospheric conditions. Texture classification techniques have recently been introduced to deal with this issue. A novel texture descriptor, the salient local binary pattern （SLBP）, is proposed for ground-based cloud classification. The SLBP takes advantage of the most frequently occurring patterns （the salient patterns） to capture descriptive information. This feature makes the SLBP robust to noise. Experimental results using ground-based cloud images demonstrate that the proposed method can achieve better results than current state-of-the-art methods.
According to the actual circumstance of the intersection,reasonably adjusting traffic light time can help to ease traffic pressure and save transportation *** this paper,Interval type-2 fuzzy sets and matched-degree a...
详细信息
According to the actual circumstance of the intersection,reasonably adjusting traffic light time can help to ease traffic pressure and save transportation *** this paper,Interval type-2 fuzzy sets and matched-degree are applied to the time of intersection signal adjusting,and five words are used to cover the range of adjusting lights’time,finally according to the average number of stranded vehicles,a query table is built to inquire and control the signal time during a certain period.
With the continuous development of data storage technology,the complexity,category and size of data increase sharply;on the other hand,the wide expansion of its application domain brings great challenges on the tradit...
详细信息
With the continuous development of data storage technology,the complexity,category and size of data increase sharply;on the other hand,the wide expansion of its application domain brings great challenges on the traditional data processing and analysis *** this paper,the data analysis and processing technology and its development status are introduced and by multi-dimensional data visualization analysis method and combining the knowledge of domain experts,the equipment purchasing fund data of a large enterprise is analyzed to provide reliable management decision to the investment and investment volume of business fund.
The leader-following output consensus problem of multi-agent systems (MAS) is studied in this paper. Each agent is modeled by a single-input single-output (SISO) system which can be further described by a controllable...
The leader-following output consensus problem of multi-agent systems (MAS) is studied in this paper. Each agent is modeled by a single-input single-output (SISO) system which can be further described by a controllable and observable linear state space model. An observer is constructed to estimate the agent's state, and the estimated state is shared with neighbor agents via the noisy communication channels. Similar to the previous work, in the proposed protocol a time-varying gain is employed to attenuate the noise's effect. However, in this paper, each agent is allowed to have its own time-varying gain. Some sufficient conditions on the time-varying gain are given for ensuring the consensus in the mean square sense. Finally, a simulation example is presented to verify the theoretical results.
Researches on office building energy consumption have been hot in these years, but few researchers consider the classification of office energy consumption performance which can evaluate user behaviors in order to off...
详细信息
Researches on office building energy consumption have been hot in these years, but few researchers consider the classification of office energy consumption performance which can evaluate user behaviors in order to offer a clear analysis of energy consumption and improve their energy saving consciousness. In this paper, we propose a novel hierarchical classification algorithm for evaluating energy consumption behaviors at a real energy managementsystem, which combines fuzzy c-means clustering with GA (genetic algorithm)-based SVM (support vector machine) to fully utilize collected samples. The experiment results with real energy consumption data show that the proposed algorithm works well to distinguish the abnormal behaviors and classify energy consumption behaviors accurately on normal offices.
Assessment and analysis of the intersection status can help to make the right choice of interventions,it’s can bring convenience to solve the traffic *** this paper,interval type-2 fuzzy sets is applied in the analys...
详细信息
Assessment and analysis of the intersection status can help to make the right choice of interventions,it’s can bring convenience to solve the traffic *** this paper,interval type-2 fuzzy sets is applied in the analysis of the intersection state and congestion intervention,dynamic fuzzy comprehensive evaluation and footprint of uncertainty are used to assess the intersection *** with the example of intersection congestion,through corresponding intervention measures to improve the intersections crowded *** the linguistic dynamic orbits of road status figured out.
Traffic control is an effective and efficient method for the problem of traffic *** complex urban traffic networks,it is necessary to design a high-level controller to regulate the traffic *** the parallel control fra...
详细信息
Traffic control is an effective and efficient method for the problem of traffic *** complex urban traffic networks,it is necessary to design a high-level controller to regulate the traffic *** the parallel control framework for complex traffic networks,we design a demand-balance MPC controller based on the MFD-based multi-subnetwork model,which can optimize the network traffic mobility and the network traffic throughput by regulating the input traffic flows of the *** transferring traffic flows among subnetworks are indirectly controlled by the demand-balance MPC controller,and a global optimality can be achieved for the entire traffic *** simulation results show the effectiveness of the proposed controller in improving the network traffic throughput.
Sparse coding has been used for target appearance modeling and applied successfully in visual tracking. However, noise may be inevitably introduced into the representation due to background clutter. To cope with this ...
详细信息
ISBN:
(纸本)9781479952106
Sparse coding has been used for target appearance modeling and applied successfully in visual tracking. However, noise may be inevitably introduced into the representation due to background clutter. To cope with this problem, we propose a saliency weighted sparse coding appearance model for visual tracking. Firstly, a spectral filtering based visual attention computational model, which combines both bottom-up and top-down visual attention, is proposed to calculate saliency map. Secondly, pooling operation in sparse coding is weighted by calculated saliency map to help target representation focus on distinctive features and suppress background clutter. Extensive experiments on a recently proposed tracking benchmark demonstrate that the proposed algorithm outperforms state-of-the-art methods in tracking objects under background clutter.
The intersection models, such as delay models and queuing length models, are the foundations of optimal signal timing for urban intersection. Lack of the field data of intersection, it is highly difficult to calibrate...
详细信息
The intersection models, such as delay models and queuing length models, are the foundations of optimal signal timing for urban intersection. Lack of the field data of intersection, it is highly difficult to calibrate parameters of the intersection models. Due to the effects of intersection topology, channelization and traffic conditions on these models, obviously it is impossible for single model to be suitable for optimal control of various intersections.
暂无评论