检索结果-内蒙古大学图书馆

A novel policy iteration based deterministic Q-learning for discrete-time nonlinear systems

Science China Chemistry 2015年第12期58卷 143-157页

作者： WEI QingLai LIU DeRong State Key Laboratory of Management and Control for Complex Systems Institute of AutomationChinese Academy of Sciences School of Automation and Electrical Engineering University of Science and Technology Beijing

In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic nonlinear systems. The idea is to use an iterative adaptive dynamic programming(ADP) technique to construct the iterative control law which optimizes the iterative Q function. When the optimal Q function is obtained, the optimal control law can be achieved by directly minimizing the optimal Q function, where the mathematical model of the system is not necessary. Convergence property is analyzed to show that the iterative Q function is monotonically non-increasing and converges to the solution of the optimality equation. It is also proven that any of the iterative control laws is a stable control law. Neural networks are employed to implement the policy iteration based deterministic Q-learning algorithm, by approximating the iterative Q function and the iterative control law, respectively. Finally, two simulation examples are presented to illustrate the performance of the developed algorithm.

关键词： adaptive critic designs adaptive dynamic programming approximate dynamic programming Q-learning policy iteration neural networks nonlinear systems optimal control

来源：评论

学校读者我要写书评

暂无评论

ACP-based social computing and parallel intelligence： Societies 5.0 and beyond

引用

CAAI Transactions on Intelligence Technology 2016年第4期1卷 377-393页

作者： XiaoWang Lingxi Li Yong Yuan Peijun Ye Fei-Yue Wang The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing 100190 China Qingduo Academy of Intelligent Industries Qingduo 266100 China Department of Electrical and Computer Engineering Purdue School of Engineering and Technology Indiana University-Purdue University Indianapolis Indianapolis IN 46202 USA

Social computing, as the technical foundation of future computational smart societies, has the potential to improve the effectiveness of opensource big data usage, systematically integrate a variety of elements including time, human, resources, scenarios, and organizations in the current cyber-physical-social world, and establish a novel social structure with fair information, equal rights, and a flat configuration. Meanwhile, considering the big modeling gap between the model world and the physical world, the concept of parallel intelligence is introduced. With the help of software-defined everything, parallel intelligence bridges the big modeling gap by means of constructing artificial systems where computational experiments can be implemented to verify social policies, economic strategies, and even military operations. Artificial systems play the role of ＂social laboratories＂ in which decisions are computed before they are executed in our physical society. Afterwards, decisions with the expected outputs are executed in parallel in both the artificial and physical systems to interactively sense, compute, evaluate and adjust system behaviors in real-time, leading system behaviors in the physical system converging to those proven to be optimal in the artificial ones. Thus, the smart guidance and management for our society can be achieved.

关键词： Social computing Societies 5.0 Parallel intelligence Knowledge automation Cyber-physical-social system Artificial societies Computational ex-periments Parallel execution

来源：评论

学校读者我要写书评

暂无评论

Event-based state estimation of discrete-state hidden Markov models

Event-based state estimation of discrete-state hidden Markov...

引用

作者： Shi, Dawei Elliott, Robert J. Chen, Tongwen State Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing100081 China School of Mathematical Sciences University of Adelaide SA5005 Australia Haskayne School of Business University of Calgary CalgaryAB Canada Department of Electrical and Computer Engineering University of Alberta EdmontonABT6G 1H9 Canada

The state estimation problem for hidden Markov models subject to event-based sensor measurement updates is considered in this work, using the change of probability approach. We assume the measurement updates are transmitted through wired or wireless communication networks. For the scenarios with reliable and unreliable communication channels, analytical expressions for the probability distributions of the states conditioned on all the past point- and set-valued measurement information are obtained. Also, we show that the scenario with a lossy channel, but without the event-trigger, can be treated as a special case of the reliable channel results. Based on these results, closed-form expressions for the estimated communication rates under the original probability measure are presented, which are shown to be the ratio between a weighted 1-norm and the 1-norm of the unnormalized conditional probability distributions of the states under the new probability measures constructed. Implementation issues are discussed, and the effectiveness of the results is illustrated by numerical examples and comparative simulations. © 2015 Elsevier Ltd. All rights reserved.

关键词： Hidden Markov models

来源：评论

学校读者我要写书评

暂无评论

Observer based policy iteration algorithm for fault tolerant control of nonlinear systems with actuator faults

Observer based policy iteration algorithm for fault tolerant...

引用

World Congress on Intelligent control and automation (WCICA)

作者： Bo Zhao Derong Liu Yuanchun Li Guang Shi State Key Laboratory of Management and Control for Complex Systems Chinese Academy of Sciences Beijing China School of Automation and Electrical Engineering University of Science and Technology Beijing Beijing China Department of Control Science and Engineering Changchun University of Technology Changchun China

ISBN: (纸本)9781467384155

This paper investigates a novel fault tolerant control scheme to handle actuator faults in nonlinear systems based on policy iteration algorithm with fault observer. The fault observer is established to estimate the actuator fault, which is used to construct an improved performance index function that reflects the fault, regulation and control simultaneously. With the help of the proper performance index function, the FTC problem is transformed into an optimal control problem. By constructing a critic neural network, the Hamilton-Jacobi-Bellman equation can be solved by using policy iteration algorithm, and then the approximated fault tolerant controller can be obtained directly. The closed-loop system is guaranteed to be uniformly ultimately bounded based on the Lyapunov's direct method. Simulation example is given to verify the effectiveness of the developed FTC scheme.

关键词： Actuators Performance analysis Observers Optimal control Nonlinear systems Fault tolerance Fault tolerant systems

来源：评论

学校读者我要写书评

暂无评论

Policy iteration for optimal control of weakly coupled nonlinear systems with completely unknown dynamics

Policy iteration for optimal control of weakly coupled nonli...

引用

American control Conference

作者： Chao Li Ding Wang Derong Liu Haibo He The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing 100190 China School of Automation and Electrical Engineering University of Science and Technology Beijing 100083 China Department of Electrical Computer and Biomedical Engineering University of Rhode Island Kingston 02881 USA

ISBN: (纸本)9781467386838

In this paper, an online learning algorithm based on policy iteration is established to solve the optimal control problem for weakly coupled nonlinear continuous-time systems. Using the weak coupling theory, the original problem is transformed into three reduced-order optimal control problems. To obtain the optimal control laws without system dynamics, we construct an online data-based integral policy iteration algorithm which is used to solve the decoupled optimal control problems. The actor-critic technique based on neural networks and the least squares method are used to implement the model-free learning algorithm. A simulation example is given to verify the applicability of the developed algorithm.

关键词： Optimal control Heuristic algorithms Mathematical model System dynamics Nonlinear systems Partitioning algorithms Computational modeling

来源：评论

学校读者我要写书评

暂无评论

Social Manufacturing Development with Sino-Finnish Innovation Cooperation

Social Manufacturing Development with Sino-Finnish Innovatio...

引用

2016年IEEE/INFORMS服务运筹、物流与信息化国际会议

作者： Jian Liu Gang Xiong Xiuqin Shang Timo R.Nyberg Yiming Wang Tongkai Ji The State Key Laboratory of Management and Control for Complex Systems Institute of AutomationChinese Academy of Sciences College of Information Science and Technology Beijing University of Chemical Technology Cloud Computing Center Chinese Academy of Sciences Department of Industrial Engineering and Management School of ScienceAalto University Beijing Engineering Research Center of Intelligent Systems and Technology Institute of AutomationChinese Academy of Sciences

Innovation is changing the world every day by offering new technical solutions for the society, and the technology development powered by innovation has been changing the operation and structure of traditional manufacturing. Social manufacturing is the new trend of manufacturing development, especially in the field of apparel industry. Social manufacturing can create opportunities for customers to participate in the produce process of tailoring, and to make more personalizing clothes, which will also benefit for the related companies' brand making process. With the assistance of internet technology and industry globalization, we can establish several modes about the trend of social manufacturing and new related technology, social manufacturing can also prompt the international division of labor by reducing the producing costs and enlarging the market capacity, we will analyze the advance of Sino-Finland cooperation in the field of innovation and apparel industry, the international cooperation in manufacturing industry will benefit both customers and industry revolution with the assistance of social manufacturing.

关键词： social manufacturing innovation apparel industry international cooperation

来源：评论

学校读者我要写书评

暂无评论

GA-simplex algorithm and its application: A case study of gas emission estimation

GA-simplex algorithm and its application: A case study of ga...

引用

IEEE International Conference on Service Operations and Logistics, and Informatics, SOLI

作者： Hui Li Hongqiang Lv Qingqi Lin Jianwen Zhang Information Science and Technology College Beijing University of Chemical Technology Beijing China State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Fluid Mechanics and Heat Transfer Laboratory Beijing University of Chemical Technology Beijing China

ISBN: (纸本)9781509029280

Among the mathematical optimization algorithms, simplex algorithm is a popular and practical algorithm which was listed as one of the top 10 algorithms of the twentieth century by the journal Computing in Science and Engineering. Although simplex algorithm is efficient in the linear programming, the quality of convergence is unacceptable in practice as a numerical breakdown of the algorithm, even for smooth and well-behaved functions. On the other hand, full convergence might be seen in genetic algorithms (GA) using only crossover. So in this paper we combine the GA and simplex algorithm by initializing simplex from the final individual in GA and getting the converged result through simplex algorithm thereafter. A case study in estimating gas emission shows noteworthy improvement of efficiency and stability, compared with GA or simplex algorithm.

关键词： Decision support systems Genetic algorithms Estimation Optimization Linear programming

来源：评论

学校读者我要写书评

暂无评论

Multi-player pursuit–evasion games with one superior evader

引用

Automatica 2016年 71卷 24-32页

作者： Jie Chen Wenzhong Zha Zhihong Peng Dongbing Gu School of Automation Beijing Institute of Technology Beijing 100081 China State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing 100081 China School of Computer Science and Electronic Engineering University of Essex Colchester CO4 3SQ UK

Inspired by the hunting and foraging behaviors of group predators, this paper addresses a class of multi-player pursuit–evasion games with one superior evader, who moves faster than the pursuers. We are concerned with the conditions under which the pursuers can capture the evader, involving the minimum number and initial spatial distribution required as well as the cooperative strategies of the pursuers. We present some necessary or sufficient conditions to regularize the encirclement formed by the pursuers to the evader. Then we provide a cooperative scheme for the pursuers to maintain and shrink the encirclement until the evader is captured. Finally, we give some examples to illustrate the theoretical results.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Two Intersections Traffic Signal control Method Based on ADHDP

Two Intersections Traffic Signal Control Method Based on ADH...

引用

2016年IEEE汽车电子与安全国际会议

作者： Lin Cao Bin Hu Xisong Dong Gang Xiong Fenghua Zhu Zhen Shen Dong Shen Yuliang Liu The State Key Laboratory of Management and Control for Complex Systems Institute of AutomationChinese Academy of Sciences College of Information Science and Technology Beijing University of Chemical Technology Institute of Smart Education Systems Qingdao Academy of Intelligent Industries Dongguan Research Institute of CASIA Cloud Computing CenterChinese Academy of Sciences Beijing Engineering Research Center of Intelligent Systems and Technology Institute of AutomationChinese Academy of Sciences

With the rapid development of Chinese economy and automotive industry,urban traffic congestion has become increasingly ***,how to effectively alleviate the traffic congestion and improve the efficiency of vehicles has become the main *** signal control is one of the effective ways to solve urban traffic *** this paper,a traffic signal control method based on Action-Dependent Heuristic Dynamic Programming(ADHDP) is *** control algorithm is simulated on two intersections,both of which have two phases with four entrance *** computer simulation results show that the control method has the better ability of on-line learning compared with traditional Fix-Time control,and can effectively improve the average speed of vehicles,and reduce travel time and alleviate the traffic pressure.

关键词： ADHDP Traffic Signal control Adaptive control Intelligent Transportation systems

来源：评论

学校读者我要写书评

暂无评论

A Survey on Big Data for Human Body Shape

A Survey on Big Data for Human Body Shape

引用

2016年IEEE/INFORMS服务运筹、物流与信息化国际会议

作者： Hongli Peng Xiuqin Shang Chao Guo Gang Xiong Timo R.Nyberg Dong Fan Yiming Wang The State Key Laboratory of Management and Control for Complex Systems Institute of AutomationChinese Academy of Sciences College of Information Science and Technology Beijing University of Chemical Technology Qingdao Academy of Intelligent Industries Beijing Engineering Research Center of Intelligent Systems and Technology Institute of AutomationChinese Academy of Sciences Cloud Computing Center Chinese Academy of Sciences Department of Industrial Engineering and Management School of ScienceAalto University

In recent years, the rapid development of network and E-commerce technologies, promotes the development of human body big data. New technologies, such as 3D scanning and 3D printing will improve our life quality. The new socialized manufacturing network composed of Io T, advanced logistics network and 3D printers. Everyone is allowed to have chance to participate in any process of the whole production manufacturing lifecycle by some ways, such as crowdsourcing. Boosts the creation, production and consumption patterns of individuation, real-time transformation and E-commerce, possibly will lead to a new industrial revolution. In this revolutionary change wave, public concerns focus on the human body big data used for social manufacturing of wearable products or personalized medical treatment. Although many scholars have done a lot of research work, the collection of the human body shape big data still faces many challenges. There is no complete, separated theoretical research works in progress, it should be summarized and improved systematically. In this paper, we review that big data for human body shape is gaining momentum. The 3D scanning and 3D modeling of human body shape are summarized and concluded. The main applications of these big data are analyzed.

关键词： big data human body shape 3D scanning 3D modeling clothing footwear mass customization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：