检索结果-内蒙古大学图书馆

Evasion strategies of a three-player lifeline game

Science China(Information Sciences) 2018年第11期61卷 144-154页

作者： Fan ZHANG Wenzhong ZHA School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex System Information Science Academy China Electronics Technology Group Corporation

This study examines a multi-player pursuit-evasion game, more specifically, a three-player lifeline game in a planar environment, where a single evader is tasked with reaching a lifeline prior to capture. A decomposition method based on an explicit policy is proposed to address the game qualitatively from two main aspects:(1) the evader's position distribution to guarantee winning the game(i.e., the escape zone),which is based on the premise of knowing the pursuers' positions initially, and(2) evasion strategies in the escape zone. First, this study decomposes the three-player lifeline game into two two-player sub-games and obtains an analytic expression of the escape zone by constructing a barrier, which is an integration of the solutions of two sub-games. This study then explicitly partitions the escape zone into several regions and derives an evasion strategy for each region. In particular, this study provides a resultant force method for the evader to balance the active goal of reaching the lifeline and the passive goal of avoiding capture. Finally,some examples from a lifeline game involving more than one pursuer are used to verify the effectiveness and scalability of the evasion strategies.

关键词： lifeline game three-player pursuit-evasion game barrier evasion strategy game of kind

来源：评论

学校读者我要写书评

暂无评论

Online reinforcement learning control by direct heuristic dynamic programming: from time-driven to event-driven

arXiv

引用

arXiv 2020年

作者： Zhao, Qingtao Si, Jennie Sun, Jian Key Laboratory of Intelligent Control and Decision of Complex System Beijing Institute of Technology Beijing100081 China Department of Electrical Computer and Energy Engineering Arizona State University TempeAZ85287 United States

In this paper time-driven learning refers to the machine learning method that updates parameters in a prediction model continuously as new data arrives. Among existing approximate dynamic programming (ADP) and reinforcement learning (RL) algorithms, the direct heuristic dynamic programming (dHDP) has been shown an effective tool as demonstrated in solving several complex learning control problems. It continuously updates the control policy and the critic as system states continuously evolve. It is therefore desirable to prevent the time-driven dHDP from updating due to insignificant system event such as noise. Toward this goal, we propose a new event-driven dHDP. By constructing a Lyapunov function candidate, we prove the uniformly ultimately boundedness (UUB) of the system states and the weights in the critic and the control policy networks. Consequently we show the approximate control and cost-to-go function approaching Bellman optimality within a finite bound. We also illustrate how the event-driven dHDP algorithm works in comparison to the original time-driven dHDP. Copyright © 2020, The Authors. All rights reserved.

关键词： Learning algorithms

来源：评论

学校读者我要写书评

暂无评论

Policy iteration based Q-learning for linear nonzero-sum quadratic differential games

引用

Science China(Information Sciences) 2019年第5期62卷 195-213页

作者： Xinxing LI Zhihong PENG Li LIANG Wenzhong ZHA School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex System Information Science Academy China Electronics Technology Group Corporation

In this paper, a policy iteration-based Q-learning algorithm is proposed to solve infinite horizon linear nonzero-sum quadratic differential games with completely unknown dynamics. The Q-learning algorithm, which employs off-policy reinforcement learning(RL), can learn the Nash equilibrium and the corresponding value functions online, using the data sets generated by behavior policies. First, we prove equivalence between the proposed off-policy Q-learning algorithm and an offline PI algorithm by selecting specific initially admissible polices that can be learned online. Then, the convergence of the off-policy Qlearning algorithm is proved under a mild rank condition that can be easily met by injecting appropriate probing noises into behavior policies. The generated data sets can be repeatedly used during the learning process, which is computationally effective. The simulation results demonstrate the effectiveness of the proposed Q-learning algorithm.

关键词： adaptive dynamic programming ADP Q-learning reinforcement learning RL linear nonzerosum quadratic differential games policy iteration PI off-policy

来源：评论

学校读者我要写书评

暂无评论

Research and practice of lightweight digital twin speeding up the implementation of flexible manufacturing systems

Research and practice of lightweight digital twin speeding u...

引用

Digital Twins and Parallel Intelligence (DTPI), IEEE International Conference on

作者： Xiaodong Zhang Bin Hu Gang Xiong Xinjie Liu Xisong Dong Dongjia Li School of Information Engineering Yantai institute of Technology Yantai China The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Qingdao Academy of Intelligent Industries Chinese Academy of Sciences Beijing China Yantai University Yantai China School of Artificial Intelligence Yantai Institute of Technology Yantai China

Parallel manufacturing in Industry 5.0 requires digital twin to digitize physical systems, building virtual models to open up channels connecting physical systems, information systems, and social systems, and transforming the physical models of the existing production environment to achieve two-way feedback of virtual and real is the current research direction. This paper proposes the modeling idea of lightweight digital twin, extracts core dimensions and performs digital virtual simulation, so as to quickly realize the complete process of two-way feedback, and realize a set of chess flexible parallel manufacturing production lines as a practice for the design of complete lightweight digital twin.

关键词： Industries Digital twin Conferences Buildings Production Manufacturing Flexible manufacturing systems

来源：评论

学校读者我要写书评

暂无评论

Coarray Tensor Train Decomposition for Bistatic MIMO Radar with Uniform Planar Array

引用

IEEE Transactions on Antennas and Propagation 2025年

作者： Xie, Qianpeng Wang, Zhanling Wen, Fangqing He, Jin Truong, Trieu-Kien National University of Defense Technology State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System Changsha410073 China Hubei University of Automotive Technology Institute of Vehicle Information Control and Network Technology Shiyan442002 China China Three Gorges University Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering Yichang443002 China Shanghai Jiao Tong University Shanghai Key Laboratory of Navigation and Location Based Services School of Electronic Information and Electrical Engineering Shanghai200240 China

Recently, tensor network decomposition has attracted increasing attention due to its high efficacy in modeling multi-dimensional correlations in high-order tensors. Considering this advantage, this study employs tensor train decomposition (TTD) to achieve joint two-dimensional direction-of-departure (2D-DOD) and direction-of-arrival (2D-DOA) estimation in bistatic multiple-input multiple-output (MIMO) radar systems with uniform planar array (UPA) configurations. First, a five-dimensional (5D) tensor is defined to incorporate the two-dimensional (2D) spatial information from transmit and receive UPAs, which is then combined with temporal information. Next, a low-rank four-dimensional (4D) tensor is generated by performing an autocorrelation operation along the temporal dimension of the 5D tensor, forming a structure that encapsulates the difference coarrays of the transmit and receive UPAs. Then, a TTD framework is designed to decompose the 4D tensor into interconnected lower-order TT-cores. Furthermore, a precise bidirectional mapping is performed between the TT-cores and the original Vandermonde factor matrices. Finally, leveraging distinct combinations of TT-cores, two innovative methods are developed to recover the Vandermonde factor matrices. The proposed methods conduct automatic pairing of 2D-DOD and obtain 2D-DOA estimates by enforcing consistent permutation orders across all factor matrices. The proposed methods are verified by simulation experiments. The results confirm that the proposed methods can surpass the existing tensor-based methods in terms of estimation accuracy. © 1963-2012 IEEE.

关键词： Matrix algebra

来源：评论

学校读者我要写书评

暂无评论

Research on Trajectory Planning and Motion control of 7-DoF Sawyer Manipulator

Research on Trajectory Planning and Motion Control of 7-DoF ...

引用

Digital Twins and Parallel Intelligence (DTPI), IEEE International Conference on

作者： Kun Luo Gang Xiong Yuxiao Wang Bin Hu Sheng Liu Shichao Chen The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijng China School of Artificial Intelligence University of Chinese Academy of Sciences Beijng China Guangdong Engineering Research Center of 3D Printing and Intelligent Manufacturing Cloud Computing Center Chinese Academy of Sciences Beijng China Qingdao Academy of Intelligent Industries Chinese Academy of Sciences Beijng China

Regarding human-machine collaborative task, generated trajectories of a robot manipulator should be able to avoid joint limits and singularities, but the 6 Degrees of Freedom(DoF) or lower DoF manipulators encounter difficulties in many schemes. In this paper, research is implemented on the methods of trajectory planning and motion control on the newly human-machine collaborative 7-DoF Sawyer manipulator. We try to pay more attention to these approaches and find a better combination between trajectory planners and motion controllers for Sawyer manipulator. First of all, comparison is proposed between the methods about trajectory planning in task space and joint space, drawing a conclusion that the latter has the advantage of quickness and smoothness on trajectories in real time. Next, we choose to plan trajectory in the joint space by interpolating positions and orientations. Three approaches, i.e., trapezoidal velocity trajectory, cubic polynomial trajectory and basic spline trajectory, are applied to interpolate positions. Experimental results show that it results in the smoothest trajectory using basic spline trajectory planning. We also compare linear and nonlinear orientation interpolations to address the angle wrapping issue, which leads to difficulties in smooth orientation interpolation between several waypoints. Combining polynomial trajectory planning methods with the proportional-derivative (PD) motion controller and the computed-torque motion controller, we focus on the performance of the two different combinations. It is found that trajectories with computed-torque controller have shorter path with a congruous convergence on joint position, and more accurate trajectories with less overshoots in position than others.

关键词： Interpolation Trajectory planning Collaboration Aerospace electronics Manipulators Trajectory Task analysis

来源：评论

学校读者我要写书评

暂无评论

A Feedback-based Print Quality Improving Strategy for FDM 3D Printing: An Optimal Design Approach

Research Square

引用

Research Square 2021年

作者： Tami, Tariku Sinshaw Xiong, Gang Fang, Qihang Dong, Xisong Shen, Zhen Wang, Fei-Yue The State Key Laboratory for Management and Control of Complex Systems Beijing Engineering Research Center of Intelligent Systems and Technology Institute of Automation Chinese Academy of Sciences Beijing100190 China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China Guangdong Engineering Research Center of 3D Printing and Intelligent Manufacturing Cloud Computing Center Chinese Academy of Sciences Dongguan523808 China

Fused deposition modelling (FDM) 3D printing, as a supporting technology in social manufacturing and cloud manufacturing, is a rapidly growing technology in the era of industry 4.0. It produces objects with the layer-by-layer material accumulation technique. However, qualitative uncertainties are the common challenges yet. In order to assure print quality, studying the error causing parameters and minimizing their effects is important. This paper presents a feedback-based error compensation strategy, which integrates fuzzy inference system and grey wolf optimization algorithm. The objectives are twofold. First, the possible errors in FDM 3D printing are discussed in detail and optimal error causing parameters are obtained in percentage. This is used to understand the effects of the printing errors in every phase of the 3D printing process. From the nine optimization configuration trials used, Config-6 that has 100 number of iterations and 60 wolves is selected due to its higher convergence speed and best fitness value. The integral absolute error (IAE) is used as an objective function and the global minimum is achieved in the iteration interval [86, 100]. The outputs of this optimization problem is used to achieve the next objective. Second, a closed-loop quality monitoring approach comprising of inner-loops and an outer-loop is utilized. The three inner-loops are used to monitor the errors during pre-printing, printing, and post-printing, respectively. The outer-loop, on the other hand, is responsible for monitoring the aggregated errors in all the three 3D printing phases. The error compensation system simulation in Matlab is run for 10 seconds, and the results show that the "normal" range deformation factors are reached within less than 2 seconds for the inner-loops, whereas the outer-loop deformation factor is achieved within 7 seconds. The responses are within the acceptable time range. © 2021, CC BY.

关键词： 3D printers

来源：评论

学校读者我要写书评

暂无评论

A Blockchain-based Framework for Central Bank Digital Currency

A Blockchain-based Framework for Central Bank Digital Curren...

引用

2019 IEEE International Conference on Service Operations and Logistics, and Informatics, SOLI 2019

作者： Han, Xuan Yuan, Yong Wang, Fei-Yue State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Qingdao Academy of Intelligent Industries Qingdao China Research Center of Military Computational Experiments and Parallel System National University of Defense Technology Changsha China

ISBN: (纸本)9781728128535

Cryptocurrency and blockchain technologies have developed in parallel in recent years, with technological breakthroughs in currency issuance, payment methods, and currency storage. However, the existing cryptocurrencies cannot replace fiat money. There is a huge gap between decentralized cryptocurrency and central bank digital currency, namely CBDC, in terms of monetary governance and circulation. In this paper, we propose the function and security requirements of CBDC, through a comprehensive analysis of the existing typical cryptocurrency and the prototype of the CBDC scheme. On this basis, we present a blockchain-based framework for CBDC with three layers, including supervisory layer, network layer and user layer, and describe the key business processes of the CBDC's entire lifecycle of issuance-circulation-withdrawal in detail. Finally, we take cross-border payment as an example to explain the transaction process of CBDC. We aim to provide theoretical guidance for CBDC design. © 2019 IEEE.

关键词： Blockchain

来源：评论

学校读者我要写书评

暂无评论

A Parallel Medical Diagnostic and Treatment system for Chronic Diseases

A Parallel Medical Diagnostic and Treatment System for Chron...

引用

Chinese Automation Congress (CAC)

作者： Jing Wang Xiao Wang Yuanyuan Guo Fei-Yue Wang The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Qingdao Academy of Intelligent Industries Qingdao China Institute of Smart Healthcare Systems Qingdao Academy of Intelligent Industries Qingdao China

ISBN: (数字)9781728176871

ISBN: (纸本)9781728176888

In order to improve the accuracy of diagnosis and the effectiveness of treatment on chronic diseases, a parallel medical diagnostic and treatment system for chronic diseases is proposed in this paper. The system consists of the artificial system, computational experiments and parallel execution. Generally, the actual medical system includes real doctors, real patients, and the process of real doctors diagnosing and creating a treatment plan. Based on the components in actual medical system, the virtual doctors and virtual patients are created in artificial system. The computational experiments are to exhaustively explore and evaluate reasonable diagnoses and treatment options, so that the most accurate diagnosis and the best treatment plan are configured. The parallel execution between the artificial and the actual system includes the interaction between virtual doctors and real doctors as well as that between the virtual patients and actual patients. The parallel execution, on the doctors' end, is to ensure the precise diagnosis of diseases and the effectiveness of the treatment plan. On the other hand, the parallel execution, on the patients' end, is to provide patients with more personal guidance on following the treatment and to assist sending feedback to the system regarding the treatment effectiveness. As the chronic diseases generally require a long-term treatment, this parallel system can better accommodate the process by continuously monitoring the treatment and sending feedback to the model so as to actively optimize the treatment plan.

关键词： Medical diagnostic imaging Medical services Diseases Medical diagnosis Deep learning Neural networks Knowledge engineering

来源：评论

学校读者我要写书评

暂无评论

A vision-based path planning and following system for a miniature robotic fish

A vision-based path planning and following system for a mini...

引用

2019 IEEE International Conference on Real-Time Computing and Robotics, RCAR 2019

作者： Lu, Yue Chen, Xingyu Wu, Zhengxing Yan, Yan Yu, Junzhi State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China University of Chinese Academy of Sciences Beijing100049 China State Key Laboratory for Turbulence and Complex System Department of Mechanics and Engineering Science BIC-ESAT College of Engineering Peking University Beijing100871 China

ISBN: (纸本)9781728137261

Most existing path following algorithms for middle- or large-sized underwater vehicles minimize yaw difference of the control object. Breaking the canonical manner, this paper presents a vision-based path planning and following system for miniature robotic fish. As for path planning, the proposed system finds a gird path based on the AStar algorithm and selects a series of target points in the grid path. By connecting these points in order, a curve path can be planned. In terms of path following, the proposed system forgoes to give a specific yaw and only uses a global camera. It obtains coordinates of the robotic fish in real time by KCF tracking algorithm to calculate an approximate motion vector. A PID controller is employed to drive the difference angle between the motion vector and the target vector (the vector from the robotic fish to the target point) to zero. By swimming to target points one by one, the robotic fish can move to the terminus following the planned path. Finally, aquatic experiments are conducted to verify the effectiveness of the vision-based path planning and following system. The results reveal that the developed system can generate a safe and smooth path, and the robotic fish can follow the path with acceptable deviation. © 2018 IEEE.

关键词： Motion planning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：