检索结果-内蒙古大学图书馆

Online adaptive Q-learning method for fully cooperative linear quadratic dynamic games

Science China(Information Sciences) 2019年第12期62卷 164-177页

作者： Xinxing LI Zhihong PENG Lei JIAO Lele XI Junqi CAI School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex Systems

A model-based offline policy iteration(PI) algorithm and a model-free online Q-learning algorithm are proposed for solving fully cooperative linear quadratic dynamic games. The PI-based adaptive Q-learning method can learn the feedback Nash equilibrium online using the state samples generated by behavior policies, without sending inquiries to the system model. Unlike the existing Q-learning methods, this novel Q-learning algorithm executes both policy evaluation and policy improvement in an adaptive *** prove the convergence of the offline PI algorithm by proving its equivalence to Newton's method while solving the game algebraic Riccati equation(GARE). Furthermore, we prove that the proposed Q-learning method will converge to the Nash equilibrium under a small learning rate if the method satisfies certain persistence of excitation conditions, which can be easily met by suitable behavior policies. Our simulation results demonstrate the good performance of the proposed online adaptive Q-learning algorithm.

关键词： adaptive dynamic programming reinforcement learning Q-learning fully cooperative linear quadratic dynamic games policy iteration off-policy

来源：评论

学校读者我要写书评

暂无评论

A Collision-Free Person-Following Approach Based on Path Planning 17

A Collision-Free Person-Following Approach Based on Path Pla...

引用

17th IEEE International Conference on Mechatronics and automation, ICMA 2020

作者： Pang, Lei Cao, Zhiqiang Yu, Junzhi Zhang, Weimin Chen, Xuechao Institute of Automation State Key Laboratory of Management and Control for Complex Systems China Beijing Institute of Technology Beijing Advanced Innovation Center for Intelligent Robots and Systems China

ISBN: (纸本)9781728164151

Person following is a crucial capability for mobile robots in tasks of human assistance and cooperation. In this paper, a person-following approach based on path planning is proposed for mobile robots, which takes person following and obstacle avoidance into account in a unified framework. The proposed approach is comprised of a sensing module and a planning module. The sensing module with a camera and a 3D LiDAR is employed to locate the target person and perceive obstacles. For the planning module, the combination of global planner and local planner effectively outputs collision-free paths and control commands for a mobile robot to keep following the target person. Experiments were conducted to evaluate the performance of the proposed approach. © 2020 IEEE.

关键词： Mobile robots

来源：评论

学校读者我要写书评

暂无评论

Suppressing Stick-Slip Vibration of Drill-String System Subject to Actuator Saturation

Suppressing Stick-Slip Vibration of Drill-String System Subj...

引用

第40届中国控制会议

作者： Zhaoqing He Chengda Lu Min Wu Jun Gao School of Automation China University of Geosciences Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Engineering Research Center of Intelligent Technology for Geo-Exploration Ministry of Education CCTEG Xi'an Research Institute

In this paper, the actuator saturation of drill-rig is considered in the mitigation of stick-slip vibration of the drill-string system. Firstly, the dynamic of stick-slip vibration is described by the combination of a multi-degree-of-freedom drill-string model and a bit-rock interaction model. To suppress stick-slip vibration while reducing the effect of saturation on control performance, a dynamic output feedback controller with an anti-windup compensator is introduced. Then, stability analysis of the resulting closed-loop system is carried out. By solving an optimization problem, the gain matrix of the anti-windup compensator is obtained. Finally, a case study is used to show the effectiveness of the method.

关键词： Drill-string system actuator saturation stick-slip vibration anti-windup compensator

来源：评论

学校读者我要写书评

暂无评论

A Real-Time Visual-Inertial Monocular Odometry by Fusing Point and Line Features

A Real-Time Visual-Inertial Monocular Odometry by Fusing Poi...

引用

第40届中国控制会议

作者： Chengwei Li Liping Yan Yuanqing Xia Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology

In this paper, a monocular visual-inertial odometry that utilize both point and line features is deduced. Compared with point features, line features provide more geometric information of the environment, which are more reliable in textureless scenes. However, extracting line segment features from the image are very time consuming, which will affect the real-time performance of the system. To deal with this problem, EDLines line segment detector is introduced to replace the LSD *** properties of lines are utilized to reject the mismatching of line segment feature. Pl ¨ucker coordinates and orthonormal representation of lines are used to represent 3 D lines. Afterwards, we optimize the state by minimizing a cost function consists of pre-integrated IMU residuals and visual feature re-projection residuals in a sliding window optimization framework. The proposed odometry was tested on the public datasets. The results demonstrate that the presented system can operate in real time with high accuracy.

关键词： visual-inertial odometry(VIO) point and line feature visual simultaneous localization and mapping(SLAM)

来源：评论

学校读者我要写书评

暂无评论

Fuzzy PID control for suppressing stick-slip vibration of drill-string system

Fuzzy PID control for suppressing stick-slip vibration of dr...

引用

Chinese automation Congress (CAC)

作者： Shuaikang Hu Chengda Lu Min Wu Zhaoqing He Haitao Song Wangnian Li School of Automation China University of Geosciences Wuhan China Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Wuhan China Engineering Research Center of Intelligent Technology for Geo-Exploration Ministry of Education Wuhan China China Coal Technology and Engineering Group Xi'an Research Institute Co. Ltd Xi'an China

In this paper, a fuzzy PID (Proportional Integral Derivative) controller is introduced to suppress the stick-slip vibration present in the drilling process. First, the dynamical model of stick-slip vibration is composed of the multi-DOF (Degree-Of-Freedom) drill-string model and the Karnopp model describing the interaction of the drill bit with the rock. Then, stability analysis is made for the initial PID parameters of our controller. To suppress the stick-slip vibration and at the same time mitigate the effects of the stratigraphic environment variation on the control performance, the fuzzy adaptive algorithm is chosen as the method of optimization controller parameters. From the experimental results, it is clear that our controller has good control performance in the complex and changing stratigraphic environment.

关键词： Vibrations Drilling PI control Delay effects Process control Rocks Stability analysis

来源：评论

学校读者我要写书评

暂无评论

A Spatio-Temporal Scale Based Affective Neural Network for Emotion Detection in Conversation

A Spatio-Temporal Scale Based Affective Neural Network for E...

引用

Chinese automation Congress (CAC)

作者： Jiang Li Xiaoping Wang Shanglin Lei Zhigang Zeng School of Artificial Intelligence and Automation Huazhong University of Science and Technology (HUST) Wuhan China Institute of Artificial Intelligence Huazhong University of Science and Technology (HUST) Wuhan China Key Laboratory of Image Processing and Intelligent Control Ministry of Education Wuhan China Key Laboratory of Brain-inspired Intelligent Systems Hubei Province Wuhan China

Emotion Detection in Conversation (EDC) has been implemented in numerous domains and is under increasing attention. The EDC task is highly challenging due to the need to incorporate both the context of the utterance and the identity of the participant. Some existing EDC approaches employ redundant network structures and inadequately model contextual utterances, resulting in limited performance gains. In this work, we devise a Spatio-Temporal scale based Affective neural Network (STANet) in a simplistic and efficacious manner. STANet consists of two main components, i.e., spatial scale network and temporal scale network, which are applied to extract spatial scale and temporal scale information in the conversation, respectively. Prior to spatio-temporal scale modeling, we encode the identity information of participants to examine its impact on the performance of emotion detection. We conduct substantial comparative experiments and ablation studies on three conversational emotion datasets, and the results demonstrate that our STANet realizes superior performance without taking advantage of external knowledge.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Information Fusion of Topological Structure and Node Features in Graph Neural Network

Information Fusion of Topological Structure and Node Feature...

引用

第40届中国控制会议

作者： Hongwei Zhang Can Wang Yuanqing Xia Tijin Yan Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology

Graph neural networks(GNNs) have shown great popularity and achieved promising performance on various graph-based tasks in the past years. However, there is little work that explores the information fusion mechanism, which plays an import role in GNNs. Besides, datasets in the real world often have noises, which make the information fusion difficult. In this paper, we give an information-theoretic explanation. Specifically, we focus on how the information from topological structures and node features fuses and how different information contributes to the downstream task. Furthermore, we propose a general framework named M-GCN to express the fusion process in GNNs. Graph embeddings and feature graph are introduced to extract the information from topological structure and node features separately in M-GCN. Extensive experiments are conducted on several benchmark datasets and experimental results show that our proposed models are more robust and outperform state-of-the-art methods.

关键词： Information Fusion Graph Neural Network Graph embedding

来源：评论

学校读者我要写书评

暂无评论

A Pilot Study on Coupling Behaviors of Limb Movements and Brain Activation Based on EEG and fNIRS Synchronization Information

A Pilot Study on Coupling Behaviors of Limb Movements and Br...

引用

IEEE International Conference on Real-time Computing and Robotics (RCAR)

作者： Xi Tang Qingge Li Yao Tang Lan Tian Yue Zheng Xiangxin Li Naifu Jiang Peng Shang Guanglin Li Liang Peng Peng Fang CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems & the Shenzhen Engineering Laboratory of Neural Rehabilitation Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen China Shenzhen College of Advanced Technology University of Chinese Academy of Sciences Shenzhen China State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China

Motion is one of the basic physiological functions of human beings. However, many brain diseases such as stroke may cause different degrees of motor dysfunctions for patients. As a commonly used rehabilitation method, active and passive exercise training may enhance patients’ neuromuscular functions and recover their motor abilities. It is known that limb movements are strongly coupled with brain activation but there is currently insufficient exploration on the coupling behaviors from the perspective of informatics. In this study, the coupling relationship between limb movements and brain activation was preliminarily studied based on three healthy subjects. Electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) signals were synchronously collected during lower limb movements, and time-frequency analysis (TFA) and transfer entropy (TE) analysis were performed to quantitatively study the brain activation behaviors. In the experiments, a desynchronization phenomenon of μ rhythm in EEG was observed during exercise states, and the experimental results demonstrate the activation rule of motor and prefrontal cortexes upon limb movements. Calculations show that there exists a bidirectional flow of information between EEG and cerebral oxygen metabolism signals, but with a difference between different directions. This work may support the rehabilitation for patients with motor dysfunctions with a guidance of quantitative indicators and also benefit the exploration on neuroscience.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Application of machine learning method in optical molecular imaging: a review

引用

Science China(Information Sciences) 2020年第1期63卷 5-20页

作者： Yu AN Hui MENG Yuan GAO Tong TONG Chong ZHANG Kun WANG Jie TIAN CAS Key Laboratory of Molecular Imaging Beijing Key Laboratory of Molecular ImagingThe State Key Laboratory of Management and Control for Complex SystemsInstitute of Automation Chinese Academy of Sciences Beijing Advanced Innovation Center for Big Data-Based Precision Medicine School of MedicineBeihang University University of Chinese Academy of Sciences

Optical molecular imaging(OMI) is an imaging technology that uses an optical signal, such as near-infrared light, to detect biological tissue in organisms. Because of its specific and sensitive imaging performance, it is applied in both preclinical research and clinical surgery. However, it requires heavy data analysis and a complex mathematical model of tomographic imaging. In recent years, machine learning(ML)-based artificial intelligence has been used in different fields because of its ability to perform powerful data processing. Its analytical capability for processing complex and large data provides a feasible scheme for the requirement of OMI. In this paper, we review ML-based methods applied in different OMI modalities.

关键词： optical molecular imaging machine learning artificial intelligence

来源：评论

学校读者我要写书评

暂无评论

Design and Development of Big Data System for Blast Furnace Ironmaking

Design and Development of Big Data System for Blast Furnace ...

引用

Industrial Cyber-Physical systems (ICPS)

作者： Qifu Chen Jinhua She Min W Zhuofu Zhang Zhenhong Liao School of Future Technology China University of Geosciences Wuhan China Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Wuhan China Engineering Research Center of Intelligent Technology for Geo-Exploration. Ministry of Education Wuhan China Hunan Valin Lianyuan Iron and Steel Co. Ltd. Loudi China School of Engineering Tokyo University of Technology Tokyo Japan School of Automation. China University of Geosciences Wuhan China

The process of blast furnace ironmaking is com-posed of several sub-processes. The process of blast furnace smelting is complicated and the data of each sub-process are scattered and not concentrated. The traditional working mode of subjective judgment based on manual experience is not conducive to the stable production of the blast furnace. Therefore, this paper develops a big data system for the production process of blast furnace, which is of great significance to realize the digital production and intelligent production of blast furnace. According to the system architecture of blast furnace ironmaking, this paper mainly designs and develops the data acquisition layer, data storage layer, data analysis layer and data application layer of the big data system.

关键词： Software design Data acquisition Smelting Memory systems architecture Production User interfaces

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：