检索结果-内蒙古大学图书馆

Online adaptive Q-learning method for fully cooperative linear quadratic dynamic games

Science China(Information Sciences) 2019年第12期62卷 164-177页

作者： Xinxing LI Zhihong PENG Lei JIAO Lele XI Junqi CAI School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex Systems

A model-based offline policy iteration(PI) algorithm and a model-free online Q-learning algorithm are proposed for solving fully cooperative linear quadratic dynamic games. The PI-based adaptive Q-learning method can learn the feedback Nash equilibrium online using the state samples generated by behavior policies, without sending inquiries to the system model. Unlike the existing Q-learning methods, this novel Q-learning algorithm executes both policy evaluation and policy improvement in an adaptive *** prove the convergence of the offline PI algorithm by proving its equivalence to Newton's method while solving the game algebraic Riccati equation(GARE). Furthermore, we prove that the proposed Q-learning method will converge to the Nash equilibrium under a small learning rate if the method satisfies certain persistence of excitation conditions, which can be easily met by suitable behavior policies. Our simulation results demonstrate the good performance of the proposed online adaptive Q-learning algorithm.

关键词： adaptive dynamic programming reinforcement learning Q-learning fully cooperative linear quadratic dynamic games policy iteration off-policy

来源：评论

学校读者我要写书评

暂无评论

Activity and Relationship Modeling Driven Weakly Supervised Object Detection

Activity and Relationship Modeling Driven Weakly Supervised ...

引用

International Conference on Pattern Recognition

作者： Yinlin Li Yang Qian Xu Yang Yuren Zhang State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China ByteDance Beijing China

This paper presents a weakly supervised object detection method based on activity label and relationship modeling, which is motivated by the assumption that configuration of human and object are similar in same activity, and joint modeling of human, active object and activity could leverage the recognition of them. Compared to most weakly supervised method taking object as independent instance, firstly, active human and object proposals are learned and filtered based on class activation map of multi-label classification. Secondly, a spatial relationship prior including relative position, scale, overlaps etc are learned dependent on action. Finally, a multi-stream object detection framework integrating the spatial prior and pairwise ROI pooling are proposed to jointly learn the object and action class. Experiments are conducted on HICO-DET dataset, and our approach outperforms the state of the art weakly supervised object detection methods.

关键词： Training Object detection Gaussian distribution Pattern recognition Proposals

来源：评论

学校读者我要写书评

暂无评论

A parallel framework for scene understanding 1

A parallel framework for scene understanding

引用

1st IEEE International Conference on Digital Twins and Parallel Intelligence, DTPI 2021

作者： Zhang, Wenwen Wang, Jiangong Wang, Kunfeng School of Software Engineering Xi'An Jiaotong University Xi'an710049 China Institute of Automation Chinese Academy of Sciences The State Key Laboratory for Management and Control of Complex Systems Beijing100190 China College of Information Science and Technology Beijing University of Chemical Technology Beijing100029 China

ISBN: (纸本)9781665433372

Different related computer vision tasks make it possible to understand and analyze the scene totally. However, there is no useful framework combining different tasks for scene understanding. In this paper, we investigate the current state of scene understanding from different aspects relying on different computer vision tasks and propose an effective framework based on the theory of parallel vision to combine different tasks for scene understanding. With the maintained artificial scene throughout time from the proposed framework, we can understand the scene in an elegant way. To explain our proposed framework, a case study is given. © 2021 IEEE.

关键词： Computer vision

来源：评论

学校读者我要写书评

暂无评论

Distance- And velocity-based collision avoidance for time-varying formation control of second-order multi-agent systems

引用

IEEE Transactions on Circuits and systems II: Express Briefs 2021年第4期68卷 1253-1257页

作者： Pang, Zhong-Hua Zheng, Chang-Bing Sun, Jian Han, Qing-Long Liu, Guo-Ping Key Laboratory of Fieldbus Technology and Automation of Beijing North China University of Technology Beijing100144 China State Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing100081 China School of Software and Electrical Engineering Swinburne University of Technology MelbourneVIC3122 Australia Department of Artificial Intelligence and Automation Wuhan University Wuhan430072 China

This brief addresses the time-varying formation control problem with collision avoidance for second-order multi-agent systems. By taking both distances and velocities between agents into account, a novel collision avoidance scheme is proposed on the basis of conventional distance-based artificial potential field methods. Compared with the latter, the proposed scheme can more accurately determine possible collision situations and thus significantly reduce possible collision areas, which consequently not only can reduce energy consumption, but also has as few adverse effects on formation maintenance as possible. Then a time-varying formation control protocol is designed so as to achieve zero steady-state position and velocity formation tracking errors without collision. Finally, theoretical analysis, numerical demonstration, as well as comparative simulation are provided to verify the effectiveness of the proposed method. © 2004-2012 IEEE.

关键词： Multi agent systems

来源：评论

学校读者我要写书评

暂无评论

Learning from the Negativity: Deep Negative Correlation Meta-Learning for Adversarial Image Classification 27th

Learning from the Negativity: Deep Negative Correlation Meta...

引用

27th International Conference on MultiMedia Modeling, MMM 2021

作者： Zheng, Wenbo Yan, Lan Wang, Fei-Yue Gou, Chao School of Software Engineering Xi’an Jiaotong University Xi’an China School of Intelligent Systems Engineering Sun Yat-sen University Guangzhou China The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783030678319

Adversarial images are commonly viewed negatively for neural network training. Here we present an opposite perspective: adversarial images can be used to investigate the problem of classifying adversarial images themselves. To this end, we propose a novel framework termed as Deep Negative Correlation Meta-Learning. In particular, we present a deep relation network to capture and memorize the relation among different samples. We further formulate a deep negative correlation learning, and design a novel meta-learning-based classifier to prevent overfitting and learn discriminative features. The final classification is derived from our relation network by learning to compare the features of samples. Experimental results demonstrate that our approach achieves significantly higher performance compared with other state-of-the-arts. © 2021, Springer Nature Switzerland AG.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

Cyber-physical -social systems for smart cities: An overview 1

Cyber-physical -social systems for smart cities: An overview

引用

1st IEEE International Conference on Digital Twins and Parallel Intelligence, DTPI 2021

作者： Anwar, Noreen Xiong, Gang Lu, Wanze Ye, Peijun Zhao, Hongxia Wei, Qinglai Institute of Automation Chinese Academy of Sciences The State Key Laboratory for Management and Control of Complex Systems Beijing China The Beijing Engineering Research Center of Intelligent Systems and Technology Institute of Automation The Cloud Computing Center Chinese Academy of Sciences China School of Artificial Intelligence and Automation Beijing University of Technology Beijing100124 China

ISBN: (纸本)9781665433372

Cyber-physical social systems (CPSS) include cyberspace, physical space, and social space. Since the introduction of CPSS, human relationships with machinery and the physical world have altered as a new paradigm. Recent estimates indicate that approximately 60 percent of the world's population will live in cities by 2030. Large, dense cities can be highly productive, innovative, and very green per capita, hence ideal for our future. However, the huge influx of new people poses enormous challenges to their administrations. Smart cities are becoming a reality, therefore, to achieve higher efficiency, optimum use of resources, management and to strengthen several features of modern towns, several elements of modern cities are automated and integrated into Information and Communications Technology (ICT). Cities and infrastructure are growing all over the world, in providing end-users with increased performance, comfort, visibility and convenience, the Smart Cities concept is critical. This paper will discuss smart cities and the CPSS concept intensively with some of its key technologies, challenges, and further development by using CPSS. © 2021 IEEE.

关键词： Smart city

来源：评论

学校读者我要写书评

暂无评论

Research on measuring magnetic field around 10kV cable based on three-split magnetic core

Research on measuring magnetic field around 10kV cable based...

引用

Energy, Electrical and Power Engineering (CEEPE), International Conference on

作者： Zhe Hou Sen Teng Wenqiang Dang Xiahaoyue Yun Zeli Ju Yang You Zixiong Cai Power Equipment Condition Assessment Center State Grid Shaanxi Electric Power Research Institute Xi’an China Power Distribution Network Department State Grid Shaanxi Electric Power Company Xi’an China Chongqing Key Laboratory of Complex Systems and Bionic Control Chongqing University of Posts and Telecommunications Chongqing China

ISBN: (数字)9798350375794

ISBN: (纸本)9798350375800

The utilization of 10kV cable in urban distribution networks and industrial settings necessitates regular maintenance and fault detection to guarantee uninterrupted power supply. Ensuring the de-energization of inspected cables on-site is crucial for operator safety, yet current methods for evaluating the energization status of 10kV cables lack effectiveness. This study introduces an electromagnetic detection sensor utilizing a three-split magnetic core design, aimed at addressing the issue of zero magnetic field integral resulting from the three-phase current vector sum of 0 in a 10kV cable. This study employs theoretical analysis and finite element simulation to investigate the magnetic induction state of a three-split magnetic core surrounding a 10kV distribution cable. The findings confirm that the three-split magnetic core is capable of detecting the magnetic field generated by the current load in the phase conductor on the outer surface of the 10kV cable. These results offer theoretical justification for further research into live state detection technology for 10kV cables utilizing the three-split magnetic core.

关键词： Magnetic flux density Sensitivity Power cables Magnetic cores Solids Vectors Finite element analysis

来源：评论

学校读者我要写书评

暂无评论

PROTOTYPICAL CONTEXT-AWARE DYNAMICS GENERALIZATION FOR HIGH-DIMENSIONAL MODEL-BASED REINFORCEMENT LEARNING

arXiv

引用

arXiv 2022年

作者： Wang, Junjie Mu, Yao Li, Dong Zhang, Qichao Zhao, Dongbin Zhuang, Yuzheng Luo, Ping Wang, Bin Hao, Jianye The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences China University of Chinese Academy of Sciences China The University of Hong Kong Hong Kong Huawei Noah's Ark Lab

The latent world model provides a promising way to learn policies in a compact latent space for tasks with high-dimensional observations, however, its generalization across diverse environments with unseen dynamics remains challenging. Although the recurrent structure utilized in current advances helps to capture local dynamics, modeling only state transitions without an explicit understanding of environmental context limits the generalization ability of the dynamics model. To address this issue, we propose a Prototypical Context-Aware Dynamics (ProtoCAD) model, which captures the local dynamics by time consistent latent context and enables dynamics generalization in high-dimensional control tasks. ProtoCAD extracts useful contextual information with the help of the prototypes clustered over batch and benefits model-based RL in two folds: 1) It utilizes a temporally consistent prototypical regularizer that encourages the prototype assignments produced for different time parts of the same latent trajectory to be temporally consistent instead of comparing the features;2) A context representation is designed which combines both the projection embedding of latent states and aggregated prototypes and can significantly improve the dynamics generalization ability. Extensive experiments show that ProtoCAD surpasses existing methods in terms of dynamics generalization. Compared with the recurrent-based model RSSM, ProtoCAD delivers 13.2% and 26.7% better mean and median performance across all dynamics generalization tasks. Copyright © 2022, The Authors. All rights reserved.

关键词： Dynamics

来源：评论

学校读者我要写书评

暂无评论

Fast control Strategy of Grid-forming Inverter Based on Power Feedforward 42

Fast Control Strategy of Grid-forming Inverter Based on Powe...

引用

42nd Chinese control Conference, CCC 2023

作者： Zhang, Sheng Fang, Zhijian Liu, Qine Xiang, Muchao Huang, Dingbang School of Automation China University of Geosciences Wuhan430074 China Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems Wuhan430074 China Engineering Research Center of Intelligent Technology for Geo-Exploration Ministry of Education Wuhan430074 China State Grid Hubei Electric Power Co. Ltd Xiangyang Power Supply Company Xiangyang441021 China Electric Power Scientific Research Institute of State Grid Hubei Electric Power Co. Ltd Wuhan430072 China

ISBN: (纸本)9789887581543

Grid-forming inverter is widely used in grid-connected systems of distributed generation because of its frequency and voltage support capacity and good stability in microgrid, but its large inertia will affect the dynamic response speed of grid-forming inverter. In order to solve this problem, this paper introduces the loop that affects the dynamic response of grid-forming inverter, and carries out small signal modeling for active loop, analyzes the dynamic performance indicators and determinants of typical second-order system. Thus, a method of adding power feedforward coefficient to the forward channel of the power loop is designed, and the response speed of the system with or without feedforward coefficient under the unit step response is compared. Finally, the simulation results show that adding the power feedforward coefficient can improve the response speed of the grid-forming inverter during startup and power switching, then achieves the effect of fast control. © 2023 Technical Committee on control Theory, Chinese Association of Automation.

关键词： Dynamic response

来源：评论

学校读者我要写书评

暂无评论

OSTER: An Orientation Sensitive Scene Text Recognizer with CenterLine Rectification 5th

OSTER: An Orientation Sensitive Scene Text Recognizer with C...

引用

5th Asian Conference on Pattern Recognition, ACPR 2019

作者： Feng, Zipeng Du, Chen Wang, Yanna Xiao, Baihua The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783030414030

Scene texts in China are always arbitrarily arranged in two forms: horizontally and vertically. These two forms of texts exhibit distinctive features, making it difficult to recognize them simultaneously. Besides, recognizing irregular scene texts is still a challenging task due to their various shapes and distorted patterns. In this paper, we propose an orientation sensitive network aiming at distinguishing between Chinese horizontal and vertical texts. The learned orientation is then passed into an attention selective network to adjust the attention maps of the sequence recognition model, leading it working for each type of texts respectively. In addition, a lightweight centerline rectification network is adopted, which enables the irregular texts more readable while no redundant labels are needed. A synthetic dataset named SCTD is released to support our training and evaluate the proposed model. Extensive experiments show that the proposed method is capable of recognizing arbitrarily-aligned scene texts accurately and efficiently, achieving state-of-the-art performance over a number of public datasets. © Springer Nature Switzerland AG 2020.

关键词： Character recognition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：