检索结果-内蒙古大学图书馆

Mixed Motivation Driven Social Multi-Agent Reinforcement Learning for Autonomous Driving

IEEE/CAA Journal of Automatica Sinica 2025年第6期12卷 1272-1282页

作者： Long Chen Peng Deng Lingxi Li Xuemin Hu State Key Laboratory of Multimodal Artificial Intelligence Systems and the State Key Laboratory of Management and Control for Complex Systems Chinese Academy of Sciences Beijing WAYTOUS Inc. Beijing Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) Shenzhen Institute of Artificial Intelligence and Robotics Xi'an Jiaotong University Xi'an China School of Computer Science and Information Engineering Hubei University Wuhan China Purdue School of Engineering and Technology Indiana University-Purdue University Indianapolis Indianapolis IN USA School of Artificial Intelligence Hubei University Wuhan Key Laboratory of Intelligent Sensing System and Security (Hubei University) Ministry of Education Wuhan China

Despite great achievement has been made in autonomous driving technologies, autonomous vehicles (AVs) still exhibit limitations in intelligence and lack social coordination, which is primarily attributed to their reliance on single-agent technologies, neglecting inter-AV interactions. Current research on multi-agent autonomous driving (MAAD) predominantly focuses on either distributed individual learning or centralized cooperative learning, ignoring the mixed-motive nature of MAAD systems, where each agent is not only self-interested in reaching its own destination but also needs to coordinate with other traffic participants to enhance efficiency and safety. Inspired by the mixed motivation of human driving behavior and their learning process, we propose a novel mixed motivation driven social multi-agent reinforcement learning method for autonomous driving. In our method, a multi-agent reinforcement learning (MARL) algorithm, called Social Learning Policy Optimization (SoLPO), which takes advantage of both the individual and social learning paradigms, is proposed to empower agents to rapidly acquire self-interested policies and effectively learn socially coordinated behavior. Based on the proposed SoLPO, we further develop a mixed-motive MARL method for autonomous driving combined with a social reward integration module that can model the mixed-motive nature of MAAD systems by integrating individual and neighbor rewards into a social learning objective for improved learning speed and effectiveness. Experiments conducted on the MetaDrive simulator show that our proposed method outperforms existing state-of-the-art MARL approaches in metrics including the success rate, safety, and efficiency. More-over, the AVs trained by our method form coordinated social norms and exhibit human-like driving behavior, demonstrating a high degree of social coordination.

关键词： Measurement Reinforcement learning Safety Driver behavior Autonomous vehicles Optimization

来源：评论

学校读者我要写书评

暂无评论

Simultaneously Calibration of Multi Hand-Eye Robot system Based on Graph

arXiv

引用

arXiv 2023年

作者： Zhou, Zishun Ma, Liping Liu, Xilong Cao, Zhiqiang Yu, Junzhi The Institute of Automation Chinese Academy of Sciences Beijing100190 China The College of Electrical Engineering and Computer Science Australian National University Canberra2601 Australia The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China The State Key Laboratory for Turbulence and Complex System Department of Advanced Manufacturing and Robotics BIC-ESAT College of Engineering Peking University Beijing100871 China

Precise calibration is the basis for the vision-guided robot system to achieve high-precision operations. systems with multiple eyes (cameras) and multiple hands (robots) are particularly sensitive to calibration errors, such as micro-assembly systems. Most existing methods focus on the calibration of a single unit of the whole system, such as poses between hand and eye, or between two hands. These methods can be used to determine the relative pose between each unit, but the serialized incremental calibration strategy cannot avoid the problem of error accumulation in a large-scale system. Instead of focusing on a single unit, this paper models the multi-eye and multi-hand system calibration problem as a graph and proposes a method based on the minimum spanning tree and graph optimization. This method can automatically plan the serialized optimal calibration strategy in accordance with the system settings to get coarse calibration results initially. Then, with these initial values, the closed-loop constraints are introduced to carry out global optimization. Simulation experiments demonstrate the performance of the proposed algorithm under different noises and various hand-eye configurations. In addition, experiments on real robot systems are presented to further verify the proposed method. © 2023, CC BY-SA.

关键词： Multipurpose robots

来源：评论

学校读者我要写书评

暂无评论

∊-k anonymization and adversarial training of graph neural networks for privacy preservation in social networks

引用

Electronic Commerce Research and Applications 2021年 50卷

作者： Tian, Hu Zheng, Xiaolong Zhang, Xingwei Zeng, Daniel Dajun The State of Key Laboratory of Management and Control for Complex System Institute of Automation Chinese Academy of Sciences Beijing100190 China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China

With the explosive growth of social networks, privacy preservation as a social good has been one common concern. Graph neural networks (GNNs) have been utilized by social network service providers to improve business service. However, traditional anonymization techniques of social networks cannot satisfy the desired privacy preservation of node attribute and graph structure and introduce information disturbance from the anonymization, leading to the performance degradation of GNNs in social network analysis. To protect sensitive user data and persist GNNs’ performance in social network analysis, we propose a two-stage privacy-preserving method of graph neural networks in the social network domain. During the first stage, we design a novel ∊-k anonymization method that can achieve ∊-local differential privacy (∊-LDP) and k-degree anonymity by incorporating the classical LDP and k-degree anonymization (k-DA) while retaining as much network community information as possible. At the second stage, we develop an adversarial training mechanism for GNNs to resist the disturbance from ∊-k anonymization and retain as much task performance as possible on anonymous social network data. Comprehensive experiments on several real-world social network datasets demonstrate the effectiveness of the proposed method for privacy-preserving node classification, link prediction, and graph clustering in social networks. The proposed method represents an interesting and important combination of classical anonymous technologies and recent GNNs and can preserve user privacy while providing business service. © 2021 Elsevier B.V.

关键词： Graph neural networks

来源：评论

学校读者我要写书评

暂无评论

Prescriptive Manufacturing in Society 5.0: Human Autonomous Organizations and “On-Demand” Smart Services

引用

IFAC-PapersOnLine 2024年第3期58卷 139-144页

作者： Xiao Wang Jun Huang Jing Yang Xiaoxing Wang Fei-Yue Wang Engineering Research Center of Autonomous Unmanned System Technology Ministry of Education Anhui University Hefei 230601 China Macau University of Science and Technology Macau 999078 China School of artificial Intelligence University of Chinese Academy of Sciences Beijing 100049 China Beijing SANBODY Technology Company Ltd Beijing 214000 China Qingdao Academy of Intelligent Industries Qingdao 266109 China State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing 100190 China

Society 5.0 addresses human behaviors and their consequences in social management, while emphasizing the integration of Cyber-Physical-Social Spaces to achieve a highly connected and circulated society. Prompted by the various social needs expressed on social media platforms, Prescriptive Manufacturing (PM) emerges as a proactive pre-manufacturing paradigm. This paper delves into PM within the context of Society 5.0. It highlights the development of Human Autonomous Organizations (HAOs) and the delivery of “on-demand” smart services, which are customized to meet both individual and broader societal demands. The social sensing framework of social needs across different social media platforms that enables the identification and anticipation of consumer demands in real-time is illustrated. This data-driven insight leverages artificial intelligence and robotics to facilitate customized design and on-demand production, aligning product creation with real user requirements. Furthermore, we discuss the implementation of human-centered smart services in PM, such as virtual try-on, virtual fitting, personalized retrofit, user-friendly scheduling, and proximity logistics, which not only enhance consumer experience but also optimize resource efficiency By examining the symbiosis between technological advancements and social need fulfillment, this study sheds light on how PM and HAOs can foster a more responsive, sustainable, and inclusive economy in society, ultimately contributing to a higher quality of life and sustainable development goals of Society 5.0.

关键词： Social Needs Sensing Human Autonomous Organization Customized Design personalized fine-tuning prescriptive manufacturing Human-Centric Smart Services

来源：评论

学校读者我要写书评

暂无评论

Learning Latent Causal Factors from the Intricate Sensor Feedback of Contact-Rich Robotic Assembly Tasks

SSRN

引用

SSRN 2023年

作者： Chen, Yurou Yu, Jiyang Lin, Zhenyang Shen, Liancheng Liu, Zhiyong The State Key Lab of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China The Center for Excellence in Brain Science and Intelligence Technology Chinese Academy of Sciences Shanghai China Beijing Institute of Spacecraft System Engineering China Academy of Space Technology Beijing China

Achieving precise robotic assembly is paramount for safety and performance in industrial settings. Conventional assembly methods require tedious manual adjustment of many parameters, and it is challenging to meet the assembly requirements with tight clearance. Robot learning has been at the forefront of research, showing potential for automation and intelligence in robotic operations. However, intricate information such as force feedback is indispensable for high-precision robot assembly tasks, and current learning methods grapple with processing this complex observation data due to discontinuous force changes during operation and the inherent noise from the force sensor. To alleviate the low learning efficiency from the problematic observations, we propose introducing the concept of latent causal factors that cause the sensor observations and truly matter in assembly tasks. This paper analyses the impact of discontinuous and noisy observations and offers two ways to infer causal factors. Based on the implied latent factors, we propose a method that learns high-precision assembly policies from interacting with the environment. The algorithm's performance is evaluated in simulated and real-world nut assembly environments, demonstrating significant improvements over the previous methods. This research also underscores the promise of causal inference in addressing intricate industrial challenges%. © 2023, The Authors. All rights reserved.

关键词： Robotic assembly

来源：评论

学校读者我要写书评

暂无评论

A Many-Objective Evolutionary Algorithm Assisted by Ideal Hyperplane

SSRN

引用

SSRN 2022年

作者： Zhang, Zhixia Wen, Jie Wang, Hui Cai, Xingjuan Cui, Zhihua Zhang, Wensheng School of Computer Science and Technology Taiyuan University of Science and Technology China School of Information Engineering Nanchang Institute of Technology Nanchang330099 China State Key Laboratory of Intelligent Control and Management of Complex System Institute of Automation Chinese Academy of Sciences China State Key Lab. for Novel Software Technology Nanjing University China

In many-objective optimization problems (MaOPs), it is a difficult task for evolutionary algorithms to balance convergence and diversity while rapidly converging to the Pareto front. As the number of objectives increases, the difficulty of evolutionary algorithms increases with individual selection pressure. To address above problems, we propose a many-objective evolution algorithm assisted by an ideal hyperplane (MaOEA-IH). Firstly, the ideal hyperplane as a reference surface to guide the individual to search the Pareto front, which is established from the extremum of each dimension of the objective space. Secondly, a parallel p -norm mating selection strategy is proposed to improve convergence. In addition, two factors are considered in this strategy: 1) different p -norm are used to measure different spatial scales;2) individual selection uncertainty is defined by incorporating a probabilistic perturbation mechanism. Thirdly, the improved shift-based density estimation strategy is used as the evaluation criterion for environmental selection to improve the convergence and diversity of solution sets and enhance selection pressure. To verify the effectiveness of the proposed algorithm, MAOEA-IH is compared with seven excellent algorithms in three benchmark sets (DTLZ, WFG and MaF). The results show that the proposed MAOEA-IH is highly competitive in solving MaOPs. © 2022, The Authors. All rights reserved.

关键词： Geometry

来源：评论

学校读者我要写书评

暂无评论

S$^{\text{4}}$TP: Social-Suitable and Safety-Sensitive Trajectory Planning for Autonomous Vehicles

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2023年第2期9卷 3220-3231页

作者： Xiao Wang Ke Tang Xingyuan Dai Jintao Xu Quancheng Du Rui Ai Yuxiao Wang Weihao Gu Engineering Research Center of Autonomous Unmanned System Technology Ministry of Education Anhui University Hefei China Haomo Technology Company Ltd. Beijing China State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Qingdao Academy of Intelligent Industries Qingdao China School of Computer and Communication Engineering University of Science and Technology Beijing Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China

In public roads, autonomous vehicles (AVs) face the challenge of frequent interactions with human-driven vehicles (HDVs), which render uncertain driving behavior due to varying social characteristics among humans. To effectively assess the risks prevailing in the vicinity of AVs in social interactive traffic scenarios and achieve safe autonomous driving, this article proposes a social-suitable and safety-sensitive trajectory planning (S $^{\text{4}}$ TP) framework. Specifically, S $^{\text{4}}$ TP integrates the Social-Aware Trajectory Prediction (SATP) and Social-Aware Driving Risk Field (SADRF) modules. SATP utilizes Transformers to effectively encode the driving scene and incorporates an AV's planned trajectory during the prediction decoding process. SADRF assesses the expected surrounding risk degrees during AVs-HDVs interactions, each with different social characteristics, visualized as two-dimensional heat maps centered on the AV. SADRF models the driving intentions of the surrounding HDVs and predicts trajectories based on the representation of vehicular interactions. S $^{\text{4}}$ TP employs an optimization-based approach for motion planning, utilizing the predicted HDVs' trajectories as input. With the integration of SADRF, S $^{\text{4}}$ TP executes real-time online optimization of the planned trajectory of AV within low-risk regions, thus improving the safety and the interpretability of the planned trajectory. We have conducted comprehensive tests of the proposed method using the SMARTS simulator. Experimental results in complex social scenarios, such as unprotected left-turn intersections, merging, cruising, and overtaking, validate the superiority of our proposed S $^{\text{4}}$ TP in terms of safety and rationality. S $^{\text{4}}$ TP achieves a pass rate of 100% across all scenarios, surpassing the current state-of-the-art methods Fanta of 98.25% and Predictive-Decision of 94.75%.

关键词： Trajectory Safety Vehicles Trajectory planning Autonomous vehicles Risk management Behavioral sciences

来源：评论

学校读者我要写书评

暂无评论

Design of A Real-time Three-electrode Cylindrical Conductivity Sensor

Design of A Real-time Three-electrode Cylindrical Conductivi...

引用

Chinese Automation Congress (CAC)

作者： GuangYao Xu En Li School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China The State Key Labrary of Management and Control for Complex System Institute of Automation Chinese Academy of Science Beijing China

ISBN: (数字)9781728176871

ISBN: (纸本)9781728176888

In this paper, we designed a real-time three-electrode cylindrical conductivity sensor for special working conditions. Compared with traditional conductivity sensors, the three-electrode design balances the relationship between measurement accuracy and structural complexity. The cylindrical electrode core can adapt to some complex working environments that traditional intrusive electrodes cannot. The CoOS real-time operating system adopted by the measurement software has the characteristics of a small kernel and low requirement for computing resources. It can well meet the demand for online measurement of conductivity sensor. The amplitude and frequency of the excitation signal can be adjusted by the measurement software, avoiding the invariance of the signal by hardware adjustment. Since the error is greatly affected by temperature, the sensor can effectively reduce the error by compensating for temperature. All electronic components of the sensor are designed with low power consumption, which can extend the working time while ensuring normal operation.

关键词： Conductivity Temperature measurement Electrodes Conductivity measurement Electrical resistance measurement Software measurement Software

来源：评论

学校读者我要写书评

暂无评论

Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving

arXiv

引用

arXiv 2024年

作者： Hu, Xuemin Chen, Pan Wen, Yijun Tang, Bo Chen, Long School of Artificial Intelligence Hubei University Wuhan430062 China Key Laboratory of Intelligent Sensing System and Security Hubei University Ministry of Education Hubei Wuhan430062 China Department of Electrical and Computer Engineering Worcester Polytechnic Institute WorcesterMA01609 United States State Key Laboratory of Multimodal Artificial Intelligence Systems State Key Laboratory of Management and Control for Complex Systems Chinese Academy of Sciences Beijing100190 China WAYTOUS Inc. Beijing100083 China Shenzhen518107 China Institute of Artificial Intelligence and Robotics Xi'an Jiaotong University Xi’an710049 China

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its industrial applications such as autonomous driving systems. Safe RL methods are developed to handle this issue by constraining the expected safety violation costs as a training objective, but the occurring probability of an unsafe state is still high, which is unacceptable in autonomous driving tasks. Moreover, these methods are difficult to achieve a balance between the cost and return expectations, which leads to learning performance degradation for the algorithms. In this paper, we propose a novel algorithm based on the long and short-term constraints (LSTC) for safe RL. The short-term constraint aims to enhance the shortterm state safety that the vehicle explores, while the long-term constraint enhances the overall safety of the vehicle throughout the decision-making process, both of which are jointly used to enhance the vehicle safety in the training process. In addition, we develop a safe RL method with dual-constraint optimization based on the Lagrange multiplier to optimize the training process for end-to-end autonomous driving. Comprehensive experiments were conducted on the MetaDrive simulator. Experimental results demonstrate that the proposed method achieves higher safety in continuous state and action tasks, and exhibits higher exploration performance in long-distance decision-making tasks compared with state-of-the-art methods. Copyright © 2024, The Authors. All rights reserved.

关键词： Lagrange multipliers

来源：评论

学校读者我要写书评

暂无评论

An Obstacles Avoidance Algorithm Based on Improved Artificial Potential Field 17

An Obstacles Avoidance Algorithm Based on Improved Artificia...

引用

17th IEEE International Conference on Mechatronics and Automation, ICMA 2020

作者： Lu, SiXi Li, En Guo, Rui Yuquan Road Beijing100049 China Institute of Automation Chinese Academy of Science State Key Laboratory of Management and Control for Complex System 95 East ZhongGuanCun Road Beijing China State Grid Shandong Electric Power Company Jinan250001 China

ISBN: (纸本)9781728164151

Obstacle avoidance is one of the most important issue in the motion planning and control of robot. There are many algorithms to avoid obstacles, but obstacle avoidance algorithm for manipulator is needed consider not only end effector, but also all links of manipulator. In terms of real-time and speed of all system, the algorithm also should be easy as possible. In this paper, an algorithm based on the improved artificial potential field is proposed to solve the problem of the local optimum. The idea of improvement is to find a path by fitting curve with target point and critical oscillating points. There is also a comparison in this paper with planning a path by tangent line. The conclusion proves that the path is much smoother by the algorithm based on improved artificial potential field in this paper. Furthermore, the problem of judder on the trajectory of traditional artificial potential field is also solved in this paper by an improved repulsive potential field function. Finally, the algorithm is proved by planning a smooth path for obstacle avoidance on manipulator: KinovaGen3 in MATLAB. © 2020 IEEE.

关键词： Manipulators

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：