检索结果-内蒙古大学图书馆

Influence Enhanced Sparse Coordination Graphs for Multi-Agent Reinforcement Learning

Neural Networks 2025年 188卷 107454页

作者： Zhang, Xiwen Chen, Jie Gan, Ming-Gang Chen, Haoxiang State Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing100081 China

In contemporary Multi-Agent Reinforcement Learning (MARL), effectively enhancing the expressive capacity of value functions has been a persistent research focus. Many studies have employed value decomposition methods;however, due to the neglect of inter-agent collaboration, these methods fall short of achieving optimal performance. Subsequent research introduced coordination graphs into value decomposition methods;nevertheless, these approaches often rely on simplistic rules to evaluate inter-agent collaboration and fail to adequately describe the collaborative relationships of agents in complex environments. Consequently, we propose Influence Enhanced Sparse Coordination Graphs (IESCG) as a solution to provide insights into the aforementioned problem. In this study, we propose influence networks as quantitative descriptions of the importance of collaboration among agents, utilizing them as crucial basis for constructing the topology of Sparse Time-Varying Coordination Graphs. Additionally, we propose Recurrent Payoff Function Networks (RPFN) to incorporate temporal information while providing necessary input to influence networks. Furthermore, Sparse Graph Advantage Selection Coefficients (SGASC) are introduced to stabilize the overall value function across different time steps, ensuring training stability. Experimental investigations conducted on the StarCraft II micromanagement and MACO benchmark indicate that our algorithm not only accelerates convergence and improves winning probabilities but also exhibits more pronounced advantages in complex scenarios. © 2025

关键词： Markov processes

来源：评论

学校读者我要写书评

暂无评论

A Velocity Tracking Approach Based on Neural Networks for a Multimodal Wheel-Legged Composite Gait on a Parallel Structure Robot

引用

IEEE/ASME Transactions on Mechatronics 2025年

作者： Xue, Junfeng Wang, Shoukun Xu, Yongkang Wang, Junzheng Beijing Institute of Technology School of Automation State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing100081 China

Parallel-legged robots are favored by many researchers due to their potent environmental adaptability and load capacity. However, the work efficiency of the parallel leg structure is always confined due to its uptight workspace and extremely uneven force distributed among actuators. Therefore, this article proposes a new type of wheel-legged composite gait for the parallel structure, inspired by the characteristic of variation in the pitch angle of the foot-end when a human walks. First, the kinematic inverse solution of the wheel-legged composite gait is derived, where the reverse rotation of the wheel alleviates the slipping phenomenon of the foot-end on stance stage in humanoid gait from the kinematic level. Meanwhile, numerical simulation and experiments have verified that the proposed gait can enlarge the workspace of a single leg for 25.4% and alleviate the maximum force on the actuators for 16.4% minimizing actuator wear. Besides, a legged motion speed tracking approach is implemented for dynamics of the wheel-legged composite gait. Among them, a whole body dynamics model is constructed to adjust the neural network weights enabling real-time adjustment of incremental proportion–integration–differentiation control parameters based on the foot longitudinal force, to scale up its control efficiency. Finally, to ameliorate the issue of limited contact friction between the robot and the ground, an encoding approach to identify the sliding state of the robot's foot-end in the X-Y plane has been proposed. This approach adaptively modifies both the longitudinal force threshold of the foot-end and the desired linear velocity of the robot body. These adjustments are guided by specific control rules, which aim to enhance the accuracy of speed tracking during legged motion across varying terrains. The resulting linear and yaw velocity steady errors are constrained to 0.05 m/s and 0.012 rad/s, respectively. © 1996-2012 IEEE.

关键词： Anthropomorphic robots

来源：评论

学校读者我要写书评

暂无评论

Design and development of a new autonomous transportation robot for finished vehicles docking transportation in RO/RO logistics terminal

引用

Advanced Engineering Informatics 2025年 66卷

作者： Xu, Yongkang Zhang, Lin Liu, Zhi Wang, Shoukun Wang, Junzheng State Key Laboratory of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing 100081 China

With the continuous growth of the automobile trade, the inefficiency of traditional cargo transshipment in Roll-On/Roll-Off (RO/RO) terminals has become increasingly pronounced. As a result, the adoption of autonomous transportation robot (ATR) for the automatic handling of finished vehicles has seen significant growth. However, ATRs designed for this purpose face several limitations, including suboptimal mobility performance and the necessity for additional infrastructure to support their operation. This paper introduces a novel ATR that offers enhanced flexibility and operational capability. To further optimize the positioning of LiDAR, we develop a multi-stage LiDAR fusion algorithm for the precise localization of finished vehicles, incorporating an event-triggered decision-making approach to improve positioning accuracy. Based on the accurate positioning data, we propose a docking strategy consisting of two key phases: the approach phase and the docking phase. During the docking phase, an enhanced Model Predictive control (MPC) algorithm, integrated with a Radial Basis Function (RBF) neural network, is designed to enable real-time adjustment of the robot's docking attitude. The effectiveness of the proposed approach is validated through real-world robot experimentals demonstrating its practical viability. © 2025

关键词： Docking control Finished vehicles RO/RO terminal Transportation robot

来源：评论

学校读者我要写书评

暂无评论

Design and Performance Analysis of a Series-Parallel Self-Aligning Index Finger Exoskeleton

引用

IEEE Robotics and Automation Letters 2025年第6期10卷 6456-6463页

作者： Sun, Ning Wang, Zelong Cheng, Long Li, Houcheng Niu, Ben Sun, Xijin Li, Ke Shandong Normal University School of Information Science and Engineering Jinan China Chinese Academy of Sciences State Key Laboratory of Management and Control for Complex Systems Institute of Automation Beijing China University of Chinese Academy of Sciences School of Artificial Intelligence Beijing China Shandong University Institute of Intelligent Medical Engineering School of Control Science and Engineering Jinan China

Hand exoskeletons have become increasingly crucial for the rehabilitation of hand function, as relevant studies have shown that using the exoskeletons to assist in rehabilitation training can improve hand motor function. However, developing a human-robot kinematic compatibility exoskeleton while providing sufficient assistance torque is still a challenge. This paper develops a series-parallel self-aligning index finger exoskeleton to assist the index finger in flexion/extension and adduction/abduction training. A series-parallel mechanism driven by two motors simultaneously was proposed for the metacarpophalangeal (MCP) joint, which can ensure human-robot joint axes self-alignment and increase the joint assistance torque. A kinematic compatibility analysis method was proposed, and the kinematic compatibility of the series-parallel mechanism was analyzed. The degrees of freedom and forward kinematics of the proposed mechanism were analyzed, and its workspace was calculated, which results show that the motion range of the MCP joint can meet the grasping training requirements. Preliminary experiments were carried out, and the results indicate that the motion trajectory coefficients of the marker points at the MCP, PIP, and DIP joints averaged for all subjects with and without the proposed exoskeleton are 0.993, 0.956, and 0.939, respectively, which can verify the kinematic transparency of the proposed mechanism. The assistance torque generated by the proposed mechanism on the MCP joint can meet the joint assistance torque requirements. In a word, the proposed exoskeleton can achieve flexion/extension and adduction/abduction training, human-robot joint axes self-alignment, and provide sufficient assistance torque. © 2016 IEEE.

关键词： Exoskeleton (Robotics)

来源：评论

学校读者我要写书评

暂无评论

Data-Driven Learning and control with Event-Triggered Measurements

引用

IEEE Transactions on Automatic control 2025年

作者： Feng, Shilun Shi, Dawei Chen, Tongwen Shi, Ling Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex Systems MIIT Key Laboratory of Servo Motion System Drive and Control School of Automation Beijing100081 China University of Alberta Department of Electrical and Computer Engineering EdmontonABT6G 1H9 Canada Hong Kong University of Science and Technology Department of Electronic and Computer Engineering Clear Water Bay Kowloon Hong Kong

Event-triggered control has attracted considerable attention for its effectiveness in resource-restricted applications. To make event-triggered control as an end-to-end solution, a key issue is how to effectively learn unknown system dynamics from event-triggered measurements and consequently, develop a learning-based event-triggered controller. Existing works learn system dynamics based on periodic time-triggered measurements, and it is yet to know how to learn a controller with performance guarantee based on event-triggered measurements. To address this issue, we consider the problem of learning an event-triggered state feedback controller for an unknown linear system based on event-triggered state measurements in this work. In particular, we first analyze the event-triggered measurements within a set-membership framework. We prove that the estimation error belongs to a bounded ellipsoid determined by the historical measurements and the event-triggering condition. Subsequently, we demonstrate that all admissible systems compatible with the collected data samples can be explicitly represented in the form of quadratic matrix inequalities using the state estimates. With the acquired set of admissible systems, a co-design problem for the data-driven controller and event-triggering condition is solved using the linear matrix inequality technique, with guaranteed closed-loop stability and L2-gain performance. Finally, numerical examples and comparisons are provided to illustrate the effectiveness of the proposed event-triggered learning and control approach. © 1963-2012 IEEE.

关键词： Networked control systems

来源：评论

学校读者我要写书评

暂无评论

Distributed Online Convex Optimization with Time-Varying Constraints: Tighter Cumulative Constraint Violation Bounds under Slater's Condition

引用

IEEE Transactions on Automatic control 2025年

作者： Yi, Xinlei Li, Xiuxian Yang, Tao Xie, Lihua Hong, Yiguang Chai, Tianyou Johansson, Karl H. National Key Laboratory of Autonomous Intelligent Unmanned Systems Shanghai Institute of Intelligent Science and Technology China Ministry of Education Frontiers Science Center for Intelligent Autonomous Systems China Massachusetts Institute of Technology Lab for Information & Decision Systems CambridgeMA02139 United States Northeastern University State Key Laboratory of Synthetical Automation for Process Industries Shenyang110819 China Nanyang Technological University School of Electrical and Electronic Engineering 50 Nanyang Avenue 639798 Singapore Kth Royal Institute of Technology Division of Decision and Control Systems School of Electrical Engineering and Computer Science Sweden Digital Futures Stockholm10044 Sweden

This paper considers distributed online convex optimization with time-varying constraints. In this setting, a network of agents makes decisions at each round, and then only a portion of the loss function and a coordinate block of the constraint function are privately revealed to each agent. The loss and constraint functions are convex and can vary arbitrarily across rounds. The agents collaborate to minimize static network regret and network cumulative constraint violation. A novel distributed online algorithm with a vanishing stepsize is proposed and it achieves an O(Tmax {c,1-c}) static network regret bound and an O(T1-c/2) network cumulative constraint violation bound, where T is the number of rounds and c∈ (0,1) is a user-defined trade-off parameter. When Slater's condition holds (i.e, there is a point that strictly satisfies the inequality constraints), the network cumulative constraint violation bound is reduced to O(T1-c). Moreover, if the loss functions are strongly convex, then static network regret bound is reduced to O(log (T)), and the network cumulative constraint violation bound is reduced to O(√log (T)T) and O(log (T)) without and with Slater's condition, respectively. To the best of our knowledge, this paper is the first to achieve tighter (network) cumulative constraint violation bounds for (distributed) online convex optimization with time-varying constraints under Slater's condition. Finally, the theoretical results are verified through numerical simulations. © 1963-2012 IEEE.

关键词： Convex optimization

来源：评论

学校读者我要写书评

暂无评论

A memetic algorithm for path planning of curvature-constrained UAVs performing surveillance of multiple ground targets

引用

Chinese Journal of Aeronautics 2014年第3期27卷 622-633页

作者： Zhang Xing Chen Jie Xin Bin Peng Zhihong School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex Systems

The problem of generating optimal paths for curvature-constrained unmanned aerial vehicles （UAVs） performing surveillance of multiple ground targets is addressed in this paper. UAVs are modeled as Dubins vehicles so that the constraints of UAVs＇ minimal turning radius can be taken into account. In view of the effective surveillance range of the sensors equipped on UAVs, the problem is formulated as a Dubins traveling salesman problem with neighborhood （DTSPN）. Considering its prohibitively high computational complexity, the Dubins paths in the sense of terminal heading relaxation are introduced to simplify the calculation of the Dubins distance, and a boundary-based encoding scheme is proposed to determine the visiting point of every target neighborhood. Then, an evolutionary algorithm is used to derive the optimal Dubins tour. To further enhance the quality of the solutions, a local search strategy based on approximate gradient is employed to improve the visiting points of target neighborhoods. Finally, by a minor modification to the individual encoding, the algorithm is easily extended to deal with other two more sophisticated DTSPN variants （multi-UAV scenario and multiple groups of targets scenario）. The performance of the algorithm is demonstrated through comparative experiments with other two state-of-the-art DTSPN algorithms identified in literature. Numerical simulations exhibit that the algorithm proposed in this paper can find high-quality solutions to the DTSPN with lower computational cost and produce significantly improved performance over the other algorithms.

关键词： Approximate gradient Dubins traveling salesmanproblem with neighborhood Local search Memetic algorithm Unmanned aerial vehicles

来源：评论

学校读者我要写书评

暂无评论

Online adaptive Q-learning method for fully cooperative linear quadratic dynamic games

引用

Science China(Information Sciences) 2019年第12期62卷 164-177页

作者： Xinxing LI Zhihong PENG Lei JIAO Lele XI Junqi CAI School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex Systems

A model-based offline policy iteration(PI) algorithm and a model-free online Q-learning algorithm are proposed for solving fully cooperative linear quadratic dynamic games. The PI-based adaptive Q-learning method can learn the feedback Nash equilibrium online using the state samples generated by behavior policies, without sending inquiries to the system model. Unlike the existing Q-learning methods, this novel Q-learning algorithm executes both policy evaluation and policy improvement in an adaptive *** prove the convergence of the offline PI algorithm by proving its equivalence to Newton's method while solving the game algebraic Riccati equation(GARE). Furthermore, we prove that the proposed Q-learning method will converge to the Nash equilibrium under a small learning rate if the method satisfies certain persistence of excitation conditions, which can be easily met by suitable behavior policies. Our simulation results demonstrate the good performance of the proposed online adaptive Q-learning algorithm.

关键词： adaptive dynamic programming reinforcement learning Q-learning fully cooperative linear quadratic dynamic games policy iteration off-policy

来源：评论

学校读者我要写书评

暂无评论

Contextual Multi-Armed Bandit-Based Dynamic Cooperative Link Configuration for AUV in UWASNs With Energy Harvesting

引用

IEEE Transactions on Cognitive Communications and Networking 2025年

作者： Dai, Jun Li, Xinbin Han, Song Yu, Junzhi Liu, Zhixin Yanshan University Key Lab of Industrial Computer Control Engineering of Hebei Province Qinhuangdao066004 China Yanshan University Key Laboratory of Intelligent Rehabilitation and Neuromodulation of Hebei Province Qinhuangdao066004 China Peking University State Key Laboratory for Turbulence and Complex Systems Department of Advanced Manufacturing and Robotics BIC-ESAT College of Engineering Beijing100871 China

This paper investigates the cooperative link configuration problem for Autonomous Underwater Vehicle (AUV) in Underwater Acoustic (UWA) sensor networks with Energy Harvesting (EH), which aims to maximize long-term cumulative capacity by jointly optimizing cooperation relay, AUV transmission power, and relay transmission power. Subject to unknown time-varying Channel state Information (CSI), unpredictable stochastic EH, and variable communication topology caused by AUV mobility, the proposed problem is an unknown dynamic combination decision optimization problem. To resist the change of the dynamic UWA communication topology with unknown time-varying CSI and EH, a novel collaborative contextual multi-armed bandit learning framework is proposed, which allows relay nodes to learn cooperatively and enriches the learning information of relays. Consequently, the proposed learning framework can resist the change of the dynamic UWA communication topology efficiently, thereby achieving the superior link configuration quickly. Besides, a learning-rate adjustment rule for the dynamic UWA communication topology is proposed to adaptively balance the exploration-exploitation, thereby avoiding missing the real superior joint relay-power configuration. Finally, simulation results show the significantly superiority of the proposed scheme. © 2015 IEEE.

关键词： Cooperative communication

来源：评论

学校读者我要写书评

暂无评论

Adaptive Robust Dead-Zone Compensation control of Electro-Hydraulic Servo systems with Load Disturbance Rejection

引用

Journal of systems Science & complexity 2015年第2期28卷 341-359页

作者： HE Yudong WANG Junzheng HAO Renjian Key Laboratory of Intelligent Control and Decision of Complex Systems School of AutomationBeijing Institute of Technology

A backstepping method based adaptive robust dead-zone compensation controller is pro- posed for the electro-hydraulic servo systems （EHSSs） with unknown dead-zone and uncertain system parameters. Variable load is seen as a sum of a constant and a variable part. The constant part is regarded as a parameter of the system to be estimated real time. The variable part together with the friction are seen as disturbance so that a robust term in the controller can be adopted to reject them. Compared with the traditional dead-zone compensation method, a dead-zone compensator is incor- porated in the EH$S without constructing a dead-zone inverse. Combining backstepping method, an adaptive robust controller （ARC） with dead-zone compensation is formed. An easy-to-use ARC tuning method is also proposed after a further analysis of the ARC structure. Simulations show that the proposed method has a splendid tracking performance, all the uncertain parameters can be estimated, and the disturbance has been rejected while the dead-zone term is well estimated and compensated.

关键词： Adaptive robust control dead-zone servo systems tuning method. compensation disturbance rejection electro-hydraulic

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：