检索结果-内蒙古大学图书馆

Obstacle-Avoidance Motion Planning Method of Manipulator Based on Deep Reinforcement Learning

Unmanned systems 2025年

作者： Liu, Yiyang Wu, Defan Fu, Yukai Bai, Hongfei Deng, Chao State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Key Laboratory of Networked Control Systems Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110169 China University of Chinese Academy of Sciences Beijing100049 China Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210023 China

In recent years, driven by the rapid advancement of industrial automation and intelligent manufacturing, the demand for manipulators to perform tasks in complex environments has significantly increased. Traditional motion planning methods face challenges of computational complexity and lack of adaptability when handling robots with redundant degrees of freedom. To address these issues, this paper proposes a novel obstacle avoidance motion planning method for manipulators based on deep reinforcement learning (DRL), which is especially important when unmanned systems operate in a GPS-free environment. The primary contributions are twofold: (i) we propose an innovative algorithm, termed PPO-HER, which incorporates hindsight experience replay (HER) into proximal policy optimization (PPO) during training, effectively leveraging failed experiences to enhance policy learning efficiency;(ii) an adaptive action exploration strategy is designed to accelerate training convergence and avoid local optima. Experimental results demonstrate that the PPO-HER algorithm and the adaptive action exploration strategy perform exceptionally well across three environments of varying difficulty, significantly improving network training speed and success rates, shortening planned paths, and enhancing autonomous obstacle avoidance capabilities. These findings provide new ideas for target location and tracking of unmanned systems, and lay the foundation for future learning and data-driven approaches in complex environments. © World Scientific Publishing Company.

关键词： Deep reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

An online learning model residual method for force control of hydraulic driven joint

引用

Expert systems with Applications 2025年 285卷

作者： Ma, Rui Tao, Zhengguo Yu, Haoyang Li, Xu Feng, Haibo Fu, Yili State Key Laboratory of Robotics and Systems Harbin Institute of Technology Heilongjiang Harbin150000 China

Force control forms the foundation for achieving dexterous motion in hydraulic robots. Tracking the desired force with high accuracy and responsiveness faces persistent challenges from the nonlinearities of the valve-controlled cylinder system, as well as model inaccuracies due to model-plant mismatch, time-varying disturbances, and unmodeled effects. An input–output feedback linearization-based proportional–integral(PI) controller is introduced to globally linearize the nonlinear dynamics and track the desired force. This controller is augmented with an online learning algorithm that fits the residuals between the nominal model and the actual plant to compensate for model inaccuracies. Additionally, current dither is introduced in the current loop control. Current dither effectively reduces spool startup friction, enhances spool dynamic response, and minimizes pressure hysteresis, thereby improving overall force control responsiveness performance. We validate these methods through comparisons with state-of-the-art approaches in terms of sinusoidal and step signal responses using simulations and a single joint testbed. The results demonstrate a 57% of the rise time improvement in step responses. This work advances hydraulic force control by synergizing model-based control with data-driven online adaptation, offering a deployable solution for high-dynamic robotic applications. © 2025 Elsevier Ltd

关键词： Hydraulic drives

来源：评论

学校读者我要写书评

暂无评论

Acceleration-level coordinated control of a dual-arm free-floating space robot under hard joint constraints

引用

Advances in Space Research 2025年第11期75卷 8122-8139页

作者： Xue, Zhihui Liu, Jinguo Zhang, Xin Zhou, Hao Li, Yangmin State Key Laboratory of Robotics Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China University of Chinese Academy of Sciences Beijing100049 China Department of Industrial and Systems Engineering The Hong Kong Polytechnic University Kowloon999077 Hong Kong School of Electrical and Mechanical Engineering University of Portsmouth PortsmouthPO1 3DJ United Kingdom

Dual-arm space robots are becoming increasingly crucial in on-orbit servicing missions. The online motion control of a dual-arm redundant space robot with hard joint constraints presents significant challenges due to its free-floating base. In this article, we proposed an acceleration-level coordinated control framework to solve hard joint constraints and dynamic singularity. The proposed framework combines a task scheduling strategy to achieve saturation in the null space, so that different tasks can achieve trajectory tracking with minimal task scaling under given joint hard constraints. The framework can achieve efficient online control by sequentially abandoning the use of joints that exceed the joint constraint and reintroducing these commands at their saturation level by projecting them into the appropriate null space. Finally, we verify the tracking performance of the algorithm through numerical simulation and experimental research. By comparing the proposed algorithm with the quadratic programming and pseudo-inverse methods, the algorithm has shown excellent online motion control performance, with a computation time of approximately 1 ms within a single sampling period. © 2025 COSPAR

关键词： Quadratic programming

来源：评论

学校读者我要写书评

暂无评论

Electric Vehicle Routing Problem with Capacitated Charging Stations and Dynamic Electricity Prices

引用

IEEE Internet of Things Journal 2025年

作者： He, Zhiye Tian, Yuning Miao, Haoyu Yao, Canqi Yang, Zaiyue Shenzhen Key Laboratory of Control Theory and Intelligent Systems Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities School of System Design and Intelligent Manufacturing Shenzhen518055 China The Hong Kong Polytechnic University Department of Logistics and Maritime Studies Hong Kong Hong Kong

With rapid electrification of transportation systems in recent years, the electric vehicle routing problem (EVRP) has received increasing attention. In order to serve a set of valuable transportation tasks using a fleet of electric vehicles, EVRP intends to jointly determine their routes and the charging schedules, with the aim of optimizing service reward and charging cost under state of charge (SOC) constraints of battery. EVRP is a difficult nonlinear integer program, and due to its intrinsic NP-hardness early EVRP studies often oversimplify the charging process and assume unlimited capacity of charging stations and constant electricity price. The contribution of this paper lies in twofold. First, to better characterize the practical charging process, this paper introduces a new graph model that can take the charging station capacity and dynamic electricity price into full consideration. Second, we design a series of transformation techniques, including reformulation SOC dynamics, Lagrangian relaxation, exact linear programming relaxation, etc, which eventually convert the original EVRP into an approximate linear program. Extensive simulations across 14 instances demonstrate that, the proposed approach is capable of solving large-scale instances over 500 nodes, and is 100 times faster than traditional analytic methods while achieving very close optimality. While comparing with the popular heuristic method ALNS (Adaptive Large Neighborhood Search), our method is several times faster and obtains much better optimality. © 2014 IEEE.

关键词： Charging stations

来源：评论

学校读者我要写书评

暂无评论

AI Enabled Automatic Mobile Robot Intelligent Navigation in Construction with Obstacle Awareness

引用

IEEE Transactions on Automation Science and Engineering 2025年

作者： Zhang, Yinlong Liu, Yuanhao Cui, Yunge Zeng, Ziming Liang, Wei Chinese Academy of Sciences State Key Laboratory of Robotics Shenyang Institute of Automation Shenyang110016 China Chinese Academy of Sciences Key Laboratory of Networked Control Systems Shenyang110016 China University of Chinese Academy of Sciences Beijing101408 China Zeekr Group Zeekr Intelligent Driving Department Shanghai110078 China Shenzhen Polytechnic University School of Automotive and Transportation Engineering Shenzhen518055 China

In the construction industry, the integration of artificial intelligence (AI) and robotics has led to significant advancements in automating various tasks. One critical aspect is the intelligent navigation of automatic mobile robot (AMR) within construction sites, where dynamic environments pose challenges such as inaccurate robot state estimation, irregular and textureless obstacle detection. To solve these issues, this paper designs an AI enabled obstacle-aware AMR intelligent navigation approach while ensuring robot safety and efficiency. Specifically, the robot is equipped with the complementary RGB camera, inertial measurement unit (IMU) and wheel encoder to estimate the states (i.e., positions, orientations and velocities), which have been tightly fused in the optimization framework. Furthermore, the RGB-Depth images are jointly fed into the AI model. It combines of Mask-RCNN and multi-scale attention network, to detect and segment the obstacles, and estimate the corresponding relative depth. It should be noted that the system incorporates obstacle awareness mechanisms to dynamically switch the robot's velocities in response to obstacles in the environment, ensuring smooth and collision-free movement. Experimental results demonstrate the effectiveness and robustness of the proposed AI-enabled navigation system in real-world construction scenarios, showcasing its potential to enhance productivity and safety in construction automation. © 2004-2012 IEEE.

关键词： Construction industry

来源：评论

学校读者我要写书评

暂无评论

Compliance while resisting: a shear-thickening fluid controller for physical human-robot interaction

arXiv

引用

arXiv 2025年

作者： Chen, Lu Chen, Lipeng Chen, Xiangchi Lu, Haojian Zheng, Yu Wu, Jun Wang, Yue Zhang, Zhengyou Xiong, Rong State Key Laboratory of Industrial Control Technology Zhejiang University Zhejiang Hangzhou China Tencent Robotics X Lab Shenzhen China

Physical human-robot interaction (pHRI) is widely needed in many fields, such as industrial manipulation, home services, and medical rehabilitation, and puts higher demands on the safety of robots. Due to the uncertainty of the working environment, the pHRI may receive unexpected impact interference, which affects the safety and smoothness of the task execution. The commonly used linear admittance control (L-AC) can cope well with high-frequency small-amplitude noise, but for medium-frequency high-intensity impact, the effect is not as good. Inspired by the solid-liquid phase change nature of shear-thickening fluid, we propose a Shear-thickening Fluid control (SFC) that can achieve both an easy human-robot collaboration and resistance to impact interference. The SFC’s stability, passivity, and phase trajectory are analyzed in detail, the frequency and time domain properties are quantified, and parameter constraints in discrete control and coupled stability conditions are provided. We conducted simulations to compare the frequency and time domain characteristics of L-AC, nonlinear admittance controller (N-AC), and SFC, and validated their dynamic properties. In real-world experiments, we compared the performance of L-AC, N-AC, and SFC in both fixed and mobile manipulators. L-AC exhibits weak resistance to impact. N-AC can resist moderate impacts but not high-intensity ones, and may exhibit self-excited oscillations. In contrast, SFC demonstrated superior impact resistance and maintained stable collaboration, enhancing comfort in cooperative water delivery tasks. Additionally, a case study was conducted in a factory setting, further affirming the SFC’s capability in facilitating human-robot collaborative manipulation and underscoring its potential in industrial applications. Copyright © 2025, The Authors. All rights reserved.

关键词： Industrial robots

来源：评论

学校读者我要写书评

暂无评论

Contextual Multi-Armed Bandit-Based Dynamic Cooperative Link Configuration for AUV in UWASNs With Energy Harvesting

引用

IEEE Transactions on Cognitive Communications and Networking 2025年

作者： Dai, Jun Li, Xinbin Han, Song Yu, Junzhi Liu, Zhixin Yanshan University Key Lab of Industrial Computer Control Engineering of Hebei Province Qinhuangdao066004 China Yanshan University Key Laboratory of Intelligent Rehabilitation and Neuromodulation of Hebei Province Qinhuangdao066004 China Peking University State Key Laboratory for Turbulence and Complex Systems Department of Advanced Manufacturing and Robotics BIC-ESAT College of Engineering Beijing100871 China

This paper investigates the cooperative link configuration problem for Autonomous Underwater Vehicle (AUV) in Underwater Acoustic (UWA) sensor networks with Energy Harvesting (EH), which aims to maximize long-term cumulative capacity by jointly optimizing cooperation relay, AUV transmission power, and relay transmission power. Subject to unknown time-varying Channel state Information (CSI), unpredictable stochastic EH, and variable communication topology caused by AUV mobility, the proposed problem is an unknown dynamic combination decision optimization problem. To resist the change of the dynamic UWA communication topology with unknown time-varying CSI and EH, a novel collaborative contextual multi-armed bandit learning framework is proposed, which allows relay nodes to learn cooperatively and enriches the learning information of relays. Consequently, the proposed learning framework can resist the change of the dynamic UWA communication topology efficiently, thereby achieving the superior link configuration quickly. Besides, a learning-rate adjustment rule for the dynamic UWA communication topology is proposed to adaptively balance the exploration-exploitation, thereby avoiding missing the real superior joint relay-power configuration. Finally, simulation results show the significantly superiority of the proposed scheme. © 2015 IEEE.

关键词： Cooperative communication

来源：评论

学校读者我要写书评

暂无评论

Global Convergence of Continual Learning on Non-IID Data

arXiv

引用

arXiv 2025年

作者： Zhu, Fei Liu, Yujing Liu, Wenzhuo Zhang, Zhaoxiang Centre for Artificial Intelligence and Robotics Hong Kong Institute of Science & Innovation CAS Hong Kong Key Laboratory of Systems and Control Academy of Mathematics and Systems Science CAS China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation CAS China School of Artificial Intelligence University of Chinese Academy of Sciences China

Continual learning, which aims to learn multiple tasks sequentially, has gained extensive attention. However, most existing work focuses on empirical studies, and the theoretical aspect remains under-explored. Recently, a few investigations have considered the theory of continual learning only for linear regressions, establishes the results based on the strict independent and identically distributed (i.i.d.) assumption and the persistent excitation on the feature data that may be difficult to verify or guarantee in practice. To overcome this fundamental limitation, in this paper, we provide a general and comprehensive theoretical analysis for continual learning of regression models. By utilizing the stochastic Lyapunov function and martingale estimation techniques, we establish the almost sure convergence results of continual learning under a general data condition for the first time. Additionally, without any excitation condition imposed on the data, the convergence rates for the forgetting and regret metrics are provided. Copyright © 2025, The Authors. All rights reserved.

关键词： Federated learning

来源：评论

学校读者我要写书评

暂无评论

Predictor-Based Time Delay control of A Hex-Jet Unmanned Aerial Vehicle

arXiv

引用

arXiv 2025年

作者： Liang, Junning Zheng, Haowen Zhang, Yuying Gao, Yongzhuo Dong, Wei Lyu, Ximin School of Intelligent Systems Engineering Sun Yat-sen University Guangzhou China State Key Laboratory of Robotics and Systems Harbin Institute of Technology Harbin China

Turbojet-powered VTOL UAVs have garnered increased attention in heavy-load transport and emergency services, due to their superior power density and thrust-to-weight ratio compared to existing electronic propulsion systems. The main challenge with jet-powered UAVs lies in the complexity of thrust vectoring mechanical systems, which aim to mitigate the slow dynamics of the turbojet. In this letter, we introduce a novel turbojet-powered UAV platform named Hex-Jet. Our concept integrates thrust vectoring and differential thrust for comprehensive attitude control. This approach notably simplifies the thrust vectoring mechanism. We utilize a predictor-based time delay control method based on the frequency domain model in our Hex-Jet controller design to mitigate the delay in roll attitude control caused by turbojet dynamics. Our comparative studies provide valuable insights for the UAV community, and flight tests on the scaled prototype demonstrate the successful implementation and verification of the proposed predictor-based time delay control technique. Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

Design and Performance Analysis of a Series-Parallel Self-Aligning Index Finger Exoskeleton

引用

IEEE robotics and Automation Letters 2025年第6期10卷 6456-6463页

作者： Sun, Ning Wang, Zelong Cheng, Long Li, Houcheng Niu, Ben Sun, Xijin Li, Ke Shandong Normal University School of Information Science and Engineering Jinan China Chinese Academy of Sciences State Key Laboratory of Management and Control for Complex Systems Institute of Automation Beijing China University of Chinese Academy of Sciences School of Artificial Intelligence Beijing China Shandong University Institute of Intelligent Medical Engineering School of Control Science and Engineering Jinan China

Hand exoskeletons have become increasingly crucial for the rehabilitation of hand function, as relevant studies have shown that using the exoskeletons to assist in rehabilitation training can improve hand motor function. However, developing a human-robot kinematic compatibility exoskeleton while providing sufficient assistance torque is still a challenge. This paper develops a series-parallel self-aligning index finger exoskeleton to assist the index finger in flexion/extension and adduction/abduction training. A series-parallel mechanism driven by two motors simultaneously was proposed for the metacarpophalangeal (MCP) joint, which can ensure human-robot joint axes self-alignment and increase the joint assistance torque. A kinematic compatibility analysis method was proposed, and the kinematic compatibility of the series-parallel mechanism was analyzed. The degrees of freedom and forward kinematics of the proposed mechanism were analyzed, and its workspace was calculated, which results show that the motion range of the MCP joint can meet the grasping training requirements. Preliminary experiments were carried out, and the results indicate that the motion trajectory coefficients of the marker points at the MCP, PIP, and DIP joints averaged for all subjects with and without the proposed exoskeleton are 0.993, 0.956, and 0.939, respectively, which can verify the kinematic transparency of the proposed mechanism. The assistance torque generated by the proposed mechanism on the MCP joint can meet the joint assistance torque requirements. In a word, the proposed exoskeleton can achieve flexion/extension and adduction/abduction training, human-robot joint axes self-alignment, and provide sufficient assistance torque. © 2016 IEEE.

关键词： Exoskeleton (robotics)

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：