检索结果-内蒙古大学图书馆

International Joint Conference on Neural Networks (IJCNN)

作者： Jianbin Jiao Xina Cheng Weijie Chen Xiaoting Yin Hao Shi Kailun Yang School of Artificial Intelligence Xidian University China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as humancomputer interaction, scene understanding, and rehabilitation training. Due to the challenges in data collection, mainstream datasets of 3D human pose estimation are primarily composed of multi-view video data collected in laboratory environments, which contains rich spatial-temporal correlation information besides the image frame content. Given the remarkable selfattention mechanism of transformers, capable of capturing the spatial-temporal correlation from multi-view video datasets, we propose a multi-stage framework for 3D sequence-to-sequence (seq2seq) human pose detection. Firstly, the spatial module represents the human pose feature by intra-image content, while the frame-image relation module extracts temporal relationships and 3D spatial positional relationship features between the multiperspective images. Secondly, the self-attention mechanism is adopted to eliminate the interference from non-human body parts and reduce computing resources. Our method is evaluated on Human3.6M, a popular 3D human pose detection dataset. Experimental results demonstrate that our approach achieves stateof-the-art performance on this dataset. The source code will be available at https://***/WUJINHUAN/3D-human-pose.

关键词： Training Three-dimensional displays Correlation Computational modeling Source coding Pose estimation Video sequences

来源：评论

学校读者我要写书评

暂无评论

SF-TIM: A Simple Framework for Enhancing Quadrupedal robot Jumping Agility by Combining Terrain Imagination and Measurement

arXiv

引用

arXiv 2024年

作者： Wang, Ze Li, Yang Xu, Long Shi, Hao Ma, Zunwang Chu, Zhen Li, Chao Gao, Fei Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University China School of Robotics and National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China State Key Laboratory of Industrial Control Technology Zhejiang University China DeepRobotics Co. Ltd. China

Dynamic jumping on high platforms and over gaps differentiates legged robots from wheeled counterparts. Compared to walking on rough terrains, dynamic locomotion on abrupt surfaces requires fusing proprioceptive and exteroceptive perception for explosive movements. In this paper, we propose SF-TIM (Simple Framework combining Terrain Imagination and Measurement), a single-policy method that enhances quadrupedal robot jumping agility, while preserving their fundamental blind walking capabilities. In addition, we introduce a terrain-guided reward design specifically to assist quadrupedal robots in high jumping, improving their performance in this task. To narrow the simulation-to-reality gap in quadrupedal robot learning, we introduce a stable and high-speed elevation map generation framework, enabling zero-shot simulation-to-reality transfer of locomotion ability. Our algorithm has been deployed and validated on both the small-/large-size quadrupedal robots, demonstrating its effectiveness in real-world applications: the robot has successfully traversed various high platforms and gaps, showing the robustness of our proposed approach. A demo video has been made available at https://***/SF-TIM. Copyright © 2024, The Authors. All rights reserved.

关键词： Multipurpose robots

来源：评论

学校读者我要写书评

暂无评论

Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systems

arXiv

引用

arXiv 2024年

作者： Gao, Yao Jiang, Qi Gao, Shaohua Sun, Lei Yang, Kailun Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China School of Robotics Hunan University Changsha410012 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

Recently, joint design approaches that simultaneously optimize optical systems and downstream algorithms through data-driven learning have demonstrated superior performance over traditional separate design approaches. However, current joint design approaches heavily rely on the manual identification of initial lenses, posing challenges and limitations, particularly for compound lens systems with multiple potential starting points. In this work, we present Quasi-Global Search Optics (QGSO) to automatically design compound lens based computational imaging systems through two parts: (i) Fused Optimization Method for Automatic Optical Design (OptiFusion), which searches for diverse initial optical systems under certain design specifications;and (ii) Efficient Physic-aware Joint Optimization (EPJO), which conducts parallel joint optimization of initial optical systems and image reconstruction networks with the consideration of physical constraints, culminating in the selection of the optimal solution in all search results. Extensive experimental results illustrate that QGSO serves as a transformative end-to-end lens design paradigm for superior global search ability, which automatically provides compound lens based computational imaging systems with higher imaging quality compared to existing paradigms. The source code will be made publicly available at https://***/LiGpy/QGSO. Copyright © 2024, The Authors. All rights reserved.

关键词： Imaging systems

来源：评论

学校读者我要写书评

暂无评论

Towards Source-Free Domain Adaptive Semantic Segmentation Via Importance-Aware and Prototype-Contrast Learning

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-13页

作者： Cao, Yihong Zhang, Hui Lu, Xiao Xiao, Zheng Yang, Kailun Wang, Yaonan College of Computer Science and Electronic Engineering Hunan University Changsha China National Engineering Research Center of Robot Vision Perception and Control Technology School of Robotics Hunan University Changsha China College of Engineering and Design Hunan Normal University Changsha China

Domain adaptive semantic segmentation enables robust pixel- wise understanding in real-world driving scenes. Source-free domain adaptation, as a more practical technique, addresses the concerns of data privacy and storage limitations in typical unsupervised domain adaptation methods, making it especially relevant in the context of intelligent vehicles. It utilizes a well-trained source model and unlabeled target data to achieve adaptation in the target domain. However, in the absence of source data and target labels, current solutions cannot sufficiently reduce the impact of domain shift and fully leverage the information from the target data. In this paper, we propose an end-to-end source-free domain adaptation semantic segmentation method via Importance-Aware and Prototype-Contrast (IAPC) learning. The proposed IAPC framework effectively extracts domain-invariant knowledge from the well-trained source model and learns domain-specific knowledge from the unlabeled target domain. Specifically, considering the problem of domain shift in the prediction of the target domain by the source model, we put forward an importance-aware mechanism for the biased target prediction probability distribution to extract domain-invariant knowledge from the source model. We further introduce a prototype-contrast strategy, which includes a prototype-symmetric cross-entropy loss and a prototype-enhanced cross-entropy loss, to learn target intra-domain knowledge without relying on labels. A comprehensive variety of experiments on two domain adaptive semantic segmentation benchmarks demonstrates that the proposed end-to-end IAPC solution outperforms existing state-of-the-art methods. The source code is publicly available at https://***/yihong-97/Source-free-IAPC. IEEE

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Learning to Learn Transferable Generative Attack for Person Re-Identification

arXiv

引用

arXiv 2024年

作者： Bian, Yuan Liu, Min Wang, Xueping Ma, Yunfeng Wang, Yaonan The College of Electrical and Information Engineering Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology Hunan Changsha China The College of Information Science and Engineering Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing Hunan Changsha China

Deep learning-based person re-identification (re-id) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider cross-dataset and cross-model transferability, ignoring the cross-test capability to perturb models trained in different domains. To powerfully examine the robustness of real-world re-id models, the Meta Transferable Generative Attack (MTGA) method is proposed, which adopts meta-learning optimization to promote the generative attacker producing highly transferable adversarial examples by learning comprehensively simulated transfer-based cross-model&dataset&test black-box meta attack tasks. Specifically, cross-model&dataset black-box attack tasks are first mimicked by selecting different re-id models and datasets for meta-train and meta-test attack processes. As different models may focus on different feature regions, the Perturbation Random Erasing module is further devised to prevent the attacker from learning to only corrupt model-specific features. To boost the attacker learning to possess cross-test transferability, the Normalization Mix strategy is introduced to imitate diverse feature embedding spaces by mixing multi-domain statistics of target models. Extensive experiments show the superiority of MTGA, especially in cross-model&dataset and cross-model&dataset&test attacks, our MTGA outperforms the SOTA methods by 21.5% and 11.3% on mean mAP drop rate, respectively. The code of MTGA will be released after the paper is accepted. Copyright © 2024, The Authors. All rights reserved.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation

arXiv

引用

arXiv 2023年

作者： Lin, Jiacheng Chen, Jiajun Yang, Kailun Roitberg, Alina Li, Siyu Li, Zhiyong Li, Shutao The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Artificial Intelligence The University of Stuttgart Stuttgart70569 Germany The College of Electrical and Information Engineering The Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province Hunan University Changsha410082 China

Interactive Image Segmentation (IIS) has emerged as a promising technique for decreasing annotation time. Substantial progress has been made in pre- and post-processing for IIS, but the critical issue of interaction ambiguity, notably hindering segmentation quality, has been under-researched. To address this, we introduce ADAPTIVECLICK – a click-aware transformer incorporating an adaptive focal loss that tackles annotation inconsistencies with tools for mask- and pixel-level ambiguity resolution. To the best of our knowledge, AdaptiveClick is the first transformer-based, mask-adaptive segmentation framework for IIS. The key ingredient of our method is the Click-Aware Mask-adaptive transformer Decoder (CAMD), which enhances the interaction between click and image features. Additionally, AdaptiveClick enables pixel-adaptive differentiation of hard and easy samples in the decision space, independent of their varying distributions. This is primarily achieved by optimizing a generalized Adaptive Focal Loss (AFL) with a theoretical guarantee, where two adaptive coefficients control the ratio of gradient values for hard and easy pixels. Our analysis reveals that the commonly used Focal and BCE losses can be considered special cases of the proposed AFL. With a plain ViT backbone, extensive experimental results on nine datasets demonstrate the superiority of AdaptiveClick compared to state-of-the-art methods. The source code is publicly available at https://***/lab206/AdaptiveClick. Copyright © 2023, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Reinforcement Learning-based Fault-Tolerant control for Unmanned Aerial Vehicles

Reinforcement Learning-based Fault-Tolerant Control for Unma...

引用

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Guoqi Wang Xudong Wang Yang Li Ziwei Gao Zhaoke Ning National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China State Key Laboratory of Advanced Design and Manufacturing Technology for Vehicle College of Mechanical and Vehicle Engineering Hunan University Changsha China School of Aeronautics and Astronautics Sichuan University Chengdu China

ISBN: (数字)9798350379228

ISBN: (纸本)9798350390780

This paper focuses on the fault-tolerant control (FTC) problem for unmanned aerial vehicles (UAVs) subject to possible multiple actuator failures, which is a tough problem to solve with traditional FTC methods since they usually require accurate mathematical models. To address the limitation of traditional FTC methods, a model-free FTC approach is proposed based on reinforcement learning (RL). Subsequently, the proposed approach is applied to construct fault-tolerant controller for UAVs without any knowledge of the quadrotor dynamic information. Then, an end-to-end control policy that can tolerant actuator failures is obtained, which can map the state of the UAVs directly to the control commands of the four rotors after learning. Finally, the effectiveness of the proposed fault-tolerant approach is demonstrated by using the flexible modular quadrotor simulator.

关键词： Fault tolerance Actuators Trajectory tracking Fault tolerant systems Autonomous aerial vehicles Stability analysis Mathematical models

来源：评论

学校读者我要写书评

暂无评论

Online Parameter Estimation For Uncertain robot Manipulators With Fixed-time Convergence

Online Parameter Estimation For Uncertain Robot Manipulators...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Chengzhi Zhu Yiming Jiang Chenguang Yang Key Laboratory of Autonomous Systems and Networked Control College of Automation Science and Engineering South China University of Technology Guangzhou China National Engineering Laboratory for Robot Visual Perception and Control Hunan University Changsha China Bristol Robotics Laboratory University of the West of England Bristol UK

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

For traditional parameter estimation schemes of uncertain robot, most of them were proposed to identify unknown parameter with desired precision, but few of them focused on the convergence time. Recently finite-time estimation techniques have been proposed by scholars to achieve estimation in finite time. In this paper, we proposed a novel estimation scheme for uncertain robot systems with fixed time instead of finite time. In order to avoid using acceleration signals during the estimation, a kind of auxiliary filtering technique was employed. Besides, a continuous and recursive update law was employed for the parameter estimation such that the computational burdens of real-time inversion of square matrices could be avoided. Finally the effectiveness of the identification algorithm is verified based on a 2-DOF uncertain robot model.

关键词： Parameter estimation Filtering Heuristic algorithms Estimation Real-time systems Manipulator dynamics Convergence

来源：评论

学校读者我要写书评

暂无评论

Stiffness Estimation and Intention Detection for Human-robot Collaboration

Stiffness Estimation and Intention Detection for Human-Robot...

引用

IEEE Conference on Industrial Electronics and Applications (ICIEA)

作者： Xiongjun Chen Yiming Jiang Chenguang Yang Key Laboratory of Autonomous Systems and Networked Control College of Automation Science and Engineering South China University of Technology Guangzhou China National Engineering Laboratory for Robot Visual Perception and Control Hunan University Changsha China Bristol Robotics Laboratory University of the West of England Bristol UK

ISBN: (数字)9781728151694

ISBN: (纸本)9781728151700

In this paper, we propose a stiffness estimation and intention detection method for human-robot collaboration. The human arm endpoint stiffness can be obtained according to the muscle activation levels of the upper arm and the human arm configurations. The estimated endpoint stiffness of human arm is matching to the robot arm joint stiffness through an appropriate mapping. The motion intention of human arm is detected based on the wrist configuration which is recognized by a Myo armband attached at the forearm of the operator. In order to reduce the time of feature engineering to ensure the performance of real-time collaboration, the wrist configuration recognition is realised based on the neural learning algorithm. The sEMG of the human forearm is directly fed into the neural network after processing by filters and sliding windows. The force sensor at the end of the robot arm is embedded in the feedback loop to make the robot arm better adapted to the operator's movement. The results of experiments performed on Baxter robot platform illustrate a good performance and verifies the proposed method.

关键词： Wrist Neural networks Collaboration Estimation robot sensing systems Manipulators robots

来源：评论

学校读者我要写书评

暂无评论

Large Scale Unsupervised Brain MRI Image Registration Solution for Learn2Reg 2024

arXiv

引用

arXiv 2024年

作者： Zhang, Yuxi Chen, Xiang Wang, Jiazheng Liu, Min Wang, Yaonan Liu, Dongdong Hu, Renjiu Zhang, Hang College of Electrical and Information Engineering Hunan University Hunan Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China New York University New York United States Cornell University New York United States

In this paper, we summarize the methods and experimental results we proposed for Task 2 in the learn2reg 2024 Challenge. This task focuses on unsupervised registration of anatomical structures in brain MRI images between different patients. The difficulty lies in: (1) without segmentation labels, and (2) a large amount of data. To address these challenges, we built an efficient backbone network and explored several schemes to further enhance registration accuracy. Under the guidance of the NCC loss function and smoothness regularization loss function, we obtained a smooth and reasonable deformation field. According to the leaderboard, our method achieved a Dice coefficient of 77.34%, which is 1.4% higher than the TransMorph. Overall, we won second place on the leaderboard for Task 2. Copyright © 2024, The Authors. All rights reserved.

关键词： Image registration

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：