检索结果-内蒙古大学图书馆

Towards Consistent Object Detection via LiDAR-Camera Synergy

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Luo, Kai Wu, Hao Yi, Kefu Yang, Kailun Hao, Wei Hu, Rongdong School of Traffic and Transportation Engineering Changsha University of Science and Technology China College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object’s position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object’s position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits excellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

Towards Consistent Object Detection via LiDAR-Camera Synergy

学校读者我要写书评

暂无评论

Towards Consistent Object Detection via LiDAR-Camera Synergy

IEEE International Conference on Systems, Man and Cybernetics

作者： Kai Luo Hao Wu Kefu Yi Kailun Yang Wei Hao Rongdong Hu College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Traffic and Transportation Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object's position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object's position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits ex-cellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD.

关键词： Point cloud compression Human computer interaction Measurement Accuracy Correlation Source coding Instruments Object detection Robustness Inference algorithms

SF-TIM: A Simple Framework for Enhancing Quadrupedal robot Jumping Agility by Combining Terrain Imagination and Measurement

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Ze Li, Yang Xu, Long Shi, Hao Ma, Zunwang Chu, Zhen Li, Chao Gao, Fei Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University China School of Robotics and National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China State Key Laboratory of Industrial Control Technology Zhejiang University China DeepRobotics Co. Ltd. China

Dynamic jumping on high platforms and over gaps differentiates legged robots from wheeled counterparts. Compared to walking on rough terrains, dynamic locomotion on abrupt surfaces requires fusing proprioceptive and exteroceptive perception for explosive movements. In this paper, we propose SF-TIM (Simple Framework combining Terrain Imagination and Measurement), a single-policy method that enhances quadrupedal robot jumping agility, while preserving their fundamental blind walking capabilities. In addition, we introduce a terrain-guided reward design specifically to assist quadrupedal robots in high jumping, improving their performance in this task. To narrow the simulation-to-reality gap in quadrupedal robot learning, we introduce a stable and high-speed elevation map generation framework, enabling zero-shot simulation-to-reality transfer of locomotion ability. Our algorithm has been deployed and validated on both the small-/large-size quadrupedal robots, demonstrating its effectiveness in real-world applications: the robot has successfully traversed various high platforms and gaps, showing the robustness of our proposed approach. A demo video has been made available at https://***/SF-TIM. Copyright © 2024, The Authors. All rights reserved.

关键词： Multipurpose robots

Learning to Learn Transferable Generative Attack for Person Re-Identification

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Bian, Yuan Liu, Min Wang, Xueping Ma, Yunfeng Wang, Yaonan The College of Electrical and Information Engineering Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology Hunan Changsha China The College of Information Science and Engineering Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing Hunan Changsha China

Deep learning-based person re-identification (re-id) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider cross-dataset and cross-model transferability, ignoring the cross-test capability to perturb models trained in different domains. To powerfully examine the robustness of real-world re-id models, the Meta Transferable Generative Attack (MTGA) method is proposed, which adopts meta-learning optimization to promote the generative attacker producing highly transferable adversarial examples by learning comprehensively simulated transfer-based cross-model&dataset&test black-box meta attack tasks. Specifically, cross-model&dataset black-box attack tasks are first mimicked by selecting different re-id models and datasets for meta-train and meta-test attack processes. As different models may focus on different feature regions, the Perturbation Random Erasing module is further devised to prevent the attacker from learning to only corrupt model-specific features. To boost the attacker learning to possess cross-test transferability, the Normalization Mix strategy is introduced to imitate diverse feature embedding spaces by mixing multi-domain statistics of target models. Extensive experiments show the superiority of MTGA, especially in cross-model&dataset and cross-model&dataset&test attacks, our MTGA outperforms the SOTA methods by 21.5% and 11.3% on mean mAP drop rate, respectively. The code of MTGA will be released after the paper is accepted. Copyright © 2024, The Authors. All rights reserved.

关键词： Generative adversarial networks

Reinforcement Learning-based Fault-Tolerant control for Unmanned Aerial Vehicles

学校读者我要写书评

暂无评论

Reinforcement Learning-based Fault-Tolerant Control for Unma...

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Guoqi Wang Xudong Wang Yang Li Ziwei Gao Zhaoke Ning National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China State Key Laboratory of Advanced Design and Manufacturing Technology for Vehicle College of Mechanical and Vehicle Engineering Hunan University Changsha China School of Aeronautics and Astronautics Sichuan University Chengdu China

ISBN: (数字)9798350379228

ISBN: (纸本)9798350390780

This paper focuses on the fault-tolerant control (FTC) problem for unmanned aerial vehicles (UAVs) subject to possible multiple actuator failures, which is a tough problem to solve with traditional FTC methods since they usually require accurate mathematical models. To address the limitation of traditional FTC methods, a model-free FTC approach is proposed based on reinforcement learning (RL). Subsequently, the proposed approach is applied to construct fault-tolerant controller for UAVs without any knowledge of the quadrotor dynamic information. Then, an end-to-end control policy that can tolerant actuator failures is obtained, which can map the state of the UAVs directly to the control commands of the four rotors after learning. Finally, the effectiveness of the proposed fault-tolerant approach is demonstrated by using the flexible modular quadrotor simulator.

关键词： Fault tolerance Actuators Trajectory tracking Fault tolerant systems Autonomous aerial vehicles Stability analysis Mathematical models

Learning compliant grasping and manipulation by teleoperation with adaptive force control

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zeng, Chao Li, Shuang Jiang, Yiming Li, Qiang Chen, Zhaopeng Yang, Chenguang Zhang, Jianwei Department of Informatics Universiẗat Hamburg Germany National Engineering Laboratory for Robot Visual Perception and Control Hunan University China Center for Cognitive Interaction Technology Bielefeld University Germany Bristol Robotics Laboratory University of the West of England United Kingdom

In this work, we focus on improving the robot's dexterous capability by exploiting visual sensing and adaptive force control. TeachNet, a vision-based teleoperation learning framework, is exploited to map human hand postures to a multifingered robot hand. We augment TeachNet, which is originally based on an imprecise kinematic mapping and position-only servoing, with a biomimetic learning-based compliance control algorithm for dexterous manipulation tasks. This compliance controller takes the mapped robotic joint angles from TeachNet as the desired goal, computes the desired joint torques. It is derived from a computational model of the biomimetic control strategy in human motor learning, which allows adapting the control variables (impedance and feedforward force) online during the execution of the reference joint angle trajectories. The simultaneous adaptation of the impedance and feedforward profiles enables the robot to interact with the environment in a compliant manner. Our approach has been verified in multiple tasks in physics simulation, i.e., grasping, opening-a-door, turning-a-cap, and touching-a-mouse, and has shown more reliable performances than the existing position control and the fixed-gain-based force control approaches. Copyright © 2021, The Authors. All rights reserved.

关键词： Remote control

AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Lin, Jiacheng Chen, Jiajun Yang, Kailun Roitberg, Alina Li, Siyu Li, Zhiyong Li, Shutao The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Artificial Intelligence The University of Stuttgart Stuttgart70569 Germany The College of Electrical and Information Engineering The Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province Hunan University Changsha410082 China

Interactive Image Segmentation (IIS) has emerged as a promising technique for decreasing annotation time. Substantial progress has been made in pre- and post-processing for IIS, but the critical issue of interaction ambiguity, notably hindering segmentation quality, has been under-researched. To address this, we introduce ADAPTIVECLICK – a click-aware transformer incorporating an adaptive focal loss that tackles annotation inconsistencies with tools for mask- and pixel-level ambiguity resolution. To the best of our knowledge, AdaptiveClick is the first transformer-based, mask-adaptive segmentation framework for IIS. The key ingredient of our method is the Click-Aware Mask-adaptive transformer Decoder (CAMD), which enhances the interaction between click and image features. Additionally, AdaptiveClick enables pixel-adaptive differentiation of hard and easy samples in the decision space, independent of their varying distributions. This is primarily achieved by optimizing a generalized Adaptive Focal Loss (AFL) with a theoretical guarantee, where two adaptive coefficients control the ratio of gradient values for hard and easy pixels. Our analysis reveals that the commonly used Focal and BCE losses can be considered special cases of the proposed AFL. With a plain ViT backbone, extensive experimental results on nine datasets demonstrate the superiority of AdaptiveClick compared to state-of-the-art methods. The source code is publicly available at https://***/lab206/AdaptiveClick. Copyright © 2023, The Authors. All rights reserved.

关键词： Pixels

Large Scale Unsupervised Brain MRI Image Registration Solution for Learn2Reg 2024

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yuxi Chen, Xiang Wang, Jiazheng Liu, Min Wang, Yaonan Liu, Dongdong Hu, Renjiu Zhang, Hang College of Electrical and Information Engineering Hunan University Hunan Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China New York University New York United States Cornell University New York United States

In this paper, we summarize the methods and experimental results we proposed for Task 2 in the learn2reg 2024 Challenge. This task focuses on unsupervised registration of anatomical structures in brain MRI images between different patients. The difficulty lies in: (1) without segmentation labels, and (2) a large amount of data. To address these challenges, we built an efficient backbone network and explored several schemes to further enhance registration accuracy. Under the guidance of the NCC loss function and smoothness regularization loss function, we obtained a smooth and reasonable deformation field. According to the leaderboard, our method achieved a Dice coefficient of 77.34%, which is 1.4% higher than the TransMorph. Overall, we won second place on the leaderboard for Task 2. Copyright © 2024, The Authors. All rights reserved.

关键词： Image registration

MATErobot: Material Recognition in Wearable robotics for People with visual Impairments

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zheng, Junwei Zhang, Jiaming Yang, Kailun Peng, Kunyu Stiefelhagen, Rainer The Institute for Robotics and Anthropomatics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Department of Engineering Science University of Oxford OxfordOX1 3PJ United Kingdom The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

People with visual Impairments (PVI) typically recognize objects through haptic perception. Knowing objects and materials before touching is desired by the target users but under-explored in the field of human-centered robotics. To fill this gap, in this work, a wearable vision-based robotic system, MATErobot, is established for PVI to recognize materials and object categories beforehand. To address the computational constraints of mobile platforms, we propose a lightweight yet accurate model MATEViT to perform pixel-wise semantic segmentation, simultaneously recognizing both objects and materials. Our methods achieve respective 40.2% and 51.1% of mIoU on COCOStuff-10K and DMS datasets, surpassing the previous method with +5.7% and +7.0% gains. Moreover, on the field test with participants, our wearable system reaches a score of 28 in the NASA-Task Load Index, indicating low cognitive demands and ease of use. Our MATErobot demonstrates the feasibility of recognizing material property through visual cues and offers a promising step towards improving the functionality of wearable robots for PVI. The source code has been made publicly available at MATErobot. Copyright © 2023, The Authors. All rights reserved.

关键词： NASA