检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Lin, Jiacheng Chen, Jiajun Yang, Kailun Roitberg, Alina Li, Siyu Li, Zhiyong Li, Shutao The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Artificial Intelligence The University of Stuttgart Stuttgart70569 Germany The College of Electrical and Information Engineering The Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province Hunan University Changsha410082 China

Interactive Image Segmentation (IIS) has emerged as a promising technique for decreasing annotation time. Substantial progress has been made in pre- and post-processing for IIS, but the critical issue of interaction ambiguity, notably hindering segmentation quality, has been under-researched. To address this, we introduce ADAPTIVECLICK – a click-aware transformer incorporating an adaptive focal loss that tackles annotation inconsistencies with tools for mask- and pixel-level ambiguity resolution. To the best of our knowledge, AdaptiveClick is the first transformer-based, mask-adaptive segmentation framework for IIS. The key ingredient of our method is the Click-Aware Mask-adaptive transformer Decoder (CAMD), which enhances the interaction between click and image features. Additionally, AdaptiveClick enables pixel-adaptive differentiation of hard and easy samples in the decision space, independent of their varying distributions. This is primarily achieved by optimizing a generalized Adaptive Focal Loss (AFL) with a theoretical guarantee, where two adaptive coefficients control the ratio of gradient values for hard and easy pixels. Our analysis reveals that the commonly used Focal and BCE losses can be considered special cases of the proposed AFL. With a plain ViT backbone, extensive experimental results on nine datasets demonstrate the superiority of AdaptiveClick compared to state-of-the-art methods. The source code is publicly available at https://***/lab206/AdaptiveClick. Copyright © 2023, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priors

arXiv

引用

arXiv 2025年

作者： Li, Siyu Cao, Yihong Shi, Hao Zang, Yongsheng He, Xuan Yang, Kailun Li, Zhiyong School of Robotics the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China College of Computer Science and Electronic Engineering Hunan University Changsha410082 China Hunan Vanguard Group Corporation Limited Changsha410100 China

The exploration of Bird’s-Eye View (BEV) mapping technology has driven significant innovation in visual perception technology for autonomous driving. BEV mapping models need to be applied to the unlabeled real world, making the study of unsupervised domain adaptation models an essential path. However, research on unsupervised domain adaptation for BEV mapping remains limited and cannot perfectly accommodate all BEV mapping tasks. To address this gap, this paper proposes HierDAMap, a universal and holistic BEV domain adaptation framework with hierarchical perspective priors. Unlike existing research that solely focuses on image-level learning using prior knowledge, this paper explores the guiding role of perspective prior knowledge across three distinct levels: global, sparse, and instance levels. With these priors, HierDA consists of three essential components, including Semantic-Guided Pseudo Supervision (SGPS), Dynamic-Aware Coherence Learning (DACL), and Cross-Domain Frustum Mixing (CDFM). SGPS constrains the cross-domain consistency of perspective feature distribution through pseudo labels generated by vision foundation models in 2D space. To mitigate feature distribution discrepancies caused by spatial variations, DACL employs uncertainty-aware predicted depth as an intermediary to derive dynamic BEV labels from perspective pseudo-labels, thereby constraining the coarse BEV features derived from corresponding perspective features. CDFM, on the other hand, leverages perspective masks of view frustum to mix multi-view perspective images from both domains, which guides cross-domain view transformation and encoding learning through mixed BEV labels. Furthermore, this paper introduces intra-domain feature exchange data augmentation to enhance the efficiency of domain adaptation learning. The proposed method is verified on multiple BEV mapping tasks, such as BEV semantic segmentation, high-definition semantic, and vectorized mapping. It demonstrates competitive perfo

关键词： Birds

来源：评论

学校读者我要写书评

暂无评论

PanoVpr: Towards Unified Perspective-to-Equirectangular visual Place Recognition via Sliding Windows Across the Panoramic View

PanoVpr: Towards Unified Perspective-to-Equirectangular Visu...

引用

International Conference on Intelligent Transportation

作者： Ze Shi Hao Shi Kailun Yang Zhe Yin Yining Lin Kaiwei Wang State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China Shanghai SUPREMIND Technology Co. Ltd Shanghai China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China

visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR.

关键词：

来源：评论

学校读者我要写书评

暂无评论

OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation

arXiv

引用

arXiv 2023年

作者： Teng, Fei Zhang, Jiaming Peng, Kunyu Wang, Yaonan Stiefelhagen, Rainer Yang, Kailun The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Institute for Visual Computing ETH Zurich Zurich8092 Switzerland

Light field cameras are capable of capturing intricate angular and spatial details. This allows for acquiring complex light patterns and details from multiple angles, significantly enhancing the precision of image semantic segmentation. However, two significant issues arise: (1) The extensive angular information of light field cameras contains a large amount of redundant data, which is overwhelming for the limited hardware resources of intelligent agents. (2) A relative displacement difference exists in the data collected by different micro-lenses. To address these issues, we propose an Omni-Aperture Fusion model (OAFuser) that leverages dense context from the central view and extracts the angular information from sub-aperture images to generate semantically consistent results. To simultaneously streamline the redundant information from the light field cameras and avoid feature loss during network propagation, we present a simple yet very effective Sub-Aperture Fusion Module (SAFM). This module efficiently embeds sub-aperture images in angular features, allowing the network to process each sub-aperture image with a minimal computational demand of only (∼1GFlops). Furthermore, to address the mismatched spatial information across viewpoints, we present a Center Angular Rectification Module (CARM) to realize feature resorting and prevent feature occlusion caused by misalignment. The proposed OAFuser achieves state-of-the-art performance on four UrbanLF datasets in terms of all evaluation metrics and sets a new record of 84.93% in mIoU on the UrbanLF-Real Extended dataset, with a gain of +3.69%. The source code for OAFuser is available at https://***/FeiBryantkit/OAFuser. Impact Statement-To solve the data abundance problem, we have reduced the significant computational consumption of light field cameras while not introducing any additional parameters. The proposed method has practical value for the deployment and application of light field cameras. The proposed

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Large Scale Unsupervised Brain MRI Image Registration Solution for Learn2Reg 2024

arXiv

引用

arXiv 2024年

作者： Zhang, Yuxi Chen, Xiang Wang, Jiazheng Liu, Min Wang, Yaonan Liu, Dongdong Hu, Renjiu Zhang, Hang College of Electrical and Information Engineering Hunan University Hunan Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China New York University New York United States Cornell University New York United States

In this paper, we summarize the methods and experimental results we proposed for Task 2 in the learn2reg 2024 Challenge. This task focuses on unsupervised registration of anatomical structures in brain MRI images between different patients. The difficulty lies in: (1) without segmentation labels, and (2) a large amount of data. To address these challenges, we built an efficient backbone network and explored several schemes to further enhance registration accuracy. Under the guidance of the NCC loss function and smoothness regularization loss function, we obtained a smooth and reasonable deformation field. According to the leaderboard, our method achieved a Dice coefficient of 77.34%, which is 1.4% higher than the TransMorph. Overall, we won second place on the leaderboard for Task 2. Copyright © 2024, The Authors. All rights reserved.

关键词： Image registration

来源：评论

学校读者我要写书评

暂无评论

Towards Consistent Object Detection via LiDAR-Camera Synergy

arXiv

引用

arXiv 2024年

作者： Luo, Kai Wu, Hao Yi, Kefu Yang, Kailun Hao, Wei Hu, Rongdong School of Traffic and Transportation Engineering Changsha University of Science and Technology China College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object’s position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object’s position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits excellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Single-Leader-Dual-Follower Teleoperation in Object-Holding Task with Internal Force Regulation 26

Single-Leader-Dual-Follower Teleoperation in Object-Holding ...

引用

26th International Conference on Automation and Computing, ICAC 2021

作者： Huang, Darong Jiang, Yiming Yang, Chenguang South China University of Technology School of Automation Science and Engineering Guangzhou510641 China Hunan University National Engineering Laboratory for Robot Visual Perception and Control Changsha410082 China University of the West of England Bristol Robotics Laboratory BristolBS16 1QY United Kingdom

ISBN: (纸本)9781860435577

robot teleoperation attracts growing attention of researchers in many domains. Plenty of factors contribute to the good performance of a smart teleoperation system, and one crucial factor is that it provides an environmental feedback for the operator. Hence, in this paper, we offer a solution to help operator to perceive the contact force of the tele-robot. In addition, we introduce a strategy to cooperatively teleoperate two follower robots by using only single leader1 robot, which helps to reduce the control burden for the operator, as well as enables the teleoperation system to avoid the problem caused by the mismatched degree of freedom (DoF). Moreover, an impedance model based technique is employed to regulate the holding internal force during object-holding tasks. Experiments are conducted gradually, using a Touch X device as the leader robot and two arms of the Baxter robot as the tele-robots. Experimental results validate the feasibility of the proposed teleoperation system. © 2021 Chinese Automation and Computing Society in the UK-CACSUK.

关键词： Remote control

来源：评论

学校读者我要写书评

暂无评论

Towards Consistent Object Detection via LiDAR-Camera Synergy

Towards Consistent Object Detection via LiDAR-Camera Synergy

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Kai Luo Hao Wu Kefu Yi Kailun Yang Wei Hao Rongdong Hu College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Traffic and Transportation Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object's position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object's position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits ex-cellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD.

关键词： Point cloud compression Human computer interaction Measurement Accuracy Correlation Source coding Instruments Object detection Robustness Inference algorithms

来源：评论

学校读者我要写书评

暂无评论

High-Speed Trajectory Tracking control for Quadrotors via Deep Reinforcement Learning

High-Speed Trajectory Tracking Control for Quadrotors via De...

引用

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Hean Hua Hang Zhong Hui Zhang Yongchun Fang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Robotics Hunan University Changsha China Institute of Robotics and Automatic Information System College of Artificial Intelligence Nankai University Tianjin Key Laboratory of Intelligent Robotics Nankai University Tianjin China

ISBN: (数字)9798350379228

ISBN: (纸本)9798350390780

This paper presents a learning-based high-speed trajectory tracking control strategy for quadrotors, which achieves efficient learning and strong reliability by the collaboration of deep reinforcement learning (RL) and self-tuning mechanism. Different from existing methods, the proposed strategy is designed to explore optimal control performance by taking advantage of model-based self-tuning mechanism and deep reinforcement learning. Specifically, the self-tuning guided deep RL scheme is put forward for quadrotors, with superior learning efficiency and strong adaptability. Firstly, a novel self-tuning mechanism is constructed and some auxiliary variables are introduced to enhance the tracking performance. Then, based on the model-driven self-tuning design, the deep RL is proposed to achieve model-guided learning, where the tuning actions are adopted in the evaluation process during training, aiming at removing the bad explorations by the carefully designed parallel evaluation. Finally, the convergence is analyzed based on the proposed learning framework, which indicates the efficient cooperation of exploration and self-tuning mechanism. To verify the effectiveness of the proposed controller, the guided training and hardware experiments are implemented to show efficient cooperation and satisfactory high-speed trajectory tracking control of the proposed method.

关键词： Training Adaptation models Trajectory tracking Heuristic algorithms Optimal control Deep reinforcement learning Hardware

来源：评论

学校读者我要写书评

暂无评论

A Muti-stage Selection Filter Based on Wavelet Packet and 2DCNN for Fault Diagnosis of Rotating Machinery

A Muti-stage Selection Filter Based on Wavelet Packet and 2D...

引用

Chinese control Conference (CCC)

作者： Wenbin He Jianxu Mao Li Liu Zhe Li Miao Yang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China State Grid Hunan Electric Power Company Limited Research Institute Changsha China

Fault information of rotating machinery is often drowned in strong noise signals, so it is crucial to accurately identify faults from high-intensity noise signals. In this article, an end-to-end fault diagnosis model is developed, which consists of a multi-stage selection filter based on wavelet packet and 2D-CNN. First, the original measured mechanical signals were processed by the three-level wavelet packet decomposition to obtain eight sub-bands with coefficient matrices. Second, the signal is reconstructed using different numbers of sub-bands, where the number is increased by one at a time to obtain eight different multi-stage reconstructed signals. Third, the reconstructed signals are reorganized into 2D signal maps; and a parallel training network is constructed using signal maps and 2D-CNN to achieve fault classification. Then, guided by the training results, eight parallel classification results are compared, so as to train the best fault diagnosis model. Finally, the simulation experiment based on a bearing data set illustrates the proposed multi-stage selection filter is effective and feasible in application.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：