检索结果-内蒙古大学图书馆

IEEE Transactions on Intelligent Vehicles 2024年 1-13页

作者： Cao, Yihong Zhang, Hui Lu, Xiao Xiao, Zheng Yang, Kailun Wang, Yaonan College of Computer Science and Electronic Engineering Hunan University Changsha China National Engineering Research Center of Robot Vision Perception and Control Technology School of Robotics Hunan University Changsha China College of Engineering and Design Hunan Normal University Changsha China

Domain adaptive semantic segmentation enables robust pixel- wise understanding in real-world driving scenes. Source-free domain adaptation, as a more practical technique, addresses the concerns of data privacy and storage limitations in typical unsupervised domain adaptation methods, making it especially relevant in the context of intelligent vehicles. It utilizes a well-trained source model and unlabeled target data to achieve adaptation in the target domain. However, in the absence of source data and target labels, current solutions cannot sufficiently reduce the impact of domain shift and fully leverage the information from the target data. In this paper, we propose an end-to-end source-free domain adaptation semantic segmentation method via Importance-Aware and Prototype-Contrast (IAPC) learning. The proposed IAPC framework effectively extracts domain-invariant knowledge from the well-trained source model and learns domain-specific knowledge from the unlabeled target domain. Specifically, considering the problem of domain shift in the prediction of the target domain by the source model, we put forward an importance-aware mechanism for the biased target prediction probability distribution to extract domain-invariant knowledge from the source model. We further introduce a prototype-contrast strategy, which includes a prototype-symmetric cross-entropy loss and a prototype-enhanced cross-entropy loss, to learn target intra-domain knowledge without relying on labels. A comprehensive variety of experiments on two domain adaptive semantic segmentation benchmarks demonstrates that the proposed end-to-end IAPC solution outperforms existing state-of-the-art methods. The source code is publicly available at https://***/yihong-97/Source-free-IAPC. IEEE

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Materobot: Material Recognition in Wearable robotics for People with Visual Impairments

MateRobot: Material Recognition in Wearable Robotics for Peo...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Junwei Zheng Jiaming Zhang Kailun Yang Kunyu Peng Rainer Stiefelhagen Institute for Robotics and Anthropomatics Karlsruhe Institute of Technology Karlsruhe Germany Department of Engineering Science University of Oxford UK School of Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

People with Visual Impairments (PVI) typically recognize objects through haptic perception. Knowing objects and materials before touching is desired by the target users but under-explored in the field of human-centered robotics. To fill this gap, in this work, a wearable vision-based robotic system, MATErobot, is established for PVI to recognize materials and object categories beforehand. To address the computational constraints of mobile platforms, we propose a lightweight yet accurate model MATEViT to perform pixel-wise semantic segmentation, simultaneously recognizing both objects and materials. Our methods achieve respective 40.2% and 51.1% of mIoU on COCOStuff-10K and DMS datasets, surpassing the previous method with +5.7% and +7.0% gains. Moreover, on the field test with participants, our wearable system reaches a score of 28 in the NASA-Task Load Index, indicating low cognitive demands and ease of use. Our MATErobot demonstrates the feasibility of recognizing material property through visual cues and offers a promising step towards improving the functionality of wearable robots for PVI. The source code has been made publicly available at MATErobot.

关键词： Visualization Source coding Semantic segmentation Visual impairment Semantics Wearable robots Mobile applications

来源：评论

学校读者我要写书评

暂无评论

Exploring Video-Based Driver Activity Recognition under Noisy Labels

arXiv

引用

arXiv 2025年

作者： Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai AI Lab China University of Sussex United Kingdom

As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://***/ilonafan/DAR-noisy-labels. Copyright © 2025, The Authors. All rights reserved.

关键词： Object recognition

来源：评论

学校读者我要写书评

暂无评论

Beyond the Field-of-View: Enhancing Scene Visibility and perception with Clip-Recurrent Transformer

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-16页

作者： Shi, Hao Jiang, Qi Yang, Kailun Yin, Xiaoting Ni, Huajian Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation and the National Engineering Research Center of Optical Instrumentation Zhejiang University Hangzhou China School of Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai SUPREMIND Technology Company Ltd Shanghai China

vision sensors are widely applied in vehicles, robots, and roadside infrastructure. However, due to limitations in hardware cost and system size, camera Field-of-View (FoV) is often restricted and may not provide sufficient coverage. Nevertheless, from a spatiotemporal perspective, it is possible to obtain information beyond the camera's physical FoV from past video streams. In this paper, we propose the concept of online video inpainting for autonomous vehicles to expand the field of view, thereby enhancing scene visibility, perception, and system safety. To achieve this, we introduce the FlowLens architecture, which explicitly employs optical flow and implicitly incorporates a novel clip-recurrent transformer for feature propagation. FlowLens offers two key features: 1) FlowLens includes a newly designed Clip-Recurrent Hub with 3D-Decoupled Cross Attention (DDCA) to progressively process global information accumulated over time. 2) It integrates a multi-branch Mix Fusion Feed Forward Network (MixF3N) to enhance the precise spatial flow of local features. To facilitate training and evaluation, we derive the KITTI360 dataset with various FoV mask, which covers both outer- and inner FoV expansion scenarios. We also conduct quantitative assessments of beyond-FoV semantics across different models and perform qualitative comparisons of beyond-FoV object detection. We illustrate that employing FlowLens to reconstruct unseen scenes even enhances perception within the field of view by providing reliable semantic context. Extensive experiments and user studies involving offline and online video inpainting, as well as beyond-FoV perception tasks, demonstrate that FlowLens achieves state-of-the-art performance. The source code and dataset are made publicly available at https://***/MasterHow/FlowLens. IEEE

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

Skeleton-Based Human Action Recognition with Noisy Labels

arXiv

引用

arXiv 2024年

作者： Xu, Yi Peng, Kunyu Wen, Di Liu, Ruiping Zheng, Junwei Chen, Yufan Zhang, Jiaming Roitberg, Alina Yang, Kailun Stiefelhagen, Rainer Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany Institute for Artificial Intelligence University of Stuttgart Germany School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and annotation of activity sequences is time-consuming and the resulting labels are often noisy. If not effectively addressed, label noise negatively affects the model’s training, resulting in lower recognition quality. Despite its importance, addressing label noise for skeleton-based action recognition has been overlooked so far. In this study, we bridge this gap by implementing a framework that augments well-established skeleton-based human action recognition methods with label-denoising strategies from various research areas to serve as the initial benchmark. Observations reveal that these baselines yield only marginal performance when dealing with sparse skeleton data. Consequently, we introduce a novel methodology, NoiseEraSAR, which integrates global sample selection, co-teaching, and Cross-Modal Mixture-of-Experts (CM-MOE) strategies, aimed at mitigating the adverse impacts of label noise. Our proposed approach demonstrates better performance on the established benchmark, setting new state-of-the-art standards. The source code for this study is accessible at https://***/xuyizdby/NoiseEraSAR. Copyright © 2024, The Authors. All rights reserved.

关键词： Musculoskeletal system

来源：评论

学校读者我要写书评

暂无评论

Accurate RGB-D SLAM in dynamic environments based on dynamic visual feature removal

引用

Science China(Information Sciences) 2022年第10期65卷 256-269页

作者： Chenxin LIU Jiahu QIN Shuai WANG Lei YU Yaonan WANG Department of Automation University of Science and Technology of China Institute of Artificial Intelligence Hefei Comprehensive National Science Center College of Electrical and Information Engineering Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University

Visual localization is considered an essential capability in robotics and has attracted increasing interest for the past few years. However, most proposed visual localization systems assume that the surrounding environment is static, which is difficult to maintain in real-world scenarios due to the presence of moving objects. In this paper, we present DFR-SLAM, a real-time and accurate RGB-D SLAM based on ORB-SLAM2 that achieves satisfactory performance in a variety of challenging dynamic scenarios. At the core of our system lies a motion consensus filtering algorithm estimating the initial camera pose and a graph-cut optimization framework combining long-term observations, prior information, and spatial coherence to jointly distinguish dynamic and static visual features. Other systems for dynamic environments detect dynamic components by using the information from short time-span frames, whereas our system uses observations from a long period of keyframes. We evaluate our system using dynamic sequences from the public TUM dataset, and the evaluation demonstrates that the proposed system outperforms the original ORB-SLAM2 system significantly. In addition, our system provides competitive localization accuracy with satisfactory real-time performance compared to closely related SLAM systems designed to adapt to dynamic environments.

关键词： SLAM dynamic environments indoor localization graph-cut robot navigation

来源：评论

学校读者我要写书评

暂无评论

Skeleton-Based Human Action Recognition with Noisy Labels

Skeleton-Based Human Action Recognition with Noisy Labels

引用

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Yi Xu Kunyu Peng Di Wen Ruiping Liu Junwei Zheng Yufan Chen Jiaming Zhang Alina Roitberg Kailun Yang Rainer Stiefelhagen Anthropomatics and Robotics Karlsruhe Institute of Technology Germany Institute for Artificial Intelligence University of Stuttgart Germany School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and annotation of activity sequences is time-consuming and the resulting labels are often noisy. If not effectively addressed, label noise negatively affects the model’s training, resulting in lower recognition quality. Despite its importance, addressing label noise for skeleton-based action recognition has been overlooked so far. In this study, we bridge this gap by implementing a framework that augments well-established skeleton-based human action recognition methods with label-denoising strategies from various research areas to serve as the initial benchmark. Observations reveal that these baselines yield only marginal performance when dealing with sparse skeleton data. Consequently, we introduce a novel methodology, NoiseEraSAR, which integrates global sample selection, co-teaching, and Cross-Modal Mixture-of-Experts (CM-MOE) strategies, aimed at mitigating the adverse impacts of label noise. Our proposed approach demonstrates better performance on the established benchmark, setting new state-of-the-art standards. The source code for this study will be made accessible at https://***/xuyizdby/NoiseEraSAR.

关键词： Training Source coding Noise Training data Benchmark testing Skeleton Noise measurement Human activity recognition Streams Standards

来源：评论

学校读者我要写书评

暂无评论

Unsupervised Deep Homography Estimation based on Transformer

Unsupervised Deep Homography Estimation based on Transformer

引用

International Conference on Advanced robotics and Mechatronics (ICARM)

作者： Tianjian Jiang Qiu Fang Qing Zhu Yaonan Wang Zhen Zhou Lin Chen Jiaming Zhou Yuefan Luo Chengzhong Wu National Engineering Research Center for Robot Visual Perception and Control Technology Hunan University Changsha Hunan China Jiangxi Communication Terminal Industry Technology Research Institute.

Homography estimation is a crucial problem in computer vision, which aims to provide an optimal transformation matrix for aligning images captured from different viewpoints. Current methods extract shallow features from image pairs and introduce learnable mask modules to improve homography estimation performance. However, they struggle to capture long-term dependencies between features and comprehend the global structures of image features. A deep unsupervised homography learning framework is proposed in this paper, consisting of a weight-sharing feature extraction network and a homography estimation network based on the Transformer model. The former extracts the local features of images, while the latter learns the correlation between them and understands the global features of images, enabling the algorithm to better estimate the homography of unaligned images. Experimental results demonstrate that the proposed method outperforms the advanced methods for estimating homography matrices in the CA-Unsupervised dataset.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation

arXiv

引用

arXiv 2024年

作者： Liu, Ruiping Zhang, Jiaming Peng, Kunyu Chen, Yufan Cao, Ke Zheng, Junwei Sarfraz, M. Saquib Yang, Kailun Stiefelhagen, Rainer Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany Mercedes-Benz Tech Innovation Germany School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

Integrating information from multiple modalities enhances the robustness of scene perception systems in autonomous vehicles, providing a more comprehensive and reliable sensory framework. However, the modality incompleteness in multi-modal segmentation remains under-explored. In this work, we establish a task called Modality-Incomplete Scene Segmentation (MISS), which encompasses both system-level modality absence and sensor-level modality errors. To avoid the predominant modality reliance in multi-modal fusion, we introduce a Missing-aware Modal Switch (MMS) strategy to proactively manage missing modalities during training. Utilizing bit-level batch-wise sampling enhances the model’s performance in both complete and incomplete testing scenarios. Furthermore, we introduce the Fourier Prompt Tuning (FPT) method to incorporate representative spectral information into a limited number of learnable prompts that maintain robustness against all MISS scenarios. Akin to fine-tuning effects but with fewer tunable parameters (1.1%). Extensive experiments prove the efficacy of our proposed approach, showcasing an improvement of 5.84% mIoU over the prior state-of-the-art parameter-efficient methods in modality missing. The source code is publicly available at https://***/RuipingL/MISS. Copyright © 2024, The Authors. All rights reserved.

关键词： Sensory perception

来源：评论

学校读者我要写书评

暂无评论

Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation

Fourier Prompt Tuning for Modality-Incomplete Scene Segmenta...

引用

IEEE Symposium on Intelligent Vehicle

作者： Ruiping Liu Jiaming Zhang Kunyu Peng Yufan Chen Ke Cao Junwei Zheng M. Saquib Sarfraz Kailun Yang Rainer Stiefelhagen Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany Mercedes-Benz Tech Innovation Germany School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

ISBN: (数字)9798350348811

ISBN: (纸本)9798350348828

关键词： Training Rain Source coding Semantic segmentation Semantics Switches Benchmark testing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：