检索结果-内蒙古大学图书馆

Sparse Optical Flow-Based Line Feature Tracking

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fu, Qiang Yu, Hongshan Ali, Islam Zhang, Hong National Engineering Laboratory for Robot Visual Perception and Control Technology Hunan University China Department of Computing Science University of Alberta Canada

In this paper we propose a novel sparse optical flow (SOF)-based line feature tracking method for the camera pose estimation problem. This method is inspired by the point-based SOF algorithm and developed based on an observation that two adjacent images in time-varying image sequences satisfy brightness invariant. Based on this observation, we redefine the goal of line feature tracking: track two endpoints of a line feature instead of the entire line based on gray value matching instead of descriptor matching. To achieve this goal, an efficient two endpoint tracking (TET) method is presented: first, describe a given line feature with its two endpoints;next, track the two endpoints based on SOF to obtain two new tracked endpoints by minimizing a pixel-level grayscale residual function;finally, connect the two tracked endpoints to generate a new line feature. The correspondence is established between the given and the new line feature. Compared with current descriptor-based methods, our TET method needs not to compute descriptors and detect line features repeatedly. Naturally, it has an obvious advantage over computation. Experiments in several public benchmark datasets show our method yields highly competitive accuracy with an obvious advantage over speed. The source code of our method is released at: https://***/cnqiangfu/TET. Copyright © 2022, The Authors. All rights reserved.

关键词： Optical flows

A Graph-Based SLAM Method Assisted by visual Marker in the Degenerate Scenes

学校读者我要写书评

暂无评论

A Graph-Based SLAM Method Assisted by Visual Marker in the D...

International Conference on Advanced robotics and Mechatronics (ICARM)

作者： Jieqingxin Zhang Hui Zhang Xidong Zhou Bo Chen Xiangchuan Wang Tao Xu College of Electrical and Information Engineering Changsha University of Science and Technology Hunan China College of Robotics also with Robot Visual Perception and Control Technology National Engineering Research Center Hunan University Hunan China College of Electrical and Information Engineering Hunan University Hunan China

In the post-COVID-19 pandemic era, hospitals and other places have an urgent need for mobile robots with autonomous disinfection ability, and robots need to complete SLAM tasks to realize autonomous navigation. Lidar is widely used for indoor SLAM. However, due to the lack of geometric structure in the indoor environment, two-dimensional lidar information degrades, rendering the robot unable to obtain effective positioning. Therefore, we leverage the easy identification and high robustness of ARTag to fuse vision and range sensor information. We introduce ARTag as visual marker to assist positioning, establish observation window to screen the acquired ARTag pose. We employ the pose graph optimization method to optimize the visual markers and laser scanning results in the back end. This reduces the positioning errors caused by the degradation of lidar information and reduces the frequency of optimization by improving the back end optimization strategy. This method is applied in a UltraViolet C (UVC) Disinfection robot experiment. Experimental results show that our method effectively improves the positioning accuracy and robustness of the robot in the environments with degraded laser information.

关键词：

Salient Object Detection in Traffic Scene through the TSOD10K Dataset

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Qiu, Yu Sun, Yuhang Mei, Jie Xiao, Lin Xu, Jing College of Information Science and Engineering Hunan Normal University Changsha410081 China National Key Laboratory of Intelligent Tracking and Forecasting for Infectious Diseases College of Artificial Intelligence Nankai University Tianjin300350 China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha410082 China

Traffic Salient Object Detection (TSOD) aims to segment the objects critical to driving safety by combining semantic (e.g., collision risks) and visual saliency. Unlike SOD in natural scene images (NSI-SOD), which prioritizes visually distinctive regions, TSOD emphasizes the objects that demand immediate driver attention due to their semantic impact, even with low visual contrast. This dual criterion, i.e., bridging perception and contextual risk, re-defines saliency for autonomous and assisted driving systems. To address the lack of task-specific benchmarks, we collect the first large-scale TSOD dataset with pixel-wise saliency annotations, named TSOD10K. TSOD10K covers the diverse object categories in various real-world traffic scenes under various challenging weather/illumination variations (e.g., fog, snowstorms, low-contrast, and low-light). Methodologically, we propose a Mamba-based TSOD model, termed Tramba. Considering the challenge of distinguishing inconspicuous visual information from complex traffic backgrounds, Tramba introduces a novel Dual-Frequency visual State Space module equipped with shifted window partitioning and dilated scanning to enhance the perception of fine details and global structure by hierarchically decomposing high/low-frequency components. To emphasize critical regions in traffic scenes, we propose a traffic-oriented Helix 2D-Selective-Scan (Helix-SS2D) mechanism that injects driving attention priors while effectively capturing global multi-direction spatial dependencies. We establish a comprehensive benchmark by evaluating Tramba and 22 existing NSI-SOD models on TSOD10K, demonstrating Tramba’s superiority. Our research establishes the first foundation for safety-aware saliency analysis in intelligent transportation systems. Copyright © 2025, The Authors. All rights reserved.

关键词： Risk perception

EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Lin, Jiacheng Chen, Jiajun Peng, Kunyu He, Xuan Li, Zhiyong Stiefelhagen, Rainer Yang, Kailun The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The School of Robotics Hunan University Changsha410012 China The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Robotics and An-Thropomatics Karlsruhe Institute of Technology Karlsruhe76131 Germany

This paper introduces the task of Auditory Referring Multi-Object Tracking (AR-MOT), which dynamically tracks specific objects in a video sequence based on audio expressions and appears as a challenging problem in autonomous driving. Due to the lack of semantic modeling capacity in audio and video, existing works have mainly focused on text-based multiobject tracking, which often comes at the cost of tracking quality, interaction efficiency, and even the safety of assistance systems, limiting the application of such methods in autonomous driving. In this paper, we delve into the problem of AR-MOT from the perspective of audio-video fusion and audio-video tracking. We put forward EchoTrack, an end-to-end AR-MOT framework with dual-stream vision transformers. The dual streams are intertwined with our Bidirectional Frequency-domain Cross-attention Fusion Module (Bi-FCFM), which bidirectionally fuses audio and video features from both frequency- and spatiotemporal domains. Moreover, we propose the Audio-visual Contrastive Tracking Learning (ACTL) regime to extract homogeneous semantic features between expressions and visual objects by learning homogeneous features between different audio and video objects effectively. Aside from the architectural design, we establish the first set of large-scale AR-MOT benchmarks, including Echo-KITTI, Echo-KITTI+, and Echo-BDD. Extensive experiments on the established benchmarks demonstrate the effectiveness of the proposed EchoTrack and its components. The source code and datasets are available at https://***/lab206/EchoTrack. Copyright © 2024, The Authors. All rights reserved.

关键词： Semantics

PanoVPR: Towards Unified Perspective-to-Equirectangular visual Place Recognition via Sliding Windows across the Panoramic View

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Shi, Ze Shi, Hao Yang, Kailun Yin, Zhe Lin, Yining Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China School of Robotics and with the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai SUPREMIND Technology Co Ltd Shanghai China

— visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR. Copyright © 2023, The Authors. All rights reserved.

关键词： Query processing

A Muti-stage Selection Filter Based on Wavelet Packet and 2DCNN for Fault Diagnosis of Rotating Machinery

学校读者我要写书评

暂无评论

A Muti-stage Selection Filter Based on Wavelet Packet and 2D...

Chinese control Conference (CCC)

作者： Wenbin He Jianxu Mao Li Liu Zhe Li Miao Yang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China State Grid Hunan Electric Power Company Limited Research Institute Changsha China

Fault information of rotating machinery is often drowned in strong noise signals, so it is crucial to accurately identify faults from high-intensity noise signals. In this article, an end-to-end fault diagnosis model is developed, which consists of a multi-stage selection filter based on wavelet packet and 2D-CNN. First, the original measured mechanical signals were processed by the three-level wavelet packet decomposition to obtain eight sub-bands with coefficient matrices. Second, the signal is reconstructed using different numbers of sub-bands, where the number is increased by one at a time to obtain eight different multi-stage reconstructed signals. Third, the reconstructed signals are reorganized into 2D signal maps; and a parallel training network is constructed using signal maps and 2D-CNN to achieve fault classification. Then, guided by the training results, eight parallel classification results are compared, so as to train the best fault diagnosis model. Finally, the simulation experiment based on a bearing data set illustrates the proposed multi-stage selection filter is effective and feasible in application.

关键词：

Semi-supervised Cloud Edge Collaborative Power Transmission Line Insulator Anomaly Detection Framework 11th

学校读者我要写书评

暂无评论

Semi-supervised Cloud Edge Collaborative Power Transmission ...

11th International Conference on Image and Graphics, ICIG 2021

作者： Yang, Yanqing Mao, Jianxu Zhang, Hui Chen, Yurong Zhong, Hang Huang, Zhihong Wang, Yaonan National Engineering Laboratory of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China State Grid Hunan Electric Power Corporation Limited Research Institute Hunan Changsha China

ISBN: (纸本)9783030873547

The widely deployed power transmission line expedites developing the age of electricity. Thus, it is necessary to maintain a power system with a great quantity of manpower and material resources, especially for crucial equipment, such as insulator string. However, the current main inspection method relies on artificial with the problem of time-consuming and labor-intensive. There is a trend of utilizing deep learning techniques on unmanned aerial vehicles (UAVs) to accomplish the inspection task, but its development is restricted by the limitation of energy. In this paper, we propose a semi-supervised cloud edge collaborative insulator string anomaly detection framework. Specifically, an anchor-free object detector is deployed on the edge device for locating the insulator. On the cloud side, we propose a generative insulator defect detection model based on the autoencoder (AE) with a generator-discriminator pattern. Particularly, we introduce the variational memory encoder-decoder architecture to model defect-free insulator data distribution. Furthermore, the adversarial strategy is employed to regularize the generated data space with input data space. In the end, the anomaly can be detected if its data space is an outlier of training defect-free distribution. Comprehensive experiments demonstrate that our method can effectively reduce the computational load, meanwhile archiving superior performance, including accuracy (0.968) and recall (0.985), for defect recognition using a standard insulator data set. © 2021, Springer Nature Switzerland AG.

关键词： Deep learning

PanoVpr: Towards Unified Perspective-to-Equirectangular visual Place Recognition via Sliding Windows Across the Panoramic View

学校读者我要写书评

暂无评论

PanoVpr: Towards Unified Perspective-to-Equirectangular Visu...

International Conference on Intelligent Transportation

作者： Ze Shi Hao Shi Kailun Yang Zhe Yin Yining Lin Kaiwei Wang State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China Shanghai SUPREMIND Technology Co. Ltd Shanghai China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China

visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR.

关键词：

Bridging on-line systems modeling with fault detection for a class of unknown nonlinear distributed parameter systems

学校读者我要写书评

暂无评论

IFAC-PapersOnLine 2022年第6期55卷 228-233页

作者： Yun Feng Yaonan Wang Yazhi Zhang College of Electrical and Information Engineering Hunan University Changsha 410082 China National Engineering Research Center for Robot Visual Perception and Control Technology Hunan University Changsha 410082 China College of Electric and Information Engineering Hunan Institute of Engineering Xiangtan 411104 China

Different from the traditional model-based fault diagnosis paradigm which is established upon the well-known observer design and analysis, a novel data-driven framework is proposed by combing systems modeling with fault detection for a class of 1-D unknown distributed parameter systems. The key idea is to transfer the on-line modeling error into the residual signal for fault detection. The proposed methodology only utilizes the I/O data and does not require extra knowledge of the system model, which increases its usability at large. Numerical simulations on a commonly used benchmark are presented for method validation.

关键词： AI FDI methods Neural approximations for optimal control estimation FDI for nonlinear Systems Distributed parameter systems