检索结果-内蒙古大学图书馆

From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Xin Hao, Chao Yu, Zitong Yue, Huanjing Yang, Jingyu School of Electrical and Information Engineering Tianjin University China Computer Vision and Pattern Recognition Laboratory School of Engineering Sciences Lappeenranta-Lahti University of Technology LUT Finland School of Computing and Information Technology Great Bay University China

The action anticipation task refers to predicting what action will happen based on observed videos, which requires the model to have a strong ability to summarize the present and then reason about the future. Experience and common sense suggest that there is a significant correlation between different actions, which provides valuable prior knowledge for the action anticipation task. However, previous methods have not effectively modeled this underlying statistical relationship. To address this issue, we propose a novel end-to-end video modeling architecture that utilizes attention mechanisms, named Anticipation via Recognition and Reasoning (ARR). ARR decomposes the action anticipation task into action recognition and sequence reasoning tasks, and effectively learns the statistical relationship between actions by next action prediction (NAP). In comparison to existing temporal aggregation strategies, ARR is able to extract more effective features from observable videos to make more reasonable predictions. In addition, to address the challenge of relationship modeling that requires extensive training data, we propose an innovative approach for the unsupervised pre-training of the decoder, which leverages the inherent temporal dynamics of video to enhance the reasoning capabilities of the network. Extensive experiments on the Epic-kitchen-100, EGTEA Gaze+, and 50salads datasets demonstrate the efficacy of the proposed methods. The code is available at https://***/linuxsino/ARR. Copyright © 2024, The Authors. All rights reserved.

关键词： Video analysis

Inspection of a helicopter blade using drone based active thermography 45

学校读者我要写书评

暂无评论

Inspection of a helicopter blade using drone based active th...

Thermosense: Thermal Infrared Applications XLV 2023

作者： Pant, Shashank Genest, Marc Ibarra-Castanedo, Clemente Avdelidis, Nicolas P. Valdes, Julio Deane, Shakeb Zolotas, Argyrios Maldague, Xavier P. National Research Council Canada OttawaONK1A 0R6 Canada Computer Vision and Systems Laboratory Department of Electrical and Computer Engineering Laval University Quebec CityQCG1V 0A6 Canada School of Aerospace Transport and Manufacturing Cranfield University CranfieldMK43 0AL United Kingdom

ISBN: (纸本)9781510661868

A drone-based inspection system that can move "freely" around an aircraft to perform the inspection of all the areas of interest in a fast and effective manner can have significant impact in reducing inspection time and cost. However, active thermography inspection using drone is challenging because the drone carrying the optical and thermal cameras is subjected to vibration and undesired motion. Since active thermography relies on the pixel temperature evolution over time, an unstable thermal video from a flying drone can cause error in the output results as any movement between the acquired images will affect the pixel position in the successive frames and thus disrupt the monitoring of the temperature evolution. This paper presents the outcome of experimental runs, where a commercially available drone equipped with both thermal and optical cameras was used to inspect a helicopter Main Rotor Blade (MRB) in a laboratory environment. © 2023 SPIE.

关键词： Inspection

Pose focus transformer meet inter-part relation

学校读者我要写书评

暂无评论

Expert Systems with Applications 2024年 240卷

作者： Luo, Yanmin Lin, Hongwei Huang, Wenlin Wang, Youjie Du, Jixiang Guo, Jing-Ming College of Computer Science and Technology Huaqiao University Xiamen361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China Maynooth International Engineering College Fuzhou University Fuzhou350108 China Department of Electrical Engineering National Taiwan University of Science and Technology Taipei10607 China

Human pose estimation in crowded scenes is a challenging task. Due to overlap and occlusion, it is difficult to infer pose clues from individual keypoints. We proposed PFFormer, a new transformer-based approach that treats pose estimation as a hierarchical set prediction problem that first focuses on human windows and coarsely predicts whole-body poses globally within them. In PFFormer, we designed a Windows Clustering Transformer (WCT), which reorganizes the image windows by filtering the attentive windows and fusing the inattentive ones, allowing the transformer to focus on the important regions while reducing the interference from the complex background, followed by compensating for the loss of information with a global transformer. Then we partition the learned body pose into a set of structural parts and perform the Inter-Part Relation Module (IPRM) to capture the correlation between multiple parts. These full-body poses and component features are refined at a finer level through the Part-to-Joint Decoder (PJD). Extensive experiments show that PFFormer performs favorably against its counterpart on challenging datasets, including COCO2017, CrowdPose, and OChuman datasets. The performance of crowded scenes, in particular, demonstrates the robustness of the proposed methods to deal with occlusion. © 2023 Elsevier Ltd

关键词： Information filtering

Combining Scene Coordinate Regression and Absolute Pose Regression for Visual Relocalization

学校读者我要写书评

暂无评论

Combining Scene Coordinate Regression and Absolute Pose Regr...

IEEE International Conference on Robotics and Automation (ICRA)

作者： Jiahao Ruan Li He Yisheng Guan Hong Zhang School of Electromechanical Engineering Guangdong University of Technology Guangzhou China Department of Electrical and Electronic Engineering Shenzhen Key - Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China

Visual relocalization is a fundamental problem in computer vision and robotics. Recently, regression-based methods become popular and they can be categorized into two classes: absolute pose regression and scene coordinate regression. In this work, we present a combined regression network that jointly learns scene coordinate regression and absolute pose regression for single-image visual relocalization. The proposed network composes of a feature encoder and two regression branches with uncertainty modeling. In particular, we design a deep feature conditioning module, aiming at propagating the coarse pose information in absolute pose regression to inform the predictions in scene coordinate regression. The proposed network is trained in an end-to-end fashion to learn both regression tasks. Moreover, we propose an uncertainty-driven RANSAC algorithm that incorporates the predicted scene coordinates and their uncertainties to solve the camera pose during inference. To the best of our knowledge, this work is the first to combine scene coordinate regression and pose regression in a hierarchical framework for visual relocalization. Experiments on indoor and outdoor benchmarks demonstrate the effectiveness and the superiority of the proposed method over the state-of-the-art methods.

关键词：

HPPS: A Hierarchical Progressive Perception System for Luggage Trolley Detection and Localization at Airports

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Zhirui Zhang, Zhe Zhao, Jieting Ye, Hanjing Wang, Jiankun Shenzhen Key Laboratory of Robotics Perception and Intelligence Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Jiaxing Research Institute Southern University of Science and Technology Jiaxing China Shenzhen Key Laboratory of Robotics and Computer Vision Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The robotic autonomous luggage trolley collection system employs robots to gather and transport scattered luggage trolleys at airports. However, existing methods for detecting and locating these luggage trolleys often fail when they are not fully visible. To address this, we introduce the Hierarchical Progressive Perception System (HPPS), which enhances the detection and localization of luggage trolleys under partial occlusion. The HPPS processes the luggage trolley’s position (x, y) and orientation (θ) separately, which requires only RGB images for labeling and training, eliminating the need for 3D coordinates and alignment. The HPPS can accurately determine the position of the luggage trolley with just one well-detected keypoint and estimate the luggage trolley’s orientation when it is partially occluded. Once the luggage trolley’s initial pose is detected, HPPS updates this information continuously to refine its accuracy until the robot begins grasping. The experiments on detection and localization demonstrate that HPPS is more reliable under partial occlusion compared to existing methods. Its effectiveness and robustness have also been confirmed through practical tests in actual luggage trolley collection tasks. A website about this work is available at HPPS. Copyright © 2024, The Authors. All rights reserved.

关键词： Robotics

Feature Correlation Aggregation: on the Path to Better Graph Neural Networks

学校读者我要写书评

暂无评论

Feature Correlation Aggregation: on the Path to Better Graph...

Proceedings of the Digital Image Computing: Technqiues and Applications (DICTA)

作者： Jieming Zhou Tong Zhang Pengfei Fang Lars Petersson Mehrtash Harandi College of Engineering and Computer Science Australian National University Canberra Australia Image and Visual Representation Laboratory EPFL Lausanne Switzerland Imaging and Computer Vision Group CSIRO Canberra Australia Department of Electrical and Computer Systems Engineering Monash University Melbourne Australia

Prior to the introduction of Graph Neural Networks (GNNs), modelling and analyzing irregular data, particularly graphs, was thought to be the Achilles’ heel of deep learning. The core concept of GNNs is to find a representation by recursively aggregating the representations of a central node and those of its neighbor, and many GNNs’ designs have demonstrated its success. However, most only focus on using the first-order information between a node and its neighbors. In this paper, we introduce a central node permutation variant function through a frustratingly simple and innocent-looking modification to the core operation of a GNN, namely the Feature cOrrelation aGgregation (FOG) module, which learns the second-order information from feature correlation between a node and its neighbors in the pipeline. By adding FOG into existing variants of GNNs, we empirically verify this second-order information complements the features generated by original GNNs across a broad set of benchmarks. A tangible boost in the model’s performance is observed where the model surpasses previous state-of-the-art results by a significant margin while employing fewer parameters. e.g., 26.202% improvement on a real-world molecular dataset using graph convolutional networks.

关键词：

Efficient Object Rearrangement via Multi-view Fusion

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Dehao Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The prospect of assistive robots aiding in object organization has always been compelling. In an image-goal setting, the robot rearranges the current scene to match the single image captured from the goal scene. The key to an image-goal rearrangement system is estimating the desired placement pose of each object based on the single goal image and observations from the current scene. In order to establish sufficient associations for accurate estimation, the system should observe an object from a viewpoint similar to that in the goal image. Existing image-goal rearrangement systems, due to their reliance on a fixed viewpoint for perception, often require redundant manipulations to randomly adjust an object’s pose for a better perspective. Addressing this inefficiency, we introduce a novel object rearrangement system that employs multi-view fusion. By observing the current scene from multiple viewpoints before manipulating objects, our approach can estimate a more accurate pose without redundant manipulation times. A standard visual localization pipeline at the object level is developed to capitalize on the advantages of multi-view observations. Simulation results demonstrate that the efficiency of our system outperforms existing single-view systems. The effectiveness of our system is further validated in a physical experiment. Copyright © 2023, The Authors. All rights reserved.

关键词：

Detail-Enhancing Framework for Reference-Based Image Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Zihan Xiong, Ziliang Tang, Hongying Yuan, Xiaobing Shanghai Institution of Micro-system and Information Technology University of Chinese Academy of Science China Computer Vision Laboratory Department of Electrical Engineering LiU Sweden School of Information Science and Technology Shanghai Tech University China

Recent years have witnessed the prosperity of reference-based image super-resolution (Ref-SR). By importing the high-resolution (HR) reference images into the single image super-resolution (SISR) approach, the ill-posed nature of this long-standing field has been alleviated with the assistance of texture transferred from reference images. Although the significant improvement in quantitative and qualitative results has verified the superiority of Ref-SR methods, the presence of misalignment before texture transfer indicates room for further performance improvement. Existing methods tend to neglect the significance of details in the context of comparison, therefore not fully leveraging the information contained within low-resolution (LR) images. In this paper, we propose a Detail-Enhancing Framework (DEF) for reference-based super-resolution, which introduces the diffusion model to generate and enhance the underlying detail in LR images. If corresponding parts are present in the reference image, our method can facilitate rigorous alignment. In cases where the reference image lacks corresponding parts, it ensures a fundamental improvement while avoiding the influence of the reference image. Extensive experiments demonstrate that our proposed method achieves superior visual results while maintaining comparable numerical outcomes. Copyright © 2024, The Authors. All rights reserved.

关键词： Textures

Ultra-Compact Magnetoelectric Sensors for Femto-Tesla Vlf Signal Reception

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Dong, Cunzheng Sun, Changxing Chen, Lei He, Yifan Liu, Yisi Luo, Bin Sun, Nian-Xiang Department of Electrical and Computer Engineering Northeastern University BostonMA02115 United States State Key Laboratory of Reliability and Intelligence of Electrical Equipment Hebei University of Technology Tianjin300130 China Key Lab of Computer Vision and Intelligent Information System Chongqing University of Arts and Sciences Chongqing402160 China

Very low-frequency (VLF) electromagnetic waves can penetrate dense conductive media, such as earth and saltwater, with minimal attenuation, allowing for long-distance signal transmission via ionospheric reflection. These characteristics make VLF waves ideal for applications in submarine navigation, subterranean mapping, underground communication, and ionospheric remote sensing. Conventional VLF signal reception has relied on magnetic loop antennas due to their low noise performance;however, their large size and reduced sensitivity due to low quality factors (Q) limit their use in portable and compact applications, particularly in underwater and underground environments. To address these challenges, we propose an ultra-compact room-temperature extremely sensitive femto-tesla magnetic sensor based on a strain-mediated high-Q Metglas/Quartz magnetoelectric (ME) resonator operating at its electromechanical resonance (EMR) at 24.55 kHz for VLF signal reception. The Metglas/Quartz ME sensor demonstrates a sensitivity and magnetic noise performance enhancement by an order of magnitude compared to conventional Metglas/PZT ME sensors, achieving an ultra-low equivalent magnetic noise level of 5 fT/Hz1/2, owing to high magnetic permeability and magnetostriction of Metglas and the high-quality factor of Quartz at EMR. Moreover, the Metglas/Quartz ME VLF receiver exhibits overwhelming near-field and far-field VLF signal reception capability, realizing a successful reception of VLF signal 400 km away from the NAA VLF Transmitter Cutler. The demonstrated ultra-compact high-Q Metglas/Quartz ME sensor capable of femto-tesla VLF signal reception shows significant improvements in magnetic sensing capability, size, power consumption, and cost compared to traditional magnetic loop antennas, making it a promising solution for portable VLF signal reception in challenging environments. © 2024, The Authors. All rights reserved.

关键词： Loop antennas