检索结果-内蒙古大学图书馆

MS-Glance: Bio-Inspired Non-Semantic Context Vectors and Their Applications in Supervising Image Reconstruction

学校读者我要写书评

暂无评论

MS-Glance: Bio-Inspired Non-Semantic Context Vectors and The...

IEEE Workshop on Applications of Computer Vision (WACV)

作者： Ziqi Gao Wendi Yang Yujia Li Lei Xing S. Kevin Zhou Division of Life Sciences and Medicine School of Biomedical Engineering University of Science and Technology of China (USTC) Hefei Anhui China Center for Medical Imaging Robotics Analytic Computing & Learning (MIRACLE) Suzhou Institute for Advance Research USTC Suzhou Jiangsu China Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology China Department of Radiation Oncology Stanford University Stanford CA USA Key Laboratory of Precision and Intelligent Chemistry USTC CAS Hefei Anhui

ISBN: (数字)9798331510831

ISBN: (纸本)9798331510848

Non-semantic context information is crucial for visual recognition, as the human visual perception system first uses global statistics to process scenes rapidly before identifying specific objects. However, while semantic information is increasingly incorporated into computer vision tasks such as image reconstruction, non-semantic information, such as global spatial structures, is often overlooked. To bridge the gap, we propose a biologically informed non-semantic context descriptor, MS-Glance, along with the Glance Index Measure for comparing two images. A Global Glance vector is formulated by randomly retrieving pixels based on a perception-driven rule from an image to form a vector representing non-semantic global context, while a local Glance vector is a flattened local image window, mimicking a zoom in observation. The Glance Index is defined as the inner product of two standardized sets of Glance vectors. We evaluate the effectiveness of incorporating Glance supervision in two reconstruction tasks: image fitting with implicit neural representation (INR) and undersampled MRI reconstruction. Extensive experimental results show that MS-Glance outperforms existing image restoration losses across both natural and medical images. The code is available at https://***/Z7Gao/MSGlance.

关键词： Computer vision Visualization Magnetic resonance imaging Fitting Vectors Image restoration Indexes Image reconstruction Biomedical imaging Visual perception

Semi-Supervised Clustering Framework for Fine-grained Scene Graph Generation 39

学校读者我要写书评

暂无评论

Semi-Supervised Clustering Framework for Fine-grained Scene ...

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Yang, Jiarui Wang, Chuan Zhang, Jun Wu, Shuyi Jinjing, Zhao Liu, Zeming Yang, Liang Shanghai Key Lab of Intell. Info. Processing School of Computer Science Fudan University China Shanghai Collaborative Innovation Center on Intelligent Visual Computing China Institute of Information Engineering CAS China School of Computer Science and Technology Beijing JiaoTong University China Guangdong Provincial Key Lab of Intell. Info. Processing & Shenzhen Key Lab of Media Security Shenzhen University China Information Research Center of Military Science PLA Academy of Military Science China National Key Laboratory of Science and Technology on Information System Security China School of Computer Science and Engineering Beihang University China School of Artificial Intelligence Hebei University of Technology China

ISBN: (纸本)157735897X

Scene Graph Generation (SGG) aims to detect all objects and identify their pairwise relationships existing in the scene. Considering the substantial human labor costs, existing scene graph annotations are often sparse and biased, which result in confusion training with low-frequency predicates. In this work, we design a Semi-Supervised Clustering framework for Scene Graph Generation (SSC-SGG) that uses the sparse labeled data to guide the generation of effective pseudo-labels from unlabeled object pairs, thus enriching the labeled sample space, especially for low-frequency interaction samples. We approach from the perspective of clustering, reducing the problem of confirmation bias in a self-training manner. Specifically, we first enhance the model’s robustness to feature extraction via prototype-based clustering, aggregating different relationship augmented features onto the same prototype. Secondly, we design a dynamic pseudo-label assignment algorithm based on a mini-batch, which adjusts the detection sensitivity to different frequency samples from the historical assignment. Finally, we conduct joint training on the pseudo-labels and the labeled data. We conduct experiments on various SGG models and achieve substantial overall performance improvements, demonstrating the effectiveness of SSC-SGG. Copyright © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词：

Towards a Revolutionary Info-Geometric Control Theory with Potential Applications of Fokker Planck Kolmogorov(FPK) Equation to System Control, Modelling and Simulation 28

学校读者我要写书评

暂无评论

Towards a Revolutionary Info-Geometric Control Theory with P...

28th International Conference on Automation and computing, ICAC 2023

作者： Mageed, Ismail A Zhou, Yuyang Liu, Yefeng Zhang, Qichun University of Bradford Dept. of Computer Science BradfordBD7 1DP United Kingdom School of Computing Engineering and the Built Environment Edinburgh Napier University Edinburgh United Kingdom School of Automation and Electrical Shenyang Institute of Technology Liaoning Key Lab of Information Physical Fusion and Intelligent Cnc Machine Tool Manufacturing Fushun China

ISBN: (纸本)9798350335859

An exposition of a ground-breaking Info-Geometric approach to FPK probability density function (PDF) is undertaken in this paper. The results extend to finding the FPK Geodesic equations (GEs) of motion. Exact analytic solutions of these GES are derived. the Some potential applications of FPK to system control, modelling and simulation are provided. Challenging Open problems are given combined with conclusion and next phase research. © 2023 IEEE.

关键词： Probability density function

Autoregressive Queries for Adaptive Tracking with Spatio-Temporal Transformers

学校读者我要写书评

暂无评论

Autoregressive Queries for Adaptive Tracking with Spatio-Tem...

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Jinxia Xie Bineng Zhong Zhiyi Mo Shengping Zhang Liangtao Shi Shuxiang Song Rongrong Ji Key Laboratory of Education Blockchain and Intelligent Technology Ministry of Education Guangxi Normal University Guilin China Guangxi Key Lab of Multi-Source Information Mining & Security Guangxi Normal University Guilin China Guangxi Key Laboratory of Machine Vision and Intelligent Control Wuzhou University School of Computer Science and Technology Harbin Institute of Technology Media Analytics and Computing Lab School of Informatics Xiamen University

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

The rich spatio-temporal information is crucial to capture the complicated target appearance variations in visual tracking. However, most top-performing tracking algorithms rely on many hand-crafted components for spatio-temporal information aggregation. Consequently, the spatio-temporal information is far away from being fully explored. To alleviate this issue, we propose an adaptive tracker with spatio-temporal transformers (named AQA-Track), which adopts simple autoregressive queries to effectively learn spatio-temporal information without many hand-designed components. Firstly, we introduce a set of learnable and autoregressive queries to capture the instantaneous target appearance changes in a sliding window fashion. Then, we design a novel attention mechanism for the interaction of existing queries to generate a new query in current frame. Finally, based on the initial target template and learnt autoregressive queries, a spatio-temporal information fusion module (STM) is designed for spatiotemporal formation aggregation to locate a target object. Benefiting from the STM, we can effectively combine the static appearance and instantaneous changes to guide robust tracking. Extensive experiments show that our method significantly improves the tracker's performance on six popular tracking benchmarks: LaSOT, LaSOT ext , TrackingNet, GOT-10k, TNL2K, and UAV123. Code and models will be https://***/orgs/GXNU-Zhonglab.

关键词： Adaptation models Visualization Computer vision Target tracking Computational modeling Transformers Market research

A Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenes

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yu, Ting Lin, Xiaojun Wang, Shuhui Sheng, Weiguo Huang, Qingming Yu, Jun School of Information Science and Technology Hangzhou Normal University Hangzhou311121 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing101408 China Key Laboratory of Complex Systems Modeling and Simulation School of Computer Science and Technology Hangzhou Dianzi University Hangzhou310018 China

Three-Dimensional (3D) dense captioning is an emerging vision-language bridging task that aims to generate multiple detailed and accurate descriptions for 3D scenes. It presents significant potential and challenges due to its closer representation of the real world compared to 2D visual captioning, as well as complexities in data collection and processing of 3D point cloud sources. Despite the popularity and success of existing methods, there is a lack of comprehensive surveys summarizing the advancements in this field, which hinders its progress. In this paper, we provide a comprehensive review of 3D dense captioning, covering task definition, architecture classification, dataset analysis, evaluation metrics, and in-depth prosperity discussions. Based on a synthesis of previous literature, we refine a standard pipeline that serves as a common paradigm for existing methods. We also introduce a clear taxonomy of existing models, summarize technologies involved in different modules, and conduct detailed experiment analysis. Instead of a chronological order introduction, we categorize the methods into different classes to facilitate exploration and analysis of the differences and connections among existing techniques. We also provide a reading guideline to assist readers with different backgrounds and purposes in reading efficiently. Furthermore, we propose a series of promising future directions for 3D dense captioning by identifying challenges and aligning them with the development of related tasks, offering valuable insights and inspiring future research in this field. Our aim is to provide a comprehensive understanding of 3D dense captioning, foster further investigations, and contribute to the development of novel applications in multimedia and related domains. Copyright © 2024, The Authors. All rights reserved.

关键词： Data handling

Autoregressive Queries for Adaptive Tracking with Spatio-Temporal Transformers

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Xie, Jinxia Zhong, Bineng Mo, Zhiyi Zhang, Shengping Shi, Liangtao Song, Shuxiang Ji, Rongrong Key Laboratory of Education Blockchain and Intelligent Technology Ministry of Education China Guangxi Key Lab of Multi-Source Information Mining & Security China Guangxi Normal University Guilin541004 China Guangxi Key Laboratory of Machine Vision and Intelligent Control Wuzhou University China School of Computer Science and Technology Harbin Institute of Technology China Media Analytics and Computing Lab School of Informatics Xiamen University China

The rich spatio-temporal information is crucial to capture the complicated target appearance variations in visual tracking. However, most top-performing tracking algorithms rely on many hand-crafted components for spatio-temporal information aggregation. Consequently, the spatio-temporal information is far away from being fully explored. To alleviate this issue, we propose an adaptive tracker with spatio-temporal transformers (named AQATrack), which adopts simple autoregressive queries to effectively learn spatio-temporal information without many hand-designed components. Firstly, we introduce a set of learnable and autoregressive queries to capture the instantaneous target appearance changes in a sliding window fashion. Then, we design a novel attention mechanism for the interaction of existing queries to generate a new query in current frame. Finally, based on the initial target template and learnt autoregressive queries, a spatio-temporal information fusion module (STM) is designed for spatio-temporal formation aggregation to locate a target object. Benefiting from the STM, we can effectively combine the static appearance and instantaneous changes to guide robust tracking. Extensive experiments show that our method significantly improves the tracker’s performance on six popular tracking benchmarks: LaSOT, LaSOText, TrackingNet, GOT-10k, TNL2K, and *** and models will be here. Copyright © 2024, The Authors. All rights reserved.

关键词： Benchmarking

Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yu, Ting Fu, Kunhao Wang, Shuhui Huang, Qingming Yu, Jun School of Information Science and Technology Hangzhou Normal University Hangzhou311121 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing101408 China Key Laboratory of Complex Systems Modeling and Simulation School of Computer Science and Technology Hangzhou Dianzi University Hangzhou310018 China

Video Question Answering (VideoQA) represents a crucial intersection between video understanding and language processing, requiring both discriminative unimodal comprehension and sophisticated cross-modal interaction for accurate inference. Despite advancements in multi-modal pre-trained models and video-language foundation models, these systems often struggle with domain-specific VideoQA due to their generalized pre-training objectives. Addressing this gap necessitates bridging the divide between broad cross-modal knowledge and the specific inference demands of VideoQA tasks. To this end, we introduce HeurVidQA, a framework that leverages domain-specific entity-action heuristics to refine pre-trained video-language foundation models. Our approach treats these models as implicit knowledge engines, employing domain-specific entity-action prompters to direct the model’s focus toward precise cues that enhance reasoning. By delivering fine-grained heuristics, we improve the model’s ability to identify and interpret key entities and actions, thereby enhancing its reasoning capabilities. Extensive evaluations across multiple VideoQA datasets demonstrate that our method significantly outperforms existing models, underscoring the importance of integrating domain-specific knowledge into video-language models for more accurate and context-aware VideoQA. Copyright © 2024, The Authors. All rights reserved.

关键词： Inference engines

An Active Landing Recovery Method for Quadrotor UAV: Localization, Tracking and Buffering Landing

学校读者我要写书评

暂无评论

IFAC-PapersOnLine 2023年第2期56卷 3366-3372页

作者： Yongkang Xu Zhihua Chen Shoukun Wang Junzheng Wang National Key Lab of Autonomous Intelligent Unmanned Systems Beijing Institute of Technology Beijing CO 100081 P.R.China Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition and MOE Key Lab of Nondestructive Testing Technology School of Information Engineering Nanchang Hangkong University Nanchang CO 330063 P.R. China

This paper proposes a principle of fully autonomous ground mobile landing recovery of Unmanned Aerial Vehicles (UAV) for the problems of relatively fixed landing point, passive recovery, poor flexibility, and environmental adaptability, which mainly includes localization, landing point tracking, and buffering landing for quadrotor UAV. Firstly, aiming at the problem that it is difficult to accurately obtain the position of a UAV in dynamic mobile landing recovery, a target location method based on Asynchronous Multisensor information Fusion(AMIF) and servo turntable focus tracking is proposed. Secondly, to achieve fast and high-precision tracking of UAVs, a tracking control strategy of an independently driven landing recovery system and a Stewart six-degree of freedom platform is proposed. Then, to solve the problems of large impact force and center of gravity instability in the landing process of UAV, a stationarity control algorithm based on model prediction and a compliance control algorithm based on adaptive variable impedance are designed to achieve active compliance control while adjusting the position and attitude of the receiving surface in real-time. Finally, a quadrotor unmanned landing and recovery experimental platform is built to verify the feasibility of the ground mobile landing and recovery strategy proposed in this paper and the effectiveness of the control algorithm.

关键词： Quadrotor UAV Mobile Autonomous recovery Target localization Falling point tracking Buffering landing

NavG: Risk-Aware Navigation in Crowded Environments Based on Reinforcement Learning with Guidance Points

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Qianyi Luo, Wentao Liu, Boyi Zhang, Ziyang Wang, Yaoyuan Liu, Jingtai Institute of Robotics and Automatic Information System Nankai University Tianjin Key Laboratory of Intelligent Robotics Tianjin China Advanced Computing and Storage Lab Huawei 2012 Lab China Department of Electronic and Computer Engineering The Kong Kong University of Science and Technology Hong Kong

Motion planning in navigation systems is highly susceptible to upstream perceptual errors, particularly in human detection and tracking. To mitigate this issue, the concept of guidance points—a novel directional cue within a reinforcement learning-based framework—is introduced. A structured method for identifying guidance points is developed, consisting of obstacle boundary extraction, potential guidance point detection, and redundancy elimination. To integrate guidance points into the navigation pipeline, a perception-to-planning mapping strategy is proposed, unifying guidance points with other perceptual inputs and enabling the RL agent to effectively leverage the complementary relationships among raw laser data, human detection and tracking, and guidance points. Qualitative and quantitative simulations demonstrate that the proposed approach achieves the highest success rate and near-optimal travel times, greatly improving both safety and efficiency. Furthermore, real-world experiments in dynamic corridors and lobbies validate the robot’s ability to confidently navigate around obstacles and robustly avoid pedestrians. © 2025, CC BY.

关键词： Travel time