检索结果-内蒙古大学图书馆

Learning Dual-Domain Calibration and Distance-Driven Correlation Filter:A Probabilistic Perspective for UAV Tracking

引用

Computers, Materials & Continua 2023年第12期77卷 3741-3764页

作者： Taiyu Yan Yuxin Cao Guoxia Xu Xiaoran Zhao Hu Zhu Lizhen Deng Jiangsu Province Key Lab on Image Processing and Image Communication Nanjing University of Posts and TelecommunicationsNanjingChina School of Computer Science Qufu Normal UniversityQufuChina National Engineering Research Center of Communication and Network Technology Nanjing University of Posts and TelecommunicationsNanjingChina

Unmanned Aerial Vehicle(UAV)tracking has been possible because of the growth of intelligent information technology in smart cities,making it simple to gather data at any time by dynamically monitoring events,people,the environment,and other aspects in the *** traditional filter creates a model to address the boundary effect and time filter degradation issues in UAV tracking *** these methods ignore the loss of data integrity terms since they are overly dependent on numerous explicit previous regularization *** light of the aforementioned issues,this work suggests a dual-domain Jensen-Shannon divergence correlation filter(DJSCF)model address the probability-based distance measuring issue in the event of filter *** two-domain weighting matrix and JS divergence constraint are combined to lessen the impact of sample imbalance and *** new tracking models that are based on the perspectives of the actual probability filter distribution and observation probability filter distribution are proposed to translate the statistical distance in the online tracking model into response *** model is roughly transformed into a linear equality constraint issue in the iterative solution,which is then solved by the alternate direction multiplier method(ADMM).The usefulness and superiority of the suggested strategy have been shown by a vast number of experimental findings.

关键词： Dual-domain weighting distance measure correlation filter ADMM

来源：评论

学校读者我要写书评

暂无评论

AMTrans:Auto-Correlation Multi-Head Attention Transformer for Infrared Spectral Deconvolution

引用

清华大学学报自然科学版（英文版） 2025年第3期30卷 1329-1341页

作者： Lei Gao Liyuan Cui Shuwen Chen Lizhen Deng Xiaokang Wang Xiaohong Yan Hu Zhu College of Electronic and Optical Engineering & College of Flexible Electronics(Future Technology) Nanjing University of Posts and TelecommunicationsNanjing 210003China Jiangsu Province Key Lab on Image Processing and Image Communication Nanjing University of Posts and TelecommunicationsNanjing 210003China National Engineering Research Center of Communication and Network Technology Nanjing University of Posts and TelecommunicationsNanjing 210003China School of Computer Science and Technology Hainan UniversityHaikou 570228China

Infrared spectroscopy analysis has found widespread applications in various fields due to advancements in technology and industry *** improve the quality and reliability of infrared spectroscopy signals,deconvolution is a crucial preprocessing *** by the transformer model,we propose an Auto-correlation Multi-head attention Transformer(AMTrans)for infrared spectrum sequence *** auto-correlation attention model improves the scaled dot-product attention in the *** utilizes attention mechanism for feature extraction and implements attention computation using the auto-correlation *** auto-correlation attention model is used to exploit the inherent sequence nature of spectral data and to effectively recovery spectra by capturing auto-correlation patterns in the *** proposed model is trained using supervised learning and demonstrates promising results in infrared spectroscopic *** comparing the experiments with other deconvolution techniques,the experimental results show that the method has excellent deconvolution performance and can effectively recover the texture details of the infrared spectrum.

关键词： spectroscopy spectral deconvolution transformer auto-correlation mechanism

来源：评论

学校读者我要写书评

暂无评论

M-RAT: a Multi-grained Retrieval Augmentation Transformer for image Captioning 17th

M-RAT: a Multi-grained Retrieval Augmentation Transformer f...

引用

17th Asian Conference on Computer Vision, ACCV 2024

作者： Song, Jiayan Pan, Renjie Zhou, Jun Yang, Hua Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai200240 China

ISBN: (纸本)9789819609079

Current encoder-decoder methods for image captioning mai-nly consist of an object detection module (two-stage), or rely on big models with large-scale datasets to improve the effectiveness, which leads to increasing computation costs and cannot introduce new external knowledge. In this paper, we propose a novel end-to-end method Multi-grained Retrieval Augmentation Transformer (M-RAT) that innovatively fuses retrieved text derived from a changeable datastore with input visual feature through a Multi-modal Aligned Encoder, and introduce a specialized attention mechanism, Multi-MSA, to exploit both local and global interactions for delicate fine-grained details. Additionally, we enhance the decoder generation ability by employing low-level and high-level fused embeddings. Experiments demonstrate that M-RAT achieves comparable performance to state-of-the-art baselines with remarkable accuracy and details, as well as showing excellent domain adaptability for novel objects. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

引用

48th IEEE International Conference on Acoustics, Speech and Signal processing, ICASSP 2023

作者： Yang, Jinhai Yang, Hua Shanghai Jiao Tong University Institution of Image Communication and Network Engineering China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai China

ISBN: (纸本)9781728163277

Few-shot learning aims for rapid adaptation with few samples. Recently, cross-granularity few-shot learning has emerged as a promising research area, where models observe coarse labels but target fine-grained recognition among novel classes. As coarse supervision tends to eliminate feature discrimination among underlying sub-classes, existing methods commonly utilize self-supervision as a complement to explore intra-class variation. However, current methods suffer from an intrinsic conflict between contrastive learning and coarse supervision. In this paper, we locate the root cause of the intrinsic conflict. Then, we resolve it by exploiting the similarity among augmented views while ignoring the unreasonable constraint between negative pairs. Besides, we decouple contrastive learning and coarse supervision into parallel branches to better regularize the latent space. Albeit simple, our approach consistently outperforms state-of-the-art methods across different benchmarks. © 2023 IEEE.

关键词： cross-granularity transfer Few-shot learning generalization image classification

来源：评论

学校读者我要写书评

暂无评论

Hydrodynamics-Informed Neural Network for Simulating Dense Crowd Motion Patterns 24

Hydrodynamics-Informed Neural Network for Simulating Dense C...

引用

32nd ACM International Conference on Multimedia, MM 2024

作者： Zhou, Yanshan Lai, Pingrui Yu, Jiaqi Xiong, Yingjie Yang, Hua Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9798400706868

With global occurrences of crowd crushes and stampedes, dense crowd simulation has been drawing great attention. In this research, our goal is to simulate dense crowd motions under six classic motion patterns, more specifically, to generate subsequent motions of dense crowds from the given initial states. Since dense crowds share similarities with fluids, such as continuity and fluidity, one common approach for dense crowd simulation is to construct hydrodynamics-based models, which consider dense crowds as fluids, guide crowd motions with Navier-Stokes equations, and conduct dense crowd simulation by solving governing equations. Despite the proposal of these models, dense crowd simulation faces multiple challenges, including the difficulty of directly solving Navier-Stokes equations due to their nonlinear nature, the ignorance of distinctive crowd characteristics which fluids lack, and the gaps in the evaluation and validation of crowd simulation models. To address the above challenges, we build a hydrodynamic model, which captures the crowd physical properties (continuity, fluidity, etc.) with Navier-Stokes equations and reflects the crowd social properties (sociality, personality, etc.) with operators that describe crowd interactions and crowd-environment interactions. To tackle the computational problem, we propose to solve the governing equation based on Navier-Stokes equations using neural networks, and introduce the Hydrodynamics-Informed Neural Network (HINN) which preserves the structure of the governing equation in its network architecture. To facilitate the evaluation, we construct a new dense crowd motion video dataset called Dense Crowd Flow Dataset (DCFD), containing six classic motion patterns (line, curve, circle, cross, cluster and scatter) and 457 video clips, which can serve as the groundtruths for various objective metrics. Numerous experiments are conducted using HINN to simulate dense crowd motions under six motion patterns with video clips fro

关键词： Navier Stokes equations

来源：评论

学校读者我要写书评

暂无评论

L2RT-FIQA: Face image Quality Assessment via Learning-to-Rank Transformer 9th

L2RT-FIQA: Face Image Quality Assessment via Learning-to-Ra...

引用

9th International Forum on Digital Multimedia communication, IFTC 2022

作者： Chen, Zehao Yang, Hua Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai China

ISBN: (纸本)9789819908554

Face recognition (FR) systems are easily constrained by complex environmental situations in the wild. To ensure the accuracy of FR systems, face image quality assessment (FIQA) is applied to reject low-quality face image unsuitable for recognition. Face quality can be defined as the accuracy or confidence of face images being correctly recognized by FR systems, which is desired to be consistent with recognition results. However, current FIQA methods show more or less inconsistency with face recognition due to the following four biases, including implicit constraint, quality labels, regression models, and backbone networks. In order to reduce such biases and enhance the consistency between FR and FIQA, this paper proposes a FIAQ method based on Learning to rank (L2R) algorithm and vision Transformer named L2RT-FIQA. L2RT-FIQA consists of three parts: relative quality labels, L2R framework, and vision Transformer backbone. Specifically, we utilize normalized intra-class and inter-class angular distance to generate relative quality labels;we employ L2R model to focus more on the quality order rather than the absolute quality value;we apply unpretrained vision transformer as our backbone to improve generalization and global information learning. Experimental results show our L2RT-FIQA effectively reduces the aforementioned four kinds of biases and outperforms other state-of-the-art FIQA methods on several challenging benchmarks. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

关键词： Face recognition

来源：评论

学校读者我要写书评

暂无评论

Sign Language Recognition using Spiking Neural Networks 2

Sign Language Recognition using Spiking Neural Networks

引用

2nd International Conference on Machine Learning and Data Engineering, ICMLDE 2023

作者： Chaudhari, Pranav Vicente-Sola, Alex Basu, Amlan Manna, Davide L. Kirkland, Paul Caterina, Gaetano Di Department of Information and Communication Technology Manipal Institute of Technology Manipal Academy of Higher Education Manipal576104 India Neuromorphic Sensor Signal Processing Lab Centre for Image and Signal Processing Electrical and Electronic Engineering Department University of Strathclyde Glasgow United Kingdom

In recent years, research in automatic Sign Language Recognition (SLR) has undergone significant progress, serving as a founda-tional base for developing applications that aim to promote the integration of deaf individuals into society. Most of this progress is owed to the recent developments in deep learning. However, the deployment of conventional Artificial Neural Networks (ANNs) can be hindered by their requirements in terms of computational power and energy consumption. Therefore, to improve the ef-ciency of current SLR systems, in this work, we propose the use of the increasingly popular Spiking Neural Networks (SNNs), which, on the one hand, provide more energy-efficient computations than conventional ANNs and, on the other hand, are able to process temporal sequences with simpler architectures thanks to their temporal dynamics. To evaluate our method, we utilize WLASL300, the 300-word (300 classes of signs) dataset from Word-Level American Sign Language, and achieve an improvement in accuracy with the SNN (+2.70%) over the previous state-of-the-art, when working with energy-efficient spiking neurons. Furthermore, we construct a non-spiking version of the same network and evaluate it in a similar manner. Our results demonstrate how the SNN has sparser activations (25% less), thanks to the use of spiking neurons, and therefore can be implemented with a lower power requirement than an ANN version of the same architecture. This work thus demonstrates the possibility of performing SLR in a very effective and efficient way, thus opening up the development of applications that span from the automatic real-time translation of dynamic signs to remote control utilizing sign languages. © 2024 Elsevier B.V.. All rights reserved.

关键词： Neural networks

来源：评论

学校读者我要写书评

暂无评论

Flicker-Free Adaptive Enhancement for Infrared Video 13

Flicker-Free Adaptive Enhancement for Infrared Video

引用

13th International Conference on Wireless communications and Signal processing, WCSP 2021

作者： Wei, Caixia Gan, Zongliang Nanjing University of Posts and Telecommunications Jiangsu Provincial Key Lab of Image Processing and Image Communication Nanjing China

ISBN: (纸本)9781665407854

Infrared videos often suffer from low contrast and insufficient texture. In order to improve poor visual effect, a novel infrared video enhancement method is proposed, which contains intra-frame brightness enhancement and inter-frame brightness continuity adjustment. In intra-frame brightness enhancement, it has two steps including global contrast enhancement and local details enhancement. To global contrast enhancement, the processed image contrast by geometric distribution, and it is incorporated into an optimization problem with a sorted histogram of each frame to yield a modified histogram. To local details enhancement, after Retinex decomposition, the reflection component is magnified by boundary preserving filter, and this strategy can effectively suppress noise in relatively uniform regions. Furthermore, to maintain inter-frame brightness continuity, adaptive parameters are introduced through optical flow to control the combination ratio of geometric distribution histogram, in which the enhancement degree of each frame can be adjusted according to inter-frame similarity and the moving region are enhanced adaptively according to the change of each frame. Experimental results demonstrate that proposed algorithm can effectively enhance the contrast and detail of infrared video, and improve the visual effect in subjective and objective quality evaluation. © 2021 IEEE.

关键词： Luminance

来源：评论

学校读者我要写书评

暂无评论

FC-GNN: Recovering Reliable and Accurate Correspondences from Interferences

FC-GNN: Recovering Reliable and Accurate Correspondences fro...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Haobo Xu Jun Zhou Hua Yang Renjie Pan Cunyan Li Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai Key Lab of Digital Media Processing and Transmission

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Finding correspondences between images is essential for many computer vision tasks and sparse matching pipelines have been popular for decades. However, matching noise within and between images, along with inconsistent key-point detection, frequently degrades the matching performance. We review these problems and thus propose: 1) a novel and unified Filtering and Calibrating (FC) approach that jointly rejects outliers and optimizes inliers, and 2) leveraging both the matching context and the underlying image texture to remove matching uncertainties. Under the guidance of the above innovations, we construct Filtering and Calibrating Graph Neural Network (FC-GNN), which follows the FC approach to recover reliable and accurate correspondences from various interferences. FC-GNN conducts an effectively combined inference of contextual and local information through careful embedding and multiple information aggregations, predicting confidence scores and calibration offsets for the input correspondences to jointly filter out outliers and improve pixel-level matching accuracy. Moreover, we exploit the local coherence of matches to perform inference on local graphs, thereby reducing computational complexity. Overall, FC-GNN operates at lightning speed and can greatly boost the performance of diverse matching pipelines across various tasks, showcasing the immense potential of such approaches to become standard and pivotal components of image matching. Code is avaiable at https://***/xuy123456/fcgnn.

关键词： Matched filters Computer vision Technological innovation Accuracy Uncertainty Computer network reliability Pipelines

来源：评论

学校读者我要写书评

暂无评论

Adaptive and Collaborative Multi-scale Alignment for Text-Based Person Search

Adaptive and Collaborative Multi-scale Alignment for Text-Ba...

引用

2023 IEEE International Conference on Visual communications and image processing, VCIP 2023

作者： Yang, Xinxin Pan, Renjie Yang, Hua Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai Key Lab of Digital Media Processing and Transmission Shanghai China Shanghai Jiao Tong University China MoE Key Lab of Artificial Intelligence AI Institute China

ISBN: (纸本)9798350359855

Text-To-image person search is challenging due to the cross-scale correspondences and information inequality between modalities. Specifically, images and text are complexly linked at different scales and images are usually more informative and complete than text. It is crucial to establish semantic correlations between modalities and focus on task-relevant information in images. In this paper, we propose a novel Adaptive and Collaborative Multi-scale Alignment network (ACMA) for text-based person search that learns semantically consistent and information-Aligned multi-modal representations. Firstly, we introduce a novel joint embedding module that adaptively integrates features of different pixels and words, thereby extracting semantically consistent multi-modal features at different scales. Second, we design a cross-modal fusion feature-based auxiliary visual branch to guide the extraction of key visual features that are beneficial for cross-modal matching. Extensive experiments validate that ACMA outperforms the state-of-The-Art method. © 2023 IEEE.

关键词： Embeddings

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：