检索结果-内蒙古大学图书馆

Interaction Confidence Attention for Human–Object Interaction Detection

International Journal of computer vision 2025年 1-20页

作者： Zhang, Hong-Bo Lin, Wang-Kai Su, Hang Lei, Qing Liu, Jing-Hua Du, Ji-Xiang Department of Computer Science and Technology Huaqiao University Xiamen361021 China Fujian Key Laboratory of Big Data Intelligence and Security Huaqiao University Xiamen361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen361021 China Fujian Province University Xiamen361021 China

In human–object interaction (HOI) detection task, ensuring that interactive pairs receive higher attention weights while reducing the weight of non-interaction pairs is imperative for enhancing HOI detection accuracy. Guiding attention learning is also a key aspect of existing transformer-based algorithms. To tackle this challenge, this study proposes a novel approach termed Interaction Confidence Score Learning Attention (ICSLA), which introduces weakening and augmentation operations into the original attention weight calculation and feature extraction processes. In ICSLA, feature learning is coupled with confidence score learning, simultaneously. Leveraging ICSLA, a new and universal decoder is devised, establishing a transformer-based one-stage HOI detection architecture. Experimental results demonstrate the effectiveness of the proposed method in improving HOI detection accuracy, offering valuable insights for further optimization of attention mechanisms. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.

关键词： Augmentation operation Human–object interaction detection Interaction confidence score learning attention Weakening operation

来源：评论

学校读者我要写书评

暂无评论

A temporal-spatial feature coordination network for change detection of VHR images 3

A temporal-spatial feature coordination network for change d...

引用

3rd International Conference on Geographic Information and Remote Sensing Technology, GIRST 2024

作者： Zeng, Yuxian Zhang, Xinxin College of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen University of Technology Xiamen361024 China

ISBN: (纸本)9781510689077

Deep learning techniques have significantly improved the accuracy and efficiency of change detection of very high resolution (VHR) images. However, many current models ignore the inherent heterogeneity of bi-temporal remote sensing images, thus making it difficult to distinguish between target changes and background variations. To address this problem, we propose a deep learning (DL) framework, namely temporal-spatial feature coordination network (TSFCN), to improve the accuracy of detection by enhancing the differentiation of change pixel features and improving the extraction and processing of change information. Further comparison and ablation experiments on the SVCD dataset show that the proposed model, compared with other models, improves the F1 scores and IoU by 2.09% and 3.81%, respectively. The results demonstrate that our model can achieve better accuracy and performance improvement. © 2025 SPIE.

关键词： Change detection

来源：评论

学校读者我要写书评

暂无评论

Adjustable Gating Prompt Transformer for Facial Attribute recognition with Limited Labeled Data 27th

Adjustable Gating Prompt Transformer for Facial Attribute R...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Ye, Qinxian Chen, Si Wang, Da-Han Jiang, Nanfeng Su, Yanfei Yan, Yan Fujian Key Laboratory of Pattern Recognition and Image Understanding School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China School of Informatics Xiamen University Xiamen361005 China

ISBN: (纸本)9783031781032

Existing supervised facial attribute recognition (FAR) methods that rely on large labeled datasets can pose a challenge in real-world scenarios. In the case of limited labeled data, the current methods that introduce auxiliary tasks with a large number of parameters are not conducive to the embedded applications of FAR. To overcome these challenges, this paper develops an adjustable gating prompt Transformer that can handle the limited labeled FAR task with a small number of training parameters. Specifically, we employ an effective image-guided prompt tuning, where the image-related prompt sequence is first generated by feeding image tokens into an image-guided prompt generation network (IPG-Net). Then, the prompt sequence can learn facial image information and guide the frozen pre-trained Transformer to fine-tune the model. In addition, dynamically adjustable gating is applied to the prompt sequence to adaptively adjust the contribution of the prompts from different encoder layers, which enhances the interaction between the different encoder layers and retains effective feature information during the iterative process. Experimental results on the CelebA and LFWA datasets demonstrate that our method outperforms competitive methods with a very small amount of training parameters when only limited labeled data are used. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Signal encoding

来源：评论

学校读者我要写书评

暂无评论

DocHFormer: Document Image Dewarping via Harmonized Modeling of Hierarchical Priors 27th

DocHFormer: Document Image Dewarping via Harmonized Modelin...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Zhou, Xinyue Li, Guanting Jiang, Nanfeng Wang, Da-Han Zhang, Xu-Yao Zhu, ShunZhi School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783031781186

Document Image Dewarping (DID) task aims to address the issue of geometry distortion and improve image quality. In this paper, we propose a simple but effective method, named DocHFormer, that can take hierarchical priors features of images, including document image mask and coordinate positions, as additional information to realize accurate representation. To better exploit these fused information for dewarping, we take them into a harmonized space random shuffle operation, which can stochastically rearrange the pixels across spatial space and further use inverse operation to recover the original order. This way can adapt to allocate each feature pixel with equal probability and thus make full use of multi-type features. Furthermore, we introduce this mechanism into local self-attention to use linear complexity to input resolution and also design a new feed-forward network with structural modeling to boost representation. With the help of the above components, our proposed DocHFormer can achieve competitive performance with lower complexity and also outperform the existing state-of-the-art on several popular datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Document Image Shadow Removal via Frequency Information-Oriented Network 27th

Document Image Shadow Removal via Frequency Information-Ori...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Yang, Fan Zhou, Xinyue Jiang, Nanfeng Wang, Da-Han Zhang, Xu-Yao Li, Guantin Man, Wang Wu, Yun School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783031781186

Removing shadows from document images can significantly improve the Quality of Experience (QoE) and boost the performance of the downstream document analysis and recognition tasks. However, existing methods still have limited generalization ability on complex document images and are prone to disrupt the image details. To address this issue, we consider the different shadow types that impact the image content on different frequency sub-bands. This motivates us to exploit frequency-domain information and further design a Frequency Information-oriented Deshadow Network (FID-Net). The proposed FID-Net mainly uses two elaborated modules, named Frequency Feature Extractor (FFE) and a Frequency Feature Refinement (FFR). FFE can generate low/high-frequency features through adaptively decomposing spectra of the shadow image. After that, FFR further refines both frequency features with mutual information operations. With the proposed key designs, extensive experimental results on the commonly used benchmarks demonstrate that the proposed method can learn discriminative shadows and achieve favorable performance against state-of-the-art approaches. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

SANS: Spatial-Aware Neural Solver for Plane Geometry Problem 27th

SANS: Spatial-Aware Neural Solver for Plane Geometry Proble...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Lin, Zi-Hao Xiao, Shun-Xin Chen, Zi-Rong Li, Jian-Min Wang, Da-Han Zhang, Xu-Yao School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Geometry problem solving (GPS) is an important research direction in artificial intelligence. Previous studies have demonstrated the effectiveness of neural solvers in GPS. However, they are deficiencies in accurately representing spatial relationships of geometric primitives within visually rich geometric diagrams. This paper presents a novel neural solver termed spatial-aware neural solver (SANS) that can perceive spatial relationships between geometric primitives. SANS includes two new modules: multimodal dual-branch spatial awareness pre-trained language module and point-primitive spatial-aware attention module. The pre-training module employs a dual-branch visual-textual point-matching strategy to align visual and textual points, and utilizes semantic structure pre-training to model global relationships. Additionally, the point-primitive spatial awareness attention module enhances the model’s ability to perceive spatial relationships between geometric primitives by accounting for the relative positions of points. Experiments show that SANS achieves 81.5 and 74.1 of accuracy on the Geometry3K and PGPS9K datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Learning Explicit Radical Representations for Zero-Shot Chinese Character recognition 27th

Learning Explicit Radical Representations for Zero-Shot Chin...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Pan, Song-Liang Wang, Da-Han Jiang, Nanfeng Zhang, Xu-Yao Zhu, Shunzhi School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Zero-shot Chinese character recognition (ZSCCR) aims to recognize unseen Chinese characters by learning the semantic knowledge of seen characters. Radical-based methods treat Chinese characters as combinations of radicals, recognizing characters by predicting the radicals in the images. Existing radical-based methods have a closed radical parsing process that cannot be intervened in mid-course, relying only on semantic labels for constraints. However, semantic embedding vectors are usually manually designed and lack alignment with visual features, making it extremely difficult for the model to learn and locate discriminative radical representations from visual features. This paper proposes a ZSCCR network called Learning Explicit Radical Representations (LERRNet). LERRNet introduces learnable attribute hint vectors to guide the model in locating discriminative radicals and learning explicit representations of images. Specifically, we introduce a Radical Relevance Enhanced Encoder (RREE) to enhance the correlation of local radicals by augmenting the relationships between grid regions in visual features. Guided by attribute hint vectors, LERRNet employs a Radical Representation Decoder (RRD) to locate the most relevant regions of each radical in the given image and learn explicit radical representations. Extensive experiments demonstrate that LERRNet outperforms state-of-the-art radical/stroke-based methods across three ZSCCR benchmarks. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Zero-shot learning

来源：评论

学校读者我要写书评

暂无评论

Multi-stage query-based feature generating and encoding for robust early action recognition

引用

Visual computer 2025年 1-17页

作者： Chen, Jie Pan, Wei-Xiang Zhang, Hong-Bo Lin, Ming-Xuan Lei, Qing Liu, Jing-Hua Department of Computer Science and Technology Huaqiao University Xiamen 361021 China Fujxian Key Laboratory of Big Data Intelligence and Security Huaqiao University Xiamen 361021 China Xiamen Key Laboratory of Computer Vision and Pattern Recognition Huaqiao University Xiamen 361021 China

This paper proposes a novel early action recognition (EAR) method based on multi-stage query-based feature generation and encoding. Existing EAR approaches often struggle with the similarity of initial action features, making it challenging to accurately extract discriminative information. To address this, our method divides the unobserved feature reconstruction process into multiple sub-stages, with each stage focusing on generating and restoring a small segment of action information. This segmentation strategy ensures that the reconstructed action information is more consistent with real-world scenarios. Furthermore, we introduce a query encoding network to model the relationships between sub-stage action features, effectively integrating them to enrich feature representations, enhance model generalization, and improve sequence coherence. Experimental results on public datasets HMDB51 and UCF101 demonstrate that our method significantly outperforms existing methods, achieving robust and accurate early action recognition. Specifically, its ability to handle action progression under different observation rates also specifically reflects the robustness of the proposed method. The code of this work is publicly available at https://***/Chenjie0921/Multiple-stage. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2025.

关键词： Early action recognition Multi-stage query Query encoding Unobserved feature reconstruction

来源：评论

学校读者我要写书评

暂无评论

OCR4HSV: A Multi-task Learning Approach for Handwritten Signature Verification 27th

OCR4HSV: A Multi-task Learning Approach for Handwritten Sig...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Lin, Chao-Qun Wang, Da-Han Su, Yan-Fei Ge, De-Wu Zhang, Xu-Yao School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China Xiamen KEYTOP Communication Technology Co. Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Handwritten signature verification (HSV) models are notably recognized for their ability to discern whether a signature is forged in an offline document. Recently, HSV technology has made significant development. However, these methods have primarily focused on the shape features of the text image and overlooked the textual feature information inherent in the text itself, which makes the HSV model overfit. In this paper, we propose a novel network model named OCR4HSV to solve the above shortcomings. The proposed OCR4HSV first attempts to combine OCR and HSV to learn textual features in a multi-task learning manner. The model employs a dual-parameter approach, combining shared parameters and independent parameters. Specifically, Within the shared parameters, the Laplace attention module (LAM) is incorporated for edge information extraction. For independent parameters, CN-Mamba is utilized for sequence feature extraction in OCR, and the multi-scale global fusion block (MGFB) is designed to enhance the distinction between reference and test sample pairs. Leveraging OCR-related information and these architectural enhancements can fully mine the inherent textual feature information and significantly mitigate overfitting in the HSV task, thereby boosting verification accuracy. Our model has achieved state-of-the-art performance on the ChiSig and HanSig datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Multi-task learning

来源：评论

学校读者我要写书评

暂无评论

SIR-HCL: Semantic-Inconsistency Reasoning and Hybrid Contrastive Learning for Efficient Cross-Emotion Anomaly Detection

引用

IEEE Transactions on Cognitive and Developmental Systems 2025年

作者： Liu, Xin Chen, Qiyan Cheung, Yiu-Ming Peng, Shu-Juan Huaqiao University Department of Computer Science Xiamen361021 China Hong Kong Baptist University Department of Computer Science SAR Hong Kong Hong Kong Xiamen Key Laboratory of Computer Vision and Pattern Recognition Xiamen361021 China Huaqiao University Fujian Key Laboratory of Big Data Intelligence and Security Xiamen361021 China Huaqiao University Department of Artificial Intelligence Xiamen China Fujian Province University Key Laboratory of Computer Vision and Machine Learning Huaqiao University Xiamen361021 China

Cross-emotion anomaly detection is an emerging and challenging research topic in cognitive analysis field, which aims at identifying the abnormal emotion pair whose semantic patterns are inconsistent across different emotional modalities. To the best of our knowledge, this topic has yet to be well studied, which could potentially benefit lots of valuable cognitive applications such as autistic children diagnosis and criminal deception detection. To this end, this paper proposes an efficient cross-emotion anomaly detection approach via semanticinconsistency reasoning and hybrid contrastive learning (SIR-HCL), which is the first attempt to detect the anomalous emotional pairs across the audio-visual emotions. First, the proposed framework utilizes dual-branch network to obtain the deep emotional features in each modality, and then employs the shared residual block to derive the semantically compatible features. Subsequently, an efficient hybrid contrastive learning approach is designed to enlarge the semantic-inconsistency among abnormal emotional pair with different affective classes, while enhancing the semantic-consistency and increasing the feature correlation between normal emotional pair from the same affective class. At the same time, an efficient bidirectional learning scheme is employed to significantly improve the data utilization and a two-component Beta Mixture Model is adaptively utilized to reason the anomalous emotion pairs. Extensive experiments evaluated on two benchmark datasets show that the proposed SIR-HCL method can well detect the anomalous emotional pairs across audio-visual emotional data, and brings substantial improvements over the state-of-the-art competing methods. © 2016 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：