检索结果-内蒙古大学图书馆

Federated Local Compact Representation Communication:Framework and Application

Machine intelligence Research 2024年第6期21卷 1103-1120页

作者： Zhengquan Luo Yunlong Wang Zilei Wang University of Science and Technology of China(USTC) Hefei230026China New Laboratory of Pattern Recognition(NLPR) Institute of AutomationChinese Academy of SciencesBeijing100190China State Key Laboratory of Multimodal Artificial Intelligence Systems(MAIS) Institute of AutomationChinese Academy of SciencesBeijing100190China

The core of federated learning(FL)is to transfer data diversity and distribution knowledge of cross-client ***-though adopted by most FL methods,model-sharing-based communication has limitations such as unstable optimization and lack of reasonable *** this paper,we propose an innovative approach that exploits a highly abstract local compact representation(LCR)as a communication carrier,paving a new feasible path for *** is not only more intuitive for multiclient joint training but also insensitive to local privacy,particularly in computer vision *** proposed LCR communication-based FL framework aims to improve performance,mitigate negative transfer,and enhance optimization ***,based on the domain adaptation theorem,in-depth theoretical proofs guarantee the contribution of representation communication from other domains,which may lead to a tight-er generalization error bound of the local ***,inspired by metric learning,a federated version of the triplet(FedTriplet)loss and distribution similarity reweighting aggregation are proposed to fully digest LCR from other clients and realize the LCRC-based FL framework with better ***-client FedTriplet transferring redresses the category boundaries in local latent space,resist-ing *** modified Wasserstein distance is employed for reweighting aggregation to overcome the negative transfer problem caused by ***,extensive experiments on MNIST/EMNIST and successful iris recognition applications demon-strate that the proposed LCRC framework is superior in terms of accuracy compared to mainstream model-sharing-based FL *** visualization results also show significant improvements in the distinguishability of the representation distribution.

关键词： Federated learning representation learning domain adaptation biometrics iris recognition

来源：评论

学校读者我要写书评

暂无评论

Understanding Driving Risks via Prompt Learning

Understanding Driving Risks via Prompt Learning

引用

2024 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2024

作者： Chang, Yubo Lyu, Fan Zhang, Zhang Wang, Liang School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China Institute of Automation Chinese Academy of Sciences New Laboratory of Pattern Recognition State Key Laboratory of Multimodal Artificial Intelligence Systems Beijing China

ISBN: (纸本)9781665410205

Understanding driving risks is crucial for enhancing driving safety. It is a challenging task to evaluate driving risks in various complex driving scenarios. Inspired by prompt-based learning, we propose an end-to-end approach for identifying the highest-risk object in the current driving scenario based on a learnable risk pool. Specifically, a method based on key-value pair matching is designed to build a memory system for learning a collection of risk prototypes. Extensive experiments on the DRAMA dataset show that the proposed method achieves an improvement of 18.6% in Mean-IOU and 3.0% in B4 score compared to the state-of-the-art (SOTA) methods, which indicates that our method can effectively localize risky objects and accurately describe the driving scenes. © 2024 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

DocHFormer: Document Image Dewarping via Harmonized Modeling of Hierarchical Priors 27th

DocHFormer: Document Image Dewarping via Harmonized Modelin...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Zhou, Xinyue Li, Guanting Jiang, Nanfeng Wang, Da-Han Zhang, Xu-Yao Zhu, ShunZhi School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783031781186

Document Image Dewarping (DID) task aims to address the issue of geometry distortion and improve image quality. In this paper, we propose a simple but effective method, named DocHFormer, that can take hierarchical priors features of images, including document image mask and coordinate positions, as additional information to realize accurate representation. To better exploit these fused information for dewarping, we take them into a harmonized space random shuffle operation, which can stochastically rearrange the pixels across spatial space and further use inverse operation to recover the original order. This way can adapt to allocate each feature pixel with equal probability and thus make full use of multi-type features. Furthermore, we introduce this mechanism into local self-attention to use linear complexity to input resolution and also design a new feed-forward network with structural modeling to boost representation. With the help of the above components, our proposed DocHFormer can achieve competitive performance with lower complexity and also outperform the existing state-of-the-art on several popular datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Document Image Shadow Removal via Frequency Information-Oriented Network 27th

Document Image Shadow Removal via Frequency Information-Ori...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Yang, Fan Zhou, Xinyue Jiang, Nanfeng Wang, Da-Han Zhang, Xu-Yao Li, Guantin Man, Wang Wu, Yun School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9783031781186

Removing shadows from document images can significantly improve the Quality of Experience (QoE) and boost the performance of the downstream document analysis and recognition tasks. However, existing methods still have limited generalization ability on complex document images and are prone to disrupt the image details. To address this issue, we consider the different shadow types that impact the image content on different frequency sub-bands. This motivates us to exploit frequency-domain information and further design a Frequency Information-oriented Deshadow Network (FID-Net). The proposed FID-Net mainly uses two elaborated modules, named Frequency Feature Extractor (FFE) and a Frequency Feature Refinement (FFR). FFE can generate low/high-frequency features through adaptively decomposing spectra of the shadow image. After that, FFR further refines both frequency features with mutual information operations. With the proposed key designs, extensive experimental results on the commonly used benchmarks demonstrate that the proposed method can learn discriminative shadows and achieve favorable performance against state-of-the-art approaches. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

SANS: Spatial-Aware Neural Solver for Plane Geometry Problem 27th

SANS: Spatial-Aware Neural Solver for Plane Geometry Proble...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Lin, Zi-Hao Xiao, Shun-Xin Chen, Zi-Rong Li, Jian-Min Wang, Da-Han Zhang, Xu-Yao School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Geometry problem solving (GPS) is an important research direction in artificial intelligence. Previous studies have demonstrated the effectiveness of neural solvers in GPS. However, they are deficiencies in accurately representing spatial relationships of geometric primitives within visually rich geometric diagrams. This paper presents a novel neural solver termed spatial-aware neural solver (SANS) that can perceive spatial relationships between geometric primitives. SANS includes two new modules: multimodal dual-branch spatial awareness pre-trained language module and point-primitive spatial-aware attention module. The pre-training module employs a dual-branch visual-textual point-matching strategy to align visual and textual points, and utilizes semantic structure pre-training to model global relationships. Additionally, the point-primitive spatial awareness attention module enhances the model’s ability to perceive spatial relationships between geometric primitives by accounting for the relative positions of points. Experiments show that SANS achieves 81.5 and 74.1 of accuracy on the Geometry3K and PGPS9K datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Sustainable Mining in the Era of Artificial intelligence

引用

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 1-4页

作者： Long Chen Yuting Xie Yutong Wang Shirong Ge Fei-Yue Wang IEEE the State Key Laboratory for Management and Control of Complex Systems at the Institute of Automation Chinese Academy of SciencesBeijing 100190China the National Laboratory of Pattern Recognition at the Institute of Automation and Waytous Ltd.China the School of Computer Science and Engineering Sun Yat-Sen UniversityGuangzhou 510275GuangdongChina the School of Mechanical Electronic and Information Engineering China University of Mining and Technology BeijingBejing 100083China the School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100190China

The mining sector historically drove the global economy but at the expense of severe environmental and health repercussions,posing sustainability challenges[1]-[3].Recent advancements on artificial intelligence(AI)are revolutionizing mining through robotic and data-driven innovations[4]-[7].While AI offers mining industry advantages,it is crucial to acknowledge the potential risks associated with its widespread ***-reliance on AI may lead to a loss of human control over mining operations in the future,resulting in unpredictable consequences.

关键词： Sustainable mining consequences

来源：评论

学校读者我要写书评

暂无评论

Learning Explicit Radical Representations for Zero-Shot Chinese Character recognition 27th

Learning Explicit Radical Representations for Zero-Shot Chin...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Pan, Song-Liang Wang, Da-Han Jiang, Nanfeng Zhang, Xu-Yao Zhu, Shunzhi School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Zero-shot Chinese character recognition (ZSCCR) aims to recognize unseen Chinese characters by learning the semantic knowledge of seen characters. Radical-based methods treat Chinese characters as combinations of radicals, recognizing characters by predicting the radicals in the images. Existing radical-based methods have a closed radical parsing process that cannot be intervened in mid-course, relying only on semantic labels for constraints. However, semantic embedding vectors are usually manually designed and lack alignment with visual features, making it extremely difficult for the model to learn and locate discriminative radical representations from visual features. This paper proposes a ZSCCR network called Learning Explicit Radical Representations (LERRNet). LERRNet introduces learnable attribute hint vectors to guide the model in locating discriminative radicals and learning explicit representations of images. Specifically, we introduce a Radical Relevance Enhanced Encoder (RREE) to enhance the correlation of local radicals by augmenting the relationships between grid regions in visual features. Guided by attribute hint vectors, LERRNet employs a Radical Representation Decoder (RRD) to locate the most relevant regions of each radical in the given image and learn explicit radical representations. Extensive experiments demonstrate that LERRNet outperforms state-of-the-art radical/stroke-based methods across three ZSCCR benchmarks. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Zero-shot learning

来源：评论

学校读者我要写书评

暂无评论

VLKEB: a large vision-language model knowledge editing benchmark 24

VLKEB: a large vision-language model knowledge editing bench...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Han Huang Haitian Zhong Tao Yu Qiang Liu Shu Wu Liang Wang Tieniu Tan University of Chinese Academy of Sciences (UCAS) and New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) and Nanjing University

ISBN: (纸本)9798331314385

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model components, and data for LVLMs editing are limited. The existing LVLM editing benchmark, which comprises three metrics (Reliability, Locality, and Generality), falls short in the quality of synthesized evaluation images and cannot assess whether models apply edited knowledge in relevant content. Therefore, we employ more reliable data collection methods to construct a new Large Vision-Language Model Knowledge Editing Benchmark, VLKEB, and extend the Portability metric for more comprehensive evaluation. Leveraging a multi-modal knowledge graph, our image data are bound with knowledge entities. This can be further used to extract entity-related knowledge, which constitutes the base of editing data. We conduct experiments of different editing methods on five LVLMs, and thoroughly analyze how do they impact the models. The results reveal strengths and deficiencies of these methods and hopefully provide insights for future research. The codes and dataset are available at: https://***/VLKEB/VLKEB.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Pin-Tuning: parameter-efficient in-context tuning for few-shot molecular property prediction 24

Pin-Tuning: parameter-efficient in-context tuning for few-sh...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Liang Wang Qiang Liu Shaozhen Liu Xin Sun Shu Wu New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) and School of Artificial Intelligence University of Chinese Academy of Sciences and University of Science and Technology of China New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) and School of Artificial Intelligence University of Chinese Academy of Sciences New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) University of Science and Technology of China

ISBN: (纸本)9798331314385

Molecular property prediction (MPP) is integral to drug discovery and material science, but often faces the challenge of data scarcity in real-world scenarios. Addressing this, few-shot molecular property prediction (FSMPP) has been developed. Unlike other few-shot tasks, FSMPP typically employs a pre-trained molecular encoder and a context-aware classifier, benefiting from molecular pre-training and molecular context information. Despite these advancements, existing methods struggle with the ineffective fine-tuning of pre-trained encoders. We attribute this issue to the imbalance between the abundance of tunable parameters and the scarcity of labeled molecules, and the lack of contextual perceptiveness in the encoders. To overcome this hurdle, we propose a parameter-efficient in-context tuning method, named Pin-Tuning. Specifically, we propose a lightweight adapter for pre-trained message passing layers (MP-Adapter) and Bayesian weight consolidation for pre-trained atom/bond embedding layers (Emb-BWC), to achieve parameter-efficient tuning while preventing over-fitting and catastrophic forgetting. Additionally, we enhance the MP-Adapters with contextual perceptiveness. This innovation allows for in-context tuning of the pre-trained encoder, thereby improving its adaptability for specific FSMPP tasks. When evaluated on public datasets, our method demonstrates superior tuning with fewer trainable parameters, improving few-shot predictive performance. Code is available at: https://***/CRIPAC-DIG/Pin-Tuning

关键词：

来源：评论

学校读者我要写书评

暂无评论

OCR4HSV: A Multi-task Learning Approach for Handwritten Signature Verification 27th

OCR4HSV: A Multi-task Learning Approach for Handwritten Sig...

引用

27th International Conference on pattern recognition, ICPR 2024

作者： Lin, Chao-Qun Wang, Da-Han Su, Yan-Fei Ge, De-Wu Zhang, Xu-Yao School of Computer and Information Engineering Xiamen University of Technology Xiamen361024 China Fujian Key Laboratory of Pattern Recognition and Image Understanding Xiamen361024 China Xiamen KEYTOP Communication Technology Co. Xiamen361024 China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation of Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783031781186

Handwritten signature verification (HSV) models are notably recognized for their ability to discern whether a signature is forged in an offline document. Recently, HSV technology has made significant development. However, these methods have primarily focused on the shape features of the text image and overlooked the textual feature information inherent in the text itself, which makes the HSV model overfit. In this paper, we propose a novel network model named OCR4HSV to solve the above shortcomings. The proposed OCR4HSV first attempts to combine OCR and HSV to learn textual features in a multi-task learning manner. The model employs a dual-parameter approach, combining shared parameters and independent parameters. Specifically, Within the shared parameters, the Laplace attention module (LAM) is incorporated for edge information extraction. For independent parameters, CN-Mamba is utilized for sequence feature extraction in OCR, and the multi-scale global fusion block (MGFB) is designed to enhance the distinction between reference and test sample pairs. Leveraging OCR-related information and these architectural enhancements can fully mine the inherent textual feature information and significantly mitigate overfitting in the HSV task, thereby boosting verification accuracy. Our model has achieved state-of-the-art performance on the ChiSig and HanSig datasets. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Multi-task learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：