检索结果-内蒙古大学图书馆

arXiv 2025年

作者： Ou, Ruizhe Hu, Yuan Zhang, Fan Chen, Jiaxin Liu, Yu Pattern Recognition and Intelligent System Lab School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China Institute of Remote Sensing and Geographic Information Systems School of Earth and Space Sciences Peking University Beijing100871 China Peking University Ordos Research Institute of Energy Ordos017000 China

Multi-modal large language models (MLLMs) have achieved remarkable success in image- and region-level remote sensing (RS) image understanding tasks, such as image captioning, visual question answering, and visual grounding. However, existing RS MLLMs lack the pixel-level dialogue capability, which involves responding to user instructions with segmentation masks for specific instances. In this paper, we propose GeoPix, a RS MLLM that extends image understanding capabilities to the pixel level. This is achieved by equipping the MLLM with a mask predictor, which transforms visual features from the vision encoder into masks conditioned on the LLM’s segmentation token embeddings. To facilitate the segmentation of multi-scale objects in RS imagery, a class-wise learnable memory module is integrated into the mask predictor to capture and store class-wise geo-context at the instance level across the entire dataset. In addition, to address the absence of large-scale datasets for training pixel-level RS MLLMs, we construct the GeoPixInstruct dataset, comprising 65,463 images and 140,412 instances, with each instance annotated with text descriptions, bounding boxes, and masks. Furthermore, we develop a two-stage training strategy to balance the distinct requirements of text generation and masks prediction in multi-modal multi-task optimization. Extensive experiments verify the effectiveness and superiority of GeoPix in pixel-level segmentation tasks, while also maintaining competitive performance in image- and region-level benchmarks. The models, dataset, and code are publicly available at https://***/Norman-Ou/GeoPix. © 2025, CC BY.

关键词： Image segmentation

来源：评论

学校读者我要写书评

暂无评论

Unsupervised Structure-Texture Separation Network for Oracle Character recognition

arXiv

引用

arXiv 2022年

作者： Wang, Mei Deng, Weihong Liu, Cheng-Lin The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China The National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China The School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China

Oracle bone script is the earliest-known Chinese writing system of the Shang dynasty and is precious to archeology and philology. However, real-world scanned oracle data are rare and few experts are available for annotation which make the automatic recognition of scanned oracle characters become a challenging task. Therefore, we aim to explore unsupervised domain adaptation to transfer knowledge from handprinted oracle data, which are easy to acquire, to scanned domain. We propose a structure-texture separation network (STSN), which is an end-to-end learning framework for joint disentanglement, transformation, adaptation and recognition. First, STSN disentangles features into structure (glyph) and texture (noise) components by generative models, and then aligns handprinted and scanned data in structure feature space such that the negative influence caused by serious noises can be avoided when adapting. Second, transformation is achieved via swapping the learned textures across domains and a classifier for final classification is trained to predict the labels of the transformed scanned characters. This not only guarantees the absolute separation, but also enhances the discriminative ability of the learned features. Extensive experiments on Oracle-241 dataset show that STSN outperforms other adaptation methods and successfully improves recognition performance on scanned data even when they are contaminated by long burial and careless excavation. © 2022, CC BY.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Learning Invariant Visual Representations for Compositional Zero-Shot Learning

arXiv

引用

arXiv 2022年

作者： Zhang, Tian Liang, Kongming Du, Ruoyi Sun, Xian Ma, Zhanyu Guo, Jun Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications China Aerospace Information Research Institute Chinese Academy of Sciences China

Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions using knowledge learned from seen attribute-object compositions in the training set. Previous works mainly project an image and a composition into a common embedding space to measure their compatibility score. However, both attributes and objects share the visual representations learned above, leading the model to exploit spurious correlations and bias towards seen pairs. Instead, we reconsider CZSL as an out-of-distribution generalization problem. If an object is treated as a domain, we can learn object-invariant features to recognize the attributes attached to any object reliably. Similarly, attribute-invariant features can also be learned when recognizing the objects with attributes as domains. Specifically, we propose an invariant feature learning framework to align different domains at the representation and gradient levels to capture the intrinsic characteristics associated with the tasks. Experiments on three CZSL benchmarks demonstrate that the proposed method significantly outperforms the previous state-of-the-art. Copyright © 2022, The Authors. All rights reserved.

关键词： Zero-shot learning

来源：评论

学校读者我要写书评

暂无评论

Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning

arXiv

引用

arXiv 2024年

作者： He, Fan He, Mingzhen Shi, Lei Huang, Xiaolin Suykens, Johan A.K. STADIUS Center for Dynamical Systems Signal Processing and Data Analytics KU Leuven Leuven Belgium MOE Key Laboratory of System Control and Information Processing Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Shanghai Key Laboratory for Contemporary Applied Mathematics School of Mathematical Sciences Fudan University Shanghai200433 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China MOE Key Laboratory of System Control and Information Processing Institute of Image Processing and Pattern Recognition Institute of Medical Robotics Shanghai Jiao Tong University Shanghai200240 China

Ridgeless regression has garnered attention among researchers, particularly in light of the "Benign Overfitting" phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression does not always perform well due to the lack of flexibility. This paper enhances kernel ridgeless regression with Locally-Adaptive-Bandwidths (LAB) RBF kernels, incorporating kernel learning techniques to improve performance in both experiments and theory. For the first time, we demonstrate that functions learned from LAB RBF kernels belong to an integral space of Reproducible Kernel Hilbert Spaces (RKHSs). Despite the absence of explicit regularization in the proposed model, its optimization is equivalent to solving an 0-regularized problem in the integral space of RKHSs, elucidating the origin of its generalization ability. Taking an approximation analysis viewpoint, we introduce an lq-norm analysis technique (with 0 © 2024, CC BY.

关键词： Vector spaces

来源：评论

学校读者我要写书评

暂无评论

MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagery

arXiv

引用

arXiv 2025年

作者： Li, Yansheng Wu, Yuning Cheng, Gong Tao, Chao Dang, Bo Wang, Yu Zhang, Jiahao Zhang, Chuge Liu, Yiting Tang, Xu Ma, Jiayi Zhang, Yongjun Information and computing science from Shandong University Weihai China Pattern recognition and intelligent system from the Huazhong University of Science and Technology Wuhan China Computer science and technology from Wuhan University Wuhan China Xidian University Xi’an China Pattern recognition and intelligent systems from Northwestern Polytechnical University Xi’an China School of Mathematics and Statistics Huazhong University of Science and Technology Wuhan China Institute for Pattern Recognition and Artificial Intelligence Huazhong China University of Science and Technology Remote sensing science and technology from Wuhan University Wuhan China School of Remote Sensing and Information Engineering Wuhan University Wuhan China Electronic circuit and system from Xidian University Xi’an China University of Colorado at Boulder BoulderCO United States Control science and engineering from the Huazhong University of Science and Technology Wuhan China Geodesy and photography from Wuhan University Wuhan China

Accurate fine-grained geospatial scene classification using remote sensing imagery is essential for a wide range of applications. However, existing approaches often rely on manually zooming remote sensing images at different scales to create typical scene samples. This approach fails to adequately support the fixed-resolution image interpretation requirements in real-world scenarios. To address this limitation, we introduce the Million-scale finE-grained geospatial scEne classification dataseT (MEET), which contains over 1.03 million zoom-free remote sensing scene samples, manually annotated into 80 fine-grained categories. In MEET, each scene sample follows a scene-in-scene layout, where the central scene serves as the reference, and auxiliary scenes provide crucial spatial context for fine-grained classification. Moreover, to tackle the emerging challenge of scene-in-scene classification, we present the Context-Aware Transformer (CAT), a model specifically designed for this task, which adaptively fuses spatial context to accurately classify the scene samples. CAT adaptively fuses spatial context to accurately classify the scene samples by learning attentional features that capture the relationships between the center and auxiliary scenes. Based on MEET, we establish a comprehensive benchmark for fine-grained geospatial scene classification, evaluating CAT against 11 competitive baselines. The results demonstrate that CAT significantly outperforms these baselines, achieving a 1.88% higher balanced accuracy (BA) with the Swin-Large backbone, and a notable 7.87% improvement with the Swin-Huge backbone. Further experiments validate the effectiveness of each module in CAT and show the practical applicability of CAT in the urban functional zone mapping. The source code and dataset will be publicly available at https://***/project/***. Copyright © 2025, The Authors. All rights reserved.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

Finger in Camera Speaks Everything: Unconstrained Air-Writing for Real-World

arXiv

引用

arXiv 2024年

作者： Wu, Meiqi Huang, Kaiqi Cai, Yuanqiang Hu, Shiyu Zhao, Yuzhong Wang, Weiqiang School of Computer Science and Technology University of Chinese Academy of Sciences Beijing100049 China Beijing University of Posts and Telecommunications Beijing100876 China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China Center for Research on Intelligent System and Engineering Institute of Automation Chinese Academy of Sciences Beijing100190 China Center for Research on Intelligent System and Engineering National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China University of Chinese Academy of Sciences Beijing100049 China CAS Center for Excellence in Brain Science and Intelligence Technology Shanghai200031 China

Air-writing is a challenging task that combines the fields of computer vision and natural language processing, offering an intuitive and natural approach for human-computer interaction. However, current air-writing solutions face two primary challenges: (1) their dependency on complex sensors (e.g., Radar, EEGs and others) for capturing precise handwritten trajectories, and (2) the absence of a video-based air-writing dataset that covers a comprehensive vocabulary range. These limitations impede their practicality in various real-world scenarios, including the use on devices like iPhones and laptops. To tackle these challenges, we present the groundbreaking air-writing Chinese character video dataset (AWCV-100K-UCAS2024), serving as a pioneering benchmark for video-based air-writing. This dataset captures handwritten trajectories in various real-world scenarios using commonly accessible RGB cameras, eliminating the need for complex sensors. AWCV-100K-UCAS2024 includes 8.8 million video frames, encompassing the complete set of 3,755 characters from the GB2312-80 level-1 set (GB1). Furthermore, we introduce our baseline approach, the video-based character recognizer (VCRec). VCRec adeptly extracts fingertip features from sparse visual cues and employs a spatio-temporal sequence module for analysis. Experimental results showcase the superior performance of VCRec compared to existing models in recognizing air-written characters, both quantitatively and qualitatively. This breakthrough paves the way for enhanced human-computer interaction in real-world contexts. Moreover, our approach leverages affordable RGB cameras, enabling its applicability in a diverse range of scenarios. The code and data examples will be made public at https://***/wmeiqi/AWCV. Copyright © 2024, The Authors. All rights reserved.

关键词： Natural language processing systems

来源：评论

学校读者我要写书评

暂无评论

Graph Convolution Based Cross-Network Multi-Scale Feature Fusion for Deep Vessel Segmentation

arXiv

引用

arXiv 2023年

作者： Zhao, Gangming Liang, Kongming Pan, Chengwei Zhang, Fandong Wu, Xianpeng Hu, Xinyang Yu, Yizhou The Department of Computer Science The University of Hong Kong Hong Kong Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Institute of Artificial Intelligence Beihang University Beijing China The AI Lab Deepwise Healthcare Beijing China Department of Cardiology of the Second Affiliated Hospital School of Medicine Zhejiang University Hangzhou China Key Laboratory of Cardiovascular of Zhejiang Province Hangzhou China

Vessel segmentation is widely used to help with vascular disease diagnosis. Vessels reconstructed using existing methods are often not sufficiently accurate to meet clinical use standards. This is because 3D vessel structures are highly complicated and exhibit unique characteristics, including sparsity and anisotropy. In this paper, we propose a novel hybrid deep neural network for vessel segmentation. Our network consists of two cascaded subnetworks performing initial and refined segmentation respectively. The second subnetwork further has two tightly coupled components, a traditional CNN-based U-Net and a graph U-Net. Cross-network multi-scale feature fusion is performed between these two U-shaped networks to effectively support high-quality vessel segmentation. The entire cascaded network can be trained from end to end. The graph in the second subnetwork is constructed according to a vessel probability map as well as appearance and semantic similarities in the original CT volume. To tackle the challenges caused by the sparsity and anisotropy of vessels, a higher percentage of graph nodes are distributed in areas that potentially contain vessels while a higher percentage of edges follow the orientation of potential nearby vessels. Extensive experiments demonstrate our deep network achieves state-of-the-art 3D vessel segmentation performance on multiple public and in-house datasets. Copyright © 2023, The Authors. All rights reserved.

关键词： Anisotropy

来源：评论

学校读者我要写书评

暂无评论

Structured DropConnect for uncertainty inference in image classification

arXiv

引用

arXiv 2021年

作者： Zheng, Wenqing Xie, Jiyang Liu, Weidong Ma, Zhanyu Pattern Recognition and Intelligent System Lab Beijing University of Posts and Telecommunications Beijing China China Mobile Research Institute Beijing China Beijing Academy of Artificial Intelligence

With the complexity of the network structure, uncertainty inference has become an important task to improve classification accuracy for artificial intelligence systems. For image classification tasks, we propose a structured DropConnect (SDC) framework to model the output of a deep neural network by a Dirichlet distribution. We introduce a DropConnect strategy on weights in the fully connected layers during training. In test, we split the network into several sub-networks, and then model the Dirichlet distribution by match its moments with the mean and variance of the outputs of these sub-networks. The entropy of the estimated Dirichlet distribution is finally utilized for uncertainty inference. In this paper, this framework is implemented on LeNet5 and VGG16 models for misclassification detection and out-of-distribution detection on MNIST and CIFAR-10 datasets. Experimental results show that the performance of the proposed SDC can be comparable to other uncertainty inference methods. Furthermore, the SDC is adapted well to different network structures with certain generalization capabilities and research *** Codes 14J60 (Primary) 14F05, 14J26 (Secondary) Copyright © 2021, The Authors. All rights reserved.

关键词： Image classification

来源：评论

学校读者我要写书评

暂无评论

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

arXiv

引用

arXiv 2024年

作者： Wan, Xujie Li, Wenjie Gao, Guangwei Lu, Huimin Yang, Jian Lin, Chia-Wen The Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210046 China Key Laboratory of Artificial Intelligence Ministry of Education Shanghai200240 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100080 China The School of Automation Southeast University Nanjing210096 China The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210094 China The Department of Electrical Engineering National Tsing Hua University Hsinchu30013 Taiwan

Recently, CNN and Transformer hybrid networks demonstrated excellent performance in face super-resolution (FSR) tasks. Since numerous features at different scales in hybrid networks, how to fuse these multi-scale features and promote their complementarity is crucial for enhancing FSR. However, existing hybrid network-based FSR methods ignore this, only simply combining the Transformer and CNN. To address this issue, we propose an attention-guided Multi-scale interaction network (AMINet), which contains local and global feature interactions as well as encoder-decoder phases feature interactions. Specifically, we propose a Local and Global Feature Interaction Module (LGFI) to promote fusions of global features and different receptive fields' local features extracted by our Residual Depth Feature Extraction Module (RDFE). Additionally, we propose a Selective Kernel Attention Fusion Module (SKAF) to adaptively select fusions of different features within LGFI and encoder-decoder phases. Our above design allows the free flow of multi-scale features from within modules and between encoder and decoder, which can promote the complementarity of different scale features to enhance FSR. Comprehensive experiments confirm that our method consistently performs well with less computational consumption and faster inference. Copyright © 2024, The Authors. All rights reserved.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

Survey on Deep Face Restoration: From Non-blind to Blind and Beyond

arXiv

引用

arXiv 2023年

作者： Li, Wenjie Wang, Mei Zhang, Kai Li, Juncheng Li, Xiaoming Zhang, Yuhang Gao, Guangwei Deng, Weihong Lin, Chia-Wen The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China The Computer Vision Lab ETH Zürich Zürich Switzerland The School of Communication and Information Engineering Shanghai University Shanghai China The Nanyang Technological University Singapore The Intelligent Visual Information Perception Laboratory Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing China The Department of Electrical Engineering National Tsing Hua University Hsinchu Taiwan

Face restoration (FR) is a specialized field within image restoration that aims to recover low-quality (LQ) face images into high-quality (HQ) face images. Recent advances in deep learning technology have led to significant progress in FR methods. In this paper, we begin by examining the prevalent factors responsible for real-world LQ images and introduce degradation techniques used to synthesize LQ images. We also discuss notable benchmarks commonly utilized in the field. Next, we categorize FR methods based on different tasks and explain their evolution over time. Furthermore, we explore the various facial priors commonly utilized in the restoration process and discuss strategies to enhance their effectiveness. In the experimental section, we thoroughly evaluate the performance of state-of-the-art FR methods across various tasks using a unified benchmark. We analyze their performance from different perspectives. Finally, we discuss the challenges faced in the field of FR and propose potential directions for future advancements. The open-source repository corresponding to this work can be found at https://***/24wenjie-li/Awesome-Face-Restoration. Copyright © 2023, The Authors. All rights reserved.

关键词： Restoration

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：