检索结果-内蒙古大学图书馆

MEET: A Million-Scale Dataset for Fine-Grained Geospatial Scene Classification with Zoom-Free Remote Sensing Imagery

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Li, Yansheng Wu, Yuning Cheng, Gong Tao, Chao Dang, Bo Wang, Yu Zhang, Jiahao Zhang, Chuge Liu, Yiting Tang, Xu Ma, Jiayi Zhang, Yongjun Information and computing science from Shandong University Weihai China Pattern recognition and intelligent system from the Huazhong University of Science and Technology Wuhan China Computer science and technology from Wuhan University Wuhan China Xidian University Xi’an China Pattern recognition and intelligent systems from Northwestern Polytechnical University Xi’an China School of Mathematics and Statistics Huazhong University of Science and Technology Wuhan China Institute for Pattern Recognition and Artificial Intelligence Huazhong China University of Science and Technology Remote sensing science and technology from Wuhan University Wuhan China School of Remote Sensing and Information Engineering Wuhan University Wuhan China Electronic circuit and system from Xidian University Xi’an China University of Colorado at Boulder BoulderCO United States Control science and engineering from the Huazhong University of Science and Technology Wuhan China Geodesy and photography from Wuhan University Wuhan China

Accurate fine-grained geospatial scene classification using remote sensing imagery is essential for a wide range of applications. However, existing approaches often rely on manually zooming remote sensing images at different scales to create typical scene samples. This approach fails to adequately support the fixed-resolution image interpretation requirements in real-world scenarios. To address this limitation, we introduce the Million-scale finE-grained geospatial scEne classification dataseT (MEET), which contains over 1.03 million zoom-free remote sensing scene samples, manually annotated into 80 fine-grained categories. In MEET, each scene sample follows a scene-in-scene layout, where the central scene serves as the reference, and auxiliary scenes provide crucial spatial context for fine-grained classification. Moreover, to tackle the emerging challenge of scene-in-scene classification, we present the Context-Aware Transformer (CAT), a model specifically designed for this task, which adaptively fuses spatial context to accurately classify the scene samples. CAT adaptively fuses spatial context to accurately classify the scene samples by learning attentional features that capture the relationships between the center and auxiliary scenes. Based on MEET, we establish a comprehensive benchmark for fine-grained geospatial scene classification, evaluating CAT against 11 competitive baselines. The results demonstrate that CAT significantly outperforms these baselines, achieving a 1.88% higher balanced accuracy (BA) with the Swin-Large backbone, and a notable 7.87% improvement with the Swin-Huge backbone. Further experiments validate the effectiveness of each module in CAT and show the practical applicability of CAT in the urban functional zone mapping. The source code and dataset will be publicly available at https://***/project/***. Copyright © 2025, The Authors. All rights reserved.

关键词： Image classification

MDKB-Bot:A Practical Framework for Multi-Domain Task-Oriented Dialogue system

学校读者我要写书评

暂无评论

Data intelligence 2019年第2期1卷 176-186页

作者： Yadi Lao Weijie Liu Sheng Gao Si Li Pattern Recognition and Intelligence System Laboratory Beijing University of Posts and TelecommunicationsBeijing 100876China

One of the major challenges to build a task-oriented dialogue system is that dialogue state transition frequently happens between multiple domains such as booking hotels or ***,the encoder-decoder model based on the end-to-end neural network has become an attractive approach to meet this ***,it usually requires a sufficiently large amount of training data and it is not flexible to handle dialogue state *** paper addresses these problems by proposing a simple but practical framework called Multi-Domain KB-BOT(MDKB-BOT),which leverages both neural networks and rule-based strategy in natural language understanding(NLU)and dialogue management(DM).Experiments on the data set of the Chinese Human-Computer Dialogue Technology Evaluation Campaign show that MDKB-BOT achieves competitive performance on several evaluation metrics,including task completion rate and user satisfaction.

关键词： Dialogue system Knowledge base Natural language understanding Slot filling Natural language generation

Progressive co-attention network for fine-grained visual classification

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhang, Tian Chang, Dongliang Ma, Zhanyu Guo, Jun Pattern Recognition and Intelligent System Lab Beijing University of Posts and Telecommunications Beijing China Beijing Academy of Artificial Intelligence Beijing China

Fine-grained visual classification aims to recognize images belonging to multiple sub-categories within a same category. It is a challenging task due to the inherently subtle variations among highly-confused categories. Most existing methods only take an individual image as input, which may limit the ability of models to recognize contrastive clues from different images. In this paper, we propose an effective method called progressive co-attention network (PCA-Net) to tackle this problem. Specifically, we calculate the channel-wise similarity by encouraging interaction between the feature channels within same-category image pairs to capture the common discriminative features. Considering that complementary information is also crucial for recognition, we erase the prominent areas enhanced by the channel interaction to force the network to focus on other discriminative regions. The proposed model has achieved competitive results on three fine-grained visual classification benchmark datasets: CUB-200-2011, Stanford Cars, and FGVC Aircraft. © 2021, CC BY.

关键词： Classification (of information)

Fine-Grained Visual Classification via Progressive Multi-granularity Training of Jigsaw Patches 1

学校读者我要写书评

暂无评论

16th European Conference on Computer Vision, ECCV 2020

作者： Du, Ruoyi Chang, Dongliang Bhunia, Ayan Kumar Xie, Jiyang Ma, Zhanyu Song, Yi-Zhe Guo, Jun Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China SketchX CVSSP University of Surrey Guildford United Kingdom

ISBN: (数字)9783030585655

ISBN: (纸本)9783030585648

Fine-grained visual classification (FGVC) is much more challenging than traditional classification tasks due to the inherently subtle intra-class object variations. Recent works are mainly part-driven (either explicitly or implicitly), with the assumption that fine-grained information naturally rests within the parts. In this paper, we take a different stance, and show that part operations are not strictly necessary – the key lies with encouraging the network to learn at different granularities and progressively fusing multi-granularity features together. In particular, we propose: (i) a progressive training strategy that effectively fuses features from different granularities, and (ii) a random jigsaw patch generator that encourages the network to learn features at specific granularities. We evaluate on several standard FGVC benchmark datasets, and show the proposed method consistently outperforms existing alternatives or delivers competitive results. The code is available at https://***/PRIS-CV/PMG-Progressive-Multi-Granularity-Training. © 2020, Springer Nature Switzerland AG.

关键词： Computer vision

Progressive Co-Attention Network for Fine-Grained Visual Classification

学校读者我要写书评

暂无评论

Progressive Co-Attention Network for Fine-Grained Visual Cla...

IEEE Visual Communications and Image Processing (VCIP)

作者： Tian Zhang Dongliang Chang Zhanyu Ma Jun Guo Pattern Recognition and Intelligent System Lab. Beijing University of Posts and Telecommunications Beijing China Beijing Academy of Artificial Intelligence Beijing China

ISBN: (纸本)9781728173221

关键词： Visualization Image recognition Visual communication Atmospheric modeling Force Benchmark testing Automobiles

Meta Balanced Network for Fair Face recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Mei Zhang, Yaobin Deng, Weihong The Pattern Recognition and Intelligent System Lab. School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Key Lab. of Trustworthy Distributed Computing and Service Ministry of Education Beijing University of Posts and Telecommunications Beijing China

Although deep face recognition has achieved impressive progress in recent years, controversy has arisen regarding discrimination based on skin tone, questioning their deployment into real-world scenarios. In this paper, we aim to systematically and scientifically study this bias from both data and algorithm aspects. First, using the dermatologist approved Fitzpatrick Skin Type classification system and Individual Typology Angle, we contribute a benchmark called Identity Shades (IDS) database, which effectively quantifies the degree of the bias with respect to skin tone in existing face recognition algorithms and commercial APIs. Further, we provide two skin-tone aware training datasets, called BUPT-Globalface dataset and BUPT-Balancedface dataset, to remove bias in training data. Finally, to mitigate the algorithmic bias, we propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss such that the model optimized by this loss can perform fairly across people with different skin tones. To determine the margins, our method optimizes a meta skewness loss on a clean and unbiased meta set and utilizes backward-on-backward automatic differentiation to perform a second order gradient descent step on the current margins. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition. The proposed datasets are available at http://***/RFW/***. © 2022, CC BY.

关键词： Face recognition

Graph Convolution Based Cross-Network Multi-Scale Feature Fusion for Deep Vessel Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhao, Gangming Liang, Kongming Pan, Chengwei Zhang, Fandong Wu, Xianpeng Hu, Xinyang Yu, Yizhou The Department of Computer Science The University of Hong Kong Hong Kong Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Institute of Artificial Intelligence Beihang University Beijing China The AI Lab Deepwise Healthcare Beijing China Department of Cardiology of the Second Affiliated Hospital School of Medicine Zhejiang University Hangzhou China Key Laboratory of Cardiovascular of Zhejiang Province Hangzhou China

Vessel segmentation is widely used to help with vascular disease diagnosis. Vessels reconstructed using existing methods are often not sufficiently accurate to meet clinical use standards. This is because 3D vessel structures are highly complicated and exhibit unique characteristics, including sparsity and anisotropy. In this paper, we propose a novel hybrid deep neural network for vessel segmentation. Our network consists of two cascaded subnetworks performing initial and refined segmentation respectively. The second subnetwork further has two tightly coupled components, a traditional CNN-based U-Net and a graph U-Net. Cross-network multi-scale feature fusion is performed between these two U-shaped networks to effectively support high-quality vessel segmentation. The entire cascaded network can be trained from end to end. The graph in the second subnetwork is constructed according to a vessel probability map as well as appearance and semantic similarities in the original CT volume. To tackle the challenges caused by the sparsity and anisotropy of vessels, a higher percentage of graph nodes are distributed in areas that potentially contain vessels while a higher percentage of edges follow the orientation of potential nearby vessels. Extensive experiments demonstrate our deep network achieves state-of-the-art 3D vessel segmentation performance on multiple public and in-house datasets. Copyright © 2023, The Authors. All rights reserved.

关键词： Anisotropy

Zero-Shot Audio Captioning Using Soft and Hard Prompts

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yiming Xu, Xuenan Du, Ruoyi Liu, Haohe Dong, Yuan Tan, Zheng-Hua Wang, Wenwu Ma, Zhanyu The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China The Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai200240 China The Department of Electronic Systems Aalborg University Aalborg9220 Denmark The Centre for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test sets from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, which, however, has received little attention. We propose an effective audio captioning method based on the contrastive language-audio pre-training (CLAP) model to address these issues. Our proposed method requires only textual data for training, enabling the model to generate text from the textual feature in the cross-modal semantic space. In the inference stage, the model generates the descriptive text for the given audio from the audio feature by leveraging the audio-text alignment from CLAP. We devise two strategies to mitigate the discrepancy between text and audio embeddings: a mixed-augmentation-based soft prompt and a retrieval-based acoustic-aware hard prompt. These approaches are designed to enhance the generalization performance of our proposed model, facilitating the model to generate captions more robustly and accurately. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method. © 2024, CC BY.

关键词： Semantics

Finger in Camera Speaks Everything: Unconstrained Air-Writing for Real-World

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wu, Meiqi Huang, Kaiqi Cai, Yuanqiang Hu, Shiyu Zhao, Yuzhong Wang, Weiqiang School of Computer Science and Technology University of Chinese Academy of Sciences Beijing100049 China Beijing University of Posts and Telecommunications Beijing100876 China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China Center for Research on Intelligent System and Engineering Institute of Automation Chinese Academy of Sciences Beijing100190 China Center for Research on Intelligent System and Engineering National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China University of Chinese Academy of Sciences Beijing100049 China CAS Center for Excellence in Brain Science and Intelligence Technology Shanghai200031 China

Air-writing is a challenging task that combines the fields of computer vision and natural language processing, offering an intuitive and natural approach for human-computer interaction. However, current air-writing solutions face two primary challenges: (1) their dependency on complex sensors (e.g., Radar, EEGs and others) for capturing precise handwritten trajectories, and (2) the absence of a video-based air-writing dataset that covers a comprehensive vocabulary range. These limitations impede their practicality in various real-world scenarios, including the use on devices like iPhones and laptops. To tackle these challenges, we present the groundbreaking air-writing Chinese character video dataset (AWCV-100K-UCAS2024), serving as a pioneering benchmark for video-based air-writing. This dataset captures handwritten trajectories in various real-world scenarios using commonly accessible RGB cameras, eliminating the need for complex sensors. AWCV-100K-UCAS2024 includes 8.8 million video frames, encompassing the complete set of 3,755 characters from the GB2312-80 level-1 set (GB1). Furthermore, we introduce our baseline approach, the video-based character recognizer (VCRec). VCRec adeptly extracts fingertip features from sparse visual cues and employs a spatio-temporal sequence module for analysis. Experimental results showcase the superior performance of VCRec compared to existing models in recognizing air-written characters, both quantitatively and qualitatively. This breakthrough paves the way for enhanced human-computer interaction in real-world contexts. Moreover, our approach leverages affordable RGB cameras, enabling its applicability in a diverse range of scenarios. The code and data examples will be made public at https://***/wmeiqi/AWCV. Copyright © 2024, The Authors. All rights reserved.

关键词： Natural language processing systems