检索结果-内蒙古大学图书馆

Multi-scale Residual Alignment Transformer for Remote Sensing Image Change Detection

学校读者我要写书评

暂无评论

IEEE geoscience and Remote Sensing Letters 2025年

作者： Li, Lei Zhou, Xiao Yu, Xiaodong Gao, Bin Yan, Guogang Liu, Yidan Cui, Tingting Zhao, Guangyu Hu, Yuxin Chinese Academy of Sciences Key Laboratory of Technology in Geo-spatial Information Processing and Application System Key Laboratory of Target Cognition and Application Technology Aerospace Information Research Institute Beijing100094 China

Deep learning (DL) methods have shown great potential for remote sensing image change detection recently, but still suffer from several limitations. Within the identical semantic concept, significant but irrelevant changes in surface texture, color and spatial shifting of building objects resulted from variations in imaging physical factors, causes feature inconsistency of building objects in bitemporal sences. Conventional DL methods lack the capability to effectively distinguish real changes from irrelevant changes, leading to some false detections. This letter propose a novel framework, the multi-scale residual alignment transformer (AlignFormer), to mitigate the above issues. Specifically, inspired by deformable attention mechanism, we firstly design an adaptive feature alignment module (AFAM) to suppress the inconsistency of feature pairs, where the regions of building can be adaptively focused on and the spatial-temporal dependencies of relevant building objects in feature pairs effectively captured, via scheme of flexibly sampling keys/Values for each given Query. Besides, we utilize an extremely tiny Swin Transformer as the backbone of differencing-based framework for obtaining hierarchical features. Moreover, inspired by residual learning strategy, three AFAMs are integrated into the framework to form the multi-scale residual architecture for the coarse-to-fine alignment of the paired features. Experimental results confirm the superiority of our proposed method over several state-of-the-art algorithms. Our code will be released at https://***/lilei-aircas/AlignFormer_CD. © 2004-2012 IEEE.

关键词： Change detection

Domain-class correlation decomposition for generalizable person re-identification

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yang, Kaiwen Tian, Xinmei CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Domain generalization in person re-identification is a highly important meaningful and practical task in which a model trained with data from several source domains is expected to generalize well to unseen target domains. Domain adversarial learning is a promising domain generalization method that aims to remove domain information in the latent representation through adversarial training. However, in person re-identification, the domain and class are correlated, and we theoretically show that domain adversarial learning will lose certain information about class due to this domain-class correlation. Inspired by casual inference, we propose to perform interventions to the domain factor d, aiming to decompose the domain-class correlation. To achieve this goal, we proposed estimating the resulting representation z∗ caused by the intervention through first- and second-order statistical characteristic matching. Specifically, we build a memory bank to restore the statistical characteristics of each domain. Then, we use the newly generated samples {z∗, y, d∗} to compute the loss function. These samples are domain-class correlation decomposed;thus, we can learn a domain-invariant representation that can capture more class-related features. Extensive experiments show that our model outperforms the state-of-the-art methods on the large-scale domain generalization Re-ID benchmark. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

Attribute Artifacts Removal for geometry-based Point Cloud Compression

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Sheng, Xihua Li, Li Liu, Dong Xiong, Zhiwei CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

geometry-based point cloud compression (G-PCC) can achieve remarkable compression efficiency for point clouds. However, it still leads to serious attribute compression artifacts, especially under low bitrate scenarios. In this paper, we propose a Multi-Scale Graph Attention Network (MS-GAT) to remove the artifacts of point cloud attributes compressed by G-PCC. We first construct a graph based on point cloud geometry coordinates and then use the Chebyshev graph convolutions to extract features of point cloud attributes. Considering that one point may be correlated with points both near and far away from it, we propose a multi-scale scheme to capture the short- and long-range correlations between the current point and its neighboring and distant points. To address the problem that various points may have different degrees of artifacts caused by adaptive quantization, we introduce the quantization step per point as an extra input to the proposed network. We also incorporate a weighted graph attentional layer into the network to pay special attention to the points with more attribute artifacts. To the best of our knowledge, this is the first attribute artifacts removal method for G-PCC. We validate the effectiveness of our method over various point clouds. Objective comparison results show that our proposed method achieves an average of 9.74% BD-rate reduction compared with Predlift and 10.13% BD-rate reduction compared with RAHT. Subjective comparison results present that visual artifacts such as color shifting, blurring, and quantization noise are reduced. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

aiWave: Volumetric Image Compression with 3-D Trained Affine Wavelet-like Transform

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Xue, Dongmei Ma, Haichuan Li, Li Liu, Dong Xiong, Zhiwei The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The Institute of Artificial Intelligence Hefei Comprehensive National Science Center Hefei230088 China

Volumetric image compression has become an urgent task to effectively transmit and store images produced in biological research and clinical practice. At present, the most commonly used volumetric image compression methods are based on wavelet transform, such as JP3D. However, JP3D employs an ideal, separable, global, and fixed wavelet basis to convert input images from pixel domain to frequency domain, which seriously limits its performance. In this paper, we first design a 3-D trained wavelet-like transform to enable signal-dependent and non-separable transform. Then, an affine wavelet basis is introduced to capture the various local correlations in different regions of volumetric images. Furthermore, we embed the proposed wavelet-like transform to an end-to-end compression framework called aiWave to enable an adaptive compression scheme for various datasets. Last but not least, we introduce the weight sharing strategies of the affine wavelet-like transform according to the volumetric data characteristics in the axial direction to reduce the number of parameters. The experimental results show that: 1) when cooperating our trained 3-D affine wavelet-like transform with a simple factorized entropy coding module, aiWave performs better than JP3D and is comparable in terms of encoding and decoding complexities;2) when adding a context module to remove signal redundancy further, aiWave can achieve a much better performance than HEVC. Copyright © 2022, The Authors. All rights reserved.

关键词： Image compression

LIQA: Lifelong blind image quality assessment

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Jianzhao Zhou, Wei Xu, Jiahua Li, Xin An, Shukun Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Existing blind image quality assessment (BIQA) methods are mostly designed in a disposable way and cannot evolve with unseen distortions adaptively, which greatly limits the deployment and application of BIQA models in real-world scenarios. To address this problem, we propose a novel Lifelong blind Image Quality Assessment (LIQA) approach, targeting to achieve the lifelong learning of BIQA. Without accessing to previous training data, our proposed LIQA can not only learn new distortions, but also mitigate the catastrophic forgetting of seen distortions. Specifically, we adopt the Split-and-Merge distillation strategy to train a single-head network that makes task-agnostic predictions. In the split stage, we first employ a distortion-specific generator to obtain the pseudo features of each seen distortion. Then, we use an auxiliary multi-head regression network to generate the predicted quality of each seen distortion. In the merge stage, we replay the pseudo features paired with pseudo labels to distill the knowledge of multiple heads, which can build the final regressed single head. Experimental results demonstrate that the proposed LIQA method can handle the continuous shifts of different distortion types and even datasets. More importantly, our LIQA model can achieve stable performance even if the task sequence is long. Copyright © 2021, The Authors. All rights reserved.

关键词： Distillation

DouZero+: Improving DouDizhu AI by Opponent Modeling and Coach-guided Learning

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhao, Youpeng Zhao, Jian Hu, Xunhan Zhou, Wengang Li, Houqiang CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei230027 China Institute of Artificial Intelligence Hefei Comprehensive National Science Center Hefei China

Recent years have witnessed the great breakthrough of deep reinforcement learning (DRL) in various perfect and imperfect information games. Among these games, DouDizhu, a popular card game in China, is very challenging due to the imperfect information, large state space, elements of collaboration and a massive number of possible moves from turn to turn. Recently, a DouDizhu AI system called DouZero has been proposed. Trained using traditional Monte Carlo method with deep neural networks and self-play procedure without the abstraction of human prior knowledge, DouZero has outperformed all the existing DouDizhu AI programs. In this work, we propose to enhance DouZero by introducing opponent modeling into DouZero. Besides, we propose a novel coach network to further boost the performance of DouZero and accelerate its training process. With the integration of the above two techniques into DouZero, our DouDizhu AI system achieves better performance and ranks top in the Botzone leaderboard among more than 400 AI agents, including DouZero. Copyright © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning

Robust Eigenvectors of Regular Simplex Tensors: Conjecture Proof

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wang, Lei Geng, Xiurui Zhang, Lei The School of Microelectronics and Communication Engineering Chongqing University Chongqing400044 China Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China University of the Chinese Academy of Sciences Beijing100049 China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Science Beijing100190 China

The concept of tensor eigenpairs has received more researches in past decades. Recent works have paid attentions to a special class of symmetric tensors termed regular simplex tensors, which is constructed by equiangular tight frame of n + 1 vectors in n-dimensional space, and the robustness of eigenpairs was investigated. In the end of the literature, a conjecture was claimed that the robust eigenvectors of a regular simplex tensor are precisely the vectors in the frame. One later work theoretically proved that the case of n = 2 was true. In this paper, we proceed further and complete the proof for the above conjecture. Some promising directions are discussed in the end for future *** Codes 15A69, 90C26 © 2023, CC BY.

关键词： Tensors

A Novel Gradient Descent Least Squares (GDLS) Algorithm for Efficient SMV Gridless Line Spectrum Estimation with applications in Tomographic SAR Imaging

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Shi, Ruizhe Zhang, Zhe Qiu, Xiaolan Ding, Chibiao School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing100190 China Suzhou Aerospace Information Research Institute Suzhou Key Laboratory of Intelligent Aerospace Big Data Application Technology Jiangsu Suzhou215123 China CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System Beijing100190 China

This paper presents a novel efficient method for gridless line spectrum estimation problem with single snapshot, namely the gradient descent least squares (GDLS) method. Conventional single snapshot (a.k.a. single measure vector or SMV) line spectrum estimation methods either rely on smoothing techniques that sacrifice the array aperture, or adopt the sparsity constraint and utilize compressed sensing (CS) method by defining prior grids and resulting in the off-grid problem. Recently emerged atomic norm minimization (ANM) methods achieved gridless SMV line spectrum estimation, but its computational complexity is extremely high;thus it is practically infeasible in real applications with large problem scales. Our proposed GDLS method reformulates the line spectrum estimations problem into a least squares (LS) estimation problem and solves the corresponding objective function via gradient descent algorithm in an iterative fashion with efficiency. The convergence guarantee, computational complexity, as well as performance analysis are discussed in this paper. Numerical simulations and real data experiments show that the proposed GDLS algorithm outperforms the state-of-the-art methods e.g., CS and ANM, in terms of estimation performances. It can completely avoid the off-grid problem, and its computational complexity is significantly lower than ANM. Our method has been tested in tomographic SAR (TomoSAR) imaging applications via simulated and real experiment data. Results show great potential of the proposed method in terms of better cloud point performance and eliminating the gridding effect. Copyright © 2022, The Authors. All rights reserved.

关键词： Spectrum analysis

Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated Image Quality Assessment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Fu, Jun Zhou, Wei Jiang, Qiuping Liu, Hantao Zhai, Guangtao The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The School of Computer Science and Informatics Cardiff University CardiffCF24 4AG United Kingdom The School of Information Science and Engineering Ningbo University Ningbo315211 China The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China

Recently, textual prompt tuning has shown inspirational performance in adapting Contrastive Language-Image Pre-training (CLIP) models to natural image quality assessment. However, such uni-modal prompt learning method only tunes the language branch of CLIP models. This is not enough for adapting CLIP models to AI generated image quality assessment (AGIQA) since AGIs visually differ from natural images. In addition, the consistency between AGIs and user input text prompts, which correlates with the perceptual quality of AGIs, is not investigated to guide AGIQA. In this letter, we propose vision-language consistency guided multi-modal prompt learning for blind AGIQA, dubbed CLIP-AGIQA. Specifically, we introduce learnable textual and visual prompts in language and vision branches of CLIP models, respectively. Moreover, we design a text-to-image alignment quality prediction task, whose learned vision-language consistency knowledge is used to guide the optimization of the above multi-modal prompts. Experimental results on two public AGIQA datasets demonstrate that the proposed method outperforms state-of-the-art quality assessment models. The source code is available at https://***/JunFu1995/CLIP-AGIQA. © 2024, CC BY-NC-ND.

关键词： Learning systems