检索结果-内蒙古大学图书馆

Article dgfnet: Dual gate fusion network for land cover classification in very high-resolution images

学校读者我要写书评

暂无评论

Remote Sensing 2021年第18期13卷

作者： Guo, Yongjie Wang, Feng Xiang, Yuming You, Hongjian The Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Sciences Beijing100190 China Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing100049 China

Deep convolutional neural networks (DCNNs) have been used to achieve state-of-the-art performance on land cover classification thanks to their outstanding nonlinear feature extraction abil-ity. DCNNs are usually designed as an encoder–decoder architecture for the land cover classification in very high-resolution (VHR) remote sensing images. The encoder captures semantic representation by stacking convolution layers and shrinking image spatial resolution, while the decoder restores the spatial information by an upsampling operation and combines it with different level features through a summation or skip connection. However, there is still a semantic gap between different-level features;a simple summation or skip connection will reduce the performance of land-cover classification. To overcome this problem, we propose a novel end-to-end network named Dual Gate Fusion Network (DGFNet) to restrain the impact of the semantic gap. In detail, the key of DGFNet consists of two main components: Feature Enhancement Module (FEM) and Dual Gate Fusion Module (DGFM). Firstly, the FEM combines local information with global contents and strengthens the feature representation in the encoder. Secondly, the DGFM is proposed to reduce the semantic gap between different level features, effectively fusing low-level spatial information and high-level semantic information in the decoder. Extensive experiments conducted on the LandCover dataset and the ISPRS Potsdam dataset proved the effectiveness of the proposed network. The DGFNet achieves state-of-art performance 88.87% MIoU on the LandCover dataset and 72.25% MIoU on the ISPRS Potsdam dataset. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

关键词： Convolution

The Z-eigenpairs of orthogonally diagonalizable symmetric tensors

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Wang, Lei Geng, Xiurui Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China University of the Chinese Academy of Sciences Beijing100049 China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Science Beijing100190 China

In this paper, we focus on a special class of symmetric tensors, which can be orthogonally diagonalizable, and investigate their Z-eigenpairs problem. We show that the eigenpairs can be uniformly expressed using several basic eigenpairs, and the number of all the eigenpairs is uniquely determined by the order and rank of the symmetric tensor. In addition, we exploit the local optimality of each eigenpair by checking the second-order necessary condition. © 2021, CC BY.

关键词： Tensors

Electromagnetic Simulation Aided SAR Target Classification Via Deep Domain Adaptation

学校读者我要写书评

暂无评论

Electromagnetic Simulation Aided SAR Target Classification V...

IEEE International Conference on Radar

作者： Xiaoling Lv Xiaolan Qiu Wenming Yu Aerospace Information Research Institute Chinese Academy of Sciences School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Suzhou Aerospace Information Research Institute Suzhou China State key Laboratory of Millimeter Waves Southeast University Nanjing China

ISBN: (纸本)9781665468893

Convolutional neural networks (CNNs) have made tremendous success in optical images classification recently. However, in synthetic aperture radar (SAR) target classification, it is difficult to annotate a large amount of real SAR images to train CNNs. Sufficient annotated images can be easily obtained through simulation, but the disparity between the simulated images and the real images makes them difficult to directly apply to the real images classification. In this paper, we propose a model that integrates multi-kernel maximum mean discrepancy (MK-MMD) and domain-adversarial training to alleviate this problem. Simulated SAR images with annotation and unlabeled real SAR images are used to train our model. First, we use domain-adversarial training to prompt the model to extract domain-invariant features. Then, the MK-MMD between the hidden representations of simulated images and real images is reduced to narrow domain discrepancy. Experimental results on the real SAR dataset demonstrate that our method effectively solves the domain shift problem and improves the classification accuracy.

关键词： Training Adaptation models Optical fiber networks Feature extraction Optical imaging Radar polarimetry Data models

LIRA: Lifelong image restoration from unknown blended distortions

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Jianzhao Lin, Jianxin Li, Xin Zhou, Wei Liu, Sen Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Most existing image restoration networks are designed in a disposable way and catastrophically forget previously learned distortions when trained on a new distortion removal task. To alleviate this problem, we raise the novel lifelong image restoration problem for blended distortions. We first design a base fork-join model in which multiple pre-trained expert models specializing in individual distortion removal task work cooperatively and adaptively to handle blended distortions. When the input is degraded by a new distortion, inspired by adult neurogenesis in human memory system, we develop a neural growing strategy where the previously trained model can incorporate a new expert branch and continually accumulate new knowledge without interfering with learned knowledge. Experimental results show that the proposed approach can not only achieve state-of-the-art performance on blended distortions removal tasks in both PSNR/SSIM metrics, but also maintain old expertise while learning new restoration tasks. Copyright © 2020, The Authors. All rights reserved.

关键词： Image reconstruction

Learning omni-frequency region-adaptive representations for real image super-resolution

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Xin Jin, Xin Yu, Tao Pang, Yingxue Sun, Simeng Zhang, Zhizheng Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Traditional single image super-resolution (SISR) methods that focus on solving single and uniform degradation (i.e., bicubic down-sampling), typically suffer from poor performance when applied into real-world low-resolution (LR) images due to the complicated realistic degradations. The key to solving this more challenging real image super-resolution (RealSR) problem lies in learning feature representations that are both informative and content-aware. In this paper, we propose an Omni-frequency Region-adaptive Network (OR-Net) to address both challenges, here we call features of all low, middle and high frequencies omni-frequency features. Specifically, we start from the frequency perspective and design a Frequency Decomposition (FD) module to separate different frequency components to comprehensively compensate the information lost for real LR image. Then, considering the different regions of real LR image have different frequency information lost, we further design a Region-adaptive Frequency Aggregation (RFA) module by leveraging dynamic convolution and spatial attention to adaptively restore frequency components for different regions. The extensive experiments endorse the effective, and scenario-agnostic nature of our OR-Net for RealSR. Copyright © 2020, The Authors. All rights reserved.

关键词： Optical resolving power

Blind omnidirectional image quality assessment with viewport oriented graph convolutional networks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Xu, Jiahua Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Quality assessment of omnidirectional images has become increasingly urgent due to the rapid growth of virtual reality applications. Different from traditional 2D images and videos, omnidirectional contents can provide consumers with freely changeable viewports and a larger field of view covering the 360° × 180° spherical surface, which makes the objective quality assessment of omnidirectional images more challenging. In this paper, motivated by the characteristics of the human vision system (HVS) and the viewing process of omnidirectional contents, we propose a novel Viewport oriented Graph Convolution Network (VGCN) for blind omnidirectional image quality assessment (IQA). Generally, observers tend to give the subjective rating of a 360-degree image after passing and aggregating different viewports information when browsing the spherical scenery. Therefore, in order to model the mutual dependency of viewports in the omnidirectional image, we build a spatial viewport graph. Specifically, the graph nodes are first defined with selected viewports with higher probabilities to be seen, which is inspired by the HVS that human beings are more sensitive to structural information. Then, these nodes are connected by spatial relations to capture interactions among them. Finally, reasoning on the proposed graph is performed via graph convolutional networks. Moreover, we simultaneously obtain global quality using the entire omnidirectional image without viewport sampling to boost the performance according to the viewing experience. Experimental results demonstrate that our proposed model outperforms state-of-the-art full-reference and no-reference IQA metrics on two public omnidirectional IQA databases. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolution

Deep local and global spatiotemporal feature aggregation for blind video quality assessment

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

In recent years, deep learning has achieved promising success for multimedia quality assessment, especially for image quality assessment (IQA). However, since there exist more complex temporal characteristics in videos, very little work has been done on video quality assessment (VQA) by exploiting powerful deep convolutional neural networks (DCNNs). In this paper, we propose an efficient VQA method named Deep SpatioTemporal video Quality assessor (DeepSTQ) to predict the perceptual quality of various distorted videos in a no-reference manner. In the proposed DeepSTQ, we first extract local and global spatiotemporal features by pre-trained deep learning models without fine-tuning or training from scratch. The composited features consider distorted video frames as well as frame difference maps from both global and local views. Then, the feature aggregation is conducted by the regression model to predict the perceptual video quality. Finally, experimental results demonstrate that our proposed DeepSTQ outperforms state-of-the-art quality assessment algorithms. Copyright © 2020, The Authors. All rights reserved.

关键词： Deep neural networks

Deep multi-scale features learning for distorted image quality assessment

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the DNN-based quality assessment models by exploiting efficient multi-scale features. In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction. Our model is based on both residual maps and distorted images in luminance domain, where the proposed network contains spatial pyramid pooling and feature pyramid from the network structure. Our proposed network is optimized in a deep end-to-end supervision manner. To validate the effectiveness of the proposed method, extensive experiments are conducted on four widely-used image quality assessment databases, demonstrating the superiority of our algorithm. © 2020, CC BY.

关键词： Deep neural networks

Towards Semantically Scalable Image Coding using Semantic Map

学校读者我要写书评

暂无评论

Towards Semantically Scalable Image Coding using Semantic Ma...

IEEE International Symposium on Circuits and systems (ISCAS)

作者： Ning Yan Dong Liu Houqiang Li Feng Wu Zhiwei Xiong Zheng-Jun Zha CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei 230027 China

ISBN: (数字)9781728133201

ISBN: (纸本)9781728133218

We propose an image coding scheme that compresses image into semantically scalable bitstream using deep neural networks. This scheme is expected to support intelligent analysis when the bitstream is partially decoded, as well as high-fidelity reconstruction of image when the bitstream is completely decoded. We implement such a semantically scalable image coding scheme based on semantic map. In the proposed scheme, the original image is firstly semantically segmented and the semantic map is compressed as the base layer. Then, the original image is segmented into several individual objects according to the semantic map, and each object is coded separately. A recurrent neural network-based encoder is used to compress these objects at several quality levels. At the decoder side, the semantic map can be directly applied for intelligent analysis. A generative adversarial network is used to synthesize a rough image using the semantic map. If user is interested in a certain object, more bits can be transmitted to enhance the quality of the object. Experimental results show that the proposed method achieves comparable compression performance with JPEG2000 at high bit rates, while facilitates intelligent analysis at low bit rates.

关键词： Semantics Image coding Image reconstruction Transform coding Encoding Image segmentation Scalability