检索结果-内蒙古大学图书馆

Adaptive hypergraph convolutional network for no-reference 360-degree image quality assessment

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fu, Jun Hou, Chen Zhou, Wei Xu, Jiahua Chen, Zhibo The CAS Key Laboratory of Technology in GeoSpatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

In no-reference 360-degree image quality assessment (NR 360IQA), graph convolutional networks (GCNs), which model interactions between viewports through graphs, have achieved impressive performance. However, prevailing GCN-based NR 360IQA methods suffer from three main limitations. First, they only use high-level features of the distorted image to regress the quality score, while the human visual system (HVS) scores the image based on hierarchical features. Second, they simplify complex high-order interactions between viewports in a pairwise fashion through graphs. Third, in the graph construction, they only consider spatial locations of viewports, ignoring its content characteristics. Accordingly, to address these issues, we propose an adaptive hypergraph convolutional network for NR 360IQA, denoted as AHGCN. Specifically, we first design a multi-level viewport descriptor for extracting hierarchical representations from viewports. Then, we model interactions between viewports through hypergraphs, where each hyperedge connects two or more viewports. In the hypergraph construction, we build a location-based hyperedge and a content-based hyperedge for each viewport. Experimental results on two public 360IQA databases demonstrate that our proposed approach has a clear advantage over state-of-the-art full-reference and no-reference IQA models. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

The Z-eigenpairs of orthogonally diagonalizable symmetric tensors

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Wang, Lei Geng, Xiurui Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China University of the Chinese Academy of Sciences Beijing100049 China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Science Beijing100190 China

In this paper, we focus on a special class of symmetric tensors, which can be orthogonally diagonalizable, and investigate their Z-eigenpairs problem. We show that the eigenpairs can be uniformly expressed using several basic eigenpairs, and the number of all the eigenpairs is uniquely determined by the order and rank of the symmetric tensor. In addition, we exploit the local optimality of each eigenpair by checking the second-order necessary condition. © 2021, CC BY.

关键词： Tensors

Article dgfnet: Dual gate fusion network for land cover classification in very high-resolution images

学校读者我要写书评

暂无评论

Remote Sensing 2021年第18期13卷

作者： Guo, Yongjie Wang, Feng Xiang, Yuming You, Hongjian The Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Sciences Beijing100190 China Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing100049 China

Deep convolutional neural networks (DCNNs) have been used to achieve state-of-the-art performance on land cover classification thanks to their outstanding nonlinear feature extraction abil-ity. DCNNs are usually designed as an encoder–decoder architecture for the land cover classification in very high-resolution (VHR) remote sensing images. The encoder captures semantic representation by stacking convolution layers and shrinking image spatial resolution, while the decoder restores the spatial information by an upsampling operation and combines it with different level features through a summation or skip connection. However, there is still a semantic gap between different-level features;a simple summation or skip connection will reduce the performance of land-cover classification. To overcome this problem, we propose a novel end-to-end network named Dual Gate Fusion Network (DGFNet) to restrain the impact of the semantic gap. In detail, the key of DGFNet consists of two main components: Feature Enhancement Module (FEM) and Dual Gate Fusion Module (DGFM). Firstly, the FEM combines local information with global contents and strengthens the feature representation in the encoder. Secondly, the DGFM is proposed to reduce the semantic gap between different level features, effectively fusing low-level spatial information and high-level semantic information in the decoder. Extensive experiments conducted on the LandCover dataset and the ISPRS Potsdam dataset proved the effectiveness of the proposed network. The DGFNet achieves state-of-art performance 88.87% MIoU on the LandCover dataset and 72.25% MIoU on the ISPRS Potsdam dataset. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

关键词： Convolution

FAN: Frequency aggregation network for real image super-resolution

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Pang, Yingxue Li, Xin Jin, Xin Wu, Yaojun Liu, Jianzhao Liu, Sen Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Single image super-resolution (SISR) aims to recover the high-resolution (HR) image from its low-resolution (LR) input image. With the development of deep learning, SISR has achieved great progress. However, It is still a challenge to restore the real-world LR image with complicated authentic degradations. Therefore, we propose FAN, a frequency aggregation network, to address the real-world image super-resolution problem. Specifically, we extract different frequencies of the LR image and pass them to a channel attention-grouped residual dense network (CA-GRDB) individually to output corresponding feature maps. And then aggregating these residual dense feature maps adaptively to recover the HR image with enhanced details and textures. We conduct extensive experiments quantitatively and qualitatively to verify that our FAN performs well on the real image super-resolution task of AIM 2020 challenge. According to the released final results, our team SR-IM achieves the fourth place on the X4 track with PSNR of 31.1735 and SSIM of 0.8728. Copyright © 2020, The Authors. All rights reserved.

关键词： Textures

Deep local and global spatiotemporal feature aggregation for blind video quality assessment

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

In recent years, deep learning has achieved promising success for multimedia quality assessment, especially for image quality assessment (IQA). However, since there exist more complex temporal characteristics in videos, very little work has been done on video quality assessment (VQA) by exploiting powerful deep convolutional neural networks (DCNNs). In this paper, we propose an efficient VQA method named Deep SpatioTemporal video Quality assessor (DeepSTQ) to predict the perceptual quality of various distorted videos in a no-reference manner. In the proposed DeepSTQ, we first extract local and global spatiotemporal features by pre-trained deep learning models without fine-tuning or training from scratch. The composited features consider distorted video frames as well as frame difference maps from both global and local views. Then, the feature aggregation is conducted by the regression model to predict the perceptual video quality. Finally, experimental results demonstrate that our proposed DeepSTQ outperforms state-of-the-art quality assessment algorithms. Copyright © 2020, The Authors. All rights reserved.

关键词： Deep neural networks

Learning omni-frequency region-adaptive representations for real image super-resolution

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Xin Jin, Xin Yu, Tao Pang, Yingxue Sun, Simeng Zhang, Zhizheng Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Traditional single image super-resolution (SISR) methods that focus on solving single and uniform degradation (i.e., bicubic down-sampling), typically suffer from poor performance when applied into real-world low-resolution (LR) images due to the complicated realistic degradations. The key to solving this more challenging real image super-resolution (RealSR) problem lies in learning feature representations that are both informative and content-aware. In this paper, we propose an Omni-frequency Region-adaptive Network (OR-Net) to address both challenges, here we call features of all low, middle and high frequencies omni-frequency features. Specifically, we start from the frequency perspective and design a Frequency Decomposition (FD) module to separate different frequency components to comprehensively compensate the information lost for real LR image. Then, considering the different regions of real LR image have different frequency information lost, we further design a Region-adaptive Frequency Aggregation (RFA) module by leveraging dynamic convolution and spatial attention to adaptively restore frequency components for different regions. The extensive experiments endorse the effective, and scenario-agnostic nature of our OR-Net for RealSR. Copyright © 2020, The Authors. All rights reserved.

关键词： Optical resolving power

Deep multi-scale features learning for distorted image quality assessment

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the DNN-based quality assessment models by exploiting efficient multi-scale features. In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction. Our model is based on both residual maps and distorted images in luminance domain, where the proposed network contains spatial pyramid pooling and feature pyramid from the network structure. Our proposed network is optimized in a deep end-to-end supervision manner. To validate the effectiveness of the proposed method, extensive experiments are conducted on four widely-used image quality assessment databases, demonstrating the superiority of our algorithm. © 2020, CC BY.

关键词： Deep neural networks

Towards Semantically Scalable Image Coding using Semantic Map

学校读者我要写书评

暂无评论

Towards Semantically Scalable Image Coding using Semantic Ma...

IEEE International Symposium on Circuits and systems (ISCAS)

作者： Ning Yan Dong Liu Houqiang Li Feng Wu Zhiwei Xiong Zheng-Jun Zha CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei 230027 China

ISBN: (数字)9781728133201

ISBN: (纸本)9781728133218

We propose an image coding scheme that compresses image into semantically scalable bitstream using deep neural networks. This scheme is expected to support intelligent analysis when the bitstream is partially decoded, as well as high-fidelity reconstruction of image when the bitstream is completely decoded. We implement such a semantically scalable image coding scheme based on semantic map. In the proposed scheme, the original image is firstly semantically segmented and the semantic map is compressed as the base layer. Then, the original image is segmented into several individual objects according to the semantic map, and each object is coded separately. A recurrent neural network-based encoder is used to compress these objects at several quality levels. At the decoder side, the semantic map can be directly applied for intelligent analysis. A generative adversarial network is used to synthesize a rough image using the semantic map. If user is interested in a certain object, more bits can be transmitted to enhance the quality of the object. Experimental results show that the proposed method achieves comparable compression performance with JPEG2000 at high bit rates, while facilitates intelligent analysis at low bit rates.

关键词： Semantics Image coding Image reconstruction Transform coding Encoding Image segmentation Scalability

Blind omnidirectional image quality assessment with viewport oriented graph convolutional networks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Xu, Jiahua Zhou, Wei Chen, Zhibo CAS Key Laboratory of Technology Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Quality assessment of omnidirectional images has become increasingly urgent due to the rapid growth of virtual reality applications. Different from traditional 2D images and videos, omnidirectional contents can provide consumers with freely changeable viewports and a larger field of view covering the 360° × 180° spherical surface, which makes the objective quality assessment of omnidirectional images more challenging. In this paper, motivated by the characteristics of the human vision system (HVS) and the viewing process of omnidirectional contents, we propose a novel Viewport oriented Graph Convolution Network (VGCN) for blind omnidirectional image quality assessment (IQA). Generally, observers tend to give the subjective rating of a 360-degree image after passing and aggregating different viewports information when browsing the spherical scenery. Therefore, in order to model the mutual dependency of viewports in the omnidirectional image, we build a spatial viewport graph. Specifically, the graph nodes are first defined with selected viewports with higher probabilities to be seen, which is inspired by the HVS that human beings are more sensitive to structural information. Then, these nodes are connected by spatial relations to capture interactions among them. Finally, reasoning on the proposed graph is performed via graph convolutional networks. Moreover, we simultaneously obtain global quality using the entire omnidirectional image without viewport sampling to boost the performance according to the viewing experience. Experimental results demonstrate that our proposed model outperforms state-of-the-art full-reference and no-reference IQA metrics on two public omnidirectional IQA databases. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolution