检索结果-内蒙古大学图书馆

Deep Multi-Scale Features Learning for Distorted Image Quality Assessment

学校读者我要写书评

暂无评论

Deep Multi-Scale Features Learning for Distorted Image Quali...

IEEE International Symposium on Circuits and systems

作者： Wei Zhou Zhibo Chen CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei China

Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the DNN-based quality assessment models by exploiting efficient multi-scale features. In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction. Our model is based on both residual maps and distorted images in luminance domain, where the proposed network contains spatial pyramid pooling and feature pyramid from the network structure. Our proposed network is optimized in a deep end-to-end supervision manner. To validate the effectiveness of the proposed method, extensive experiments are conducted on four widely-used image quality assessment databases, demonstrating the superiority of our algorithm.

关键词： Image quality Visualization Databases Visual systems Streaming media Quality assessment Video recording

Analyzing Time Complexity of Practical Learned Image Compression Models

学校读者我要写书评

暂无评论

Analyzing Time Complexity of Practical Learned Image Compres...

IEEE Visual Communications and Image processing (VCIP)

作者： Xiaohan Pan Zongyu Guo Zhibo Chen CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei China

ISBN: (纸本)9781728173221

We have witnessed the rapid development of learned image compression (LIC). The latest LIC models have outperformed almost all traditional image compression standards in terms of rate-distortion (RD) performance. However, the time complexity of LIC model is still underdiscovered, limiting the practical applications in industry. Even with the acceleration of GPU, LIC models still struggle with long coding time, especially on the decoder side. In this paper, we analyze and test a few prevailing and representative LIC models, and compare their complexity with traditional codecs including H.265/HEVC intra and H.266/VVC intra. We provide a comprehensive analysis on every module in the LIC models, and investigate how bitrate changes affect coding time. We observe that the time complexity bottleneck mainly exists in entropy coding and context modelling. Although this paper pay more attention to experimental statistics, our analysis reveals some insights for further acceleration of LIC model, such as model modification for parallel computing, model pruning and a more parallel context model.

关键词： Analytical models Image coding Codecs Visual communication Computational modeling Rate-distortion Decoding

Dominant Physical Scattering Mechanism Analysis for GF-3 Typical Ground Objects by Polarimetric Decomposition

学校读者我要写书评

暂无评论

Dominant Physical Scattering Mechanism Analysis for GF-3 Typ...

IEEE International Symposium on geoscience and Remote Sensing (IGARSS)

作者： Jin Yan Qiu Xiaolan Lijia Huang Laboratory of Spatial Information Intelligent Processing System Institute of Electronics Chinese Academy of Sciences Suzhou China Key Laboratory of Technology in Geo-spatial Information Processing and Application System CAS

The dominant scattering mechanism is of great significance for the application of ground objects classification and target detection. It can also verify the quality of the polarimetric data by check the dominant scattering mechanism of known ground objects. In order to improve the application performance, this paper studies the dominant scattering mechanism of GF-3 typical ground objects based on a large number of data slices. The GF-3 fully polarimetric data slices are classified based on the MODIS global classification map, and the GF-3 slice library of typical ground objects is constructed. Based on large amounts of GF-3 samples, we carry out the statistical analysis of dominant scattering mechanism separation results for typical GF-3 ground objects (building, woodland, cultivated land, grassland and waters) of by means of h/alpha/A decomposition. The quantitative results reveal the polarimetric scattering feature of different ground objects, and provide reference for fully polarimetric SAR application.

关键词： Scattering Synthetic aperture radar Entropy Buildings Statistical analysis Radar polarimetry Sensors

No-reference light field image quality assessment based on micro-lens image

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Luo, Ziyuan Zhou, Wei Shi, Likun Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Light field image quality assessment (LF-IQA) plays a significant role due to its guidance to Light Field (LF) contents acquisition, processing and application. The LF can be represented as 4-D signal, and its quality depends on both angular consistency and spatial quality. However, few existing LF-IQA methods concentrate on effects caused by angular inconsistency. Especially, no-reference methods lack effective utilization of 2-D angular information. In this paper, we focus on measuring the 2-D angular consistency for LF-IQA. The Micro-Lens Image (MLI) refers to the angular domain of the LF image, which can simultaneously record the angular information in both horizontal and vertical directions. Since the MLI contains 2-D angular information, we propose a No-Reference Light Field image Quality assessment model based on MLI (LF-QMLI). Specifically, we first utilize Global Entropy Distribution (GED) and Uniform Local Binary Pattern descriptor (ULBP) to extract features from the MLI, and then pool them together to measure angular consistency. In addition, the information entropy of Sub-Aperture Image (SAI) is adopted to measure spatial quality. Extensive experimental results show that LF-QMLI achieves the state-of-the-art performance. Copyright © 2019, The Authors. All rights reserved.

关键词： Image quality

A coarse-to-fine framework for learned color enhancement with non-local attention

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Shan, Chaowei Zhang, Zhizheng Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Automatic color enhancement is aimed to adaptively adjust photos to expected styles and tones. For current learned methods in this field, global harmonious perception and local details are hard to be well-considered in a single model simultaneously. To address this problem, we propose a coarse-tofine framework with non-local attention for color enhancement in this paper. Within our framework, we propose to divide enhancement process into channel-wise enhancement and pixel-wise refinement performed by two cascaded Convolutional Neural Networks (CNNs). In channel-wise enhancement, our model predicts a global linear mapping for RGB channels of input images to perform global style adjustment. In pixel-wise refinement, we learn a refining mapping using residual learning for local adjustment. Further, we adopt a non-local attention block to capture the long-range dependencies from global information for subsequent fine-grained local refinement. We evaluate our proposed framework on the commonly using benchmark and conduct sufficient experiments to demonstrate each technical component within it. Copyright © 2019, The Authors. All rights reserved.

关键词： Pixels

Learning omni-frequency region-adaptive representations for real image super-resolution

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Li, Xin Jin, Xin Yu, Tao Pang, Yingxue Sun, Simeng Zhang, Zhizheng Chen, Zhibo CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Traditional single image super-resolution (SISR) methods that focus on solving single and uniform degradation (i.e., bicubic down-sampling), typically suffer from poor performance when applied into real-world low-resolution (LR) images due to the complicated realistic degradations. The key to solving this more challenging real image super-resolution (RealSR) problem lies in learning feature representations that are both informative and content-aware. In this paper, we propose an Omni-frequency Region-adaptive Network (OR-Net) to address both challenges, here we call features of all low, middle and high frequencies omni-frequency features. Specifically, we start from the frequency perspective and design a Frequency Decomposition (FD) module to separate different frequency components to comprehensively compensate the information lost for real LR image. Then, considering the different regions of real LR image have different frequency information lost, we further design a Region-adaptive Frequency Aggregation (RFA) module by leveraging dynamic convolution and spatial attention to adaptively restore frequency components for different regions. The extensive experiments endorse the effective, and scenario-agnostic nature of our OR-Net for RealSR. Copyright © 2020, The Authors. All rights reserved.

关键词： Optical resolving power

spatial Decomposition and Temporal Fusion based Inter Prediction for Learned Video Compression

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sheng, Xihua Li, Li Liu, Dong Li, Houqiang The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Video compression performance is closely related to the accuracy of inter prediction. It tends to be difficult to obtain accurate inter prediction for the local video regions with inconsistent motion and occlusion. Traditional video coding standards propose various technologies to handle motion inconsistency and occlusion, such as recursive partitions, geometric partitions, and long-term references. However, existing learned video compression schemes focus on obtaining an overall minimized prediction error averaged over all regions while ignoring the motion inconsistency and occlusion in local regions. In this paper, we propose a spatial decomposition and temporal fusion based inter prediction for learned video compression. To handle motion inconsistency, we propose to decompose the video into structure and detail (SDD) components first. Then we perform SDD-based motion estimation and SDD-based temporal context mining for the structure and detail components to generate short-term temporal contexts. To handle occlusion, we propose to propagate long-term temporal contexts by recurrently accumulating the temporal information of each historical reference feature and fuse them with short-term temporal contexts. With the SDD-based motion model and long short-term temporal contexts fusion, our proposed learned video codec can obtain more accurate inter prediction. Comprehensive experimental results demonstrate that our codec outperforms the reference software of H.266/VVC on all common test datasets for both PSNR and MS-SSIM. Copyright © 2024, The Authors. All rights reserved.

关键词： Image compression

Domain-class correlation decomposition for generalizable person re-identification

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Yang, Kaiwen Tian, Xinmei CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Domain generalization in person re-identification is a highly important meaningful and practical task in which a model trained with data from several source domains is expected to generalize well to unseen target domains. Domain adversarial learning is a promising domain generalization method that aims to remove domain information in the latent representation through adversarial training. However, in person re-identification, the domain and class are correlated, and we theoretically show that domain adversarial learning will lose certain information about class due to this domain-class correlation. Inspired by casual inference, we propose to perform interventions to the domain factor d, aiming to decompose the domain-class correlation. To achieve this goal, we proposed estimating the resulting representation z∗ caused by the intervention through first- and second-order statistical characteristic matching. Specifically, we build a memory bank to restore the statistical characteristics of each domain. Then, we use the newly generated samples {z∗, y, d∗} to compute the loss function. These samples are domain-class correlation decomposed;thus, we can learn a domain-invariant representation that can capture more class-related features. Extensive experiments show that our model outperforms the state-of-the-art methods on the large-scale domain generalization Re-ID benchmark. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

FreqAlign: Excavating Perception-oriented Transferability for Blind Image Quality Assessment from A Frequency Perspective

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Xin Lu, Yiting Chen, Zhibo The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Blind Image Quality Assessment (BIQA) is susceptible to poor transferability when the distribution shift occurs, e.g., from synthesis degradation to authentic degradation. To mitigate this, some studies have attempted to design unsupervised domain adaptation (UDA) based schemes for BIQA, which intends to eliminate the domain shift through adversarial-based feature alignment. However, the feature alignment is usually taken at the low-frequency space of features since the global average pooling operation. This ignores the transferable perception knowledge in other frequency components and causes the sub-optimal solution for the UDA of BIQA. To overcome this, from a novel frequency perspective, we propose an effective alignment strategy, i.e., Frequency Alignment (dubbed FreqAlign), to excavate the perception-oriented transferability of BIQA in the frequency space. Concretely, we study what frequency components of features are more proper for perception-oriented alignment. Based on this, we propose to improve the perception-oriented transferability of BIQA by performing feature frequency decomposition and selecting the frequency components that contained the most transferable perception knowledge for alignment. To achieve a stable and effective frequency selection, we further propose the frequency movement with a sliding window to find the optimal frequencies for alignment, which is composed of three strategies, i.e., warm up with pre-training, frequency movement-based selection, and perturbation-based finetuning. Extensive experiments under different domain adaptation settings of BIQA have validated the effectiveness of our proposed method. The code will be released at https://***/lixinustc/Openworld-IQA. Copyright © 2023, The Authors. All rights reserved.

关键词： Alignment