检索结果-内蒙古大学图书馆

A Bayesian adaptive weighted total generalized variation model for image restoration

学校读者我要写书评

暂无评论

A Bayesian adaptive weighted total generalized variation mod...

IEEE International Conference on Image processing

作者： Zhenbo Lu Houqiang Li Weiping Li CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Heifei Anhui China

In recent years, the Total Generalized Variation (TGV) model has received lots of attention in image processing community. Though this model can restore image with natural intensity transitions, its spatial identical parameter setting limits its performance. In this paper, we propose a novel Adaptive Weighted Total Generalized Variation model for image restoration. We analyze the TGV model from Bayesian Probability view and derive a novel adaptive parameter calculation scheme for it, exploiting the image's self-similarity. Experiment results on image deblurring and reconstruction show that by adapting the parameters in TGV model to image contents, the proposed model can restore image's edges and details well and achieve significant improvement over state of the art variational based models.

关键词： Adaptation models Image restoration Mathematical model Approximation methods Bayes methods TV Minimization

Deep learning-based video coding: A review and a case study

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Liu, Dong Li, Yue Lin, Jianping Li, Houqiang Wu, Feng CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

The past decade has witnessed great success of deep learning technology in many disciplines, especially in computer vision and image processing. However, deep learning-based video coding remains in its infancy. This paper reviews the representative works about using deep learning for image/video coding, which has been an actively developing research area since the year of 2015. We divide the related works into two categories: new coding schemes that are built primarily upon deep networks (deep schemes), and deep network-based coding tools (deep tools) that shall be used within traditional coding schemes or together with traditional coding tools. For deep schemes, pixel probability modeling and auto-encoder are the two approaches, that can be viewed as predictive coding scheme and transform coding scheme, respectively. For deep tools, there have been several proposed techniques using deep learning to perform intra-picture prediction, inter-picture prediction, cross-channel prediction, probability distribution prediction, transform, post- or in-loop filtering, down- and up-sampling, as well as encoding optimizations. According to the newest reports, deep schemes have achieved comparable or even higher compression efficiency than the state-of-the-art traditional schemes, such as High Efficiency Video Coding (HEVC) based scheme, for image coding;deep tools have demonstrated the compression capability beyond HEVC for video coding. However, deep schemes have not yet reached the current height of HEVC for video coding, and deep tools remain largely unexplored at many aspects including the tradeoff between compression efficiency and encoding/decoding complexity, the optimization for perceptual naturalness or semantic quality, the speciality and universality, the federated design of multiple deep tools, and so on. In the hope of advocating the research of deep learning-based video coding, we present a case study of our developed prototype video codec, namely Deep Learning Vi

关键词： Video signal processing

A New Non-local Video Denoising Scheme Using Low-Rank Representation and Total Variation Regularization

学校读者我要写书评

暂无评论

A New Non-local Video Denoising Scheme Using Low-Rank Repres...

IEEE International Symposium on Circuits and systems

作者： Qingbo Lu Zhenbo Lu Xiaoqing Tao Houqiang Li CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei Anhui China

ISBN: (纸本)9781479934331

In this article, we present a novel non-local video denoising scheme using low-rank representation and total variation regularization. The proposed scheme attempts to make full use of the intrinsic properties that the grouping similar patches not only lie in a low-rank subspace but are also sparse in total variation (TV) domain. For a group of similar patches, we formulate video denoising problem into a concise model that combines nuclear norm, TV regularization and l_1 norm. The experiments demonstrate that the proposed scheme is capable of handling multi-type noise including dense Gaussian noise and random-valued sparse noise, while maintaining the texture information meantime. The results show that our scheme achieves noticeable performance improvement over the state-of-the-art video denoising methods.

关键词： video denoising low-rank representation total variation alternating direction method

LIQA: Lifelong blind image quality assessment

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liu, Jianzhao Zhou, Wei Xu, Jiahua Li, Xin An, Shukun Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Existing blind image quality assessment (BIQA) methods are mostly designed in a disposable way and cannot evolve with unseen distortions adaptively, which greatly limits the deployment and application of BIQA models in real-world scenarios. To address this problem, we propose a novel Lifelong blind Image Quality Assessment (LIQA) approach, targeting to achieve the lifelong learning of BIQA. Without accessing to previous training data, our proposed LIQA can not only learn new distortions, but also mitigate the catastrophic forgetting of seen distortions. Specifically, we adopt the Split-and-Merge distillation strategy to train a single-head network that makes task-agnostic predictions. In the split stage, we first employ a distortion-specific generator to obtain the pseudo features of each seen distortion. Then, we use an auxiliary multi-head regression network to generate the predicted quality of each seen distortion. In the merge stage, we replay the pseudo features paired with pseudo labels to distill the knowledge of multiple heads, which can build the final regressed single head. Experimental results demonstrate that the proposed LIQA method can handle the continuous shifts of different distortion types and even datasets. More importantly, our LIQA model can achieve stable performance even if the task sequence is long. Copyright © 2021, The Authors. All rights reserved.

关键词： Distillation

Neural network-based arithmetic coding of intra prediction modes in HEVC

学校读者我要写书评

暂无评论

arXiv 2017年

作者： Song, Rui Liu, Dong Li, Houqiang Wu, Feng CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

In both H.264 and HEVC, context-adaptive binary arithmetic coding (CABAC) is adopted as the entropy coding method. CABAC relies on manually designed binarization processes as well as handcrafted context models, which may restrict the compression efficiency. In this paper, we propose an arithmetic coding strategy by training neural networks, and make preliminary studies on coding of the intra prediction modes in HEVC. Instead of binarization, we propose to directly estimate the probability distribution of the 35 intra prediction modes with the adoption of a multi-level arithmetic codec. Instead of handcrafted context models, we utilize convolutional neural network (CNN) to perform the probability estimation. Simulation results show that our proposed arithmetic coding leads to as high as 9.9% bits saving compared with CABAC. Copyright © 2017, The Authors. All rights reserved.

关键词： Forecasting

Hierarchical co-segmentation of 3D point clouds for indoor scene

学校读者我要写书评

暂无评论

Hierarchical co-segmentation of 3D point clouds for indoor s...

International Conference on systems, Signals and Image processing, IWSSIP

作者： Yanting Lin CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei City China

ISBN: (纸本)9781509063451

Segmentation of point clouds has been studied under a variety of scenarios. However, the segmentation of scanned point clouds for a clustered indoor scene remains significantly challenging due to noisy and incomplete data, as well as scene complexity. Based on the observation that objects in an indoor scene vary largely in scale but are typically supported by planes, we propose a co-segmentation approach. This technique utilizes the mutual agency between the point clouds captured at different times after the objects' poses change due to human actions. Hence, we hierarchically segment scenes from different times into patches and generate tree structures to store their relations. By iteratively clustering patches and co-analyzing them based on the relations between patches, we modify the tree structures and generate our results. To test the robustness of our method, we evaluate it on imperfectly scanned point clouds from a childroom, a bedroom, and two offices scenes.

关键词： Three-dimensional displays Image color analysis geometry Mathematical model Principal component analysis Silicon

Efficient structure-preserving superpixel segmentation based on minimum spanning tree

学校读者我要写书评

暂无评论

Efficient structure-preserving superpixel segmentation based...

IEEE International Conference on Multimedia and Expo (ICME)

作者： Yu Bai Xuejin Chen CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei Anhui China

ISBN: (纸本)9781467372596

We propose a novel superpixel algorithm based on Minimum Spanning Tree (MST), to generate superpixels efficiently while strictly adhere to object boundaries. The MST, which built by gradually removing strong edges of the image graph extracted from the image, is more sensitive to image local structures. Therefore, an efficient hierarchical clustering strategy is basically employed in our algorithm to segment the input image into superpixels based on the tree distance. To gradually merge the image pixels and remove texture noises, a multi-layer scheme with different resolutions of superpixels is proposed. In each layer, the graph is constructed from the lower layer and segmented into superpixels in a linear complexity with the node number in the graph. Because the node number in each layer is exponentially reduced, the computational time of our method mainly concentrates on the first few layers, which is linear with the number of image pixels. The experimental results conducted on the Berkeley Segmentation Dataset demonstrate that our method outperforms state-of-the-art methods both in terms of structure preservation and computational efficiency.

关键词： Image segmentation Image color analysis Image edge detection Clustering algorithms Partitioning algorithms Joining processes Colored noise

A METHOD OF AIRBORNE INSAR DEM RECONSTRUCTION IN LAYOVER AREAS

学校读者我要写书评

暂无评论

A METHOD OF AIRBORNE INSAR DEM RECONSTRUCTION IN LAYOVER ARE...

IEEE International geoscience and Remote Sensing Symposium

作者： Fangfang LI Bing HAN Xue LIN Donghui HU Chibiao DING Key Laboratory of Geo-Spatial Information Processing and Application System Technology Chinese Academy of Sciences

ISBN: (纸本)9781467311601

The layover phenomenon of SAR imaging arises when different height contributions collapse in the same range-azimuth resolution cell, due to the presence of strong terrain slopes or discontinuities in the scenarios. Because of the phase discontinuities, for single baseline interferometric SAR, it is difficult to recover the accurate unwrapped phase in layover areas by traditional phase unwrapping methods. In this paper, according to the phase characteristic of layover areas, we propose a new method to retrieve unwrapped phase based on local frequency estimate. It can avoid the unwrapping error resulted from the phase jump at the edge of layover areas. As a result, relative accurate DEM of layover areas can be reconstructed, which is beneficial to afterward geocoding in InSAR topographic mapping.

关键词： SAR interferometry Layover Interferometric phase DEM reconstruction Local frequency estimate phase step resolution cell local frequency Synthetic aperture radar discontinuities Phase indium Radar polarimetry geocoding Topographic Mapping Reconstructions PHASE LAG CHARACTERISTIC

Quality assessment of stereoscopic 360-degree images from multi-viewports

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Xu, Jiahua Luo, Ziyuan Zhou, Wei Zhang, Wenyuan Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Objective quality assessment of stereoscopic panoramic images becomes a challenging problem owing to the rapid growth of 360-degree contents. Different from traditional 2D image quality assessment (IQA), more complex aspects are involved in 3D omnidirectional IQA, especially unlimited field of view (FoV) and extra depth perception, which brings difficulty to evaluate the quality of experience (QoE) of 3D omnidirectional images. In this paper, we propose a multi-viewport based full-reference stereo 360 IQA model. Due to the freely changeable viewports when browsing in the head-mounted display, our proposed approach processes the image inside FoV rather than the projected one such as equirectangular projection (ERP). In addition, since overall QoE depends on both image quality and depth perception, we utilize the features estimated by the difference map between left and right views which can reflect disparity. The depth perception features along with binocular image qualities are employed to further predict the overall QoE of 3D 360 images. The experimental results on our public Stereoscopic OmnidirectionaL Image quality assessment Database (SOLID) show that the proposed method achieves a significant improvement over some well-known IQA metrics and can accurately reflect the overall QoE of perceived images. Copyright © 2019, The Authors. All rights reserved.

关键词： Quality of service