检索结果-内蒙古大学图书馆

Virtual view synthesis using layered depth image generation and depth-based inpainting for filling disocclusions and translucent disocclusions

引用

JOURNAL OF VISUAL COMMUNICATION AND image REPRESENTATION 2016年第Jul.期38卷 351-366页

作者： Muddala, Suryanarayana M. Sjostrom, Marten Olsson, Roger Mid Sweden Univ Dept Informat & Commun Syst S-85170 Sundsvall Sweden

View synthesis is an efficient solution to produce content for 3DTV and FTV. However, proper handling of the disocclusions is a major challenge in the view synthesis. Inpainting methods offer solutions for handling disocclusions, though limitations in foreground-background classification causes the holes to be filled with inconsistent textures. Moreover, the state-of-the art methods fail to identify and fill disocclusions in intermediate distances between foreground and background through which background may be visible in the virtual view (translucent disocclusions). Aiming at improved rendering quality, we introduce a layered depth image (LDI) in the original camera view, in which we identify and fill occluded background so that when the LDI data is rendered to a virtual view, no disocclusions appear but views with consistent data are produced also handling translucent disocclusions. Moreover, the proposed foreground-background classification and inpainting fills the disocclusions with neighboring background texture consistently. based on the objective and subjective evaluations, the proposed method outperforms the state-of-the art methods at the disocclusions. (C) 2016 Elsevier Inc. All rights reserved.

关键词： View synthesis depth-image based rendering image inpainting Texture synthesis Hole filling Disocclusions Translucent disocclusions Layered depth image

来源：评论

学校读者我要写书评

暂无评论

Analysis of the depth-shift distortion as an estimator for view synthesis distortion

引用

SIGNAL PROCESSING-image COMMUNICATION 2016年 41卷 128-143页

作者： Carballeira, Pablo Cabrera, Julian Jaureguizar, Fernando Garcia, Narciso Univ Politecn Madrid ETSI Telecomunicac Grp Tratamiento Imagenes Ciudad Univ E-28040 Madrid Spain

Aiming for 3D Video encoders with reduced computational complexity, we analyze the performance of depth-shift distortion in depth-image based rendering algorithms, incurred when coding depth maps in 3D Video, as an estimator of the distortion of synthesized views. We propose several distortion models that capture (i) the geometric distortion caused by the depth coding error, (ii) the pixel-mapping precision in view synthesis and (iii) the method to aggregate depth-shift distortion caused by the coding error in a depth block. Our analysis starts with the evaluation of the correlation between the depth-shift distortion values obtained with these models, and the actual distortion on synthesized views, with the aim of identifying the most accurate one. The correlation results show that one of the models can be used as a reasonable estimator of the synthesis distortion in low complexity depth encoders. These results also show that the Sum of Absolute Error (SAE) captures better the distortion on a depth block than the Sum of Squared Error (SSE). The correlation analysis is performed at three levels: frame, MB-row and MB. Results show that correlation values are consistently high at the frame level and for most MB-row positions, while lower values are achieved at the MB level and for specific rows at the MB row level. Finally, to assess the results obtained by the correlation analysis, the different depth-shift distortion models are employed in two algorithms of the rate-distortion optimization (RDO) cycle of the depth encoder: (i) Quantization Parameter (QP) selection and (ii) mode decision. We evaluate the QP selection algorithm at three levels: frame, MB row and MB, and the mode decision at the MB level. At the frame level, results show that the use of depth-shift distortion is equivalent to synthesis distortion, with the advantage of a lower computational complexity. At sub-frame levels, the results are consistent with the comparative correlation results, giving guide

关键词： 3D Video depth-image based rendering depth coding Rate-distortion optimization

来源：评论

学校读者我要写书评

暂无评论

BLOCK based RATE-DISTORTION ANALYSIS FOR QUALITY IMPROVEMENT OF SYNTHESIZED VIEWS

BLOCK BASED RATE-DISTORTION ANALYSIS FOR QUALITY IMPROVEMENT...

引用

4th 3DTV Conference on the True Vision - Capture, Transmission and Display of 3D Video

作者： Carballeira, P. Tech, G. Cabrera, J. Mueller, K. Jaureguizar, F. wiegand, T. Garcia, N. Univ Politecn Madrid ETSI Telecomunicac Grp Tratamiento Imagenes Ciudad Univ E-28040 Madrid Spain HHI Fraunhofer Inst Telecommun Image Proc Dept D-10587 Berlin Germany

ISBN: (纸本)9781424463794

We present a preliminary study on the Rate-Distortion (RD) gain that can be achieved applying RD optimization techniques in a multiview plus depth encoder. We consider the use of Multiview Video Coding (MVC) for both, color and depth sequences, and evaluate the improvement that can be obtained allowing a quantization parameter (QP) assignment on a macroblock basis compared to the use of a fixed QP for the whole sequence. The optimization criterion is the minimization of the distortion of the synthesized views generated at the receiver. Our motivation for this criterion is to capture the impact of depth coding according to its final purpose: the generation of virtual views. Since a unique objective quality metric for view synthesis artifacts evaluation has not been set yet, the performance of several algorithms for quality evaluation of the target synthesized view have been compared. Beyond obtaining a better RD performance, as could be expected, results also show that optimized synthesized views achieve absolute lower distortion values than the best result of the approach that uses a fixed QP for the whole sequence.

关键词： 3D video multiview video coding depth-image based rendering rate-distortion optimization

来源：评论

学校读者我要写书评

暂无评论

CORRELATION MODEL SELECTION FOR INTERACTIVE VIDEO COMMUNICATION 24

CORRELATION MODEL SELECTION FOR INTERACTIVE VIDEO COMMUNICAT...

引用

24th IEEE International Conference on image Processing (ICIP)

作者： Bidgoli, Navid Mahmoudian Maugey, Thomas Roumy, Aline INRIA Rennes Bretagne Atlantique Rennes France Univ Rennes 1 Rennes France

ISBN: (纸本)9781509021758

Interactive video communication has been recently proposed for multi-view videos. In this scheme, the server has to store the views as compact as possible, while being able to transmit them independently to the users, who are allowed to navigate interactively among the views, hence requesting a subset of them. To achieve this goal, the compression must be done using a model-based coding in which the correlation between the predicted view generated on the user side and the original view has to be modeled by a statistical distribution. In this paper we propose a framework for lossless fixed-length source coding to select a model among a candidate set of models that incurs the lowest extra rate cost to the system. Moreover, in cases where the depth image is available, we provide a method to estimate the correlation model.

关键词： Correlation model selection depth-image based rendering Interactive video Lossless coding Fixed-Length interactive source coding

来源：评论

学校读者我要写书评

暂无评论

RECONSTRUCTION OF MULTIVIEW imageS TAKEN WITH NON-REGULAR SAMPLING SENSORS

RECONSTRUCTION OF MULTIVIEW IMAGES TAKEN WITH NON-REGULAR SA...

引用

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

作者： Richter, Thomas Jonscher, Markus Schnurrer, Wolfgang Seiler, Juergen Kaup, Andre Univ Erlangen Nurnberg D-91058 Erlangen Germany

ISBN: (纸本)9781479928934

Increasing spatial image resolution is a widely discussed area in the field of image processing. In this paper, we present an efficient reconstruction approach for high-resolution images, taken with irregularly shielded low-resolution sensors in a multiview setup. The approach is based on the sparsity assumption, meaning that natural images can be efficiently represented in a transform-domain using only few coefficients. Utilizing information from adjacent cameras results in a better reconstruction quality for the central high-resolution view. Since neighboring camera perspectives might differ in illumination, the information from adjacent views has to be adapted to the view to be reconstructed. The simulation results show that a proper incorporation of information from neighboring views leads to a PSNR gain of up to 2.20 dB compared to a state-of-the-art singleview reconstruction approach.

关键词： Multiview non-regular sampling image reconstruction sparsity depth-image based rendering

来源：评论

学校读者我要写书评

暂无评论

depth-based INPAINTING FOR DISOCCLUSION FILLING

DEPTH-BASED INPAINTING FOR DISOCCLUSION FILLING

引用

3DTV-Conference on True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)

作者： Muddala, Suryanarayana M. Sjostrom, Marten Olsson, Roger Mid Sweden Univ Dept Informat & Commun Syst S-85170 Sundsvall Sweden

ISBN: (纸本)9781479947584

depth-based inpainting methods can solve disocclusion problems occurring in depth-image-based rendering. However, inpainting in this context suffers from artifacts along foreground objects due to foreground pixels in the patch matching. In this paper, we address the disocclusion problem by a refined depth-based inpainting method. The novelty is in classifying the foreground and background by using available local depth information. Thereby, the foreground information is excluded from both the source region and the target patch. In the proposed inpainting method, the local depth constraints imply inpainting only the background data and preserving the foreground object boundaries. The results from the proposed method are compared with those from the state-of-the art inpainting methods. The experimental results demonstrate improved objective quality and a better visual quality along the object boundaries.

关键词： View synthesis depth-image based rendering image inpainting disocclusions

来源：评论

学校读者我要写书评

暂无评论

Key view selection in distributed multiview coding

Key view selection in distributed multiview coding

引用

IEEE Visual Communications and image Processing Conference

作者： Maugey, Thomas Petrazzuoli, Giovanni Frossard, Pascal Cagnazzo, Marco Pesquet-Popescu, Beatrice Ecole Polytech Fed Lausanne Lausanne Switzerland Telecom ParisTech Paris France

ISBN: (纸本)9781479961399

Multiview image and video systems with large number of views lead to new problems in data representation, transmission and user interaction. In order to reduce the data volumes, most distributed multiview coding schemes exploit the inter-view redundancies at the decoder side, using view synthesis from key views. In the situation where many views are considered, the two following questions become fundamental: i) how many key views have to be chosen for keeping a good reconstruction quality with reasonable coding cost? ii) where to place them optimally in the multiview sequences? We propose in this paper an algorithm for selecting the key views in a distributed multiview coding scheme. based on a novel metric for the correlation between the views, we formulate an optimization problem for the positioning of the key views such that both the distortion of the reconstruction and the coding rate cost are effectively minimized. We then propose a new optimization strategy based on shortest path algorithm that permits to determine both the optimal number of key views and their positions in the image set. We experimentally validate our solution in a practical distributed multiview coding system and we show that considering the 3D scene geometry in the key view positioning brings significant rate-distortion improvements compared to distance-based key view selection as it is commonly done in the literature.

关键词： distributed multiview coding key view positioning inter-view correlation depth-image based rendering

来源：评论

学校读者我要写书评

暂无评论

EFFICIENT VIEW SYNTHESIS FOR MULTI-VIEW VIDEO PLUS depth

EFFICIENT VIEW SYNTHESIS FOR MULTI-VIEW VIDEO PLUS DEPTH

引用

20th IEEE International Conference on image Processing (ICIP)

作者： Vijayanagar, Krishna Rao Kim, Joohee Lee, Yunsik Kim, Jong-bok IIT Dept Elect & Comp Engn Chicago IL 60616 USA Korea Elect Technol Inst Songnam Gyungki Do South Korea Sane Syst Anyang Si Gyungki Do South Korea

ISBN: (纸本)9781479923410

depth-image based rendering is a popular technique for rendering virtual views for the multi-view video plus depth (MVD) 3DTV format. Instead of transmitting a high number of views to the receiver, only a few views are transmitted along with their corresponding depth maps and the missing views are interpolated from these transmitted views. This process is called view synthesis and has been the focus of a lot of research in recent times. In addition to the obvious quality constraints of view synthesis, focus needs to be laid on the efficiency and speed of the view synthesis process. In this paper, we propose a simple, highly efficient view synthesis process that utilizes a separable look-up table based technique to speed up the 3-D warping process. We also develop a reliability-based weighting scheme for blending the candidate views into the final synthesized view. Simulation results show that the proposed method is approximately 6 times faster than VSRS 3.5 and has comparable objective quality. The proposed method is inherently parallel thus making it suitable to act as a framework for implementing high-speed view synthesis on a GP-GPU.

关键词： multi-view video coding depth-image based rendering view synthesis 3DTV

来源：评论

学校读者我要写书评

暂无评论

EFFICIENT VIEW SYNTHESIS FOR MULTI-VIEW VIDEO PLUS depth

EFFICIENT VIEW SYNTHESIS FOR MULTI-VIEW VIDEO PLUS DEPTH

引用

IEEE International Conference on image Processing

作者： Krishna Rao Vijayanagar Joohee Kim Yunsik Lee Jong-bok Kim Illinois Institute of Technology Dept. of Electrical and Computer Engineering Illinois USA. Korea Electronics Technology Institute (KETI) Bundang-gu Sungnam-si Gyungki-do South Korea. Sane System 439 DongAhn-Gu An Yang-Si Gyungki-Do South Korea.

ISBN: (纸本)9781479923427

关键词： multi-view video coding depth-image based rendering view synthesis 3DTV

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：