Rate control has not been well studied for multi-view video coding (MVC). In this paper, we propose an efficient rate control algorithm for MVC by improving the quadratic rate-distortion (R-D) model, which reasonably ...
详细信息
ISBN:
(纸本)9780819482341
Rate control has not been well studied for multi-view video coding (MVC). In this paper, we propose an efficient rate control algorithm for MVC by improving the quadratic rate-distortion (R-D) model, which reasonably allocate bit-rate among views based on correlation analysis. The proposed algorithm consists of four levels for rate bits control more accurately, of which the frame layer allocates bits according to frame complexity and temporal activity. Extensive experiments show that the proposed algorithm can efficiently implement bit allocation and rate control according to coding parameters.
Several quality evaluation studies have been performed for video-plus-depth coding systems. In these studies, however, the distortions in the synthesized views have been quantified in experimental setups where both th...
详细信息
ISBN:
(纸本)9781424463794
Several quality evaluation studies have been performed for video-plus-depth coding systems. In these studies, however, the distortions in the synthesized views have been quantified in experimental setups where both the texture and depth videos are compressed. Nevertheless, there are several factors that affect the quality of the synthesized view. Incorporating more than one source of distortion in the study could be misleading;one source of distortion could mask (or be masked by) the effect of other sources of distortion. In this paper, we conduct a quality evaluation study that aims to assess the distortions introduced by the view synthesis procedure and depth map compression in multiview-video-plus-depth coding systems. We report important findings that many of the existing studies have overlooked, yet are essential to the reliability of quality evaluation. In particular, we show that the view synthesis reference software yields high distortions that mask those due to depth map compression, when the distortion is measured by average luma peak signal-to-noise ratio. In addition, we show what quality metric to use in order to reliably quantify the effect of depth map compression on view synthesis quality. Experimental results that support these findings are provided for both synthetic and real multiview-video-plus-depth sequences.
In this paper, the potential for improving the compression efficiency of multi-view video coding with depth information is explored. The proposed technique uses downsampling prior to encoding, for arbitrary views and ...
详细信息
ISBN:
(纸本)9781424417605
In this paper, the potential for improving the compression efficiency of multi-view video coding with depth information is explored. The proposed technique uses downsampling prior to encoding, for arbitrary views and depth maps. A bit-rate adaptive downscaling-ratio decision approach is proposed for certain views and depth maps prior to encoding. Colour and depth videos are considered separately due to their different characteristics and effects on synthesized free view-point videos. The inter-view references, if present, are downsampled to the same resolution as the input video to be coded. The results for several multi-view with depth sequences indicate that using bit-rate adaptive mixed spatial resolution coding for both views and depth maps can achieve savings in bit-rate, compared to full resolution and fixed depth-to-colour ratio multi-viewcoding when the quality of synthesized viewpoints are considered. The computational complexity in the encoder is significantly reduced at the same time, since the number of blocks coded is reduced, and hence the number of block mode decisions carried out is reduced.
Color inconsistency between views is an important problem to be solved in multi-viewvideo applications, such as free viewpoint television and other three-dimensional video systems. In this paper, by combining with mu...
详细信息
Color inconsistency between views is an important problem to be solved in multi-viewvideo applications, such as free viewpoint television and other three-dimensional video systems. In this paper, by combining with multi-view video coding, a coding-oriented multi-viewvideo color correction method is proposed. We first separate foreground and background in first Group Of Pictures (GOP) by using SKIP coding mode. Then by transferring means and standard deviations in backgrounds, color correction is performed for each frame in GOP, and multi-view video coding is performed and used to renew the backgrounds. Experimental results ances in color correction and multi-viewvideo show the proposed method can obtain better performcoding.
Since multiviewvideocoding (MVC) based on H.264/AVC uses a prediction scheme exploiting inter-view correlation among multiviewvideo, MVC encoder compresses multiple views more efficiently than simulcast H.264/AVC e...
详细信息
Since multiviewvideocoding (MVC) based on H.264/AVC uses a prediction scheme exploiting inter-view correlation among multiviewvideo, MVC encoder compresses multiple views more efficiently than simulcast H.264/AVC encoder. However, in case that the number of views to be encoded increases in MVC, the total encoding time will be greatly increased. To reduce computational complexity in MVC, a fast mode decision using both Macroblock-based region segmentation information and global disparity vector among views is proposed to reduce the encoding time. The proposed method achieves on the average 1.5 similar to 2.9 reduction of the total encoding time with the PSNR (Peak Signal-to-Noise Ratio) degradation of about 0.05 dB.
We have developed a new type of television named FTV (Free viewpoint TV). FTV is an innovative media that enables us to view a 3D scene by freely changing Our viewpoints. FTV will be widely used since it is an ultimat...
详细信息
ISBN:
(纸本)9781424445936
We have developed a new type of television named FTV (Free viewpoint TV). FTV is an innovative media that enables us to view a 3D scene by freely changing Our viewpoints. FTV will be widely used since it is an ultimate 3DTV, a natural interface between human and environment, and an innovative tool to create new types of content and art. FTV has been contributing to the standardization of MVC (multi-view video coding) and 3DV (3D video) at MPEG. MVC is the first phase of FTV and 3DV is the second phase of FTV. An FTV system can be constructed in various ways, but typically includes multiple viewpoint video capture, image correction, depth estimation, coding/decoding and view interpolation. coding is related to view generation in FTV. In this paper, 4 frameworks for FTV coding are discussed and an FTV data format as a combination of FTV data units is proposed.
We have developed a new type of television named FTV (Free-viewpoint TV). FTV is an innovative visual media that enables us to view a 3D scene by freely changing our viewpoints. We constructed the world's first re...
详细信息
ISBN:
(纸本)9781424442904
We have developed a new type of television named FTV (Free-viewpoint TV). FTV is an innovative visual media that enables us to view a 3D scene by freely changing our viewpoints. We constructed the world's first real-time FTV system including the complete chain from capturing to display. We have also developed new type of ray capture and display technologies such as a 360-degree mirror-scan ray capturing system and a 360 degree ray-reproducing display. MPEG has been conducting the standardization activities of FTV. The first phase of FTV was multi-view video coding and the second phase is 3D video.
In this work, we propose virtual view interpolation algorithm and prediction structure for full parallax multi-view video coding The proposed virtual view interpolation algorithm estimates the disparity information by...
详细信息
ISBN:
(纸本)9783642104664
In this work, we propose virtual view interpolation algorithm and prediction structure for full parallax multi-view video coding The proposed virtual view interpolation algorithm estimates the disparity information by bilateral criterion and disparity smoothness The interpolated view is used as additional reference frame, and novel direct mode is applied to it, Simulation results demonstrate that our proposed virtual view interpolation algorithm shows the better quality than the conventional interpolation algorithm Moreover, the proposed prediction structure, which uses the interpolated view as an additional reference with novel direct mode, shows the significant coding gain
view interpolation has been applied in multiviewviewcoding. However, existing schemes assume all cameras are aligned. These methods may not perform well when neighboring cameras point to different directions. In thi...
详细信息
ISBN:
(纸本)9781424442904
view interpolation has been applied in multiviewviewcoding. However, existing schemes assume all cameras are aligned. These methods may not perform well when neighboring cameras point to different directions. In this paper, we apply the rectification based view interpolation to MVC. We first derive the theoretical performance gain of the rectification based view interpolation over existing interpolation method. We then analyze the rate-distortion performance of the proposed MVC method, and compare with the disparity compensation based MVC and view interpolation based MVC without rectification. The analyses show that view rectification can offer additional coding gain over existing view interpolation based MVC, especially when the disparity estimation is accurate and when the neighboring cameras are close to each others. Preliminary experimental results are provided to verify the theoretical analysis.
In this paper, a new multi-viewcoding (MVC) scheme is proposed and evaluated. The scheme offers improved low-delay view random access capability and at the same time comparable compression performance with respect to...
详细信息
ISBN:
(纸本)9781424425709
In this paper, a new multi-viewcoding (MVC) scheme is proposed and evaluated. The scheme offers improved low-delay view random access capability and at the same time comparable compression performance with respect to the reference multi-viewcoding scheme currently used. The proposed scheme uses the concept of multiple-resolution viewcoding, exploiting the trade-off between quantization distortion and downsampling distortion at changing bit-rates, which in turn provides improved coding efficiency. Bipredictive (B) coded views, used in the conventional MVC method, are replaced with predictive coded downscaled views, reducing the view dependency in a multi-view set and hence reducing the random view access delay, but preserving the compression performance at the same time. Results show that the proposed method reduces the view random access delay in a MVC system significantly, but has a similar objective and subjective performance with the conventional MVC method.
暂无评论