检索结果-内蒙古大学图书馆

Efficient representation of disoccluded regions in 3d video coding

ANNALS OF TELECOMMUNICATIONS 2025年第1-2期80卷 123-137页

作者： Farid, Muhammad Shahid Babar, Badi uz Zaman Khan, Muhammad Hassan Univ Punjab Dept Comp Sci Lahore 54590 Pakistan

Three-dimensional (3d) video technology has gained immense admiration in recent times due to its numerous applications, particularly in the television and cinema industry. Three-dimensional television (3dTV) and free-viewpoint television (FTV) are two well-known applications that provide the end-user with a real-world and high-quality 3d display. In both applications, multiple views captured from different viewpoints are rendered simultaneously to offer depth sensation to the viewer. A large number of views are needed to enable FTV. However, transmitting this massive amount of data is challenging due to bandwidth limitations. Multiview video-plus-depth (MVd) is the most popular format where in addition to color images, corresponding depth information is also available which represents the scene geometry. The MVd format with the help of depth image-based rendering (dIBR) enables the generation of views at novel viewpoints. In this paper, we introduce a panorama-based representation of MVd data with an efficient keyframe-based disocclusions handling technique. The panorama view for a stereo pair with depth is constructed from the left view and the novel appearing region of the right view which is not visible from the left viewpoint. The disocclusions that appear in the right view when obtained from the dIBR of the left view are collected in a special frame named as keyframe. On the decoder side, the left view is available with a simple crop of panorama view. The right view is obtained through dIBR of the left view combined with the appearing region from the panorama view. The disocclusions in this warped view are filled from the keyframe. The panorama view with additional keyframes and the corresponding depth map are compressed using the standard HEVC codec. The experimental evaluations performed on standard MVd sequences showed that the proposed scheme achieves excellent video quality while saving considerable bit rate compared to HEVC simulcast.

关键词： Multiview video plus depth 3d video coding Free-viewpoint TV Autostereoscopy

来源：评论

学校读者我要写书评

暂无评论

Vision-oriented algorithm for fast decision in 3d video coding

引用

IET IMAGE PROCESSING 2022年第8期16卷 2263-2281页

作者： Lin, Jie-Ru Chen, Mei-Juan Yeh, Chia-Hung Lin, Shinfeng d. Sue, Kuen-Liang Kau, Lih-Jen Ciou, Yi-Sheng Natl Dong Hwa Univ Dept Elect Engn Hualien Taiwan Natl Taiwan Normal Univ Dept Elect Engn Taipei 10610 Taiwan Natl Sun Yat Sen Univ Dept Elect Engn Kaohsiung Taiwan Natl Dong Hwa Univ Dept Computet Sci & Informat Engn Hualien Taiwan Natl Cent Univ Dept Informat Management Taoyuan Taiwan Natl Taipei Univ Technol Dept Elect Engn Taipei Taiwan

This paper designs a novel method to reduce the coding complexity of 3d-HEVC encoder by utilizing the properties of human visual perception. Two vision-oriented edge detections are proposed: for colour texture detection, the authors adopt the Just-Noticeable distortion (JNd);for depth map, the authors combine the Sample Adaptive Offset (SAO) and the Just Noticeable depth difference (JNdd) model. The authors also analyse the properties of colour texture and depth map to classify the coding tree unit (CTU) into various kinds of types, including complex-edge CTU, moderate-edge CTU and homogeneous CTU. Besides, fast mode decisions and early termination criteria are performed individually on each type of CTUs according to their characteristics. Especially for those CTUs with more edge information, the proposed projection-based fast mode decision and residual-based early termination preserve important colour texture while speeding up the coding at the same time. The proposed vision-oriented algorithm reduces 31.981% of the overall average coding time with only 1.580% Bd-Bitrate increase. Experimental results show that the proposed algorithm can provide considerable time-saving while still maintain the video quality, which outperforms the previous researches.

关键词： projection-based fast mode decision residual-based early termination preserve important colour texture homogeneous CTU Sample Adaptive Offset 3d video coding video coding complex-edge CTU fast decision depth map colour texture detection edge detection vision-oriented algorithm 3d-HEVC encoder human visual perception Noticeable depth difference model vision-oriented edge detections image texture coding tree unit visual perception Just-Noticeable distortion moderate-edge CTU coding complexity early termination criteria fast mode decisions edge information average coding time

来源：评论

学校读者我要写书评

暂无评论

HEVC-based three-layer texture and depth coding for lossless synthesis in 3d video coding

引用

MULTIMEdIA TOOLS ANd APPLICATIONS 2020年第29-30期79卷 20929-20945页

作者： Lee, Jin Young Park, Hyun Wook Sejong Univ Sch Intelligent Mechatron Engn Seoul South Korea Korea Adv Inst Sci & Technol KAIST Dept Elect Engn Daejeon South Korea

Efficient lossless coding of a texture image and its corresponding depth map is important to perform accurate view synthesis in 3d applications. In this paper, a novel HEVC-based three-layer texture and depth coding method is proposed for lossless synthesis in 3d video coding. The proposed method performs lossy and lossless texture coding in the first and second layers, respectively. A quantization parameter (QP) in the first lossy coding layer is adaptively selected for each block, based on a relationship between the first and second layers. In the third layer, the lossy depth coding is performed by using synthesis-based depth coding and texture-based depth intra prediction mode. The synthesis-based depth coding technique adopts the lossy coding but guarantees zero synthesis distortion. The texture-based depth intra prediction mode performs the depth prediction by using the associated texture information. Experimental results demonstrate that the proposed method obtains higher coding performance than conventional lossless coding methods.

关键词： 3d video coding depth coding HEVC Lossless coding Lossless synthesis

来源：评论

学校读者我要写书评

暂无评论

Pixel-Level View Synthesis distortion Estimation for 3d video coding

引用

IEEE TRANSACTIONS ON CIRCUITS ANd SYSTEMS FOR video TECHNOLOGY 2020年第7期30卷 2229-2239页

作者： Jin, Jian Liang, Jie Zhao, Yao Lin, Chunyu Yao, Chao Meng, Lili Beijing Jiao Tong Univ Inst Informat Sci Beijing 100044 Peoples R China Beijing Key Lab Adv Informat Sci & Network Techno Beijing 100044 Peoples R China Simon Fraser Univ Sch Engn Sci Burnaby BC V5A 1S6 Canada Beijing Univ Posts & Telecommun Inst Sensing Technol & Business Beijing 100876 Peoples R China Shandong Normal Univ Dept Informat Sci & Engn Jinan 250358 Peoples R China

Recently, region-based 3d video coding has been proposed. However, existing view synthesis distortion estimation (VSdE) methods are performed at the frame level. To guide the rate-distortion optimization process of region-based 3d video coding schemes, this paper proposes the first pixel-level VSdE (PL-VSdE) method. We first give the definition of the pixel-level view synthesis distortion. To estimate it, a backward prediction method is then developed, which starts from the pixels of interest (POIs) in the virtual view and finds their corresponding pixels in the reference view via a coarse-to-fine approach, denoted as coarse-to-fine backward prediction (CFBP) method. Additionally, the CFBP fully considers the details of 3d warping, the rounding operation and the warping competition in view synthesis, leading to improve accuracy of the prediction. Besides, a table-lookup method and a warping property are introduced to speed up the CFBP. After integrating the CFBP into the PL-VSdE, we can estimate the view synthesis distortion at the pixel level. Our method is carried out pixel-by-pixel independently, which is friendly for parallel processing. The experimental results demonstrate that our proposed method has significant advantages in both accuracy and efficiency compared with the state-of-the-art frame-level VSdE methods.

关键词： distortion video coding Cameras Estimation Rendering (computer graphics) Information science Rate-distortion 3d video coding depth-image-based rendering (dIBR) distortion estimation 3d warping

来源：评论

学校读者我要写书评

暂无评论

Adaptive Bit Allocation for 3d video coding

引用

CIRCUITS SYSTEMS ANd SIGNAL PROCESSING 2017年第5期36卷 2102-2124页

作者： Yang, Chao An, Ping Shen, Liquan Liu, deyang Shanghai Univ Sch Commun & Informat Engn 149 Yanchang Rd Shanghai 200072 Peoples R China Key Lab Adv Display & Syst Applicat 149 Yanchang Rd Shanghai 200072 Peoples R China

In the multi-view video plus depth 3d video coding, texture image and depth map are coded jointly. The texture image is utilized for displaying and synthesizing the virtual view as reference image. The depth map provides the scene geometry information and is utilized to synthesize the virtual view at the terminal through depth-Image Based Rendering technique. The distortion of the compressed texture image and depth map will be propagated to the synthesized virtual view. Besides the coding efficiency of texture image and depth map, bit allocation between texture image and depth map also has a great effect on the synthesized virtual view quality. Several methods are proposed for bit allocation between texture image and depth map, but most of them attempt to allocate a fixed target bitrate based on virtual view distortion model to achieve optimal synthesized virtual view quality, and the modeling process brings extra complexity. In practical application, the video sequence has different contents and fixed bit ratio cannot achieve optimal performance. In this paper, we propose an adaptive bit allocation algorithm for 3d video coding. First, we present a model to estimate the synthesized virtual view distortion, and then adjust the bit ratio between adjacent views and between texture image and depth map at Group of Picture level based on the virtual view quality fluctuation. We adjust the bit ratio to achieve the optimal virtual view quality for different video contents. Experimental results demonstrate that the proposed algorithm can optimally allocate bits to achieve optimal virtual view quality under different target bitrates and for different video contents, and the computational complexity of the proposed algorithm is extremely low.

关键词： 3d video coding Bit allocation Rate control Virtual view distortion

来源：评论

学校读者我要写书评

暂无评论

Bit allocation for 3d video coding based on lagrangian multiplier adjustment

引用

SIGNAL PROCESSING-IMAGE COMMUNICATION 2017年 52卷 1-5页

作者： Yang, Chao An, Ping Liu, deyang Shen, Liquan Li, Kai Minist Educ Key Lab Adv Displays & Syst Applicat Shanghai Peoples R China Shanghai Univ Sch Commun & Informat Engn Shanghai Peoples R China

Multi-view video plus depth (MVd) format 3d video consists of color texture image and gray depth map, the depth map provides the scene geometry information and is utilized to synthesize the virtual views through depth Image Based Rendering (dIBR) technique. The quality of the synthesized virtual views is related to the qualities of both texture image and depth map, thus bit allocation between texture image and depth map is very important in 3d video coding. In this paper, we propose to optimally allocate bits between texture image and depth map by adjusting the Lagrangian Multiplier (LM) in depth map coding, we adjust the LM based on the difference between texture image coding Quantization Parameter (QP) and depth map QP. Experimental results show that the proposed method can achieve optimal 3d video coding performance for different sequences under different bitrates, and the complexity of our method is extremely low.

关键词： Bit allocation Rate distortion optimization Lagrangian multiplier adjustment 3d video coding

来源：评论

学校读者我要写书评

暂无评论

An Adaptive Error Concealment Method for depth Map in 3d video coding

引用

INTERNATIONAL JOURNAL OF FUZZY SYSTEMS 2016年第1期18卷 62-71页

作者： Lee, Pei-Jun Kuo, Kuei-Ting Natl Chi Nan Univ Dept Elect Engn Puli Taiwan

Stereoscopic images and video are synthesized from virtual views, which are produced from a real view and its depth map. However, this process involves a large amount of data which not only increases the transmission load, but also must be stored within the display devices which therefore must possess huge storage capacities. To solve these problems, the Joint video Team has developed the 3d video coding (3dVC) standard to reduce the redundant data for multiview video and its depth map through the correlation between the real view and its corresponding depth map. When depth data in the 3dVC bitstream are lost during transmission, it causes the decoded depth map to be incomplete. Then the quality of the decoded depth map is reduced and the quality of the stereoscopic video will also be decreased. To increase the reconstructed quality of the damaged macro-block, this paper proposes an adaptive error concealment selection to determine the most suitable error concealment method based on fuzzy reasoning. The temporal and spatial correlations of the damaged macro-block which are defined by the motion vectors of neighboring blocks and their depth information are used for the adaptive selection. From the simulation result, the proposed algorithm can reduce the concealing time by at least 0.15-2.86 frame/sec and can improve quality by about 0.13-0.17 dB. The proposed algorithm is suitable for the 3dVC video transmission.

关键词： 3d video coding depth map Adaptive error concealment selection Views correlation

来源：评论

学校读者我要写书评

暂无评论

Rate distortion Optimization using SSIM for 3d video coding 23

Rate Distortion Optimization using SSIM for 3D Video Coding

引用

23rd International Conference on Pattern Recognition (ICPR)

作者： Harshalatha, Y. Biswas, Prabir Kumar Indian Inst Technol Kharagpur Dept Elect & Elect Commun Engn Kharagpur 721302 W Bengal India

ISBN: (纸本)9781509048472

coding efficiency can be enhanced through rate-distortion optimization (RdO) that provides a trade-off between bit-rate and distortion. In this paper, we have proposed Structural SIMilarity (SSIM) based RdO for 3d video coding improvement. SSIM index is a quality metric that gives better approximation to visual quality. Most of the existing literature on 3d video coding employs sum-of-squared error (SSE) as a measure of distortion, which does not always correlate to visual quality. In order to overcome this gap, SSIM-based RdO is implemented in this paper. Lagrange multiplier is modified to obtain optimum rate along with a reduction in distortion which improves the perceptual quality of the video. The entropy of macroblock (MB) is also considered in the scaling of Lagrange multiplier to increase RdO performance. The proposed algorithm is implemented in 3dV-ATM reference software. Experimental results show an improvement in the perceptual quality of the synthesized sequences with bitrate reduction of 6 - 15%.

关键词： 3d video coding Lagrange multiplier Perceptual Vision Rate-distortion optimization SSIM Virtual view synthesis

来源：评论

学校读者我要写书评

暂无评论

3d video coding Using Just Noticeable depth difference Based on H.265/HEVC 11

3D Video Coding Using Just Noticeable Depth Difference Based...

引用

11th International Conference on Computational Intelligence and Security (CIS)

作者： Bai, Yuejin Zhang, Yana Li, Zhaohui Commun Univ China Sch Informat Engn Beijing Peoples R China

ISBN: (纸本)9781467386609

Just noticeable depth difference (JNdd) model represents the depth sensitivity of human visual system (HVS). Human eyes have different depth sensitivity for different distance and binocular disparity information. The JNdd model indicates that human can easily perceive the depth change when an object is close to the screen plane, but less sensitive to a distant object. If the depth information is below the JNdd threshold, there are visual redundancies, and we can process a video with bigger compression ratio. In this paper, we apply Silva's JNdd model to H.265/HEVC for the color image coding. We propose a perception region division algorithm (PRdA), through which we divide the depth map into four regions with different depth. Then, the quantization parameter is adjusted depending on a visual perception threshold. Experimental results show that our color image coding scheme improves the image quality without increasing bitrates.

关键词： just noticeable depth difference (JNdd) 3d video coding rate distortion optimization

来源：评论

学校读者我要写书评

暂无评论

Panorama View With Spatiotemporal Occlusion Compensation for 3d video coding

引用

IEEE TRANSACTIONS ON IMAGE PROCESSING 2015年第1期24卷 205-219页

作者： Farid, Muhammad Shahid Lucenteforte, Maurizio Grangetto, Marco Univ Turin Dipartimento Informat I-10124 Turin Italy Univ Punjab Lahore 54890 Pakistan

The future of novel 3d display technologies largely depends on the design of efficient techniques for 3d video representation and coding. Recently, multiple view plus depth video formats have attracted many research efforts since they enable intermediate view estimation and permit to efficiently represent and compress 3d video sequences. In this paper, we present spatiotemporal occlusion compensation with panorama view (STOP), a novel 3d video coding technique based on the creation of a panorama view and occlusion coding in terms of spatiotemporal offsets. The panorama picture represents the most of the visual information acquired from multiple views using a single virtual view, characterized by a larger field of view. Encoding the panorama video with state-of-the-art HECV and representing occlusions with simple spatiotemporal ancillary information STOP achieves high-compression ratio and good visual quality with competitive results with respect to competing techniques. Moreover, STOP enables free viewpoint 3d TV applications whilst allowing legacy display to get a bidimensional service using a standard video codec and simple cropping operations.

关键词： 3d-TV 3d video coding HEVC AVC depth image based rendering

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：