检索结果-内蒙古大学图书馆

CNN-LNN Based Fast CU Partitioning Decision for VVC 3D Video depth map Intra coding

IEEE ACCESS 2023年 11卷 87420-87429页

作者： Wang, Fengqin Wang, Zhiying Zhang, Qiuwen Zhengzhou Univ Light Ind Coll Comp & Commun Engn Zhengzhou 450002 Peoples R China

Currently, the coding efficacy of the cutting-edge video coding standard H.266/VVC surpasses that of 3D-HEVC (3D-High Efficiency Video coding), but the existing VVC (Versatile Video coding) low-complexity coding algorithm is mainly optimized for 2D video coding and cannot fully utilize the characteristics of the depth map itself. Based on this, we propose a fast decision algorithm employing the CNN (Convolutional Neural Network)-LNN (Lightweight Neural Network) model to diminish the intricacy of depth map intra coding in VVC 3D video. The algorithm treats the CU partitioning process in depth map coding as a two-stage process, first adding a non-local block and spatial pyramid pooling to the CNN model, enabling the proposed CNN model to skip the flat regions in the depth map and perform adaptive partitioning prediction of CUs in the edge regions;then, the LNN model is used to make early decision on TT (Ternary Tree) partition for CUs that need to be partitioned, and skip decisions for CUs that do not need to be partitioned by TT, so as to reduce some unnecessary RDO calculations. Experimental results illustrate that the algorithm achieves a notable reduction in encoding time amounting to 43.23% on average, with a negligible impact on the increase of BDBR.

关键词： VVC 3D video depth map coding CU early prediction CNN-LNN

来源：评论

学校读者我要写书评

暂无评论

Fast intra-mode decision for depth map coding in 3D-HEVC

引用

JOURNAL OF REAL-TIME IMAGE PROCESSING 2020年第5期17卷 1637-1646页

作者： Zhang, Ruyi Jia, Kebin Liu, Pengyu Sun, Zhonghua Beijing Univ Technol Fac Informat Technol Beijing 100124 Peoples R China Beijing Univ Technol Beijing Key Lab Computat Intelligence & Intellige Beijing 100124 Peoples R China

3D-high efficiency video coding (3D-HEVC) contains more encoding viewpoints than traditional HEVC, resulting in a significant increase of coding complexity. In this paper, we propose a low complexity intra mode decision algorithm to reduce the number of intra modes by detecting the flat area and texture direction of the depth map. The corresponding intra prediction modes are skipped when the flat region condition is satisfied. Otherwise, the direction of the edge is detected to decrease the number of angle modes in rough mode decision, which can reduce the intra-coding complexity and coding time cost. Experimental results demonstrate that the proposed algorithm achieves on average 36.48% time saving with negligible degradation of coding performance.

关键词： 3D-HEVC depth map coding Edge detection Rough mode decision (RMD) Intra mode decision

来源：评论

学校读者我要写书评

暂无评论

Overview of current development in depth map coding of 3D video and its future

引用

IET SIGNAL PROCESSING 2020年第1期14卷 1-14页

作者： Chan, Yui-Lam Fu, Chang-Hong Chen, Hao Tsang, Sik-Ho Hong Kong Polytech Univ Dept Elect & Informat Engn Hung Hom Kowloon Hong Kong Peoples R China Nanjing Univ Sci & Technol Sch Elect & Opt Engn 200 Xiao Ling Wei St Nanjing Peoples R China

3D videos have attracted attention from academia and industry after great success in the film industry. Multiview video plus depth (MVD) is the most popular 3D video format to provide vivid 3D feeling and has been adopted as an international 3D video coding standard, namely 3D extension of high efficiency video coding (HEVC). MVD includes a limited number of textures and depth maps to synthesise virtual views. In MVD, depth samples describe the distance between a camera and an actual object as a grey-level image. The characteristics of depth maps are quite different from texture images. Consequently, new coding tools are designed for depth maps in 3D-HEVC to improve the coding efficiency at the expense of high-computational complexity, which faces great challenges in coding systems. depth map coding is also an important technique in immersive media to support three degrees of freedom 3DoF+/6DoF applications such as virtual reality/augmented reality. The study starts with an overview of what has been done over the last decade in 3D-HEVC, especially depth map coding, regarding theories, methodologies, current research and state-of-the-art fast approaches. Following this, a comprehensive comparison of the reviewed techniques is presented, and an outlook on its future trends is provided.

关键词： image texture video coding stereo image processing computational complexity depth map coding multiview video plus depth MVD international 3D video coding standard high efficiency video coding 3D-HEVC image texture high-computational complexity

来源：评论

学校读者我要写书评

暂无评论

Occlusion-Aware depth map coding Optimization Using Allowable depth map Distortions

引用

IEEE TRANSACTIONS ON IMAGE PROCESSING 2019年第11期28卷 5266-5280页

作者： Gao, Pan Smolic, Aljosa Nanjing Univ Aeronaut & Astronaut Coll Comp Sci & Technol Nanjing 211106 Jiangsu Peoples R China Trinity Coll Dublin Sch Comp Sci & Stat Dublin D02 PN40 2 Ireland

In depth map coding, rate-distortion optimization for those pixels that will cause occlusion in view synthesis is a rather challenging task, since the synthesis distortion estimation is complicated by the warping competition and the occlusion order can be easily changed by the adopted optimization strategy. In this paper, an efficient depth map coding approach using allowable depth map distortions is proposed for occlusion-inducing pixels. First, we derive the range of allowable depth level change for both the zero disparity error case and non-zero disparity error case with theoretic and geometrical proofs. Then, we formulate the problem of optimally selecting the depth distortion within allowable depth distortion range with the objective to minimize the overall synthesis distortion involved in the occlusion. The unicity and occlusion order invariance properties of allowable depth distortion range is demonstrated. Finally, we propose a dynamic programming based algorithm to locate the optimal depth distortion for each pixel. Simulation results illustrate the performance improvement of the proposed algorithm over the other state-of-the-art depth map coding optimization schemes.

关键词： depth map coding allowable depth distortions occlusion rate-distortion optimization

来源：评论

学校读者我要写书评

暂无评论

Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for depth map coding in 3D-HEVC

引用

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 2018年第3期28卷 706-718页

作者： Lei, Jianjun Duan, Jinhui Wu, Feng Ling, Nam Hou, Chunping Tianjin Univ Sch Elect Informat Engn Tianjin 300072 Peoples R China Univ Sci & Technol China Sch Informat Sci & Technol Hefei 230026 Anhui Peoples R China Santa Clara Univ Dept Comp Engn Santa Clara CA 95053 USA

The 3D extension of High Efficiency Video coding significantly improves the coding efficiency of 3D video at the expense of computational complexity. This paper presents a novel fast mode decision algorithm for depth map coding based on the grayscale similarity and inter-view correlation. First, depth map grayscale similarity is adopted to judge whether the reference frame could assist the coding of the current frame. When the difference in the average grayscale between the co-located coding unit (CU) and the current CU is smaller than the similarity threshold, the depth level of the current CU will be restricted by that of the coded reference CU. Second, the grayscale similarity and inter-view correlation are jointly used for dependent views to achieve early decision on the best prediction unit (PU) mode. The mode decision procedure will be determined early when the co-located CU, which has a grayscale similarity with the current CU, selects Merge or Inter 2Nx2N as the best prediction mode. Moreover, when the corresponding CU in the independent view selects Merge or Inter 2N x 2N as the best prediction mode, the current CU will skip other PU modes checking based on the strong inter-view correlation. Finally, different strategies are proposed for the P-frames and B-frames of dependent views in view of the characteristics of different prediction structures. For B frames, the PU mode information of the coded independent view is utilized as reference to skip the unnecessary mode decision processes. For P frames, the spatial-temporal correlation is considered in the process of early mode decision to determine whether to choose the Merge mode or Inter 2N x 2N as the best mode. Experimental results show that our proposed scheme achieves considerable time saving with negligible degradation of coding performance.

关键词： 3D extension of High Efficiency Video coding (3D-HEVC) depth map coding early termination grayscale similarity inter-view correlation video coding visual communication

来源：评论

学校读者我要写书评

暂无评论

Adaptive Lagrangian Multiplier derivation model for depth map coding

引用

SIGNAL PROCESSING-IMAGE COMMUNICATION 2018年 65卷 26-32页

作者： Zheng, Ziqi Huo, Junyan Li, Bingbing Yuan, Hui Xidian Univ State Key Lab Integrated Serv Networks Xian 710071 Shaanxi Peoples R China Shandong Univ Sch Informat Sci & Engn Jinan 250100 Shandong Peoples R China

In stereoscopic video coding, vast and varied coding modes are utilized to adapt various video content. In order to select the optimal coding parameter set for coding unit, rate-distortion optimization (RDO) criterion is employed as a critical technology. It has been found that the Lagrangian Multiplier of RDO criterion for depth map coding has an impact on coding performance of stereoscopic video. Therefore, the Lagrangian Multiplier should be determined properly. In this paper, we first provide an analysis of the factors that could affect the Lagrangian Multiplier. Then, an adaptive Lagrangian Multiplier derivation model for depth map coding in 3D-HEVC is established by involving these affect factors. At last, the optimal coding parameter set can be obtained by the adjusted RDO criterion through the derived Lagrangian Multiplier. Experimental results demonstrate that the proposed adaptive Lagrangian Multiplier derivation model can lead to a favorable coding performance of stereoscopic video. An average 3.13% bitrate saving can be achieved compared with the HTM 16.0 reference software. Moreover, compared to two other state-of-art methods, namely the Yang's method and the Huo's method, the proposed model can achieve 0.21% and 0.11% bitrate savings, respectively.

关键词： Lagrangian Multiplier Rate-distortion optimization (RDO) Multiview video plus depth (MVD) 3D-HEVC depth map coding

来源：评论

学校读者我要写书评

暂无评论

Model-based Lagrangian multiplier derivation method for depth map coding

引用

ELECTRONICS LETTERS 2018年第14期54卷 880-881页

作者： Zheng, Ziqi Huo, Juanyan Li, Bingbing Yang, Fuzheng Xidian Univ State Key Lab Integrated Serv Networks Xian 710071 Shaanxi Peoples R China

Rate-distortion optimisation (RDO) is the key technology that is used to choose the optimal coding parameters in video coding. As the Lagrangian multiplier plays a vital role in RDO, a model-based Lagrangian multiplier derivation method is proposed for depth map coding. This method is based on the analysis of the relationships among the Lagrangian multiplier, the coding distortion, the coding bitrate and the quantisation step. Experimental results demonstrate that the proposed method can achieve an average 3.42% bitrate saving compared with the method in HTM 16.0 reference software, and an average 0.41% bitrate saving compared with a state-of-art method.

关键词： rate distortion theory optimisation video coding data compression rate-distortion optimisation RDO optimal coding parameters video coding depth map coding coding distortion coding bitrate model-based Lagrangian multiplier derivation method quantisation step HTM 16 0 reference software

来源：评论

学校读者我要写书评

暂无评论

Pixel-Wise Interframe Prediction based on Dense Three-Dimensional Motion Estimation for depth map coding

引用

IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS 2017年第9期E100D卷 2039-2043页

作者： Kasai, Shota Kameda, Yusuke Ishikawa, Tomokazu Matsuda, Ichiro Itoh, Susumu Tokyo Univ Sci Noda Chiba 2788510 Japan

We propose a method of interframe prediction in depth map coding that uses pixel-wise 3D motion estimated from encoded textures and depth maps. By using the 3D motion, an approximation of the depth map frame to be enc... 详细信息

关键词： depth map coding motion compensation optical flow 3DTV MVD

来源：评论

学校读者我要写书评

暂无评论

High-performance depth map coding for 3D-AVC

引用

SIGNAL IMAGE AND VIDEO PROCESSING 2016年第6期10卷 1017-1024页

作者： Kang, Jinmi Chung, Kidong Pusan Natl Univ Dept Comp Engn Busan South Korea

Achieving high-performance coding for a depth map is one of the most important challenges in 3D video coding. In this paper, a quality enhancement method is proposed to accomplish better coding efficiency. A new technique separating contour and flat regions is designed, and a contour-aware quality enhancement algorithm is presented to improve depth map quality. We also propose a fast mode decision process to reduce computational complexity. The proposed fast algorithm uses similarity between texture video and depth map coding. The encoding process for a depth map is terminated early by using coded information from a texture video. Experimental results show that the quality of the depth map is improved by 0.11-0.59 dB, which translates into a bit rate saving of 2.19-8.19%.The proposed fast algorithm saves encoding time, on average, by 36.4%.

关键词： depth map coding Fast mode decision Quality enhancement 3D video system

来源：评论

学校读者我要写书评

暂无评论

A Novel Mode Decision for depth map coding in 3D-AVS

A Novel Mode Decision for Depth Map Coding in 3D-AVS

引用

30th IEEE Conference on Visual Communications and Image Processing (VCIP)

作者： Su, Jing Luo, Falei Wang, Shanshe Wang, Shiqi Guo, Xiaoqiang Ma, Siwei Peking Univ Shenzhen Grad Sch Shenzhen Peoples R China Peking Univ Inst Digital Media Beijing Peoples R China Peking Univ Cooperat Medianet Innovat Ctr Beijing Peoples R China Acad Broadcasting & Sci Beijing Peoples R China

ISBN: (纸本)9781509053162

In this paper, a new mode decision scheme is proposed for depth map coding in 3D-AVS. The novelty of the paper mainly contains the following two points. Firstly, an improved distortion estimation model of synthesized views is proposed. Secondly, for the mode decision of depth map coding, the distortion is represented to be the weighted sum of depth distortion and estimated distortion of the synthesized view. We proposed a new scheme to derive the weighting factors adaptively based on the disparity. Then the distortion is utilized to calculate the rate distortion cost for mode decision. Experimental results demonstrate that the proposed scheme achieves remarkable performance improvement in 3D-AVS. The average BD-rate gain is about 12%.

关键词： Terms depth distortion view synthesized distortion estimation depth map coding disparity 3D-AVS

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：