检索结果-内蒙古大学图书馆

GAN-based multi-view video coding with spatio-temporal EPI reconstruction

SIGNAL PROCESSING-IMAGE COMMUNICATION 2025年 132卷

作者： Lan, Chengdong Yan, Hao Luo, Cheng Zhao, Tiesong Fuzhou Univ Fujian Key Lab Intelligent Proc & Wireless Transmi Fuzhou 350108 Peoples R China

The introduction of multiple viewpoints in video scenes inevitably increases the bitrates required for storage and transmission. To reduce bitrates, researchers have developed methods to skip intermediate viewpoints during compression and delivery, and ultimately reconstruct them using Side Information (SInfo). Typically, depth maps are used to construct SInfo. However, these methods suffer from reconstruction inaccuracies and inherently high bitrates. In this paper, we propose a novel multi-view video coding method that leverages the image generation capabilities of Generative Adversarial Network (GAN) to improve the reconstruction accuracy of SInfo. Additionally, we consider incorporating information from adjacent temporal and spatial viewpoints to further reduce SInfo redundancy. At the encoder, we construct a spatio-temporal Epipolar Plane Image (EPI) and further utilize a convolutional network to extract the latent code of a GAN as SInfo. At the decoder, we combine the SInfo and adjacent viewpoints to reconstruct intermediate views using the GAN generator. Specifically, we establish a joint encoder constraint for reconstruction cost and SInfo entropy to achieve an optimal trade-off between reconstruction quality and bitrate overhead. Experiments demonstrate the significant improvement in Rate-Distortion (RD) performance compared to state-of-the-art methods.

关键词： multi-view video coding Generative adversarial network Latent code learning Epipolar plane image

来源：评论

学校读者我要写书评

暂无评论

multi-view video coding with view interpolation prediction for 2D camera arrays

引用

JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 2010年第5-6期21卷 474-486页

作者： Chung, Tae-Young Jung, Il-Lyong Song, Kwanwoong Kim, Chang-Su Korea Univ Sch Elect Engn Seoul South Korea

An efficient compression algorithm for multi-view video sequences, which are captured by two-dimensional (2D) camera arrays, is proposed in this work. First, we propose a novel prediction structure, called three-dimensional hierarchical B prediction (3DHBP), which can efficiently reduce horizontal inter-view redundancies, vertical inter-view redundancies, and temporal redundancies in multi-view videos. Second, we develop a view interpolation scheme based on the bilateral disparity estimation. The interpolation scheme yields high quality view frames by adapting disparity estimation and compensation procedures using the information in neighboring frames. Simulation results demonstrate that the proposed multi-view video coding algorithm provides significantly better rate-distortion (R-D) performance than the conventional algorithm, by employing the 3DHBP structure and using interpolated view frames as additional reference frames. 2009 Elsevier Inc. All rights reserved.

关键词： multi-view video coding Hierarchical B prediction view interpolation Bilateral criterion 2D camera array 3D-TV H.264/AVC

来源：评论

学校读者我要写书评

暂无评论

multi-view video coding Based on Vector Estimation and Weighted Disparity Interpolation

引用

CIRCUITS SYSTEMS AND SIGNAL PROCESSING 2009年第6期28卷 913-923页

作者： Liu, Suxing An, Ping Zhang, Zhaoyang Zhang, Qian Yan, Tao Shanghai Univ Sch Commun & Informat Engn Shanghai 200072 Peoples R China Minist Educ Key Lab Adv Displays & Syst Applicat Shanghai 200072 Peoples R China

Aiming at fully exploiting the temporal and spatial redundancy and answering the "Call for Proposals" for multi-view video coding (MVC) issued by MPEG, a MVC scheme based on vector field estimation and weighted disparity interpolation is presented. By extending the loop constraint to multi-view images for a parallel camera model and proposing the novel "vector field estimation" scheme, the temporal and spatial redundancy is significantly reduced. Also, weighted disparity interpolation is performed to predict adjacent disparity vectors. Experimental results over multi-view image sets imply that the coding efficiency is improved about 0.2-0.5 dB compared with previous coding approaches such as H.264/AVC simulcast and JMVM.

关键词： multi-view video coding Vector field estimation Loop constraint Weighted disparity interpolation

来源：评论

学校读者我要写书评

暂无评论

multi-view video coding with flexible view-temporal prediction structure for fast random access

引用

7th Pacific Rim Conference on multimedia

作者： Liu, Yanwei Huang, Qingming Ji, Xiangyang Zhao, Debin Gao, Wen Chinese Acad Sci Inst Comp Technol Beijing Peoples R China Chinese Acad Sci Grad Sch Beijing Peoples R China Harbin Inst Technol Dept Comp Sci Harbin 150006 Peoples R China Peking Univ Sch Elect Engn & Comp Sci Beijing Peoples R China

ISBN: (纸本)3540487662

multi-view video is becoming increasingly popular, as it provides users greatly enhanced viewing experience. multi-view video coding (MVC) focuses on exploiting not only the temporal correlation among the adjacent pictures for each view, but also inter-view correlation. Though the coding efficiency is a key target for MVC, the view-temporal prediction structure for improving the compression efficiency usually results in the decoding delay and limits the random access ability. Random access ability is an important feature in MVC because it provides the view switching, temporal frame sweepingly browsing and other interactive abilities for the client users in multi-view video streaming. In this paper, we propose an algorithm to flexibly regulate the view-temporal prediction structure. It is able to achieve a good trade-off between compression performance and random access ability.

关键词： multi-view video coding random access view-temporal prediction structure

来源：评论

学校读者我要写书评

暂无评论

Error-Resilient multi-view video coding Based on End-to-End Rate-Distortion Optimization

引用

Chinese Journal of Electronics 2016年第2期25卷 277-283页

作者： GAO Pan PENG Qiang WANG Qionghua School of Information Science and Technology Southwest Jiaotong University School of Mechanical and Electrical Engineering University of Southern Queensland School of Electronics and Information Engineering Sichuan University

video transmission over packet-switched networks usually suffers from packet losses. The use of the prediction loop in video coding will cause these errors to propagate to subsequent frames, and thus significantly impacts on the received video quality. With the increasing number of cameras to capture the scene, robustly delivering multi-view video over error-prone channels becomes a rather challenging task. A rate-distortion optimization algorithm is proposed to improve error resilience for multi-view video transmission. A recursive model to estimate the end-to-end distortion is developed for multiview video coding, in which the distortion model explicitly takes into consideration the inherent error resilience property of the hierarchical bi-prediction structure. Based on the proposed distortion model, end-to-end rate-distortion optimization criterion is employed to perform coding mode switching. Extensive experimental results demonstrate significant performance gains can be achieved for multi-view video communication against transmission errors.

关键词： multi-view video coding Error-resilient Distortion estimation Mode switching

来源：评论

学校读者我要写书评

暂无评论

coding statistics based fast mode decision for multi-view video coding

引用

JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 2013年第6期24卷 686-699页

作者： Chan, Chia-Chi Tang, Chih-Wei Natl Cent Univ Dept Commun Engn Visual Commun Lab Jhongli 32001 Taiwan

Reduction of high computational complexity of multi-view video coding (MVC) is necessary for realization in consumer electronics. Since mode decision is one of the key computational bottlenecks of multiview video encoders, this paper proposes a coding statistics based fast mode decision algorithm. First of all, a rate-distortion cost based fast DIRECT mode decision algorithm early terminates the mode decision process if possible. Next, the candidates for Inter modes are reduced by taking the advantage of the correlation between an optimal mode and motion cost. The proper thresholds to reduce the candidates for the above two fast algorithms can be easily derived from exponential functions at run time. Finally, motion vector difference based motion characteristics is referred to further speed up the mode decision process of Inter modes. The experimental results show that the proposed scheme reduces up to 70.82% of encoding time with negligible degradation of RD performance. (C) 2012 Elsevier Inc. All rights reserved.

关键词： multi-view video coding Fast mode decision RD cost Motion cost Motion vector difference DIRECT mode Inter mode Intra mode

来源：评论

学校读者我要写书评

暂无评论

Error-resilient multi-view video coding using Wyner-Ziv techniques

引用

multiMEDIA TOOLS AND APPLICATIONS 2015年第18期74卷 7957-7982页

作者： Gao, Pan Peng, Qiang Xiang, Wei Southwest Jiaotong Univ Sch Informat Sci & Technol Chengdu 610031 Sichuan Peoples R China Univ So Queensland Sch Mech & Elect Engn Toowoomba Qld 4350 Australia

In this paper, a Wyner-Ziv (WZ) coding based error-resilient scheme is proposed for multi-view video transmission over error-prone channels. At the encoder, the key frames of the odd views are protected by WZ encoding to generate the auxiliary bit-stream alongside the multi-view video coded bit-stream. At the decoder, error-concealed multi-view decoded frames are used as the side information (SI) for WZ decoding. Based on the study on the characteristics of multi-view video coding (MVC) and the propagating behavior of channel errors, a recursive model to estimate the transmission distortion is developed in the transform domain, in which the channel-induced distortion takes into consideration both motion and disparity compensation. With the proposed model, we propose a rate control strategy for WZ encoding to infer the minimum bit rate so as to correct the SI errors. The WZ bit rate estimation method exploits the correlation between the original bit-planes and the SI bit-planes as well as the bit-plane interdependency. Extensive experimental results show that the proposed error-resilient scheme outperforms Reed Solomon based forward error correction method by about 1.1 dB and outperforms the adaptive intra refresh algorithm by approximately 1.6 dB at the packet loss rate 10 %.

关键词： multi-view video coding Wyner-Ziv coding Error resilience Transmission distortion estimation Bit rate estimation

来源：评论

学校读者我要写书评

暂无评论

Light Field multi-view video coding With Two-Directional Parallel Inter-view Prediction

引用

IEEE TRANSACTIONS ON IMAGE PROCESSING 2016年第11期25卷 5104-5117页

作者： Wang, Gengkun Xiang, Wei Pickering, Mark Chen, Chang Wen Univ Southern Queensland Sch Mech & Elect Engn Toowoomba Qld 4350 Australia James Cook Univ Coll Sci Technol & Engn Cairns Qld 4870 Australia UNSW Sch Engn & Informat Technol Canberra ACT 2600 Australia SUNY Buffalo Dept Comp Sci & Engn Buffalo NY 14260 USA

Light field (LF) technology has been popularly adopted by a wide range of conventional industries. However, one problem when dealing with LFs is the sheer size of data volume. There have been many multi-view video coding (MVC)-based LF video coding methods reported in the literature, aiming at finding the best prediction structure for LF video coding. It is clear that the number of possible prediction structures is unlimited, and it is also observed that the coding bit-rate can be reduced by increasing the number of bi-directionally encoded views in the prediction structure. However, none work has been conducted to analyze the relationship of the prediction structure with its coding performance. In light of this observation, we first design a new LF-MVC prediction structure by extending the inter-view prediction into a two-directional parallel structure. Analytical models for source coding rate and encoding time are developed to analyze their relationships with the prediction structure, and are proven to be well-matched to our experimental results. Experimental evaluation of two LF video sequences demonstrates that the proposed LF-MVC prediction structure can achieve a factor of 26% bit-rate reduction against the conventional MVC prediction structure for an LF video with 5 x 5 views, and a further 34% bit-rate reduction for an LF video with a larger 10 x 10 views. Compared with the state-of-the-art MVC-based LF video coding prediction structures in the literature, LF-MVC can achieve the best coding performance, and with its high encoding efficiency, is well suited for deployment in practical LF-based 3D systems.

关键词： Light field video multi-view video coding prediction structure source coding rate encoding time

来源：评论

学校读者我要写书评

暂无评论

Fast inter-frame prediction in multi-view video coding based on perceptual distortion threshold model

引用

SIGNAL PROCESSING-IMAGE COMMUNICATION 2019年 70卷 199-209页

作者： Jiang, Gangyi Du, Baozhen Fang, Shuqing Yu, Mei Shao, Feng Peng, Zongju Chen, Fen Ningbo Univ Fac Informat Sci & Engn Ningbo Zhejiang Peoples R China Ningbo Polytech Elect & Informat Coll Ningbo Zhejiang Peoples R China

multi-view video coding (MVC) utilizes hierarchical B picture prediction structure and adopts many coding techniques to remove spatiotemporal and inter-view redundancies at the cost of high computational complexity. In this paper, a novel perceptual distortion threshold model (PDTM) is proposed to reveal the relationship between the mode selection of inter-frame prediction and coding distortion threshold. Based on the proposed PDTM, a new fast inter-frame prediction algorithm in MVC is developed aimed at minimizing computational complexity for dependent view coding. Then the fast MVC algorithm is incorporated into the multi-view High Efficiency video coding (MV-HEVC) software to improve MVC coding efficiency. In practical coding, the mode selection for inter-frame prediction of dependent views may be early terminated based on the thresholds derived from the PDTM, thereby reducing the coding time complexity. Experimental results demonstrate that the proposed algorithm can reduce the computational complexity of the dependent views by 52.9% compared with the HTM14.1 algorithm under the coding structure of hierarchical B pictures. Moreover, the bitrate is increased by 0.9% under the same subjective quality and only increased by 1.0% under the same objective quality peak signal-to-noise ratio (PSNR). Compared with the state-of-the-art fast algorithm, the proposed algorithm can save more coding time, while the bitrate under the same PSNR increases slightly.

关键词： multi-view video coding Perceptual distortion threshold model Binocular just noticeable difference Fast mode decision

来源：评论

学校读者我要写书评

暂无评论

Color correction algorithm based on camera characteristics for multi-view video coding

引用

SIGNAL IMAGE AND video PROCESSING 2014年第5期8卷 955-966页

作者： Jung, Jae-Il Ho, Yo-Sung Gwangju Inst Sci & Technol Dept Informat & Commun C 412 Kwangju 500712 South Korea

Various types of multi-view camera systems have been proposed for capturing three dimensional scenes. Yet, color distributions among multi-view images remain inconsistent in most cases, degrading multi-view video coding performance. In this paper, we propose a color correction algorithm based on the camera characteristics to effectively solve such a problem. Initially, we model camera characteristics and estimate their coefficients by means of correspondences between views. To consider occlusion in multi-view images, correspondences are extracted via feature-based matching. During coefficient estimation with nonlinear regression, we remove outliers in the extracted correspondences. Consecutively, we generate lookup tables for each camera using the model and estimated coefficients. Such tables are employed for fast color converting in the final color correction process. The experimental results show that our algorithm enhances coding efficiency with gains of up to 0.9 and 0.8 dB for luminance and chrominance components, respectively. Further, the method also improves subjective viewing quality and reduces color distance between views.

关键词： Camera characteristic curve Color correction Color inconsistency problem multi-view video coding

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：