检索结果-内蒙古大学图书馆

Attention-Based inter-Prediction for Versatile Video coding

IEEE ACCESS 2023年 11卷 84313-84322页

作者： Tran, Quang Nhat Yang, Shih-Hsuan Natl Taipei Univ Technol Dept Comp Sci & Informat Engn Taipei 106344 Taiwan Family Technol Co Ltd AI Ctr Da Nang 550000 Vietnam

Versatile Video coding (VVC) is the latest video coding standard, which provides significant coding efficiency to its successors based on new coding tools and flexibility. In this paper, we propose a generative adversarial network-based inter-picture prediction approach for VVC. The proposed method involves two major parts, deep attention map estimation and deep frame interpolation. Adjacent VVC-coded frames in every other frame are taken as the reference data for the proposed inter-picture prediction. The deep attention map classifies pixels into high-interest and low-interest. The low-interest pixels are replaced by the generated data from frame interpolation without extra coded bits, while the other pixels are encoded using the conventional VVC coding tools. The generation of the attention map and interpolated frame can be incorporated into the VVC encoding algorithm under a unified framework. Experimental results show that the proposed method improves the coding efficiency of VVC with a moderate increase (26.7%) in runtime. A BD-rate savings of 1.91% on average was achieved compared to the VVC reference software in the Random-Access configuration. A significant reduction in bitrate was observed for chroma components (U and V).

关键词： Attention map deep learning deep video coding tool generative adversarial networks (GANs) inter coding video coding Versatile Video coding (VVC)

来源：评论

学校读者我要写书评

暂无评论

Adaptive Variance-Threshold-Based Skip Modes for Learned Video Compression Using a Motion Complexity Criterion

Adaptive Variance-Threshold-Based Skip Modes for Learned Vid...

引用

Picture coding Symposium (PCS)

作者： Brand, Fabian Seiler, Juergen Sauer, Johannes Alshina, Elena Kaup, Andre Friedrich Alexander Univ Erlangen Nurnberg Multimedia Commun & Signal Proc Erlangen Germany Huawei Technol Dusseldorf GmbH Dusseldorf Germany

ISBN: (纸本)9798350358483;9798350358490

Skip modes are a powerful tool to reduce the rate in video compression. The main idea is that the residual areas where the prediction performs well are not transmitted since the prediction quality is good enough that the prediction signal itself can be used as the reconstruction signal. This is commonly used, e.g., in the compression standard VVC, where a skip flag can be transmitted for inter blocks under certain conditions. The skipped residual block is then not transmitted and the content is instead inferred to be zero at the decoder. Current learning-based methods use different kinds of skip modes. One possibility here arises from the fact that the coders estimate and transmit the variance for each transmitted symbol. It has been proposed to use this estimated variance to derive a skip mode. When the variance falls below a threshold, the symbol is not transmitted. In this paper we propose an extension to this method. By classifying each position in the latent space according to the local motion complexity, we can transmit adaptive thresholds for each class. That way, we can employ motion information to refine the granularity of the skip mode. When we implement this method in FVC, we are able to save up 2.11% rate on a GOP 20 sequence. We also discuss the behavior of increasingly adaptive skip modes in scenarios with larger GOP size, where error-propagation becomes a larger issue.

关键词： video compression inter coding skip mode motion compensation learning-based compression

来源：评论

学校读者我要写书评

暂无评论

On Benefits and Challenges of Conditional interframe Video coding in Light of Information Theory

On Benefits and Challenges of Conditional Interframe Video C...

引用

Picture coding Symposium (PCS)

作者： Brand, Fabian Seiler, Juergen Kaup, Andre Friedrich Alexander Univ Erlangen Nurnberg Multimedia Commun & Signal Proc Erlangen Germany

ISBN: (纸本)9781665492577

The rise of variational autoencoders for image and video compression has opened the door to many elaborate coding techniques. One example here is the possibility of conditional interframe coding. Here, instead of transmitting the residual between the original frame and the predicted frame (often obtained by motion compensation), the current frame is transmitted under the condition of knowing the prediction signal. In practice, conditional coding can be straightforwardly implemented using a conditional autoencoder, which has also shown good results in recent works. In this paper, we provide an information theoretical analysis of conditional coding for inter frames and show in which cases gains compared to traditional residual coding can be expected. We also show the effect of information bottlenecks which can occur in practical video coders in the prediction signal path due to the network structure, as a consequence of the data-processing theorem or due to quantization. We demonstrate that conditional coding has theoretical benefits over residual coding but that there are cases in which the benefits are quickly canceled by small information bottlenecks of the prediction signal.

关键词： video compression inter coding conditional coding information theory conditional autoencoder

来源：评论

学校读者我要写书评

暂无评论

In favor of fully intra coding for HEVC video transmission over lossy channels

引用

SIGNAL IMAGE AND VIDEO PROCESSING 2021年第1期15卷 165-173页

作者： Kazemi, Mohammad Univ Isfahan Dept Elect Engn Esfahan *** Iran

Packet loss is inevitable when the video is transmitted over lossy channels. HEVC, due to the relatively large coding unit and high compression ratio, is much sensitive to data loss. Against the data loss, the responses of inter or intra coded blocks/frames are not the same. In the case of intra coding, the inter-frame dependency is removed and hence the error propagation is mitigated. However, with intra coding, since there is no motion vector, error concealment is more challenging than inter coding. Another difference between inter and intra coding is compression ratio where it is usually much better when using inter prediction. In this paper, taking into account the above trade-offs, a series of experiments is conducted to show the domain of preference of intra or inter coding in the application of HEVC video transmission over packet lossy networks. It is achieved that, if ratio of bitrates of I-Frames and P-Frames is smaller than a threshold, fully intra coding provides higher PSNR than some complicated methods;the improvement is as much as 2.5 dB sometimes. The performance of the proposed method is not the best as experimental results show, but besides its acceptable Rate-Quality behavior, it provides some side advantages.

关键词： Video transmission Intra coding inter coding Error concealment

来源：评论

学校读者我要写书评

暂无评论

Reference Frame Generation Algorithm using Dynamical Learning PredNet for VVC

Reference Frame Generation Algorithm using Dynamical Learnin...

引用

IEEE international Conference on Consumer Electronics (ICCE)

作者： Katayama, Takafumi Song, Tian Shimamoto, Takashi Jiang, Xiantao Tokushima Univ Grad Sch Technol Ind & Social Sci Tokushima 7708506 Japan Shanghai Maritime Univ Dept Informat Engn Shanghai 201306 Peoples R China

ISBN: (纸本)9781728197661

The reference frame plays an important role in the coding efficiency of inter-frame prediction in versatile video coding (VVC). In particular, the prediction of non-linear motion is a challenge for the motion compensation. In this paper, we proposed a new reference frame generation algorithm using dynamical learning PredNet for the inter prediction. The proposed PredNet which include training and inference is implemented to frame buffer in the VVC encoder. The proposed VVC encoder is achieved by the pipeline processing. The simulation results show that the proposed algorithm can achieve an improvement of 0.58% BD-rate comparing to the original VVC algorithm.

关键词： Versatile Video coding (VVC) inter coding Recurrent neural network

来源：评论

学校读者我要写书评

暂无评论

INTRA TO inter: TOWARDS INTRA PREDICTION FOR LEARNING-BASED VIDEO CODERS USING OPTICAL FLOW

INTRA TO INTER: TOWARDS INTRA PREDICTION FOR LEARNING-BASED ...

引用

IEEE international Conference on Image Processing (ICIP)

作者： Brand, Fabian Seiler, Jurgen Kaup, Andre Friedrich Alexander Univ Erlangen Nurnberg Multimedia Commun & Signal Proc Erlangen Germany

ISBN: (纸本)9781665441155

Traditional video coders often rely on a block structure for transmission. Here each block is coded separately and sequentially and for each block the encoder can decide whether to use intra or inter prediction. This way, inter and intra prediction can be mixed within a single frame. This has advantages when new areas are uncovered, which were not present in the reference frame, and can hence not be predicted well. These areas are typically predicted using intra prediction. Currently much research goes into end-to-end-trained video coders which do not operate on a block level and typically use dense motion fields for inter prediction. There it is more difficult to incorporate intra prediction for uncovered regions. In this paper we propose a novel concept which enables us to reinterpret classical angular intra prediction in a way that we can transmit it as part of the dense motion field. We can save an average of 18% rate for the transmission of the motion vectors for the same quality of the prediction image.

关键词： inter coding Optical Flow Non-Block-Based Video coding Intra Prediction

来源：评论

学校读者我要写书评

暂无评论

Kvazaar 2.0: Fast and Efficient Open-Source HEVC inter Encoder 20

Kvazaar 2.0: Fast and Efficient Open-Source HEVC Inter Encod...

引用

11th ACM Multimedia Systems Online Conference (MMSys)

作者： Lemmetti, Ari Viitanen, Marko Mercat, Alexandre Vanne, Jarno Tampere Univ Ultra Video Grp Tampere Finland

ISBN: (纸本)9781450368452

High Efficiency Video coding (HEVC) is the key to economic video transmission and storage in the current multimedia applications but tackling its inherent computational complexity requires powerful video codec implementations. This paper presents Kvazaar 2.0 HEVC encoder that is the new release of our academic open-source software (***/ultravideo/kvazaar) . Kvazaar 2.0 introduces novel inter coding functionality that is built on advanced rate-distortion optimization (RDO) scheme and speeded up with several early termination mechanisms, SIMD-optimized coding tools, and parallelization strategies. Our experimental results show that the proposed coding scheme makes Kvazaar 125 times as fast as the HEVC reference software HM on the Intel Xeon E5-2699 v4 22-core processor at the additional coding cost of only 2.4% on average. In constant quantization parameter (QP) coding, Kvazaar is also 3 times as fast as the respective preset of the well-known practical x265 HEVC encoder and is still able to attain 10.7% lower average bit rate than x265 for the same objective visual quality. These results indicate that Kvazaar has become one of the leading open-source HEVC encoders in practical high-efficiency video coding.

关键词： High Efficiency Video coding (HEVC) Kvazaar HEVC encoder open-source rate-distortion optimization (RDO) inter coding

来源：评论

学校读者我要写书评

暂无评论

HISTORY-BASED MOTION VECTOR PREDICTION FOR FUTURE VIDEO coding

HISTORY-BASED MOTION VECTOR PREDICTION FOR FUTURE VIDEO CODI...

引用

IEEE international Conference on Multimedia and Expo (ICME)

作者： Li, Junru Wang, Meng Zhang, Li Zhang, Kai Liu, Hongbin Wang, Shiqi Ma, Siwei Gao, Wen Peking Univ Inst Digital Media Beijing Peoples R China City Univ Hong Kong Dept Comp Sci Hong Kong Peoples R China Bytedance Inc San Diego CA 92122 USA

ISBN: (纸本)9781538695524

The third generation of the audio video coding standard (AVS3) is the latest standardization developed by Audio Video coding Standard Working Group of China on the basis of IEEE 1857.4. In this paper, we propose a History-based Motion Vector Prediction (HMVP) method for inter coding, which fully explores the history motion information of previous coded blocks. More specifically, an HMVP table, which records HMVP candidates, is elaborately maintained with limited capacity. In particular, the motion information of the previous coded blocks updates the HMVP table on-the-fly by appending the candidate to the last entry of the table after encoding or decoding an inter block. As such, the HMVP candidates act as additional modes for skip or direct modes to enhance coding efficiency. Besides, HMVP occupies limited memory to store motion info, which is crucial in real applications. Experimental results show that HMVP brings better coding performance with up to 1.38% and 2.33% BD-Rate reduction for random access and low-delay P configurations, respectively, on the latest TAVS3-2.2 platform. Moreover, nearly no encoding and decoding burden is introduced by HMVP. The proposed HMVP has been adopted by AVS3.

关键词： Motion information Motion vector prediction HMVP AVS3 inter coding SKIP/DIRECT mode

来源：评论

学校读者我要写书评

暂无评论

Recent Development of AVS Video coding Standard: AVS3

Recent Development of AVS Video Coding Standard: AVS3

引用

Picture coding Symposium (PCS)

作者： Zhang, Jiaqi Jia, Chuanmin Lei, Meng Wang, Shanshe Ma, Siwei Gao, Wen Chinese Acad Sci Inst Comp Technol Beijing Peoples R China Univ Chinese Acad Sci Beijing Peoples R China Peking Univ Inst Digital Media Beijing Peoples R China

ISBN: (纸本)9781728147048

The paper presents a systematic and comprehensive overview of the third generation of Audio Video Standard (AVS) in China. The AVS standards continuously attract extensive attention both domestically and worldwide along with the industrialization of AVS2 standard and the broadcasting of China Central Television (CCTV) 4K channel. Currently, AVS3 has adopted many novel coding techniques including block partitioning structure, intra/inter and transform coding tools. The compression performance has been significantly improved that the latest version of AVS3 obtains about 24.3% and 26.88% bit-rate reduction against AVS2 and HEVC respectively under 4K resolution sequences.

关键词： AVS3 video coding standard intra coding inter coding

来源：评论

学校读者我要写书评

暂无评论

AN EFFECTIVE STRATEGY FOR EARLY SKIP MODE DECISION IN HEVC 25

AN EFFECTIVE STRATEGY FOR EARLY SKIP MODE DECISION IN HEVC

引用

25th IEEE international Conference on Image Processing (ICIP)

作者： Kim, Jieon Izquierdo, Ebroul Queen Mary Univ London Sch Elect Engn & Comp Sci London England

ISBN: (纸本)9781479970612

High Efficiency Video coding (HEVC) can provide up to twice better compression efficiency than its predecessor, H.264/Advanced Video coding (AVC) but its high encoding complexity is a main obstacle for practical applications. In this paper, an early SKIP mode decision scheme is proposed to reduce the complexity of inter mode decision in HEVC. The proposed method firstly employs the merge_flag information of spatial neighbouring candidates for the SKIP mode. In case the best spatial candidate of the SKIP mode is encoded with merge_flag equal to one, the rate-distortion (RD) cost value of 2Nx2N Merge or inter 2Nx2N PU mode is further exploited to determine the early SKIP mode for the current CU. Experimental results show that the proposed method can provide on average 39.07% encoder speed-up for an average 0.53% bitrate increase in Random Access (RA) main configuration compared to the HEVC test model (HM) 16.13 reference software.

关键词： HEVC rate-distortion inter coding complexity reduction merge mode skip mode

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：