检索结果-内蒙古大学图书馆

Object Segmentation-Assisted Inter Prediction for Versatile Video Coding

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Zhuoyuan Yuan, Zikun Li, Li Liu, Dong Tang, Xiaohu Wu, Feng CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China Information Security and National Computing Grid Laboratory Southwest Jiaotong University Chengdu610031 China

In modern video coding standards, block-based inter prediction is widely adopted, which brings high compression efficiency. However, in natural videos, there are usually multiple moving objects of arbitrary shapes, resulting in complex motion fields that are difficult to represent compactly. This problem has been tackled by more flexible block partitioning methods in the Versatile Video Coding (VVC) standard, but the more flexible partitions require more overhead bits to signal and still cannot be made arbitrarily shaped. To address this limitation, we propose an object segmentation-assisted inter prediction method (SAIP), where objects in the reference frames are segmented by some advanced technologies. With a proper indication, the object segmentation mask is translated from the reference frame to the current frame as the arbitrary-shaped partition of different regions without any extra signal. Using the segmentation mask, motion compensation is separately performed for different regions, achieving higher prediction accuracy. The segmentation mask is further used to code the motion vectors of different regions more efficiently. Moreover, the segmentation mask is considered in the joint rate-distortion optimization for motion estimation and partition estimation to derive the motion vector of different regions and partition more accurately. The proposed method is implemented into the VVC reference software, VTM version 12.0. Experimental results show that the proposed method achieves up to 1.98%, 1.14%, 0.79%, and on average 0.82%, 0.49%, 0.37% BD-rate reduction for common test sequences, under the Low-delay P, Low-delay B, and Random Access configurations, respectively. Copyright © 2024, The Authors. All rights reserved.

关键词： Video signal processing

Towards Hybrid-Optimization Video Coding

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Huo, Shuai Liu, Dong Li, Li Ma, Siwei Wu, Feng Gao, Wen The Cas Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The Institute of Digital Media Peking University Beijing100871 China

Video coding is a mathematical optimization problem of rate and distortion essentially. To solve this complex optimization problem in practice, two popular video coding frameworks have been developed: block-based hybrid video coding and end-to-end learned video coding. If we rethink video coding from the perspective of optimization, we find that the existing two frameworks represent two directions of optimization solutions. Block-based hybrid video coding represents the discrete optimization solution because those irrelevant coding modes are discrete in mathematics. The discrete solution provides multiple starting points (i.e. modes) in global optimization space and then searches for the best one among them. However, the search-based optimization algorithm is not efficient enough. On the other hand, end-to-end learned video coding represents the continuous optimization solution because the optimization algorithm of deep learning, gradient descent, is based on a continuous function. The continuous solution optimizes a group of model parameters efficiently by such a numerical algorithm. However, limited by only one starting point, it is easy to fall into the local optimum. To better solve the optimization problem, we propose a hybrid of discrete and continuous optimization video coding. We regard video coding as a hybrid of the discrete and continuous optimization problem, and use both search and numerical algorithm to solve it. Our idea is to provide multiple discrete starting points in the global space and optimize the local optimum around each point by numerical algorithm efficiently. Finally, we search for the global optimum among those local optimums. Guided by the hybrid optimization idea, we design a hybrid optimization video coding framework, which is built on continuous deep networks entirely and also contains some discrete modes. We conduct a comprehensive set of experiments to verify the efficiency of our hybrid optimization. Compared to the continuous opti

关键词： Deep neural networks

Sequential reinforced 360-degree video adaptive streaming with cross-user attentive network

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Fu, Jun Chen, Zhibo Chen, Xiaoming Li, Weiping CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China School of Computer Science and Engineering Beijing Technology and Business University China

In the tile-based 360-degree video streaming, predicting user’s future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user’s quality of experience (QoE). Traditional single-user based viewpoint prediction methods fail to achieve good performance in long-term prediction, and the recently proposed reinforcement learning (RL) based ABR schemes applied in traditional video streaming can not be directly applied in the tile-based 360-degree video streaming due to the exponential action space. Therefore, we propose a sequential reinforced 360-degree video streaming scheme with cross-user attentive network. Firstly, considering different users may have the similar viewing preference on the same video, we propose a cross-user attentive network (CUAN), boosting the performance of long-term viewpoint prediction by selectively utilizing cross-user information. Secondly, we propose a sequential RL-based (360SRL) ABR approach, transforming action space size of each decision step from exponential to linear via introducing a sequential decision structure. We evaluate the proposed CUAN and 360SRL using trace-driven experiments and experimental results demonstrate that CUAN and 360SRL outperform existing viewpoint prediction and ABR approaches with a noticeable margin. Copyright © 2020, The Authors. All rights reserved.

关键词： Forecasting

A Novel Reconstruction Filter for the Azimuth Multi-Channel SAR

学校读者我要写书评

暂无评论

A Novel Reconstruction Filter for the Azimuth Multi-Channel ...

IEEE International Conference on Radar

作者： Mingyang Shang Xiaolan Qiu Junying Yang Lihua Zhong Yu Xin Chibiao Ding Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems Aerospace Information Research Institute Chinese Academic of Sciences Beijing China Beijing Institute of Remote Sensing Information Beijing China

ISBN: (纸本)9781665468893

The compensation of channel imbalances plays a vital role in signal processing of the azimuth multi-channel (AMC) synthetic aperture radar (SAR). In the operational AMC SAR system, the channel imbalance is usually considered to be a constant in both the time and frequency domain for one image. However, since the antenna patterns of all channels cannot be strictly consistent, the channel imbalances may vary with the Doppler frequency. This paper establishes the signal model of AMC SAR with channel imbalances changing with Doppler frequency and proposes a novel compensation method during the reconstruction for the echo signals received by all channels. This method has been verified by simulations and real data acquired by Gaofen-3 (GF-3). The result shows that this method has excellent potential for improving the image quality for AMC SAR.

关键词： Image quality Antenna measurements Azimuth Filter banks Receiving antennas Channel estimation Signal processing

Two-Step Bistatic Spaceborne Sliding-Spotlight SAR Imaging Agorithm Based on Accurate Range Model

学校读者我要写书评

暂无评论

Two-Step Bistatic Spaceborne Sliding-Spotlight SAR Imaging A...

IEEE International Symposium on geoscience and Remote Sensing (IGARSS)

作者： Jianbing Xiang Xiaolei Lv Xikai Fu Ye Yun University of Chinese Academy of Sciences Beijing China Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems Aerospace Information Research Institute Chinese Academy of Sciences Beijing China

ISBN: (数字)9781728163741

ISBN: (纸本)9781728163758

The slant range errors caused by traditional hyperbolic range equation (THRE) with stop-and-go assumption will lead to image defocusing in high resolution spaceborne sliding-spotlight Bistatic SAR system (ST-BiSAR). In this paper, an accurate bistatic slant range model based on uniform acceleration curve motion (UARM) is proposed, which is precisely fitted with the actual range history. Then, a two-step imaging algorithm based on UARM and method of reversion series (MSR) is introduced to eliminate aliasing phenomenon and realize focus. Finally, simulation results verify the correctness and effectives of the proposed range model and imaging algorithms.

关键词： Mathematical model Imaging Satellites Synthetic aperture radar Acceleration Manganese Azimuth

An efficient four-parameter affine motion model for video coding

学校读者我要写书评

暂无评论

arXiv 2017年

作者： Li, Li Li, Houqiang Liu, Dong Yang, Haitao Lin, Sixin Chen, Huanbang Wu, Feng CAS Key Laboratory of Technology Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China Media Technology Laboratory Central Research Institute Huawei Technologies Co. Ltd

In this paper, we study a simplified affine motion model based coding framework to overcome the limitation of translational motion model and maintain low computational complexity. The proposed framework mainly has three key contributions. First, we propose to reduce the number of affine motion parameters from 6 to 4. The proposed four-parameter affine motion model can not only handle most of the complex motions in natural videos but also save the bits for two parameters. Second, to efficiently encode the affine motion parameters, we propose two motion prediction modes, i.e., advanced affine motion vector prediction combined with a gradient-based fast affine motion estimation algorithm and affine model merge, where the latter attempts to reuse the affine motion parameters (instead of the motion vectors) of neighboring blocks. Third, we propose two fast affine motion compensation algorithms. One is the one-step sub-pixel interpolation, which reduces the computations of each interpolation. The other is the interpolation-precision-based adaptive block size motion compensation, which performs motion compensation at the block level rather than the pixel level to reduce the interpolation times. Our proposed techniques have been implemented based on the state-of-the-art high efficiency video coding standard, and the experimental results show that the proposed techniques altogether achieve on average 11.1% and 19.3% bits saving for random access and low delay configurations, respectively, on typical video sequences that have rich rotation or zooming motions. Meanwhile, the computational complexity increases of both encoder and decoder are within an acceptable range. Copyright © 2017, The Authors. All rights reserved.

关键词： Motion estimation

Study on the three dimension imaging methods of fully-polarised array InSAR

学校读者我要写书评

暂无评论

Study on the three dimension imaging methods of fully-polari...

IET International Radar Conference (IRC 2023)

作者： Shujie Song Xiaolan Qiu Songtao Shangguan Key Laboratory of Technology in Geo-spatial Information Processing and Application System Chinese Academy of Sciences Beijing People's Republic of China Suzhou Key Laboratory of Microwave Imaging Processing and Application Technology Suzhou People's Republic of China

ISBN: (数字)9781837240982

Fully-polarised (FP) array interferometric Synthetic Aperture Radar (FP-Array-InSAR) is an important technology in three-dimensional (3D) reconstruction and image interpretation of various scattering mechanisms (SMs) by exploiting the structural and polarisation properties of the targets. There has been a solid foundation for multi-baseline PolInSAR, but lack of systematic comparison and analysis for FP-Array-InSAR. Relying on the UAV-borne FP-Array-InSAR system developed by our research team, this paper applies two 3D imaging methods, one based on polarisation decomposition and the other based on multi-baseline (MB) polarimetric coherence optimization, to four-channel FP-array-InSAR datasets from Suzhou, China. Finally, this paper compares and analyses the experimental results of these two methods, and then gives their applicable scenarios. Such comparative experiments are positive for the rational selection and application of different methods in FP-array-InSAR.

关键词：

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Shen, Xu Tian, Xinmei He, Anfeng Sun, Shaoyan Tao, Dacheng CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei Anhui230027 China Centre for Quantum Computation & Intelligent Systems Faculty of Engineering and Information Technology University of Technology Sydney UltimoNSW2007 Australia

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with sufficient layers and parameters, hierarchical combinations of convolution (matrix multiplication and nonlinear activation) and pooling operations should be able to learn a robust mapping from transformed input images to transform-invariant representations. In this paper, we propose randomly transforming (rotation, scale, and translation) feature maps of CNNs during the training stage. This prevents complex dependencies of specific rotation, scale, and translation levels of training images in CNN models. Rather, each convolutional kernel learns to detect a feature that is generally helpful for producing the transform-invariant answer given the combinatorially large variety of transform levels of its input feature maps. In this way, we do not require any extra training supervision or modification to the optimization process and training images. We show that random transformation provides significant improvements of CNNs on many benchmark tasks, including small-scale image recognition, large-scale image recognition, and image retrieval. The code is available at https: ACM ISBN 978-1-4503-2138-9. Copyright © 2019, The Authors. All rights reserved.

关键词： Image recognition

Visual analyses of music history: A user-centric approach

学校读者我要写书评

暂无评论

arXiv 2017年

作者： Zhang, Jingxian Liu, Dong Media Lab Massachusetts Institute of Technology CambridgeMA02139 United States CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China

Music history, referring to the records of users' listening or downloading history in online music services, is the primary source for music service providers to analyze users' preferences on music and thus to provide personalized recommendations to users. In order to engage users into the service and to improve user experience, it would be beneficial to provide visual analyses of one user's music history as well as visualized recommendations to that user. In this paper, we take a user-centric approach to the design of such visual analyses. We start by investigating user needs on such visual analyses and recommendations, then propose several different visualization schemes, and perform a pilot study to collect user feedback on the designed schemes. We further conduct user studies to verify the utility of the proposed schemes, and the results not only demonstrate the effectiveness of our proposed visualization, but also provide important insights to guide the visualization design in the future. Copyright © 2017, The Authors. All rights reserved.

关键词： Visualization