检索结果-内蒙古大学图书馆

No-reference quality assessment for 360-degree images by analysis of multi-frequency information and local-global naturalness

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhou, Wei Xu, Jiahua Jiang, Qiuping Chen, Zhibo CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China School of Information Science and Engineering Ningbo University Ningbo315211 China

360-degree/omnidirectional images (OIs) have achieved remarkable attentions due to the increasing applications of virtual reality (VR). Compared to conventional 2D images, OIs can provide more immersive experience to consumers, benefitting from the higher resolution and plentiful field of views (FoVs). Moreover, observing OIs is usually in the head mounted display (HMD) without references. Therefore, an efficient blind quality assessment method, which is specifically designed for 360-degree images, is urgently desired. In this paper, motivated by the characteristics of the human visual system (HVS) and the viewing process of VR visual contents, we propose a novel and effective no-reference omnidirectional image quality assessment (NR OIQA) algorithm by Multi-Frequency information and Local-Global Naturalness (MFILGN). Specifically, inspired by the frequency-dependent property of visual cortex, we first decompose the projected equirectangular projection (ERP) maps into wavelet subbands by using discrete Haar wavelet transform (DHWT). Then, the entropy intensities of low-frequency and high-frequency subbands are exploited to measure the multi-frequency information of OIs. Besides, except for considering the global naturalness of ERP maps, owing to the browsed FoVs, we extract the natural scene statistics (NSS) features from each viewport image as the measure of local naturalness. With the proposed multi-frequency information measurement and local-global naturalness measurement, we utilize support vector regression (SVR) as the final image quality regressor to train the quality evaluation model from visual quality-related features to human ratings. To our knowledge, the proposed model is the first no-reference quality assessment method for 360-degreee images that combines multi-frequency information and image naturalness. Experimental results on two publicly available OIQA databases demonstrate that our proposed MFILGN outperforms state-of-the-art full-reference (FR) a

关键词： Helmet mounted displays

A NOVEL APPROACH TO PHASE ERROR ESTIMATION IN MULTI-CHANNEL SCANSAR

学校读者我要写书评

暂无评论

A NOVEL APPROACH TO PHASE ERROR ESTIMATION IN MULTI-CHANNEL ...

IET International Radar Conference 2023, IRC 2023

作者： Lv, Yini Zhong, Lihua Shang, Mingyang Qiu, Xiaolan Ding, Chibiao Aerospace Information Research Institute Chinese Academic of Sciences Beijing China Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems Chinese Academy of Sciences Beijing China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing China

ISBN: (纸本)9781839539954

The phase error between channels in azimuth multi-channel (AMC) synthetic aperture radar (SAR) system can deteriorate the reconstruction performance, leading to azimuth ambiguity in the final image. Therefore, phase error estimation is an essential step in AMC SAR imaging. However, due to the special beam scanning of AMC scanned-beam SAR (ScanSAR), the Doppler spectrum of the point target is incomplete and asymmetric, which makes the traditional phase error estimation methods unsuitable for ScanSAR. Taking the Doppler spectrum characteristics into account, a new method of multi-channel ScanSAR phase error estimation is proposed. The proposed method divides the Doppler centroid (DC) of the strong scattering point target into baseband DC and ambiguity DC. The spatial cross-correlation coefficient (SCCC) method is adopted to estimate the baseband DC. Then, the frequency cross-correlation coefficient (FCCC) method is proposed to estimate the DC ambiguity number. After estimating the precise DC, the frequency correlation method (FCM) is improved to estimate the phase error. Finally, the validation of the proposed method is demonstrated with the simulation data and GF-3 dual channel data. © The Institution of Engineering & technology 2023.

关键词： Synthetic aperture radar

Aircraft Detection in Sar Images Using Saliency Based Location Regression Network

学校读者我要写书评

暂无评论

Aircraft Detection in Sar Images Using Saliency Based Locati...

IEEE International Symposium on geoscience and Remote Sensing (IGARSS)

作者： Wenhui Diao Fangzheng Dou Kun Fu Xian Sun Key Laboratory of Spatial Information Processing and Application System Technology Chinese Academy of Sciences Beijing China

In this paper, a novel framework for aircraft detection in high resolution apron area in Synthetic Aperture Radar (SAR) images is proposed, which combines the strength of location regression based convolutional neural network (CNN) framework and the salient features of target in SAR images. Specifically, a Constant False Alarm Rate (CFAR) based target pre-locating algorithm is introduced, which can match the scale of target in SAR images more accurate compared to the existing region proposal method. In addition, in order to eliminate the fact of overfitting, we explore several strategies for SAR data augmentation, including translation, adding noise and rotation within a small range. Experiments are conducted on the data set acquired by the TerraSAR-X satellite in a resolution of 3.0 meters. The results show that the proposed detection framework could effectively obtain a more accurate detection result.

关键词： Synthetic aperture radar Aircraft Object detection Training Image resolution Radar imaging Atmospheric modeling

Cut-and-Fold: Automatic 3D modeling from a single image

学校读者我要写书评

暂无评论

Cut-and-Fold: Automatic 3D modeling from a single image

IEEE International Conference on Multimedia and Expo Workshops (ICMEW)

作者： Guihang Wang Xuejin Chen Si Chen CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei Anhui China University of California San Diego La Jolla California USA

ISBN: (纸本)9781479947164

This paper presents a novel approach to automatically generate a plausible 3D model from a single outdoor image. Outdoor scene can be modeled as a set of planar billboards such as ground, sky and vertical trees or buildings. This Cut-and-Fold system takes the advantages of the statistical classification method for high-level geometric labeling of the image regions and the automatic image segmentation algorithm for detailed boundaries of the geometric regions to generate accurate geometric labeling and realistic rendering of novel views. Taking a single image as input, our method first roughly classifies each sub-region to the geometric categories: vertical, ground or sky. Then image segmentation algorithm is employed to refine the labeling results and generate accurate boundaries for the geometric regions. After cutting the image into several regions with their geometric labels, the system folds the regions into 3D billboards with accurate boundaries. The experimental results demonstrate that our method is capable of creating plausible 3D models automatically for a wide range of outdoor scenes.

关键词： Image segmentation Abstracts Labeling Indium phosphide Three-dimensional displays Solid modeling

A Close Look at Few-shot Real Image Super-resolution from the Distortion Relation Perspective

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Xin Jin, Xin Fu, Jun Yu, Xiaoyuan Tong, Bei Chen, Zhibo The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The Eastern Institute for Advanced Study China Huawei Cloud China

Collecting amounts of distorted/clean image pairs in the real world is non-trivial, which seriously limits the practical applications of these supervised learning-based methods on real-world image super-resolution (RealSR). Previous works usually address this problem by leveraging unsupervised learning-based technologies to alleviate the dependency on paired training samples. However, these methods typically suffer from unsatisfactory texture synthesis due to the lack of supervision of clean images. To overcome this problem, we are the first to have a close look at the under-explored direction for RealSR, i.e., few-shot real-world image super-resolution, which aims to tackle the challenging RealSR problem with few-shot distorted/clean image pairs. Under this brand-new scenario, we propose Distortion Relation guided Transfer Learning (DRTL) for the few-shot RealSR by transferring the rich restoration knowledge from auxiliary distortions (i.e., synthetic distortions) to the target RealSR under the guidance of distortion relation. Concretely, DRTL builds a knowledge graph to capture the distortion relation between auxiliary distortions and target distortion (i.e., real distortions in RealSR). Based on the distortion relation, DRTL adopts a gradient reweighting strategy to guide the knowledge transfer process between auxiliary distortions and target distortions. In this way, DRTL could quickly learn the most relevant knowledge from the synthetic distortions for the target distortion. We instantiate DRTL with two commonly-used transfer learning paradigms, including pre-training and meta-learning pipelines, to realize a distortion relation-aware Few-shot RealSR. Extensive experiments on multiple benchmarks and thorough ablation studies demonstrate the effectiveness of our DRTL. Copyright © 2021, The Authors. All rights reserved.

关键词： Textures

Networked Predictive Control Based On The Round-Trip Delay

学校读者我要写书评

暂无评论

Networked Predictive Control Based On The Round-Trip Delay

第三十四届中国控制会议

作者： Wang Binglin Kang Yu Yin Baoqun Xie Zhen Department of Automation University of Science and Technology of China The State Key Laboratory of Fire Science University of Science and Technology of China and Key Laboratory of Technology in Geo-Satial Information Processing and Application System Chinese Academy of Science School of Electrical Engineering and Automation Hefei University of Technology

ISBN: (纸本)9781467374439

Network predictive control is effectively in dealing with time-delay, data dropouts, packets disorders of Network Control system. This paper studies the stochastic stability of a affine nonlinear system within random time delay. The system controller is consist of a control prediction generator(CPG) at the controller side and a network delay compensator(NDC) at the plant side. Different from the previous literatures that model the random delay of the feedback channel and the forward channel as Markov chain respectively, the model in this paper is based on the round-trip delay, which making the predictive control process more concise but without losing generality. Then, this paper gives the necessary and sufficient conditions for stochastic stability of the closed-loop system. Finally, a numerical example is given to demonstrate the effectiveness of the proposed method.

关键词： Predictive Control,Affine system,Markov Process,Stochastic Stability

Towards Hybrid-Optimization Video Coding

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Huo, Shuai Liu, Dong Li, Li Ma, Siwei Wu, Feng Gao, Wen The Cas Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The Institute of Digital Media Peking University Beijing100871 China

Video coding is a mathematical optimization problem of rate and distortion essentially. To solve this complex optimization problem in practice, two popular video coding frameworks have been developed: block-based hybrid video coding and end-to-end learned video coding. If we rethink video coding from the perspective of optimization, we find that the existing two frameworks represent two directions of optimization solutions. Block-based hybrid video coding represents the discrete optimization solution because those irrelevant coding modes are discrete in mathematics. The discrete solution provides multiple starting points (i.e. modes) in global optimization space and then searches for the best one among them. However, the search-based optimization algorithm is not efficient enough. On the other hand, end-to-end learned video coding represents the continuous optimization solution because the optimization algorithm of deep learning, gradient descent, is based on a continuous function. The continuous solution optimizes a group of model parameters efficiently by such a numerical algorithm. However, limited by only one starting point, it is easy to fall into the local optimum. To better solve the optimization problem, we propose a hybrid of discrete and continuous optimization video coding. We regard video coding as a hybrid of the discrete and continuous optimization problem, and use both search and numerical algorithm to solve it. Our idea is to provide multiple discrete starting points in the global space and optimize the local optimum around each point by numerical algorithm efficiently. Finally, we search for the global optimum among those local optimums. Guided by the hybrid optimization idea, we design a hybrid optimization video coding framework, which is built on continuous deep networks entirely and also contains some discrete modes. We conduct a comprehensive set of experiments to verify the efficiency of our hybrid optimization. Compared to the continuous opti

关键词： Deep neural networks

Aircraft recognition in high resolution SAR images using saliency map and scattering structure features

学校读者我要写书评

暂无评论

Aircraft recognition in high resolution SAR images using sal...

IEEE International Symposium on geoscience and Remote Sensing (IGARSS)

作者： Fangzheng Dou Wenhui Diao Xian Sun Siyu Wang Kun Fu Guangluan Xu Key Laboratory of Spatial Information Processing and Application System Technology Chinese Academy of Sciences Beijing China

ISBN: (纸本)9781509033331

Scattering structure features of targets is of great importance for Synthetic Aperture Radar (SAR) image analysis. In this paper, a novel algorithm for aircraft recognition in high resolution apron area of SAR images is proposed. The algorithm combines the strength of gradient saliency map and scattering structure features to improve accuracy and efficiency. Specially, Constant False-Alarm Rate (CFAR) algorithm is carried out to segment images. Then, a new efficient object locating method based on directional local gradient map is proposed to detect aircraft targets. Then, the candidate slices as well as template slices are modeled using Gaussian Mixture Model (GMM), which will be treated as structure features. In the recognition stage, a novel similarity measurement algorithm based on Kullback-Leibler Divergence for GMM models is proposed for classification. We conduct experiments on the dataset with 3.0m resolution and the recognition results demonstrate the accuracy of our proposed method.

关键词： Scattering Synthetic aperture radar Aircraft Feature extraction Atmospheric modeling Target recognition Image recognition

Sequential reinforced 360-degree video adaptive streaming with cross-user attentive network

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Fu, Jun Chen, Zhibo Chen, Xiaoming Li, Weiping CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China School of Computer Science and Engineering Beijing Technology and Business University China

In the tile-based 360-degree video streaming, predicting user’s future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user’s quality of experience (QoE). Traditional single-user based viewpoint prediction methods fail to achieve good performance in long-term prediction, and the recently proposed reinforcement learning (RL) based ABR schemes applied in traditional video streaming can not be directly applied in the tile-based 360-degree video streaming due to the exponential action space. Therefore, we propose a sequential reinforced 360-degree video streaming scheme with cross-user attentive network. Firstly, considering different users may have the similar viewing preference on the same video, we propose a cross-user attentive network (CUAN), boosting the performance of long-term viewpoint prediction by selectively utilizing cross-user information. Secondly, we propose a sequential RL-based (360SRL) ABR approach, transforming action space size of each decision step from exponential to linear via introducing a sequential decision structure. We evaluate the proposed CUAN and 360SRL using trace-driven experiments and experimental results demonstrate that CUAN and 360SRL outperform existing viewpoint prediction and ABR approaches with a noticeable margin. Copyright © 2020, The Authors. All rights reserved.

关键词： Forecasting