检索结果-内蒙古大学图书馆

Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Models

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Sun, Wei Wen, Wen Min, Xiongkuo Lan, Long Zhai, Guangtao Ma, Kede The Institute of Image Communication and Information Processing Shanghai Jiao Tong University Shanghai200240 China The Department of Computer Science City University of Hong Kong Kowloon Hong Kong The Institute for Quantum Information State Key Laboratory of High Performance Computing College of Computer Science and Technology National University of Defense Technology Changsha410073 China The Institute of Image Communication and Information Processing The MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai200240 China The Department of Computer Science The Shenzhen Research Institute City University of Hong Kong Kowloon Hong Kong

Blind video quality assessment (BVQA) plays an indispensable role in monitoring and improving the end-users’ viewing experience in various real-world video-enabled media applications. As an experimental field, the improvements of BVQA models have been measured primarily on a few human-rated VQA datasets. Thus, it is crucial to gain a better understanding of existing VQA datasets in order to properly evaluate the current progress in BVQA. Towards this goal, we conduct a first-of-its-kind computational analysis of VQA datasets via designing minimalistic BVQA models. By minimalistic, we restrict our family of BVQA models to build only upon basic blocks: a video preprocessor (for aggressive spatiotemporal downsampling), a spatial quality analyzer, an optional temporal quality analyzer, and a quality regressor, all with the simplest possible instantiations. By comparing the quality prediction performance of different model variants on eight VQA datasets with realistic distortions, we find that nearly all datasets suffer from the easy dataset problem of varying severity, some of which even admit blind image quality assessment (BIQA) solutions. We additionally justify our claims by comparing our model generalization capabilities on these VQA datasets, and by ablating a dizzying set of BVQA design choices related to the basic building blocks. Our results cast doubt on the current progress in BVQA, and meanwhile shed light on good practices of constructing next-generation VQA datasets and models. Code is available at https://***/sunwei925/***. Copyright © 2023, The Authors. All rights reserved.

关键词： Deep neural networks

Eye Movement Pattern Modeling and Visual Comfort Viewing S3D images

学校读者我要写书评

暂无评论

Eye Movement Pattern Modeling and Visual Comfort Viewing S3D...

IEEE Visual communications and image processing (VCIP)

作者： Chi Zhang Jun Zhou Xiao Gu Shouchen Zhu Alan. C. Bovik Institute of Image Communication & Network Enginerring Shanghai Jiao Tong University Shanghai China Shanghai Key Lab of Digital Media Processing & Transmissions Shanghai Jiao Tong University China Shanghai Yanan High School Shanghai China Department of Electrical and Computer Engineering The University of Texas at Austin USA

ISBN: (纸本)9781538644591;9781538644584

Stereoscopic-3D (S3D) displays are widely used but present problems related to experiences of visual discomfort for human vision. One aspect of this issue is the movement of the gaze point within different depth fields. Here we aim to analyze the relationship between eye movement patterns and visual comfort experienced when viewing S3D images. Rather than simply labeling eye movement data according to categories such as gaze, saccade and so on, we depoly nonparametric Bayesian method to analyze and cluster several eye movement patterns, and to relate them to visual comfort. The results are relevant to the prediction of visual comfort assessment in S3D images by automatic algorithms.

关键词： Visualization Hidden Markov models Bayes methods Brain modeling Graphical models Three-dimensional displays

Blind Quality Assessment for in-the-Wild images via Hierarchical Feature Fusion and Iterative Mixed Database Training

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Sun, Wei Min, Xiongkuo Tu, Danyang Zhai, Guangtao Ma, Siwei The Institute of Image Communication and Information Processing Shanghai Jiao Tong University China The MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai200240 China The Institute of Digital Media School of Electronic Engineering and Computer Science Peking University Beijing100871 China

image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user’s quality of experience (QoE) and also benefit lots of computer vision algorithms. Most existing blind image quality assessment (BIQA) models were developed for synthetically distorted images, however, they perform poorly on in-the-wild images, which are widely existed in various practical applications. In this paper, we propose a novel BIQA model for in-the-wild images by addressing two critical problems in this field: how to learn better quality-aware feature representation, and how to solve the problem of insufficient training samples in terms of their content and distortion diversity. Considering that perceptual visual quality is affected by both low-level visual features (e.g. distortions) and high-level semantic information (e.g. content), we first propose a staircase structure to hierarchically integrate the features from intermediate layers into the final feature representation, which enables the model to make full use of visual information from low-level to high-level. Then an iterative mixed database training (IMDT) strategy is proposed to train the BIQA model on multiple databases simultaneously, so the model can benefit from the increase in both training samples and image content and distortion diversity and can learn a more general feature representation. Experimental results show that the proposed model outperforms other state-of-the-art BIQA models on six in-the-wild IQA databases by a large margin. Moreover, the proposed model shows an excellent performance in the cross-database evaluation experiments, which further demonstrates that the learned feature representation is robust to images with diverse distortions and content. The code is available at https://***/sunwei925/StairIQA. Copyright © 2021, The Authors. All rights reserved.

关键词： Semantics

Extended State Observer Based Fault-Tolerant Predictive Control for a Four-Mecanum Wheels Mobile Robot

学校读者我要写书评

暂无评论

Extended State Observer Based Fault-Tolerant Predictive Cont...

IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems

作者： Binghao Yang Dongliang Wang Ziling Wen Wu Wei Wenji Li Zhun Fan Key Lab of Digital Signal and Image Processing of Guangdong Province Shantou University Guangdong China School of Department of Electronic and Information Engineering Shantou University Guangdong China Key Laboratory of Autonomous Systems and Networked Control Ministry of Education Guangzhou Guangdong China School of Automation Science and Engineering South China University of Technology Guangzhou Guangdong China

ISBN: (数字)9798331506056

ISBN: (纸本)9798331506063

The application of unmanned vehicles in industrial cargo transportation is becoming increasingly widespread, particularly playing a significant role in transporting heavy-duty goods. However, when performing such tasks, whether in single-vehicle transportation or multi-vehicle collaborative transportation, the occurrence of wheel failures can potentially lead to serious safety accidents. Therefore, this paper proposes a fault-tolerant control scheme, establishing a kinematic model considering disturbances and failures, and adopts model predictive control for trajectory tracking. Additionally, an extended state observer is introduced to observe system states and counteract disturbances. To address potential failure issues, a controller reconstruction strategy is proposed. Finally, the effectiveness and superiority of the controller is validated through numerical simulation and comparative experiment.

关键词： Fault tolerance Trajectory tracking Fault tolerant systems Wheels Transportation Kinematics Predictive models Safety State estimation Predictive control

ROAD CENTRAL CONTOUR EXTRACTION FROM HIGH RESOLUTION SATELLITE image USING TENSOR VOTING FRAMEWORK

学校读者我要写书评

暂无评论

ROAD CENTRAL CONTOUR EXTRACTION FROM HIGH RESOLUTION SATELLI...

2006 International Conference on Machine Learning and Cybernetics(IEEE第五届机器学习与控制论坛)

作者： SHENG ZHENG JIAN LIU WEN-ZHONG SHI GUANG-XI ZHU Electronic & Information Engineering Dept. Huazhong University of Science and Technology Wuhan 430 State Education Commission Key Laboratory for Image Processing and Intelligent Control Inst.for Pat Advanced Research Center for Spatial Information Technology Department of Land Surveying and Geo-In Chinese Key lab of optic & electronics Huazhong University of Science and Technology Wuhan 430074

In this paper, a unique road contour extraction approach from high resolution satellite image is proposed, in which the road contour was extracted in two steps. Firstly, support vector machines (SVM) was employed merely to classify the image into two groups of categories: a road group and a non-road group. The identified road group images are the discrete and irregularly distributed sampled points, and they are an uncompleted data set for the road. Secondly, the road contour was extracted from the road group images using the tensor voting framework, since the tensor voting technique is superior to the traditional methods in extracting the geometrical structure from the uncompleted data set. The experimental results on the high resolution satellite image demonstrate that the proposed approach worked well with images comprised by both rural and urban area features.

关键词： Tensor voting framework Road central line extraction High-resolution satellite image

Online Attentive Kernel-Based Temporal Difference Learning

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Guang Chen, Xingguo Yang, Shangdong Wang, Huihui Dong, Shaokang Gao, Yang The the Jiangsu Key Laboratory of Big Data Security & Intelligent Processing Nanjing University of Posts and Telecommunications National Engineering Laboratory for Agri-Product Quality Traceability Beijing Technology and Business University China The State Key Laboratory for Novel Software Technology Nanjing University China The PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology China

With rising uncertainty in the real world, online Reinforcement Learning (RL) has been receiving increasing attention due to its fast learning capability and improving data efficiency. However, online RL often suffers from complex Value Function Approximation (VFA) and catastrophic interference, creating difficulty for the deep neural network to be applied to an online RL algorithm in a fully online setting. Therefore, a simpler and more adaptive approach is introduced to evaluate value function with the kernel-based model. Sparse representations are superior at handling interference, indicating that competitive sparse representations should be learnable, non-prior, non-truncated and explicit when compared with current sparse representation methods. Moreover, in learning sparse representations, attention mechanisms are utilized to represent the degree of sparsification, and a smooth attentive function is introduced into the kernel-based VFA. In this paper, we propose an Online Attentive Kernel-Based Temporal Difference (OAKTD) algorithm using two-timescale optimization and provide convergence analysis of our proposed algorithm. Experimental evaluations showed that OAKTD outperformed several Online Kernel-based Temporal Difference (OKTD) learning algorithms in addition to the Temporal Difference (TD) learning algorithm with Tile Coding on public Mountain Car, Acrobot, CartPole and Puddle World tasks. Copyright © 2022, The Authors. All rights reserved.

关键词： Learning algorithms

Observer-Based Robust Containment Control of Multi-agent Systems With Input Saturation

学校读者我要写书评

暂无评论

Observer-Based Robust Containment Control of Multi-agent Sys...

Chinese Control Conference (CCC)

作者： Juan Qian Xiaoling Wang Guo-Ping Jiang Housheng Su College of Automation and College of Artificial Intelligence Nanjing University of Posts and Telecommunications and Jiangsu Engineering Lab for IOT Intelligent Robots(IOTRobot) Nanjing PR China School of Artificial Intelligence and Automation Image Processing and Intelligent Control Key Laboratory of Education Ministry ofChina Huazhong University of Science and Technology Wuhan PR China

ISBN: (数字)9789881563903

ISBN: (纸本)9781728165233

In this paper, the robust containment control problem of the leader-following multi-agent systems with input saturation and input additive disturbance is addressed, where the followers can be informed by multiple leaders. With the help of the lowand-high gain feedback technique and the high-gain observer approach, a distributed control algorithm for each agent is firstly designed by using the observed output information, then sufficient conditions are provided to guarantee the semi-global robust containment of the system. Finally, some numerical simulations are given to verify the correctness of the theoretical results.

关键词： Multi-agent systems Robustness Observers Electronic mail State feedback Additives

Ensemble of deep convolutional neural networks for automatic pavement crack detection and measurement

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Fan, Zhun Li, Chong Chen, Ying Di Mascio, Paola Chen, Xiaopeng Zhu, Guijie Loprencipe, Giuseppe Key Lab of Digital Signal and Image Processing of Guangdong Province Shan’tou515063 China College of Engineering Shantou University Shan’tou515063 China Department of Civil Construction and Environmental Engineering Sapienza University of Rome Rome00184 Italy Department of Industrial Engineering Pusan National University Busan609735 Korea Republic of

Automated pavement crack detection and measurement are important road issues. Agencies have to guarantee the improvement of road safety. Conventional crack detection and measurement algorithms can be extremely time-consuming and low efficiency. Therefore, recently, innovative algorithms have received increased attention from researchers. In this paper, we propose an ensemble of convolutional neural networks (without a pooling layer) based on probability fusion for automated pavement crack detection and measurement. Specifically, an ensemble of convolutional neural networks was employed to identify the structure of small cracks with raw images. Secondly, outputs of the individual convolutional neural network model for the ensemble were averaged to produce the final crack probability value of each pixel, which can obtain a predicted probability map. Finally, the predicted morphological features of the cracks were measured by using the skeleton extraction algorithm. To validate the proposed method, some experiments were performed on two public crack databases (CFD and AigleRN) and the results of the different state-of-the-art methods were compared. To evaluate the efficiency of crack detection methods, three parameters were considered: precision (Pr), recall (Re) and F1 score (F1). For the two public databases of pavement images, the proposed method obtained the highest values of the three evaluation parameters: for the CFD database, Pr = 0.9552, Re = 0.9521 and F1 = 0.9533 (which reach values up to 0.5175 higher than the values obtained on the same database with the other methods), for the AigleRN database, Pr = 0.9302, Re = 0.9166 and F1 = 0.9238 (which reach values up to 0.7313 higher than the values obtained on the same database with the other methods). The experimental results show that the proposed method outperforms the other methods. For crack measurement, the crack length and width can be measure based on different crack types (complex, common, thin, and inter

关键词： Convolution

VG-Swarm: A Vision-based Gene Regulation Network for UAVs Swarm Behavior Emergence

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Cai, Yuwei Li, Huanlin Hong, Juncao Xu, Peng Cheng, Hui Zhu, Xiaomin Hu, Bingliang Hao, Zhifeng Fan, Zhun Key Lab of Digital Signal and Image Processing of Guangdong Province College of Engineering University of Shantou Guangdong China School of Computer Science and Engineering University of Sun Yat-Sen Guangdong China College of Systems Engineering National University of Defense Technology Hunan Changsha China Xi’an Institute of Optics and Precision Mechanics Shanxi China

Unmanned Aerial Vehicles (UAVs) dynamic encirclement is an emerging field with great potential. Researchers often get inspiration from biological systems, either from macro-world like fish schools or bird flocks etc, or from micro-world like gene regulatory networks (GRN). However, most swarm control algorithms rely on centralized control, global information acquisition, and communications among neighboring agents. In this work, we propose a distributed swarm control method based purely on vision and GRN without any direct communications, in which swarm agents of e.g. UAVs can generate an entrapping pattern to encircle an escaping target of UAV based purely on their installed omnidirectional vision sensors. A finite-state-machine (FSM) describing the behavioral model of each drone is also designed so that a swarm of drones can accomplish searching and entrapping of the target collectively in an integrated way. We verify the effectiveness and efficiency of the proposed method in various simulation and real-world experiments. Copyright © 2022, The Authors. All rights reserved.

关键词： Drones