This paper presents a co-saliency detection algorithm based on clustering and diffusion process. For each image in a set, intra saliency maps are constructed from the measure of boundary and contrast priors. Then, seg...
详细信息
ISBN:
(纸本)9781509053162
This paper presents a co-saliency detection algorithm based on clustering and diffusion process. For each image in a set, intra saliency maps are constructed from the measure of boundary and contrast priors. Then, segmented regions of all images are clustered based on features of colors, intra saliency and coherence of saliency. Co-saliency of each cluster is computed from combination of foreground probability and coherence of the cluster. The co-saliency of cluster is propagated over the segmented regions according to affinity between the cluster and segments. In addition, we adopt an intra image diffusion process from a graph with learned fully affinity in order to improve spatial consistency of co-saliency maps. Experimental results show that our algorithm yields better results compared to the state-of-the-art methods in terms of precision-recall curve, visual plausibility and computational cost.
image enhancement is widely popular due to its capability of producing "better" visual quality for specific applications. Although many enhancement algorithms have been developed in recent years, the studies...
详细信息
ISBN:
(纸本)9781509053162
image enhancement is widely popular due to its capability of producing "better" visual quality for specific applications. Although many enhancement algorithms have been developed in recent years, the studies towards blind assessment of enhanced images are still very lacking. In this paper, we propose a data-driven blind image quality assessment (BIQA) method based on the quality-aware deep neural network (Q-DNN). Unlike the conventional hand-crafted features designed for measuring the degradation level of specific distortion types, a supervised learning model is utilized in our Q-DNN, which is capable of adaptively updating the feature extractor and quality regressor for describing the visual artifacts caused by different image enhancement tasks. Experimental results on two challenging enhanced image databases show that the proposed method is significantly superior to the state-of-the-art BIQA metrics.
Identifying the light source of an image is important for imageprocessing tasks such as colour correction and white point balancing. This is also known as colour constancy in computer vision. This paper presents a no...
详细信息
ISBN:
(纸本)9781509053162
Identifying the light source of an image is important for imageprocessing tasks such as colour correction and white point balancing. This is also known as colour constancy in computer vision. This paper presents a novel clustering classification colour constancy framework (the 4C method). Based on the assumption that similar illuminants will result in similar white point colours, we first use a clustering algorithm to group similar white point colours of the training samples into the same cluster. We then treat the images in the same cluster as belonging to the same illumination source and each cluster as one class of illuminants. The colour constancy problem, i.e., that of estimating the unknown illuminant of an image, becomes that of identifying which illuminant class (cluster) the images illuminant falling into. To achieve this, we derive an effective colour feature representation of the image and use a general classification algorithm to classify the image into one of the illuminant classes (clusters). We present experimental results on publicly available testing datasets and show that our new method is competitive to state of the art.
Designing a reliable and generic perceptual quality metric is a challenging issue in three-dimensional (3D) visual signal processing. Due to the limited knowledge on 3D perceptual, it is difficult to fuse the visual i...
详细信息
ISBN:
(纸本)9781509053162
Designing a reliable and generic perceptual quality metric is a challenging issue in three-dimensional (3D) visual signal processing. Due to the limited knowledge on 3D perceptual, it is difficult to fuse the visual information of left and right views in an effective way. In this paper, we propose a complex singular value decomposition (CSVD) based stereoscopic image quality assessment (SIQA) metric. First, the corresponding blocks of the left/right view are grouped into complex representation (CR) block through the scale-invariant feature transform (SIFT) view matching process. Then we compute the CSVD coefficients of each CR block. Final, a CSVD based quality pooling stage is employed to predict the final visual quality of the distorted 3D image. Experimental results demonstrate that the proposed metric has good consistency with 3D perception of human.
I n this paper, we present a new image restoration framework based on two high-level regularizations that can predict and preserve the better informative structures in the image. The sparse representation of a blurred...
详细信息
ISBN:
(纸本)9781509053162
I n this paper, we present a new image restoration framework based on two high-level regularizations that can predict and preserve the better informative structures in the image. The sparse representation of a blurred image is first obtained to globally encode the salient structures by applying a group of coupled framelet filters. Then a physical meaning regularizer is derived to estimate the point spread function based on the frequency response characteristics of the image. Moreover, based on the operator of structure tensor, a novel nonlocal total variation as the regularizer is established to measure the image variation and non-local self-similarity. Finally, these two highlevel regularizers are integrated into an objective function to constrain the ill-posedness. Compared with the state-of-the-art restoration methods, our algorithm can not only suppress strong noises effectively but also recover the sharp structures from the severe and complex blurred images.
Recent image sharpness metrics are usually proposed for visible light image and infrared image sharpness assessment is seldom discussed. As for infrared images, we usually concern more about the salient regions. There...
详细信息
ISBN:
(纸本)9781509053162
Recent image sharpness metrics are usually proposed for visible light image and infrared image sharpness assessment is seldom discussed. As for infrared images, we usually concern more about the salient regions. Therefore, in this paper, a novel no-reference algorithm based on saliency detection (SD) and singular value decomposition (SVD) is proposed to assess infrared image sharpness. Gaussian blur is first used to build a reference image. Then salient regions are detected by combining the local mean and variation. Next, singular value decomposition-based metric is proposed to evaluate the variation between original image and reference image. The image quality score is finally obtained by using the five-parameter logistic regression. Experimental results show that the proposed method correlates well with the subjective quality evaluations of infrared images and is highly competitive with state-of-the-art visible light image sharpness metrics.
An effective content-based image retrieval (CBIR) system depends on the discriminative feature which represents an image. In this work, we explore deep convolutional features for a CBIR system. We first show the effec...
详细信息
ISBN:
(纸本)9781509053162
An effective content-based image retrieval (CBIR) system depends on the discriminative feature which represents an image. In this work, we explore deep convolutional features for a CBIR system. We first show the effectiveness of deep convolutional channel features for a CBIR system. Then we introduce a Multi Level Pooling method (MLP) to obtain object-aware features from convolutional layers and finally the features extracted from different layers are incorporated to a short representation vector. Through multiple experiments, we show that our approach can achieve state-of-art results on several benchmark retrieval datasets.
We propose an improved algorithm for no-reference image quality assessment (NR-IQA) using the convolutional neural network (CNN) and neural theory based saliency detection. Firstly, we extract non-overlapping patches ...
详细信息
ISBN:
(纸本)9781509053162
We propose an improved algorithm for no-reference image quality assessment (NR-IQA) using the convolutional neural network (CNN) and neural theory based saliency detection. Firstly, we extract non-overlapping patches from the input image. For each patch, we obtain the quality score by CNN network, which consists of seven layers and integrates feature learning and regression into image patch quality estimation. Considering that the patches attracting much attention take significant role in visual perception, an efficient technique based on free energy based neural model is used to detect the saliency map. This saliency map is then applied as a weighting mask to output the quality score of the whole image. Results of experiments show that our algorithm achieves state-of-the-art performance, as compared with the prevailing IQA methods.
Existing view interpolation methods like DIBR require accurate disparity map which greatly limits their applications. To this aim, we propose a novel mesh-based view interpolation algorithm capable of synthesizing vis...
详细信息
ISBN:
(纸本)9781509053162
Existing view interpolation methods like DIBR require accurate disparity map which greatly limits their applications. To this aim, we propose a novel mesh-based view interpolation algorithm capable of synthesizing visually coherent virtual views with rough disparity map estimated by stereo matching algorithms. We adopt an edge-aware mesh cutting method to explicitly handle occlusion and preserve sharp depth discontinuities. Experiments on Middlebury dataset and 3D-HEVC test sequences demonstrate that proposed method outperforms DIBR and state-of-the-art mesh-based view interpolation algorithm in terms of visual quality and PSNR.
Most traditional image coding schemes based on compressed sensing exploited the sparse domain in fixed bases and less consider the image non-stationary characteristic and human visual characteristic, which leads to po...
详细信息
ISBN:
(纸本)9781509053162
Most traditional image coding schemes based on compressed sensing exploited the sparse domain in fixed bases and less consider the image non-stationary characteristic and human visual characteristic, which leads to poor performance of the reconstruction. In this paper, we proposed a novel sparse CS scheme combined with just-noticeable difference (JND) Model and random permutation. Firstly, the DCT-based JND profile has been utilized to remove the perceptual redundancies which also makes the signal sparser, then the random permutation is adopted to balance the sparsity of each block in image. Experimental results show that the proposed perceptual sparse algorithm outperforms some existing approaches, and it can achieve better subjective and objective image quality compared to other algorithms when the sampling rate is above 0.3.
暂无评论