检索结果-内蒙古大学图书馆

LEDNet: Deep Network for Single image Haze Removal 2018

学校读者我要写书评

暂无评论

LEDNet: Deep Network for Single Image Haze Removal

Proceedings of the 11th Indian Conference on computer Vision, Graphics and image Processing

作者： Akshay Dudhane Subrahmanyam Murala Abhinav Dhall Computer Vision and Pattern Recognition Lab Indian Institute of Technology Ropar India Learning Affect and Semantic Image Analysis Group Indian Institute of Technology Ropar India

ISBN: (纸本)9781450366151

Haze during the bad weather, degrades the visibility of the scene drastically. Degradation of scene visibility varies with respect to the transmission coefficient/map (Tc) of the scene. Estimation of accurate Tc is key step to reconstruct the haze free scene. Previously, local as well as global priors were proposed to estimate the Tc. We, on the other hand, propose integration of local and global approaches to learn both point level and object level Tc. The proposed local encoder decoder network (LEDNet) estimates the scene transmission map in two stages. During first stage, network estimates the point level Tc using parallel convolutional filters and spatial invariance filtering. The second stage comprises of a two level encoder-decoder architecture which anticipates the object level Tc. We also propose, local air-light estimation (LAE) algorithm, which is able to obtain the air-light component of the outdoor scene. Combination of LEDNet and LAE improves the accuracy of haze model to recover the scene radiance. Structural similarity index, mean square error and peak signal to noise ratio are used to evaluate the performance of the proposed approach for single image haze removal. Experiments on benchmark datasets show that LEDNet outperforms the existing state-of-the-art methods for single image haze removal.

关键词： Haze removal transmission map CNN

Real-time image Smoothing via Iterative Least Squares

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Liu, Wei Zhang, Pingping Huang, Xiaolin Yang, Jie Shen, Chunhua Reid, Ian School of Computer Science University of Adelaide Adelaide5005 Australia School of Information and Communication Engineering Dalian University of Technology Dalian116024 China Institute of Image Processing and Pattern Recognition & Institute of Medical Robotics Shanghai Jiao Tong University Shanghai200240 China Institute of Image Processing and Pattern Recognition & Institute of Medical Robotics Shanghai Jiao Tong University Shanghai200240 China

Edge-preserving image smoothing is a fundamental procedure for many computer vision and graphic applications. There is a tradeoff between the smoothing quality and the processing speed: the high smoothing quality usually requires a high computational cost which leads to the low processing speed. In this paper, we propose a new global optimization based method, named iterative least squares (ILS), for efficient edge-preserving image smoothing. Our approach can produce high-quality results but at a much lower computational cost. Comprehensive experiments demonstrate that the propose method can produce results with little visible artifacts. Moreover, the computation of ILS can be highly parallel, which can be easily accelerated through either multi-thread computing or the GPU hardware. With the acceleration of a GTX 1080 GPU, it is able to process images of 1080p resolution (1920 × 1080) at the rate of 20fps for color images and 47fps for gray images. In addition, the ILS is flexible and can be modified to handle more applications that require different smoothing properties. Experimental results of several applications show the effectiveness and efficiency of the proposed method. The code is available at https://***/wliusjtu/Real-time-image-Smoothing-via-Iterative-Least-Squares Copyright © 2020, The Authors. All rights reserved.

关键词： Textures

Partial Differential Equations is All You Need for Generating Neural Architectures - A Theory for Physical Artificial Intelligence Systems

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Guo, Ping Huang, Kaizhu Xu, Zenglin Image Processing & Pattern Recognition Lab. Beijing Normal University Beijing100875 China Data Science Research Center Duke Kunshan University Jiangsu Kunshan215316 China School of Computer Science and Technology Harbin Institute of Technology at ShenZhen Peng Cheng National Lab Guangdong Shenzhen510855 China

In this work, we generalize the reaction-diffusion equation in statistical physics, Schrödinger equation in quantum mechanics, and Helmholtz equation in paraxial optics into the neural partial differential equations (NPDE), which can be considered as the fundamental equations in the field of artificial intelligence research. We take the finite difference method to discretize NPDEs for finding the numerical solution. Moreover, the basic building blocks of deep neural network architectures, including multi-layer perceptron, convolutional neural networks, and recurrent neural networks, are generated. The learning strategies, such as Adaptive moment estimation, L-BFGS, pseudoinverse learning algorithms, and partial differential equation constrained optimization, are also developed. This work is of significance in that it presents a clear view of interpretable deep neural networks physically, enables high possibility to be applied to analog computing device design, and paves the road to physical artificial intelligence. © 2021, CC BY-NC-SA.

关键词： Schrodinger equation

Edge-Aware Graph Attention Network for Ratio of Edge-User Estimation in Mobile Networks

学校读者我要写书评

暂无评论

Edge-Aware Graph Attention Network for Ratio of Edge-User Es...

International Conference on Pattern recognition

作者： Jiehui Deng Sheng Wan Xiang Wang Enmei Tu Xiaolin Huang Jie Yang Chen Gong PCA Lab the Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Hong Kong Polytechnic University Hong Kong SAR China

Estimating the Ratio of Edge-Users (REU) is an important issue in mobile networks, as it helps the subsequent adjustment of loads in different cells. However, existing approaches usually determine the REU manually, which are experience-dependent and labor-intensive, and thus the estimated REU might be imprecise. Considering the inherited graph structure of mobile networks, in this paper, we utilize a graph-based deep learning method for automatic REU estimation, where the practical cells are deemed as nodes and the load switchings among them constitute edges. Concretely, Graph Attention Network (GAT) is employed as the backbone of our method due to its impressive generalizability in dealing with networked data. Nevertheless, conventional GAT cannot make full use of the information in mobile networks, since it only incorporates node features to infer the pairwise importance and conduct graph convolutions, while the edge features that are actually critical in our problem are disregarded. To accommodate this issue, we propose an Edge-Aware Graph Attention Network (EAGAT), which is able to fuse the node features and edge features for REU estimation. Extensive experimental results on two real-world mobile network datasets demonstrate the superiority of our EAGAT approach to several state-of-the-art methods.

关键词： Deep learning Fuses Estimation Switches Pattern recognition

Face recognition - A one-shot learning perspective 15

学校读者我要写书评

暂无评论

Face recognition - A one-shot learning perspective

15th International Conference on Signal image Technology and Internet Based Systems, SISITS 2019

作者： Chanda, Sukalpa Gv, Asish Chakrapani Brun, Anders Hast, Anders Pal, Umapada Doermann, David Department of Information Technology Østfold University College Norway Computer Vision and Pattern Recognition Unit Indian Statistical Institute India Centre for Image Analysis Uppsala University Sweden Computer Science and Engineering University at Buffalo United States

ISBN: (纸本)9781728156866

Ability to learn from a single instance is something unique to the human species and One-shot learning algorithms try to mimic this special capability. On the other hand, despite the fantastic performance of Deep Learning-based methods on various image classification problems, performance often depends having on a huge number of annotated training samples per class. This fact is certainly a hindrance in deploying deep neural network-based systems in many real-life applications like face recognition. Furthermore, an addition of a new class to the system will require the need to re-train the whole system from scratch. Nevertheless, the prowess of deep learned features could also not be ignored. This research aims to combine the best of deep learned features with a traditional One-Shot learning framework. Results obtained on 2 publicly available datasets are very encouraging achieving over 90% accuracy on 5-way One-Shot tasks, and 84% on 50-way One-Shot problems. © 2019 IEEE.

关键词： Face recognition

Energy enhanced tissue texture in spectral computed tomography for lesion classification

学校读者我要写书评

暂无评论

Visual Computing for Industry,Biomedicine,and Art 2019年第1期2卷 138-149页

作者： Yongfeng Gao Yongyi Shi Weiguo Cao Shu Zhang Zhengrong Liang Department of Radiology Stony Brook UniversityStony BrookNY 11794USA Institute of Image Processing and Pattern Recognition Xi’an Jiaotong UniversityXi’an 710049ShanxiChina Departments of Radiology Biomedical EngineeringComputer Scienceand Electrical EngineeringStony Brook UniversityStony BrookNY 11794USA

Tissue texture reflects the spatial distribution of contrasts of image voxel gray levels,i.e.,the tissue heterogeneity,and has been recognized as important biomarkers in various clinical *** computed tomography(CT)is believed to be able to enrich tissue texture by providing different voxel contrast images using different X-ray ***,this paper aims to address two related issues for clinical usage of spectral CT,especially the photon counting CT(PCCT):(1)texture enhancement by spectral CT image reconstruction,and(2)spectral energy enriched tissue texture for improved lesion *** issue(1),we recently proposed a tissue-specific texture prior in addition to low rank prior for the individual energy-channel low-count image reconstruction problems in PCCT under the Bayesian *** results showed the proposed method outperforms existing methods of total variation(TV),low-rank TV and tensor dictionary learning in terms of not only preserving texture features but also suppressing image *** issue(2),this paper will investigate three models to incorporate the enriched texture by PCCT in accordance with three types of inputs:one is the spectral images,another is the cooccurrence matrices(CMs)extracted from the spectral images,and the third one is the Haralick features(HF)extracted from the *** were performed on simulated photon counting data by introducing attenuationenergy response curve to the traditional CT images from energy integration *** results showed the spectral CT enriched texture model can improve the area under the receiver operating characteristic curve(AUC)score by 7.3%,0.42%and 3.0%for the spectral images,CMs and HFs respectively on the five-energy spectral data over the original single energy data *** CM-and HF-inputs can achieve the best AUC of 0.934 and *** texture themed study shows the insight that incorporating clinical important prior information,e.g.,tiss

关键词： Tissue texture Spectral computed tomography Lesion classification Machine learning Bayesian reconstruction

Rotation equivariant feature image pyramid network for object detection in optical remote sensing imagery

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Shamsolmoali, Pourya Zareapoor, Masoumeh Chanussot, Jocelyn Zhou, Huiyu Yang, Jie The Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai200240 China The GIPSA-Lab Université Grenoble Alpes CNRS Grenoble INP Grenoble38000 France The Faculty of Electrical and Computer Engineering University of Iceland Reykjavik101 Iceland The School of Informatics University of Leicester LeicesterLE1 7RH United Kingdom

To read the paper please go to IEEE Transactions on Geoscience and Remote Sensing on IEEE Xplore. Detection of objects is extremely important in various aerial vision-based applications. Over the last few years, the methods based on convolution neural networks have made substantial progress. However, because of the large variety of object scales, densities, and arbitrary orientations, the current detectors struggle with the extraction of semantically strong features for small-scale objects by a predefined convolution kernel. To address this problem, we propose the rotation equivariant feature image pyramid network (REFIPN), an image pyramid network based on rotation equivariance convolution. The proposed model adopts single-shot detector in parallel with a lightweight image pyramid module to extract representative features and generate regions of interest in an optimization approach. The proposed network extracts feature in a wide range of scales and orientations by using novel convolution filters. These features are used to generate vector fields and determine the weight and angle of the highest-scoring orientation for all spatial locations on an image. By this approach, the performance for small-sized object detection is enhanced without sacrificing the performance for large-sized object detection. The performance of the proposed model is validated on two commonly used aerial benchmarks and the results show our proposed model can achieve state-of-the-art performance with satisfactory efficiency. Copyright © 2021, The Authors. All rights reserved.

关键词： Object detection

Efficient spatialtemporal context modeling for action recognition?

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Cao, Congqi Lu, Yue Zhang, Yifan Jiang, Dongmei Zhang, Yanning Natl. Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Lab on Speech and Image Information Processing School of Computer Science Northwestern Poly-technical University Xi'an710129 China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing100190 China

Contextual information plays an important role in action recognition. Local operations have difficulty to model the relation between two elements with a long-distance interval. However, directly modeling the contextual information between any two points brings huge cost in computation and memory, especially for action recognition, where there is an additional temporal dimension. Inspired from 2D criss-cross attention used in segmentation task, we propose a recurrent 3D criss-cross attention (RCCA-3D) module to model the dense long-range spatiotemporal contextual information in video for action recognition. The global context is factorized into sparse relation maps. We model the relationship between points in the same line along the direction of horizon, vertical and depth at each time, which forms a 3D criss-cross structure, and duplicate the same operation with recurrent mechanism to transmit the relation between points in a line to a plane finally to the whole spatiotemporal space. Compared with the non-local method, the proposed RCCA-3D module reduces the number of parameters and FLOPs by 25% and 30% for video context modeling. We evaluate the performance of RCCA-3D with two latest action recognition networks on three datasets and make a thorough analysis of the architecture, obtaining the optimal way to factorize and fuse the relation maps. Comparisons with other state-of-the-art methods demonstrate the effectiveness and efficiency of our model. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

NiuEM: A Nested-iterative Unsupervised Learning Model for Single-particle Cryo-EM image Processing

学校读者我要写书评

暂无评论

NiuEM: A Nested-iterative Unsupervised Learning Model for Si...

2020 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2020

作者： Hu, Rui Cai, Jiaming Zheng, Wangjie Yang, Yang Shen, Hong-Bin Shanghai Jiao Tong University Key Lab. of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Department of Computer Science and Engineering Shanghai200240 China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China Shanghai Jiao Tong University Department of Bioinformatics and Biostatistics Shanghai200240 China

ISBN: (纸本)9781728162157

Cryo-electron microscopy (cryo-EM) has become a mainstream technology for solving spatial structures of biomacromolecules, while the processing of cryo-EM images is a very challenging task. One of the great challenges is the high noise in the images. A common method is to cluster the images with close projecting angles to get mean images, which are used for 3D reconstruction. However, due to the extremely low signal-to-noise-ratio, common clustering methods often fail to obtain high-quality mean images, leading to poorly reconstructed structures. In this study, we present a new unsupervised learning framework, called NiuEM, to discriminate images captured from different angles and yield cluster-mean images. NiuEM first generates pseudo-labels and then exploits both contrastive loss and cross-entropy loss for training convolutional layers to learn feature representations. Moreover, the pseudo-labels are updated iteratively to enhance the reliability of labels. We assess the performance of NiuEM on four data sets via both visualized and quantitative experiments. Especially, two kinds of metrics are adopted to measure the performance, regarding the clustering quality and the resolution of reconstructed 3D models, respectively. The experimental results show that NiuEM achieves very competitive clustering accuracy in the comparison with the state-of-the-art image clustering methods. Moreover, the cluster mean images yielded by NiuEM lead to better initial 3D models compared with the mainstream reconstruction tools. © 2020 IEEE.

关键词： image reconstruction