检索结果-内蒙古大学图书馆

Rotation equivariant feature image pyramid network for object detection in optical remote sensing imagery

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Shamsolmoali, Pourya Zareapoor, Masoumeh Chanussot, Jocelyn Zhou, Huiyu Yang, Jie The Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai200240 China The GIPSA-Lab Université Grenoble Alpes CNRS Grenoble INP Grenoble38000 France The Faculty of Electrical and Computer Engineering University of Iceland Reykjavik101 Iceland The School of Informatics University of Leicester LeicesterLE1 7RH United Kingdom

To read the paper please go to IEEE Transactions on Geoscience and Remote Sensing on IEEE Xplore. Detection of objects is extremely important in various aerial vision-based applications. Over the last few years, the methods based on convolution neural networks have made substantial progress. However, because of the large variety of object scales, densities, and arbitrary orientations, the current detectors struggle with the extraction of semantically strong features for small-scale objects by a predefined convolution kernel. To address this problem, we propose the rotation equivariant feature image pyramid network (REFIPN), an image pyramid network based on rotation equivariance convolution. The proposed model adopts single-shot detector in parallel with a lightweight image pyramid module to extract representative features and generate regions of interest in an optimization approach. The proposed network extracts feature in a wide range of scales and orientations by using novel convolution filters. These features are used to generate vector fields and determine the weight and angle of the highest-scoring orientation for all spatial locations on an image. By this approach, the performance for small-sized object detection is enhanced without sacrificing the performance for large-sized object detection. The performance of the proposed model is validated on two commonly used aerial benchmarks and the results show our proposed model can achieve state-of-the-art performance with satisfactory efficiency. Copyright © 2021, The Authors. All rights reserved.

关键词： Object detection

A Recent Survey of Vision Transformers for Medical image Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Khan, Asifullah Rauf, Zunaira Khan, Abdul Rehman Rathore, Saima Khan, Saddam Hussain Shah, Sahar Farooq, Umair Asif, Hifsa Asif, Aqsa Zahoora, Umme Khalil, Rafi Ullah Qamar, Suleman Asif, Umme Hani Khan, Faiza Babar Majid, Abdul Gwak, Jeonghwan Pattern Recognition Lab Department of Computer & Information Sciences Pakistan Institute of Engineering & Applied Sciences Nilore Islamabad45650 Pakistan Pakistan Institute of Engineering & Applied Sciences Nilore Islamabad45650 Pakistan Center for Mathematical Sciences Pakistan Institute of Engineering & Applied Sciences Nilore Islamabad45650 Pakistan Avid Radio pharmaceuticals PhiladelphiaPA United States Eli Lilly and Company IndianapolisIN United States Swat Pakistan Air University E-9 Islamabad44230 Pakistan Digital Image Processing Lab Department of Computer Science Islamia College Peshawar Pakistan Pakistan Institute of Engineering & Applied Sciences Nilore Islamabad45650 Pakistan Department of Software Korea National University of Transportation Chungju27469 Korea Republic of

Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. In recent years, Vision Transformers (ViTs) have emerged as a promising technique for addressing the challenges in medical image segmentation. In medical images, structures are usually highly interconnected and globally distributed. ViTs utilize their multi-scale attention mechanism to model the long-range relationships in the images. However, they do lack image-related inductive bias and translational invariance, potentially impacting their performance. Recently, researchers have come up with various ViT-based approaches that incorporate CNNs in their architectures, known as Hybrid Vision Transformers (HVTs) to capture local correlation in addition to the globa l information in the images. This survey paper provides a detailed review of the recent advancements in ViTs and HVTs for medical image segmentation. Along with the categorization of ViT and HVT-based medical image segmentation approaches we also present a detailed overview of their real-time applications in several medical image modalities. This survey may serve as a valuable resource for researchers, healthcare practitioners, and students in understanding the state-of-the-art approaches for ViT-based medical image segmentation. Copyright © 2023, The Authors. All rights reserved.

关键词： Diagnosis

Efficient spatialtemporal context modeling for action recognition?

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Cao, Congqi Lu, Yue Zhang, Yifan Jiang, Dongmei Zhang, Yanning Natl. Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Lab on Speech and Image Information Processing School of Computer Science Northwestern Poly-technical University Xi'an710129 China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing100190 China

Contextual information plays an important role in action recognition. Local operations have difficulty to model the relation between two elements with a long-distance interval. However, directly modeling the contextual information between any two points brings huge cost in computation and memory, especially for action recognition, where there is an additional temporal dimension. Inspired from 2D criss-cross attention used in segmentation task, we propose a recurrent 3D criss-cross attention (RCCA-3D) module to model the dense long-range spatiotemporal contextual information in video for action recognition. The global context is factorized into sparse relation maps. We model the relationship between points in the same line along the direction of horizon, vertical and depth at each time, which forms a 3D criss-cross structure, and duplicate the same operation with recurrent mechanism to transmit the relation between points in a line to a plane finally to the whole spatiotemporal space. Compared with the non-local method, the proposed RCCA-3D module reduces the number of parameters and FLOPs by 25% and 30% for video context modeling. We evaluate the performance of RCCA-3D with two latest action recognition networks on three datasets and make a thorough analysis of the architecture, obtaining the optimal way to factorize and fuse the relation maps. Comparisons with other state-of-the-art methods demonstrate the effectiveness and efficiency of our model. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

The effect of data augmentation on classification of atrial fibrillation in short single-lead ecg signals using deep neural networks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Hatamian, Faezeh Nejati Ravikumar, Nishant Vesal, Sulaiman Kemeth, Felix P. Struck, Matthias Maier, Andreas Department of Image Processing and Medical Technology Fraunhofer Institute for Integrated Circuits IIS Erlangen Germany Pattern Recognition Lab Department of Computer Science Friedrich-Alexander University Erlangen-Nrnberg Erlangen Germany School of Computing LICAMM Leeds Institute of Cardiovascular and Metabolic Medicine School of Medicine University of Leeds United Kingdom

Cardiovascular diseases are the most common cause of mortality worldwide. Detection of atrial fibrillation (AF) in the asymptomatic stage can help prevent strokes. It also improves clinical decision making through the delivery of suitable treatment such as, anticoagulant therapy, in a timely manner. The clinical significance of such early detection of AF in electrocardiogram (ECG) signals has inspired numerous studies in recent years, of which many aim to solve this task by leveraging machine learning algorithms. ECG datasets containing AF samples, however, usually suffer from severe class imbalance, which if unaccounted for, affects the performance of classification algorithms. Data augmentation is a popular solution to tackle this problem. In this study, we investigate the impact of various data augmentation algorithms, e.g., oversampling, Gaussian Mixture Models (GMMs) and Generative Adversarial Networks (GANs), on solving the class imbalance problem. These algorithms are quantitatively and qualitatively evaluated, compared and discussed in detail. The results show that deep learning-based AF signal classification methods benefit more from data augmentation using GANs and GMMs, than oversampling. Furthermore, the GAN results in circa 3% better AF classification accuracy in average while performing comparably to the GMM in terms of f1-score. Copyright © 2020, The Authors. All rights reserved.

关键词： Diseases

Data consistent artifact reduction for limited angle tomography with deep learning prior

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Huang, Yixing Preuhs, Alexander Lauritsch, Günter Manhart, Michael Huang, Xiaolin Maier, Andreas Pattern Recognition Lab Friedrich-Alexander-Universitt Erlangen-Nrnberg Erlangen91058 Germany Siemens Healthcare GmbH Forchheim91301 Germany Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai200240 China Erlangen91058 Germany

Robustness of deep learning methods for limited angle tomography is challenged by two major factors: a) due to insufficient training data the network may not generalize well to unseen data;b) deep learning methods are sensitive to noise. Thus, generating reconstructed images directly from a neural network appears inadequate. We propose to constrain the reconstructed images to be consistent with the measured projection data, while the unmeasured information is complemented by learning based methods. For this purpose, a data consistent artifact reduction (DCAR) method is introduced: First, a prior image is generated from an initial limited angle reconstruction via deep learning as a substitute for missing information. Afterwards, a conventional iterative reconstruction algorithm is applied, integrating the data consistency in the measured angular range and the prior information in the missing angular range. This ensures data integrity in the measured area, while inaccuracies incorporated by the deep learning prior lie only in areas where no information is acquired. The proposed DCAR method achieves significant image quality improvement: for 120° cone-beam limited angle tomography more than 10% RMSE reduction in noise-free case and more than 24% RMSE reduction in noisy case compared with a state-of-the-art U-Net based method. Copyright © 2019, The Authors. All rights reserved.

关键词： image enhancement

Multi-level graph convolutional network with automatic graph learning for hyperspectral image classification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wan, Sheng Gong, Chen Pan, Shirui Yang, Jie Yang, Jian PCA Lab Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Laboratory of Image Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai200240 China Faculty of Information Technology Monash University ClaytonVIC3800 Australia

Nowadays, deep learning methods, especially the Graph Convolutional Network (GCN), have shown impressive performance in hyperspectral image (HSI) classification. However, the current GCN-based methods treat graph construction and image classification as two separate tasks, which often results in suboptimal performance. Another defect of these methods is that they mainly focus on modeling the local pairwise importance between graph nodes while lack the capability to capture the global contextual information of HSI. In this paper, we propose a Multi-level GCN with Automatic Graph Learning method (MGCN-AGL) for HSI classification, which can automatically learn the graph information at both local and global levels. By employing attention mechanism to characterize the importance among spatially neighboring regions, the most relevant information can be adaptively incorporated to make decisions, which helps encode the spatial context to form the graph information at local level. Moreover, we utilize multiple pathways for local-level graph convolution, in order to leverage the merits from the diverse spatial context of HSI and to enhance the expressive power of the generated representations. To reconstruct the global contextual relations, our MGCN-AGL encodes the long range dependencies among image regions based on the expressive representations that have been produced at local level. Then inference can be performed along the reconstructed graph edges connecting faraway regions. Finally, the multi-level information is adaptively fused to generate the network output. In this means, the graph learning and image classification can be integrated into a unified framework and benefit each other. Extensive experiments have been conducted on three real-world hyperspectral datasets, which are shown to outperform the state-of-the-art methods. Copyright © 2020, The Authors. All rights reserved.

关键词： image classification

Unsupervised Local Discrimination for Medical images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chen, Huai Wang, Renzhen Wang, Xiuying Li, Jieyu Fang, Qu Li, Hui Bai, Jianhao Peng, Qing Meng, Deyu Wang, Lisheng Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University Shanghai200240 China School of Mathematics and Statistics Ministry of Education Key Lab of Intelligent Networks and Network Security Xi’an Jiaotong University Xi’an710049 China The School of Computer Science The University of Sydney SydneyNSW2006 Australia Department of Ophthalmology Shanghai Tenth People’s Hospital Tongji University Shanghai200240 China The Cooperative Medianet Innovation Center Shanghai Jiao Tong University Shanghai200240 China The Changchun GeneScience Pharmaceutical Co. LTD China

Contrastive learning, which aims to capture general representation from unlab.led images to initialize the medical analysis models, has been proven effective in alleviating the high demand for expensive annotations. Current methods mainly focus on instance-wise comparisons to learn the global discriminative features, however, pretermitting the local details to distinguish tiny anatomical structures, lesions, and tissues. To address this challenge, in this paper, we propose a general unsupervised representation learning framework, named local discrimination (LD), to learn local discriminative features for medical images by closely embedding semantically similar pixels and identifying regions of similar structures across different images. Specifically, this model is equipped with an embedding module for pixel-wise embedding and a clustering module for generating segmentation. And these two modules are unified through optimizing our novel region discrimination loss function in a mutually beneficial mechanism, which enables our model to reflect structure information as well as measure pixel-wise and region-wise similarity. Furthermore, based on LD, we propose a center-sensitive one-shot landmark localization algorithm and a shape-guided cross-modality segmentation model to foster the generalizability of our model. When transferred to downstream tasks, the learned representation by our method shows a better generalization, outperforming representation from 18 state-of-the-art (SOTA) methods and winning 9 out of all 12 downstream tasks. Especially for the challenging lesion segmentation tasks, the proposed method achieves significantly better performances. The source codes are publicly availab.e at https://***/HuaiChen-1994/LDLearning. Copyright © 2021, The Authors. All rights reserved.

关键词： Embeddings

The Effect of Data Augmentation on Classification of Atrial Fibrillation in Short Single-Lead ECG Signals Using Deep Neural Networks

学校读者我要写书评

暂无评论

The Effect of Data Augmentation on Classification of Atrial ...

IEEE International Conference on Acoustics, Speech and Signal processing

作者： Faezeh Nejati Hatamian Nishant Ravikumar Sulaiman Vesal Felix P. Kemeth Matthias Struck Andreas Maier Department of Image Processing and Medical Technology Fraunhofer Institute for Integrated Circuits IIS Erlangen Germany Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB) School of Computing LICAMM Leeds Institute of Cardiovascular and Metabolic Medicine School of Medicine University of Leeds United Kingdom Pattern Recognition Lab Friedrich-Alexander University Erlangen-Nürnberg Erlangen Germany

ISBN: (数字)9781509066315

ISBN: (纸本)9781509066322

关键词：

Learning data-adaptive non-parametric kernels

学校读者我要写书评

暂无评论

The Journal of Machine Learning Research

The Journal of Machine Learning Research 2020年第1期21卷 8590-8628页

作者： Fanghui Liu Xiaolin Huang Chen Gong Jie Yang Li Li Department of Electrical Engineering ESAT-STADIUS KU Leuven Belgium Institute of Image Processing and Pattern Recognition Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China PCA Lab Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education School of Computer Science and Engineering Nanjing University of Science and Technology China and Department of Computing Hong Kong Polytechnic University Hong Kong SAR China Department of Automation BNRist Tsinghua University China

In this paper, we propose a data-adaptive non-parametric kernel learning framework in margin based kernel methods. In model formulation, given an initial kernel matrix, a data-adaptive matrix with two constraints is imposed in an entry-wise scheme. Learning this data-adaptive matrix in a formulation-free strategy enlarges the margin between classes and thus improves the model flexibility. The introduced two constraints are imposed either exactly (on small data sets) or approximately (on large data sets) in our model, which provides a controllab.e trade-off between model flexibility and complexity with theoretical demonstration. In algorithm optimization, the objective function of our learning framework is proven to be gradient-Lipschitz continuous. Thereby, kernel and classifier/regressor learning can be efficiently optimized in a unified framework via Nesterov's acceleration. For the scalab.lity issue, we study a decomposition-based approach to our model in the large sample case. The effectiveness of this approximation is illustrated by both empirical studies and theoretical guarantees. Experimental results on various classification and regression benchmark data sets demonstrate that our non-parametric kernel learning framework achieves good performance when compared with other representative kernel learning based algorithms.

关键词： support vector machines non-parametric kernel learning gradient-Lipschitz continuous