检索结果-内蒙古大学图书馆

Handwritten and Machine Printed Text Separation in Document images Using the Bag of Visual Words Paradigm

学校读者我要写书评

暂无评论

Handwritten and Machine Printed Text Separation in Document ...

International Workshop on Frontiers in Handwriting recognition

作者： Konstantinos Zagoris Ioannis Pratikakis Apostolos Antonacopoulos Basilis Gatos Nikos Papamarkos Pattern Recognition and Image Analysis (PRImA) Research Laboratory School of Computing Science and Engineering University of Salford Greater Manchester UK Department of Electrical and Computer Engineering Democritus University of Thrace Xanthi Greece Institute of Informatics and Telecommunications National Center for Scientific Research Demokritos Athens Greece

In a number of types of documents, ranging from forms to archive documents and books with annotations, machine printed and handwritten text may be present in the same document image, giving rise to significant issues within a digitisation and recognition pipeline. It is therefore necessary to separate the two types of text before applying different recognition methodologies to each. In this paper, a new approach is proposed which strives towards identifying and separating handwritten from machine printed text using the Bag of Visual Words paradigm (BoVW). Initially, blocks of interest are detected in the document image. For each block, a descriptor is calculated based on the BoVW. The final characterization of the blocks as Handwritten, Machine Printed or Noise is made by a Support Vector Machine classifier. The promising performance of the proposed approach is shown by using a consistent evaluation methodology which couples meaningful measures along with a new dataset.

关键词： Visualization Noise image segmentation Hidden Markov models Gabor filters Handwriting recognition Text recognition

3D RoI-aware U-net for accurate and efficient colorectal tumor segmentation

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Huang, Yi-Jie Dou, Qi Wang, Zi-Xian Liu, Li-Zhi Jin, Ying Li, Chao-Feng Wang, Lisheng Chen, Hao Xu, Rui-Hua Institute of Image Processing and Pattern Recognition Department of Automation Shanghai Jiao Tong University China Imsight Medical Technology Co. Ltd. China Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong Sun Yat-sen University Cancer Center State Key Laboratory of Oncology in South China Collaborative Innovation Center for Cancer Medicine Guangzhou China

Segmentation of colorectal cancerous regions from 3D Magnetic Resonance (MR) images is a crucial procedure for radiotherapy which conventionally requires accurate delineation of tumour boundaries at an expense of labor, time and reproducibility. While deep learning based methods serve good baselines in 3D image segmentation tasks, small applicable patch size limits effective receptive field and degrades segmentation performance. In addition, Regions of interest (RoIs) localization from large whole volume 3D images serves as a preceding operation that brings about multiple benefits in terms of speed, target completeness, reduction of false positives. Distinct from sliding window or non-joint localization-segmentation based models, we propose a novel multitask framework referred to as 3D RoI-aware U-Net (3D RU-Net), for RoI localization and in-region segmentation where the two tasks share one backbone encoder network. With the region proposals from the encoder, we crop multi-level RoI in-region features from the encoder to form a GPU memory-efficient decoder for detail-preserving segmentation and therefore enlarged applicable volume size and effective receptive field. To effectively train the model, we designed a Dice formulated loss function for the global-to-local multi-task learning procedure. Based on the efficiency gains demonstrated by the proposed method, we went on to ensemble models with different receptive fields to achieve even higher performance costing minor extra computational expensiveness. Extensive experiments were subsequently conducted on 64 cancerous cases with a four-fold cross-validation, and the results showed significant superiority in terms of accuracy and efficiency over conventional state-of-the art frameworks. In conclusion, the proposed method has a huge potential for extension to other 3D object segmentation tasks from medical images due to its inherent generalizability. The code for the proposed method is publicly available. Copyright ©

关键词： Signal encoding

Efficient spatialtemporal context modeling for action recognition?

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Cao, Congqi Lu, Yue Zhang, Yifan Jiang, Dongmei Zhang, Yanning Natl. Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology Shaanxi Provincial Key Lab on Speech and Image Information Processing School of Computer Science Northwestern Poly-technical University Xi'an710129 China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing100190 China

Contextual information plays an important role in action recognition. Local operations have difficulty to model the relation between two elements with a long-distance interval. However, directly modeling the contextual information between any two points brings huge cost in computation and memory, especially for action recognition, where there is an additional temporal dimension. Inspired from 2D criss-cross attention used in segmentation task, we propose a recurrent 3D criss-cross attention (RCCA-3D) module to model the dense long-range spatiotemporal contextual information in video for action recognition. The global context is factorized into sparse relation maps. We model the relationship between points in the same line along the direction of horizon, vertical and depth at each time, which forms a 3D criss-cross structure, and duplicate the same operation with recurrent mechanism to transmit the relation between points in a line to a plane finally to the whole spatiotemporal space. Compared with the non-local method, the proposed RCCA-3D module reduces the number of parameters and FLOPs by 25% and 30% for video context modeling. We evaluate the performance of RCCA-3D with two latest action recognition networks on three datasets and make a thorough analysis of the architecture, obtaining the optimal way to factorize and fuse the relation maps. Comparisons with other state-of-the-art methods demonstrate the effectiveness and efficiency of our model. Copyright © 2021, The Authors. All rights reserved.

关键词： Machine learning

Sparse generalized canonical correlation analysis: Distributed alternating iteration based approach

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Cai, Jia Lv, Kexin Huo, Junyi Huang, Xiaolin Yang, Jie School of Statistics and Mathematics Guangdong University of Finance & Economics Big Data and Educational Statistics Application Laboratory 21 Chisha Road Guangzhou Guangdong510320 China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University MOE Key Laboratory of System Control and Information Processing 800 Dongchuan Road Shanghai200240 China School of Electronics and Computer Science University of Southampton University Road SouthamptonSO17 1BJ United Kingdom

Sparse canonical correlation analysis (CCA) is a useful statistical tool to detect latent information with sparse structures. However, sparse CCA works only for two datasets, i.e., there are only two views or two distinct objects. To overcome this limitation, in this paper, we propose a sparse generalized canonical correlation analysis (GCCA), which could detect the latent relations of multiview data with sparse structures. Moreover, the introduced sparsity could be considered as Laplace prior on the canonical variates. Specifically, we convert the GCCA into a linear system of equations and impose 1 minimization penalty for sparsity pursuit. This results in a nonconvex problem on Stiefel manifold, which is difficult to solve. Motivated by Boyd’s consensus problem, an algorithm based on distributed alternating iteration approach is developed and theoretical consistency analysis is investigated elaborately under mild conditions. Experiments on several synthetic and real world datasets demonstrate the effectiveness of the proposed algorithm. Copyright © 2020, The Authors. All rights reserved.

关键词： Statistical mechanics

COVID-MTL: Multitask learning with shift3D and random-weighted loss for automated diagnosis and severity assessment of COVID-19

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Bao, Guoqing Chen, Huai Liu, Tongliang Gong, Guanzhong Yin, Yong Wang, Lisheng Wang, Xiuying School of Computer Science The University of Sydney J12/1 Cleveland St Darlington SydneyNSW2008 Australia Department of Automation Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Department of Radiation Oncology Shandong Cancer Hospital and Institute Shandong First Medical University Shandong Academy of Medical Sciences Jinan250117 China

There is an urgent need for automated methods to assist accurate and effective assessment of COVID-19. Radiology and nucleic acid test (NAT) are complementary COVID-19 diagnosis methods. In this paper, we present an end-to-end multitask learning (MTL) framework (COVID-MTL) that is capable of automated and simultaneous detection (against both radiology and NAT) and severity assessment of COVID-19. COVID-MTL learns different COVID-19 tasks in parallel through our novel random-weighted loss function, which assigns learning weights under Dirichlet distribution to prevent task dominance;our new 3D real-time augmentation algorithm (Shift3D) introduces space variances for 3D CNN components by shifting low-level feature representations of volumetric inputs in three dimensions;thereby, the MTL framework is able to accelerate convergence and improve joint learning performance compared to single-task models. By only using chest CT scans, COVID-MTL was trained on 930 CT scans and tested on separate 399 cases. COVID-MTL achieved AUCs of 0.939 and 0.846, and accuracies of 90.23% and 79.20% for detection of COVID-19 against radiology and NAT, respectively, which outperformed the state-of-the-art models. Meanwhile, COVID-MTL yielded AUC of 0.800 ± 0.020 and 0.813 ± 0.021 (with transfer learning) for classifying control/suspected, mild/regular, and severe/critically-ill cases. To decipher the recognition mechanism, we also identified high-throughput lung features that were significantly related (P © 2020, CC BY.

关键词： Radiology

Constructing multi-modality and multi-classifier radiomics predictive models through reliable classifier fusion

学校读者我要写书评

暂无评论

arXiv 2017年

作者： Zhou, Zhiguo Zhou, Zhi-Jie Hao, Hongxia Li, Shulong Chen, Xi Zhang, You Folkert, Michael Wang, Jing Department of Radiation Oncology UT Southwestern Medical Center DallasTX United States High-Tech Institute of Xi'an Xi'an China Department of Information and Control Engineering Xi'an University of Technology Xi'an China School of Computer Science and Technology Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education Xidian University Xi'an China School of Biomedical Engineering Southern Medical Unversity Guangzhou China Institute of Image Processing and Pattern Recognition Xi'an Jiaotong Unversity Xi'an China

Radiomics aims to extract and analyze large numbers of quantitative features from medical images and is highly promising in staging, diagnosing, and predicting outcomes of cancer treatments. Nevertheless, several challenges need to be addressed to construct an optimal radiomics predictive model. First, the predictive performance of the model may be reduced when features extracted from an individual imaging modality (e.g. PET, CT, MRI) are blindly combined into a single predictive model. Second, because many different types of classifiers are available to construct a predictive model, selecting an "optimal" classifier for a particular application is still challenging. In this work, we developed multi-modality and multi-classifier radiomics predictive models that address the aforementioned issues in currently available models. Specifically, a new reliable classifier fusion strategy was proposed to optimally combine output from different modalities and classifiers. In this strategy, modality-specific classifiers were first trained, and an analytic evidential reasoning (ER) rule was developed to fuse the output score from each modality to construct an optimal predictive model. One public datasets and two clinical case studies were performed to validate model performance. The experimental results indicated that the proposed ER rule based radiomics models outperformed the traditional models that rely on a single classifier or simply use combined features from different modalities. Copyright © 2017, The Authors. All rights reserved.

关键词： Diagnosis

Affine Non-negative Collaborative Representation Based pattern Classification

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yin, He-Feng Wu, Xiao-Jun Feng, Zhen-Hua Kittler, Josef School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence Jiangnan University Wuxi214122 China Department of Computer Science University of Surrey GuildfordGU2 7XH United Kingdom Centre for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

—During the past decade, representation-based classification methods have received considerable attention in pattern recognition. In particular, the recently proposed non-negative representation based classification (NRC) method has been reported to achieve promising results in a wide range of classification tasks. However, NRC has two major drawbacks. First, there is no regularization term in the formulation of NRC, which may result in unstable solution and misclassification. Second, NRC ignores the fact that data usually lies in a union of multiple affine subspaces, rather than linear subspaces in practical applications. To address the above issues, this paper presents an affine non-negative collaborative representation (ANCR) model for pattern classification. To be more specific, ANCR imposes a regularization term on the coding vector. Moreover, ANCR introduces an affine constraint to better represent the data from affine subspaces. The experimental results on several benchmarking datasets demonstrate the merits of the proposed ANCR method. The source code of our ANCR is publicly available at https://***/yinhefeng/ANCR. Copyright © 2020, The Authors. All rights reserved.

关键词： Vectors

image synthesis with adversarial networks: A comprehensive survey and case studies

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Shamsolmoali, Pourya Zareapoor, Masoumeh Granger, Eric Zhou, Huiyu Wang, Ruili Emre Celebi, M. Yang, Jie Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Laboratoire d’imagerie De vision et d’intelligence artificielle École de technologie supérieure Montreal Canada School of Informatics University of Leicester United Kingdom School of Natural and Computational Sciences Massey University Auckland New Zealand Department of Computer Science University of Central Arkansas United States

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a well-studied research in the GANs. GANs are powerful models for learning complex distributions to synthesize semantically meaningful samples. However, there is a lack of comprehensive review in this field, especially lack of a collection of GANs loss-variant, evaluation metrics, remedies for diverse image generation, and stable training. Given the current fast GANs development, in this survey, we provide a comprehensive review of adversarial models for image synthesis. We summarize the synthetic image generation methods, and discuss the categories including image-to-image translation, fusion image generation, label-to-image mapping, and text-to-image translation. We organize the literature based on their base models, developed ideas related to architectures, constraints, loss functions, evaluation metrics, and training datasets. We present milestones of adversarial models, review an extensive selection of previous works in various categories, and present insights on the development route from the model-based to data-driven methods. Further, we highlight a range of potential future research directions. One of the unique features of this review is that all software implementations of these GAN methods and datasets have been collected and made available in one place at https://***/pshams55/GAN-CaseStudy. © 2020, CC BY-NC-ND.

关键词： Generative adversarial networks

CNN-based invertible wavelet scattering for the investigation of diffusion properties of the in vivo human heart in diffusion tensor imaging

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Deng, Zeyu Wang, Lihui Kuai, Zixiang Chen, Qijian Cheng, Xinyu Yang, Feng Yang, Jie Zhu, Yuemin Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province College of Computer Science and Technology Guizhou University Guiyang550025 China Imaging Center Harbin Medical University Cancer Hospital Harbin150081 China School of Computer and Information Technology Beijing Jiaotong University Beijing100044 China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai200240 China University Lyon INSA Lyon CNRS Inserm IRP Metislab CREATIS UMR5220 U1206 LyonF-69621 France

In vivo diffusion tensor imaging (DTI) is a promising technique to investigate noninvasively the fiber structures of the in vivo human heart. However, signal loss due to motions remains a persistent problem in in vivo cardiac DTI. We propose a novel motion-compensation method for investigating in vivo myocardium structures in DTI with free-breathing acquisitions. The method is based on an invertible Wavelet Scattering achieved by means of Convolutional Neural Network (WSCNN). It consists of first extracting translation-invariant wavelet scattering features from DW images acquired at different trigger delays and then mapping the fused scattering features into motion-compensated spatial DW images by performing an inverse wavelet scattering transform achieved using CNN. The results on both simulated and acquired in vivo cardiac DW images showed that the proposed WSCNN method effectively compensates for motion-induced signal loss and produces in vivo cardiac DW images with better quality and more coherent fiber structures with respect to existing methods, which makes it an interesting method for measuring correctly the diffusion properties of the in vivo human heart in DTI under free breathing. Copyright © 2019, The Authors. All rights reserved.

关键词： Diffusion tensor imaging