检索结果-内蒙古大学图书馆

TTPP: Temporal transformer with progressive prediction for efficient action anticipation

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Wen Peng, Xiaojiang Su, Yanzhou Qiao, Yu Cheng, Jian School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu Sichuan611731 China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab. Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society

Video action anticipation aims to predict future action categories from observed frames. Current state-of-the-art approaches mainly resort to recurrent neural networks to encode history information into hidden states, and predict future actions from the hidden representations. It is well known that the recurrent pipeline is inefficient in capturing long-term information which may limit its performance in predication task. To address this problem, this paper proposes a simple yet efficient Temporal Transformer with Progressive Prediction (TTPP) framework, which repurposes a Transformer-style architecture to aggregate observed features, and then leverages a light-weight network to progressively predict future features and actions. Specifically, predicted features along with predicted probabilities are accumulated into the inputs of subsequent prediction. We evaluate our approach on three action datasets, namely TVSeries, THUMOS-14, and TV-Human-Interaction. Additionally we also conduct a comprehensive study for several popular aggregation and prediction strategies. Extensive results show that TTPP not only outperforms the state-of-the-art methods but also more efficient. Copyright © 2020, The Authors. All rights reserved.

关键词： Forecasting

BasicVSR: The search for essential components in video super-resolution and beyond

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chan, Kelvin C.K. Wang, Xintao Yu, Ke Dong, Chao Loy, Chen Change S-Lab Nanyang Technological University Singapore Applied Research Center Tencent PCG CUHK – SenseTime Joint Lab Chinese University of Hong Kong Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China

Video super-resolution (VSR) approaches tend to have more components than the image counterparts as they need to exploit the additional temporal dimension. Complex designs are not uncommon. In this study, we wish to untangle the knots and reconsider some most essential components for VSR guided by four basic functionalities, i.e., Propagation, Alignment, Aggregation, and Upsampling. By reusing some existing components added with minimal redesigns, we show a succinct pipeline, BasicVSR, that achieves appealing improvements in terms of speed and restoration quality in comparison to many state-of-the-art algorithms. We conduct systematic analysis to explain how such gain can be obtained and discuss the pitfalls. We further show the extensibility of BasicVSR by presenting an information-refill mechanism and a coupled propagation scheme to facilitate information aggregation. The BasicVSR and its extension, IconVSR, can serve as strong baselines for future VSR approaches. © 2020, CC BY.

关键词： Optical resolving power

Are fast labeling methods reliable? A case study of computer-aided expert annotations on microscopy slides

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Marzahl, Christian Bertram, Christof A. Aubreville, Marc Petrick, Anne Weiler, Kristina Glasel, Agnes C. Fragoso, Marco Merz, Sophie Bartenschlager, Florian Hoppe, Judith Langenhagen, Alina Jasensky, Anne Voigt, Jorn Klopeisch, Robert Maier, Andreas Pattern Recognition Lab Department of Computer Science Friedrich-Alexander-Universitat Research and Development EUROIMMUN Medizinische Labordiagnostika AG Institute of Veterinary Pathology Freie Universitat Berlin Department of Veterinary Clinical Sciences Clinical Pathology and Clinical Pathophysiology Justus-Liebig-University Giessen

Deep-learning-based pipelines have shown the potential to revolutionalize microscopy image diagnostics by providing visual augmentations and evaluations to a trained pathology expert. However, to match human performance, the methods rely on the availability of vast amounts of high-quality labeled data, which poses a significant challenge. To circumvent this, augmented labeling methods, also known as expert-algorithm-collaboration, have recently become popular. However, potential biases introduced by this operation mode and their effects for training deep neuronal networks are not entirely understood. This work aims to shed light on some of the effects by providing a case study for three pathologically relevant diagnostic settings. Ten trained pathology experts performed a labeling tasks first without and later with computergenerated augmentation. To investigate different biasing effects, we intentionally introduced errors to the augmentation. Furthermore, we developed a novel loss function which incorporates the experts' annotation consensus in the training of a deep learning classifier. In total, the pathology experts annotated 26,015 cells on 1,200 images in this novel annotation study. Backed by this extensive data set, we found that the consensus of multiple experts and the deep learning classifier accuracy, was significantly increased in the computer-aided setting, versus the unaided annotation. However, a significant percentage of the deliberately introduced false labels was not identified by the experts. Additionally, we showed that our loss function profited from multiple experts and outperformed conventional loss functions. At the same time, systematic errors did not lead to a deterioration of the trained classifier accuracy. Furthermore, a deep learning classifier trained with annotations from a single expert with computer-aided support can outperform the combined annotations from up to nine experts. Copyright © 2020, The Authors. All rights reserved.

关键词： Pathology

Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Network

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Wenjie Li, Juncheng Gao, Guangwei Deng, Weihong Yang, Jian Qi, Guo-Jun Lin, Chia-Wen Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100080 China Intelligent Visual Information Perception Laboratory Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210046 China Key Laboratory of Artificial Intelligence Ministry of Education Shanghai200240 China Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China School of Communication and Information Engineering Shanghai University Shanghai200444 China School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210094 China Research Center for Industries of the Future the School of Engineering Westlake University Hangzhou310024 China OPPO Research SeattleWA98101 United States Department of Electrical Engineering National Tsing Hua University Hsinchu30013 Taiwan

Lightweight image super-resolution aims to reconstruct high-resolution images from low-resolution images using low computational costs. However, existing methods result in the loss of middle-layer features due to activation functions. To minimize the impact of intermediate feature loss on reconstruction quality, we propose a Feature Interaction Weighted Hybrid Network (FIWHN), which comprises a series of Wide-residual Distillation Interaction Block (WDIB) as the backbone. Every third WDIB forms a Feature Shuffle Weighted Group (FSWG) by applying mutual information shuffle and fusion. Moreover, to mitigate the negative effects of intermediate feature loss, we introduce Wide Residual Weighting units within WDIB. These units effectively fuse features of varying levels of detail through a Wide-residual Distillation Connection (WRDC) and a Self-Calibrating Fusion (SCF). To compensate for global feature deficiencies, we incorporate a Transformer and explore a novel architecture to combine CNN and Transformer. We show that our FIWHN achieves a favorable balance between performance and efficiency through extensive experiments on low-level and high-level tasks. Codes will be available at https://***/IVIPLab/FIWHN. Copyright © 2022, The Authors. All rights reserved.

关键词： Image reconstruction

ICDAR 2019 CROHME + TFD: Competition on recognition of Handwritten Mathematical Expressions and Typeset Formula Detection

学校读者我要写书评

暂无评论

ICDAR 2019 CROHME + TFD: Competition on Recognition of Handw...

International Conference on Document Analysis and recognition

作者： Mahshad Mahdavi Richard Zanibbi Harold Mouchere Christian Viard-Gaudin Utpal Garain Document and Pattern Recognition Lab Rochester Institute of Technology Rochester NY USA University of Nantes Nantes France LS2N - UMR CNRS 6004 University of Nantes Nantes France Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India

We summarize the tasks, protocol, and outcome for the 6th Competition on recognition of Handwritten Mathematical Expressions (CROHME), which includes a new formula detection in document images task (+ TFD). For CROHME + TFD 2019, participants chose between two tasks for recognizing handwritten formulas from 1) online stroke data, or 2) images generated from the handwritten strokes. To compare LATEX strings and the labeled directed trees over strokes (label graphs) used in previous CROHMEs, we convert LATEX and stroke-based label graphs to label graphs defined over symbols (symbol-level label graphs, or symLG). More than thirty (33) participants registered for the competition, with nineteen (19) teams submitting results. The strongest formula recognition results were produced by the USTC-iFLYTEK research team, for both stroke-based (81%) and image-based (77%) input. For the new typeset formula detection task, the Samsung R&D institute Ukraine (Team 2) obtained a very strong F-score (93%). System performance has improved since the last CROHME - still, the competition results suggest that recognition of handwritten formulae remains a difficult structural pattern recognition task.

关键词： Task analysis Handwriting recognition Tools Measurement Layout Image recognition

A novel hybrid convolutional neural network for accurate organ segmentation in 3d head and neck CT images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chen, Zijie Li, Cheng He, Junjun Ye, Jin Song, Diping Wang, Shanshan Gu, Lixu Qiao, Yu Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China Shanghai AI Lab Shanghai China Shenzhen Yino Intelligence Techonology Co. Ltd. Guangdong Shenzhen China Co. Ltd. Guangdong Shenzhen China Paul C. Lauterbur Research Center for Biomedical Imaging Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China School of Biomedical Engineering Shanghai Jiao Tong University Shanghai China Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China Peng Cheng Laboratory Guangdong Shenzhen China Pazhou Lab Guangdong Guangzhou China

Radiation therapy (RT) is widely employed in the clinic for the treatment of head and neck (HaN) cancers. An essential step of RT planning is the accurate segmentation of various organs-at-risks (OARs) in HaN CT images. Nevertheless, segmenting OARs manually is time-consuming, tedious, and error-prone considering that typical HaN CT images contain tens to hundreds of slices. Automated segmentation algorithms are urgently required. Recently, convolutional neural networks (CNNs) have been extensively investigated on this task. Particularly, 3D CNNs are frequently adopted to process 3D HaN CT images. There are two issues with naïve 3D CNNs. First, the depth resolution of 3D CT images is usually several times lower than the in-plane resolution. Direct employment of 3D CNNs without distinguishing this difference can lead to the extraction of distorted image features and influence the final segmentation performance. Second, a severe class imbalance problem exists, and large organs can be orders of times larger than small organs. It is difficult to simultaneously achieve accurate segmentation for all the organs. To address these issues, we propose a novel hybrid CNN that fuses 2D and 3D convolutions to combat the different spatial resolutions and extract effective edge and semantic features from 3D HaN CT images. To accommodate large and small organs, our final model, named Organ-Net2.5D, consists of only two instead of the classic four downsampling operations, and hybrid dilated convolutions are introduced to maintain the respective field. Experiments on the MICCAI 2015 challenge dataset demonstrate that OrganNet2.5D achieves promising performance compared to state-of-the-art methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Wenjie Li, Juncheng Gao, Guangwei Deng, Weihong Zhou, Jiantao Yang, Jian Qi, Guo-Jun The Intelligent Visual Information Perception Laboratory Institute of Advanced Technology Nanjing University of Posts and Telecommunications Nanjing210046 China The Provincial Key Laboratory for Computer Information Processing Technology Soochow University Suzhou215006 China The School of Communication and Information Engineering Shanghai University Shanghai200444 China Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Nanjing University of Science and Technology Nanjing210094 China The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China The State Key Laboratory of Internet of Things for Smart City Department of Computer and Information Science Faculty of Science and Technology University of Macau 999078 China The School of Computer Science and Technology Nanjing University of Science and Technology Nanjing210094 China The Research Center for Industries of the Future The School of Engineering Westlake University Hangzhou310024 China OPPO Research SeattleWA98101 United States

Recently, Transformer-based methods have shown impressive performance in single image super-resolution (SISR) tasks due to the ability of global feature extraction. However, the capabilities of Transformers that need to incorporate contextual information to extract features dynamically are neglected. To address this issue, we propose a lightweight Cross-receptive Focused Inference Network (CFIN) that consists of a cascade of CT Blocks mixed with CNN and Transformer. Specifically, in the CT block, we first propose a CNN-based Cross-Scale Information Aggregation Module (CIAM) to enable the model to better focus on potentially helpful information to improve the efficiency of the Transformer phase. Then, we design a novel Cross-receptive Field Guided Transformer (CFGT) to enable the selection of contextual information required for reconstruction by using a modulated convolutional kernel that understands the current semantic information and exploits the information interaction within different self-attention. Extensive experiments have shown that our proposed CFIN can effectively reconstruct images using contextual information, and it can strike a good balance between computational cost and model performance as an efficient model. Source codes will be available at https://***/IVIPLab/CFIN. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantics

CRNN based jersey-bib number/text recognition in sports and marathon images 15

学校读者我要写书评

暂无评论

CRNN based jersey-bib number/text recognition in sports and ...

15th IAPR International Conference on Document Analysis and recognition, ICDAR 2019

作者： Nag, Sauradip Ramachandra, Raghavendra Shivakumara, Palaiahnakote Pal, Umapada Lu, Tong Kankanhalli, Mohan Department of Computer Science & Engineering Kalyani Government Engineering College Kalyani India Faculty of Information Technology and Electrical Engineering Norwegian University of Science and Technology Norway Faculty of Computer System and Information Technology University of Malaya Malaysia Computer Vision and Pattern Recognition Unit Indian Statistical Institute Kolkata India National Key Lab for Novel Software Technology Nanjing University China Department of Computer Science School of Computing National University of Singapore Singapore Singapore

ISBN: (纸本)9781728128610

The primary challenge in tracing the participants in sports and marathon video or images is to detect and localize the jersey/Bib number that may present in different regions of their outfit captured in cluttered environment conditions. In this work, we proposed a new framework based on detecting the human body parts such that both Jersey Bib number and text is localized reliably. To achieve this, the proposed method first detects and localize the human in a given image using Single Shot Multibox Detector (SSD). In the next step, different human body parts namely, Torso, Left Thigh, Right Thigh, that generally contain a Bib number or text region is automatically extracted. These detected individual parts are processed individually to detect the Jersey Bib number/text using a deep CNN network based on the 2-channel architecture based on the novel adaptive weighting loss function. Finally, the detected text is cropped out and fed to a CNN-RNN based deep model abbreviated as CRNN for recognizing jersey/Bib/text. Extensive experiments are carried out on the four different datasets including both bench-marking dataset and a new dataset. The performance of the proposed method is compared with the state-of-the-art methods on all four datasets that indicates the improved performance of the proposed method on all four datasets. © 2019 IEEE.

关键词： Sports

Auxiliary Demographic Information Assisted Age Estimation With Cascaded Structure

学校读者我要写书评

暂无评论

IEEE TRANSACTIONS ON CYBERNETICS 2018年第9期48卷 2531-2541页

作者： Wan, Jun Tan, Zichang Lei, Zhen Guo, Guodong Li, Stan Z. Center for Biometrics and Security Research and the National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing China Lane Department of Computer Science and Electrical Engineering West Virginia University Morgantown WV USA

Owing to the variations including both intrinsic and extrinsic factors, age estimation remains a challenging problem. In this paper, five cascaded structure frameworks are proposed for age estimation based on convolutional neural networks. All frameworks are learned and guided by auxiliary demographic information, since other demographic information (i.e., gender and race) is beneficial for age prediction. Each cascaded structure framework is embodied in a parent network and several subnetworks. For example, one of the applied framework is a gender classifier trained by gender information, and then two subnetworks are trained by the male and female samples, respectively. Furthermore, we use the features extracted from the cascaded structure frameworks with Gaussian process regression that can boost the performance further for age estimation. Experimental results on the MORPH II and CACD datasets have gained superior performances compared to the state-of-the-art methods. The mean absolute error is significantly reduced from 3.63 to 2.93 years under the same test protocol on the MORPH II dataset.

关键词： Age estimation convolutional neural networks (CNNs) demographic Gaussian process regression (GPR)