检索结果-内蒙古大学图书馆

Exploring Fusion Strategies for Accurate RGBT Visual Object Tracking

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tang, Zhangyong Xu, Tianyang Li, Hui Wu, Xiao-Jun Zhu, XueFeng Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and decision-level fusion. Specifically, different from the existing methods, paradigm of image fusion task is heeded for fusion at pixel level. Feature-level fusion is fulfilled by attention mechanism with channels excited optionally. Besides, at decision level, a novel fusion strategy is put forward since an effortless averaging configuration has shown the superiority. The effectiveness of the proposed decision-level fusion strategy owes to a number of innovative contributions, including a dynamic weighting of the RGB and TIR contributions and a linear template update operation. A variant of which produced the winning tracker at the Visual Object Tracking Challenge 2020 (VOT-RGBT2020). The concurrent exploration of innovative pixel- and feature-level fusion strategies highlights the advantages of the proposed decision-level fusion method. Extensive experimental results on three challenging datasets, i.e., GTOT, VOT-RGBT2019, and VOT-RGBT2020, demonstrate the effectiveness and robustness of the proposed method, compared to the state-of-the-art approaches. Code will be shared at https://***/Zhangyong-Tang/DFAT. © 2022, CC BY.

关键词： Pixels

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Hui Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In the image fusion field, the design of deep learning-based fusion methods is far from routine. It is invariably fusion-task specific and requires a careful consideration. The most difficult part of the design is to choose an appropriate strategy to generate the fused image for a specific task in hand. Thus, devising learnable fusion strategy is a very challenging problem in the community of image fusion. To address this problem, a novel end-to-end fusion network architecture (RFN-Nest) is developed for infrared and visible image fusion. We propose a residual fusion network (RFN) which is based on a residual architecture to replace the traditional fusion approach. A novel detail-preserving loss function, and a feature enhancing loss function are proposed to train RFN. The fusion model learning is accomplished by a novel two-stage training strategy. In the first stage, we train an auto-encoder based on an innovative nest connection (Nest) concept. Next, the RFN is trained using the proposed loss functions. The experimental results on public domain data sets show that, compared with the existing methods, our end-to-end fusion network delivers a better performance than the state-of-the-art methods in both subjective and objective evaluation. The code of our fusion method is available at https://***/hli1221/imagefusion-rfn-nest. © 2021, CC BY-NC-ND.

关键词： Image fusion

Evaluation of feature sensitivity to training data inaccuracy in detection of retinal lesions

学校读者我要写书评

暂无评论

Evaluation of feature sensitivity to training data inaccurac...

Workshops on Image Processing Theory, Tools and Applications, IPTA

作者： Lauri Laaksonen Antti Hannuksela Ela Claridge Pauli Fält Markku Hauta-Kasari Hannu Uusitalo Lasse Lensu Machine Vision and Pattern Recognition Laboratory Lappeenranta university of Technology Lappeenranta Finland School of Computer Science The University of Birmingham United Kingdom School of Computing University of Eastern Finland Finland Department of Ophthalmology University of Tampere Finland TAUH Eye Center Tampere University Hospital Finland

computer aided diagnostic and segmentation tools have become increasingly important in reducing the workload of medical experts performing diagnosis, monitoring and documentation of various eye diseases such as age-related macular degeneration (AMD), diabetic retinopathy (DR) and glaucoma. Supervised methods have been developed for the segmentation and detection of lesions, and the reported performance has been good. The supervised methods, however, need representative data to properly train the classifier. Inaccuracies in the ground truth may have a significant impact on the performance of a supervised method as the training data are not representative. In this study, a quantitative evaluation of the sensitivity of different image features, including colour, texture, edge and higher-level features, to inaccuracy in the ground truth on exudates is presented. A mean decrease of approx. 20% in sensitivity and 13% in specificity was observed when using the most inaccurate training data.

关键词： Training data Sensitivity Retina Image color analysis Image segmentation Feature extraction Lesions

Feature refinement: An expression-specific feature learning and fusion method for micro-expression recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhou, Ling Mao, Qirong Huang, Xiaohua Zhang, Feifei Zhang, Zhihong School of Computer Science and Communication Engineering Jiangsu University ZhenjiangJiangsu212013 China School of Computer Engineering Nanjing Institute of Technology China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing100190 China Xiamen University Xiamen China Center for Machine Vision and Signal Analysis University of Oulu Finland

Micro-Expression recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for micro-expression recognition. However, they do not reveal the specific discriminative characteristics, which lead to sub-optimal performance. This paper proposes a novel Feature Refinement (FR) with expression-specific feature learning and fusion for micro-expression recognition. It aims to obtain salient and discriminative features for specific expressions and also predict expression by fusing the expression-specific features. FR consists of an expression proposal module with attention mechanism and a classification branch. First, an inception module is designed based on optical flow to obtain expression-shared features. Second, in order to extract salient and discriminative features for specific expression, expression-shared features are fed into an expression proposal module with attention factors and proposal loss. Last, in the classification branch, labels of categories are predicted by a fusion of the expression-specific features. Experiments on three publicly available databases validate the effectiveness of FR under different protocol. Results on public benchmarks demonstrate that our FR provides salient and discriminative information for micro-expression recognition. The results also show our FR achieves better or competitive performance with the existing state-of-the-art methods on micro-expression recognition. Copyright © 2021, The Authors. All rights reserved.

关键词： Deep learning

When Face recognition Meets with Deep Learning: An Evaluation of Convolutional Neural Networks for Face recognition

学校读者我要写书评

暂无评论

When Face Recognition Meets with Deep Learning: An Evaluatio...

International Conference on computer vision Workshops (ICCV Workshops)

作者： Guosheng Hu Yongxin Yang Dong Yi Josef Kittler William Christmas Stan Z. Li Timothy Hospedales Centre for Vision Speech and Signal Processing University of Surrey UK Indicates equal contribution LEAR team Inria Grenoble Rhone-Alpes Montbonnot France Electronic Engineering and Computer Science Queen Mary University of London UK Chinese Academy of Sciences Center for Biometrics and Security Research & National Laboratory of Pattern Recognition China

Deep learning, in particular Convolutional Neural Network (CNN), has achieved promising results in face recognition recently. However, it remains an open question: why CNNs work well and how to design a 'good' architecture. The existing works tend to focus on reporting CNN architectures that work well for face recognition rather than investigate the reason. In this work, we conduct an extensive evaluation of CNN-based face recognition systems (CNN-FRS) on a common ground to make our work easily reproducible. Specifically, we use public database LFW (Labeled Faces in the Wild) to train CNNs, unlike most existing CNNs trained on private databases. We propose three CNN architectures which are the first reported architectures trained using LFW data. This paper quantitatively compares the architectures of CNNs and evaluates the effect of different implementation choices. We identify several useful properties of CNN-FRS. For instance, the dimensionality of the learned features can be significantly reduced without adverse effect on face recognition accuracy. In addition, a traditional metric learning method exploiting CNN-learned features is evaluated. Experiments show two crucial factors to good CNN-FRS performance are the fusion of multiple CNNs and metric learning. To make our work reproducible, source code and models will be made publicly available.

关键词： Face recognition Face Databases Measurement Training Object recognition Convolutional codes

ICDAR2019 Robust reading challenge on multi-lingual scene text detection and recognition – RRC-MLT-2019

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Nayef, Nibal Patel, Yash Busta, Michal Chowdhury, Pinaki Nath Karatzas, Dimosthenis Khlif, Wafa Matas, Jiri Pal, Umapada Burie, Jean-Christophe Liu, Cheng-lin Ogier, Jean-Marc L3i Laboratory University of La Rochelle France Computer Vision Center Universitat Autònoma de Barcelona Spain CVPR unit Indian Statistical Institute India Robotics Institute Carnegie Mellon Universiry Pittsburgh United States Center for Machine Perception Department of Cybernetics Czech Technical University Prague Czech Republic National Laboratory of Pattern Recognition Institute of Automation of Chinese Academy of Sciences China

With the growing cosmopolitan culture of modern cities, the need of robust Multi-Lingual scene Text (MLT) detection and recognition systems has never been more immense. With the goal to systematically benchmark and push the state-of-the-art forward, the proposed competition builds on top of the RRC-MLT-2017 with an additional end-to-end task, an additional language in the real images dataset, a large scale multi-lingual synthetic dataset to assist the training, and a baseline End-to-End recognition method. The real dataset consists of 20,000 images containing text from 10 languages. The challenge has 4 tasks covering various aspects of multi-lingual scene text: (a) text detection, (b) cropped word script classification, (c) joint text detection and script classification and (d) end-to-end detection and recognition. In total, the competition received 60 submissions from the research and industrial communities. This paper presents the dataset, the tasks and the findings of the presented RRC-MLT-2019 challenge. Copyright © 2019, The Authors. All rights reserved.

关键词： Large dataset

BasicVSR: The search for essential components in video super-resolution and beyond

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Chan, Kelvin C.K. Wang, Xintao Yu, Ke Dong, Chao Loy, Chen Change S-Lab Nanyang Technological University Singapore Applied Research Center Tencent PCG CUHK – SenseTime Joint Lab Chinese University of Hong Kong Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China

Video super-resolution (VSR) approaches tend to have more components than the image counterparts as they need to exploit the additional temporal dimension. Complex designs are not uncommon. In this study, we wish to untangle the knots and reconsider some most essential components for VSR guided by four basic functionalities, i.e., Propagation, Alignment, Aggregation, and Upsampling. By reusing some existing components added with minimal redesigns, we show a succinct pipeline, BasicVSR, that achieves appealing improvements in terms of speed and restoration quality in comparison to many state-of-the-art algorithms. We conduct systematic analysis to explain how such gain can be obtained and discuss the pitfalls. We further show the extensibility of BasicVSR by presenting an information-refill mechanism and a coupled propagation scheme to facilitate information aggregation. The BasicVSR and its extension, IconVSR, can serve as strong baselines for future VSR approaches. © 2020, CC BY.

关键词： Optical resolving power

Collaborative Multi-View Convolutions With Gating For Accurate And Fast Volumetric Medical Image Segmentation

学校读者我要写书评

暂无评论

Collaborative Multi-View Convolutions With Gating For Accura...

IEEE International Symposium on Biomedical Imaging

作者： Cheng Li Jin Ye Junjun He Shanshan Wang Lixu Gu Yu Qiao Paul C. Lauterbur Research Center for Biomedical Imaging SIAT CAS Shenzhen China Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab SIAT CAS Shenzhen China SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China School of Biomedical Engineering/the Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China

ISBN: (纸本)9781665412469;9781665429474

Due to their high capacity in capturing 3D spatial information, 3D Fully Convolutional Neural Networks (3D FCNs), especially 3D U-Net, are prevalent for volumetric medical image segmentation. However, 3D convolutions are much more computationally complex than 2D convolutions and thus, are more prone to overfitting. This paper proposes Collaborative Multi-View convolutions (CMV convs) that can keep the model complexity similar to those employing 2D convolutions while capturing the 3D spatial context like 3D convolutions. Specifically, CMV convs simultaneously extract information from three orthogonal views with three parameter-shared 2D convolutions. A Global-Guided Gating mechanism (3G) is further designed that selectively passes information from CMV convs to the next stage. Combined with 3G, a CMV conv become a G-CMV conv that constitutes a plug-and-play module, which can be easily integrated into various 3D CNNs for image segmentation. Extensive experiments utilizing BraTS18 dataset have been conducted. Our method achieves competitive results compared to state-of-the-art methods with over 10× fewer parameters than 3D-UNet.

关键词： Solid modeling Image segmentation Interpolation Three-dimensional displays Computational modeling Biological system modeling Collaboration

A new convolutional neural network based on a saprse convolutional layer for animal face detection

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2021年

作者： Jarraya, Islem BenSaid, Fatma Ouarda, Wael Pal, Umapada Alimi, Adel M. BP 1173 Sfax3038 Tunisia Digital Research Center of Sfax B.P. 275 Sakiet Ezzit Sfax3021 Tunisia Computer Vision and Pattern Recognition Unit Indian Statistical Institute 203 B.T. Road Kolkata700 108 India Department of Electrical and Electronic Engineering Science Faculty of Engineering and the Built Environment University of Johannesburg South Africa

This paper focuses on the face detection problem of three popular animal categories that need control such as horses, cats and dogs. To be precise, a new Convolutional Neural Network for Animal Face Detection (CNNAFD) is actually investigated using processed filters based on gradient features and applied with a new way. A new convolutional layer is proposed through a sparse feature selection method known as Automated Negotiation-based Online Feature Selection (ANOFS). CNNAFD ends by stacked fully connected layers which represent a strong classifier. The fusion of CNNAFD and MobileNetV2 constructs the new network CNNAFD-MobileNetV2 which improves the classification results and gives better detection decisions. Our work also introduces a new Tunisian Horse Detection Database (THDD). The proposed detector with the new CNNAFDMobileNetV2 network achieved an average precision equal to 99.78%, 99% and 98.28% for cats, dogs and horses respectively. © 2021, CC BY.

关键词： Animals