检索结果-内蒙古大学图书馆

Exploring Fusion Strategies for Accurate RGBT Visual Object Tracking

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tang, Zhangyong Xu, Tianyang Li, Hui Wu, Xiao-Jun Zhu, XueFeng Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and decision-level fusion. Specifically, different from the existing methods, paradigm of image fusion task is heeded for fusion at pixel level. Feature-level fusion is fulfilled by attention mechanism with channels excited optionally. Besides, at decision level, a novel fusion strategy is put forward since an effortless averaging configuration has shown the superiority. The effectiveness of the proposed decision-level fusion strategy owes to a number of innovative contributions, including a dynamic weighting of the RGB and TIR contributions and a linear template update operation. A variant of which produced the winning tracker at the Visual Object Tracking Challenge 2020 (VOT-RGBT2020). The concurrent exploration of innovative pixel- and feature-level fusion strategies highlights the advantages of the proposed decision-level fusion method. Extensive experimental results on three challenging datasets, i.e., GTOT, VOT-RGBT2019, and VOT-RGBT2020, demonstrate the effectiveness and robustness of the proposed method, compared to the state-of-the-art approaches. Code will be shared at https://***/Zhangyong-Tang/DFAT. © 2022, CC BY.

关键词： Pixels

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Hui Wu, Xiao-Jun Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In the image fusion field, the design of deep learning-based fusion methods is far from routine. It is invariably fusion-task specific and requires a careful consideration. The most difficult part of the design is to choose an appropriate strategy to generate the fused image for a specific task in hand. Thus, devising learnable fusion strategy is a very challenging problem in the community of image fusion. To address this problem, a novel end-to-end fusion network architecture (RFN-Nest) is developed for infrared and visible image fusion. We propose a residual fusion network (RFN) which is based on a residual architecture to replace the traditional fusion approach. A novel detail-preserving loss function, and a feature enhancing loss function are proposed to train RFN. The fusion model learning is accomplished by a novel two-stage training strategy. In the first stage, we train an auto-encoder based on an innovative nest connection (Nest) concept. Next, the RFN is trained using the proposed loss functions. The experimental results on public domain data sets show that, compared with the existing methods, our end-to-end fusion network delivers a better performance than the state-of-the-art methods in both subjective and objective evaluation. The code of our fusion method is available at https://***/hli1221/imagefusion-rfn-nest. © 2021, CC BY-NC-ND.

关键词： Image fusion

When Face recognition Meets with Deep Learning: An Evaluation of Convolutional Neural Networks for Face recognition

学校读者我要写书评

暂无评论

When Face Recognition Meets with Deep Learning: An Evaluatio...

International Conference on computer vision Workshops (ICCV Workshops)

作者： Guosheng Hu Yongxin Yang Dong Yi Josef Kittler William Christmas Stan Z. Li Timothy Hospedales Centre for Vision Speech and Signal Processing University of Surrey UK Indicates equal contribution LEAR team Inria Grenoble Rhone-Alpes Montbonnot France Electronic Engineering and Computer Science Queen Mary University of London UK Chinese Academy of Sciences Center for Biometrics and Security Research & National Laboratory of Pattern Recognition China

Deep learning, in particular Convolutional Neural Network (CNN), has achieved promising results in face recognition recently. However, it remains an open question: why CNNs work well and how to design a 'good' architecture. The existing works tend to focus on reporting CNN architectures that work well for face recognition rather than investigate the reason. In this work, we conduct an extensive evaluation of CNN-based face recognition systems (CNN-FRS) on a common ground to make our work easily reproducible. Specifically, we use public database LFW (Labeled Faces in the Wild) to train CNNs, unlike most existing CNNs trained on private databases. We propose three CNN architectures which are the first reported architectures trained using LFW data. This paper quantitatively compares the architectures of CNNs and evaluates the effect of different implementation choices. We identify several useful properties of CNN-FRS. For instance, the dimensionality of the learned features can be significantly reduced without adverse effect on face recognition accuracy. In addition, a traditional metric learning method exploiting CNN-learned features is evaluated. Experiments show two crucial factors to good CNN-FRS performance are the fusion of multiple CNNs and metric learning. To make our work reproducible, source code and models will be made publicly available.

关键词： Face recognition Face Databases Measurement Training Object recognition Convolutional codes

Landmark-RxR: solving vision-and-language navigation with fine-grained alignment supervision 21

学校读者我要写书评

暂无评论

Landmark-RxR: solving vision-and-language navigation with fi...

Proceedings of the 35th International Conference on Neural Information Processing Systems

作者： Keji He Yan Huang Qi Wu Jianhua Yang Dong An Shuanglin Sima Liang Wang Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Artificial Intelligence University of Chinese Academy of Sciences School of Computer Science University of Adelaide School of Artificial Intelligence Beijing University of Posts and Telecommunications Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Future Technology University of Chinese Academy of Sciences Center for Research on Intelligent Perception and Computing National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences and School of Artificial Intelligence University of Chinese Academy of Sciences and Center for Excellence in Brain Science and Intelligence Technology (CEBSIT) and Chinese Academy of Sciences Artificial Intelligence Research (CAS-AIR)

ISBN: (纸本)9781713845393

In vision-and-Language Navigation (VLN) task, an agent is asked to navigate inside 3D indoor environments following given instructions. Cross-modal alignment is one of the most critical challenges in VLN because the predicted trajectory needs to match the given instruction accurately. In this paper, we address the cross-modal alignment challenge from the perspective of fine-grain. Firstly, to alleviate weak cross-modal alignment supervision from coarse-grained data, we introduce a human-annotated fine-grained VLN dataset, namely Landmark-RxR. Secondly, to further enhance local cross-modal alignment under fine-grained supervision, we investigate the focal-oriented rewards with soft and hard forms, by focusing on the critical points sampled from fine-grained Landmark-RxR. Moreover, to fully evaluate the navigation process, we also propose a re-initialization mechanism that makes metrics insensitive to difficult points, which can cause the agent to deviate from the correct trajectories. Experimental results show that our agent has superior navigation performance on Landmark-RxR, en-RxR and R2R.

关键词：

Evaluation of feature sensitivity to training data inaccuracy in detection of retinal lesions

学校读者我要写书评

暂无评论

Evaluation of feature sensitivity to training data inaccurac...

Workshops on Image Processing Theory, Tools and Applications, IPTA

作者： Lauri Laaksonen Antti Hannuksela Ela Claridge Pauli Fält Markku Hauta-Kasari Hannu Uusitalo Lasse Lensu Machine Vision and Pattern Recognition Laboratory Lappeenranta university of Technology Lappeenranta Finland School of Computer Science The University of Birmingham United Kingdom School of Computing University of Eastern Finland Finland Department of Ophthalmology University of Tampere Finland TAUH Eye Center Tampere University Hospital Finland

computer aided diagnostic and segmentation tools have become increasingly important in reducing the workload of medical experts performing diagnosis, monitoring and documentation of various eye diseases such as age-related macular degeneration (AMD), diabetic retinopathy (DR) and glaucoma. Supervised methods have been developed for the segmentation and detection of lesions, and the reported performance has been good. The supervised methods, however, need representative data to properly train the classifier. Inaccuracies in the ground truth may have a significant impact on the performance of a supervised method as the training data are not representative. In this study, a quantitative evaluation of the sensitivity of different image features, including colour, texture, edge and higher-level features, to inaccuracy in the ground truth on exudates is presented. A mean decrease of approx. 20% in sensitivity and 13% in specificity was observed when using the most inaccurate training data.

关键词： Training data Sensitivity Retina Image color analysis Image segmentation Feature extraction Lesions

Undo the codebook bias by linear transformation for visual applications 13

学校读者我要写书评

暂无评论

Undo the codebook bias by linear transformation for visual a...

21st ACM International Conference on Multimedia, MM 2013

作者： Zhang, Chunjie Zhang, Yifan Wang, Shuhui Pang, Junbiao Liang, Chao Huang, Qingming Tian, Qi School of Computer and Control Engineering University of Chinese Academy of Sciences 100049 Beijing China National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing China Key Lab of Intell. Info. Process Institute of Computing Technology Chinese Academy of Sciences Beijing 100190 China College of Computer Science and Technology Beijing University of Technology 100124 Beijing China School of Computer National Engineering Research Center for Multimedia Software Wuhan University 430072 Wuhan China Department of Computer Sciences University of Texas at San Antonio San Antonio TX 78249 United States

ISBN: (纸本)9781450324045

The bag of visual words model (BoW) and its variants have demonstrate their effectiveness for visual applications and have been widely used by researchers. The BoW model first extracts local features and generates the corresponding codebook, the elements of a codebook are viewed as visual words. The local features within each image are then encoded to get the final histogram representation. However, the codebook is dataset dependent and has to be generated for each image dataset. This costs a lot of computational time and weakens the generalization power of the BoW model. To solve these problems, in this paper, we propose to undo the dataset bias by codebook linear transformation. To represent every points within the local feature space using Euclidean distance, the number of bases should be no less than the space dimensions. Hence, each codebook can be viewed as a linear transformation of these bases. In this way, we can transform the pre-learned codebooks for a new dataset. However, not all of the visual words are equally important for the new dataset, it would be more effective if we can make some selection using sparsity constraints and choose the most discriminative visual words for transformation. We propose an alternative optimization algorithm to jointly search for the optimal linear transformation matrixes and the encoding parameters. Image classification experimental results on several image datasets show the effectiveness of the proposed method. Copyright © 2013 ACM.

关键词： Linear transformations

A new journey from SDRTV to HDRTV

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chen, Xiangyu Zhang, Zhengwen Ren, Jimmy S. Tian, Lynhoo Qiao, Yu Dong, Chao ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shanghai China SenseTime Research Shanghai China Qing Yuan Research Institute Shanghai Jiao Tong University Shanghai China Shanghai AI Laboratory Shanghai China

Nowadays modern displays are capable to render video content with high dynamic range (HDR) and wide color gamut (WCG). However, most available resources are still in standard dynamic range (SDR). Therefore, there is an urgent demand to transform existing SDR-TV contents into their HDR-TV versions. In this paper, we conduct an analysis of SDRTV-to-HDRTV task by modeling the formation of SDRTV/HDRTV content. Base on the analysis, we propose a three-step solution pipeline including adaptive global color mapping, local enhancement and highlight generation. Moreover, the above analysis inspires us to present a lightweight network that utilizes global statistics as guidance to conduct image-adaptive color mapping. In addition, we construct a dataset using HDR videos in HDR10 standard, named HDRTV1K, and select five metrics to evaluate the results of SDRTV-to-HDRTV algorithms. Furthermore, our final results achieve state-of-the-art performance in quantitative comparisons and visual quality. The code and dataset are available at https://***/ chxy95/HDRTVNet. Copyright © 2021, The Authors. All rights reserved.

关键词： Color

nnDetection: A Self-configuring Method for Medical Object Detection

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Baumgartner, Michael Jäger, Paul F. Isensee, Fabian Maier-Hein, Klaus H. Division of Medical Image Computing German Cancer Research Center Heidelberg Germany Interactive Machine Learning Group German Cancer Research Center Germany HIP Applied Computer Vision Lab. German Cancer Research Center Germany Pattern Analysis and Learning Group Heidelberg University Hospital Germany

Simultaneous localisation and categorization of objects in medical images, also referred to as medical object detection, is of high clinical relevance because diagnostic decisions often depend on rating of objects rather than e.g. pixels. For this task, the cumbersome and iterative process of method configuration constitutes a major research bottleneck. Recently, nnU-Net has tackled this challenge for the task of image segmentation with great success. Following nnU-Net’s agenda, in this work we systematize and automate the configuration process for medical object detection. The resulting self-configuring method, nnDetection, adapts itself without any manual intervention to arbitrary medical detection problems while achieving results en par with or superior to the state-of-the-art. We demonstrate the effectiveness of nnDetection on two public benchmarks, ADAM and LUNA16, and propose 11 further medical object detection tasks on public data sets for comprehensive method evaluation. Code is at https://***/MIC-DKFZ/nnDetection. Copyright © 2021, The Authors. All rights reserved.

关键词： Object recognition

Fine-Grained Topography and Modularity of the Macaque Frontal Pole Cortex Revealed by Anatomical Connectivity Profiles

学校读者我要写书评

暂无评论

Neuroscience Bulletin 2020年第12期36卷 1454-1473页

作者： Bin He Long Cao Xiaoluan Xia Baogui Zhang Dan Zhang Bo You Lingzhong Fan Tianzi Jiang School of Mechanical and Power Engineering Harbin University of Science and TechnologyHarbin 150080China Brainnetome Center Institute of AutomationChinese Academy of SciencesBeijing 100190China National Laboratory of Pattern Recognition Institute of AutomationChinese Academy of Sciences(CAS)Beijing 100190China Center for Excellence in Brain Science and Intelligence Technology Institute of AutomationCASBeijing 100190China Key Laboratory for Neuroinformation of the Ministry of Education School of Life Science and TechnologyUniversity of Electronic Science and Technology of ChinaChengdu 610054China The Queensland Brain Institute University of QueenslandBrisbaneQLD 4072Australia University of CAS Beijing 100049China College of Information and Computer Taiyuan University of TechnologyTaiyuan 030600China Chinese Institute for Brain Research Beijing 102206China Core Facility Center of Biomedical AnalysisTsinghua UniversityBeijing 100084China

The frontal pole cortex(FPC)plays key roles in various higher-order functions and is highly developed in non-human *** essential missing piece of information is the detailed anatomical connections for finer parcellation of the macaque FPC than provided by the previous tracer *** is important for understanding the functional architecture of the cerebral ***,combining cross-validation and principal component analysis,we formed a tractography-based parcellation scheme that applied a machine learning algorithm to divide the macaque FPC(2 males and 6 females)into eight subareas using high-resolution diffusion magnetic resonance imaging with the 9.4 T Bruker system,and then revealed their subregional ***,we applied improved hierarchical clustering to the obtained parcels to probe the modular structure of the subregions,and found that the dorsolateral FPC,which contains an extension to the medial FPC,was mainly connected to regions of the default-mode *** ventral FPC was mainly involved in the social-interaction network and the dorsal FPC in the metacognitive *** results enhance our understanding of the anatomy and circuitry of the macaque brain,and contribute to FPC-related clinical research.

关键词： Macaque Frontal pole cortex Anatomical connectivity profile Parcellation Neuroimaging Principal component analysis