检索结果-内蒙古大学图书馆

arXiv 2021年

作者： Fu, Kexue Liu, Shaolei Luo, Xiaoyuan Wang, Manning Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention China

3D point cloud registration is a fundamental problem in computer vision and robotics. There has been extensive research in this area, but existing methods meet great challenges in situations with a large proportion of outliers and time constraints, but without good transformation initialization. Recently, a series of learning-based algorithms have been introduced and show advantages in speed. Many of them are based on correspondences between the two point clouds, so they do not rely on transformation initialization. However, these learning-based methods are sensitive to outliers, which lead to more incorrect correspondences. In this paper, we propose a novel deep graph matching-based framework for point cloud registration. Specifically, we first transform point clouds into graphs and extract deep features for each point. Then, we develop a module based on deep graph matching to calculate a soft correspondence matrix. By using graph matching, not only the local geometry of each point but also its structure and topology in a larger range are considered in establishing correspondences, so that more correct correspondences are found. We train the network with a loss directly defined on the correspondences, and in the test stage the soft correspondences are transformed into hard one-to-one correspondences so that registration can be performed by singular value decomposition. Furthermore, we introduce a transformer-based method to generate edges for graph construction, which further improves the quality of the correspondences. Extensive experiments on registering clean, noisy, partial-to-partial and unseen category point clouds show that the proposed method achieves state-of-the-art performance. The code will be made publicly available at https://***/fukexue/RGM. Copyright © 2021, The Authors. All rights reserved.

关键词： Surface measurement

来源：评论

学校读者我要写书评

暂无评论

Dual Attention Poser: Dual Path Body Tracking Based on Attention

Dual Attention Poser: Dual Path Body Tracking Based on Atten...

引用

IEEE computer society Conference on computer Vision and Pattern Recognition Workshops (CVPRW)

作者： Xinhan Di Xiaokun Dai Xinkang Zhang Xinrong Chen Deepearthgo Academy for Engineering&Technology Fudan Universiry Shanghai Key Laboratory of Medical Image Computing and Computer Assisted Intervention Fudan University

Currently, mixed reality head-mounted displays tracking the full body of users is an important human-computer interaction mode through the pose of the head and the hands. Unfortunately, users’ virtual representation and experience is limited due to high reconstruction error when simple transformer network architecture is applied. In this paper, we present a novel model, named Dual Attention Poser, which can learn the whole body reconstruction at a high accuracy. The proposed model consists of three key modules. Among them, dual-path attention encoder is designed to extract feature of the sparse signals. Cross attention mixer module enable the fusion of representation in the double path. Attention-gated-mlp decoder is applied to decode the hidden feature from the sparse input through attention gate. Test results on the AMASS dataset show that Dual Attention Poser can reduce the error by up to 18.2% in comparison with the state-of-the-art results.

关键词：

来源：评论

学校读者我要写书评

暂无评论

The Rise of AI Language Pathologists: Exploring Two-level Prompt Learning for Few-shot Weakly-supervised Whole Slide image Classification

arXiv

引用

arXiv 2023年

作者： Qu, Linhao Luo, Xiaoyuan Fu, Kexue Wang, Manning Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention China

This paper introduces the novel concept of few-shot weakly supervised learning for pathology Whole Slide image (WSI) classification, denoted as FSWC. A solution is proposed based on prompt learning and the utilization of a large language model, GPT-4. Since a WSI is too large and needs to be divided into patches for processing, WSI classification is commonly approached as a Multiple Instance Learning (MIL) problem. In this context, each WSI is considered a bag, and the obtained patches are treated as instances. The objective of FSWC is to classify both bags and instances with only a limited number of labeled bags. Unlike conventional few-shot learning problems, FSWC poses additional challenges due to its weak bag labels within the MIL framework. Drawing inspiration from the recent achievements of vision-language models (V-L models) in downstream few-shot classification tasks, we propose a two-level prompt learning MIL framework tailored for pathology, incorporating language prior knowledge. Specifically, we leverage CLIP to extract instance features for each patch, and introduce a prompt-guided pooling strategy to aggregate these instance features into a bag feature. Subsequently, we employ a small number of labeled bags to facilitate few-shot prompt learning based on the bag features. Our approach incorporates the utilization of GPT-4 in a question- and-answer mode to obtain language prior knowledge at both the instance and bag levels, which are then integrated into the instance and bag level language prompts. Additionally, a learnable component of the language prompts is trained using the available few-shot labeled data. We conduct extensive experiments on three real WSI datasets encompassing breast cancer, lung cancer, and cervical cancer, demonstrating the notable performance of the proposed method in bag and instance classification. Codes will be available at https://***/miccaiif/TOP. Copyright © 2023, The Authors. All rights reserved.

关键词： Pathology

来源：评论

学校读者我要写书评

暂无评论

Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide image Classification

arXiv

引用

arXiv 2022年

作者： Qu, Linhao Luo, Xiaoyuan Wang, Manning Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention China

computer-aided pathology diagnosis based on the classification of Whole Slide image (WSI) plays an important role in clinical practice, and it is often formulated as a weakly-supervised Multiple Instance Learning (MIL) problem. Existing methods solve this problem from either a bag classification or an instance classification perspective. In this paper, we propose an end-to-end weakly supervised knowledge distillation framework (WENO) for WSI classification, which integrates a bag classifier and an instance classifier in a knowledge distillation framework to mutually improve the performance of both classifiers. Specifically, an attention-based bag classifier is used as the teacher network, which is trained with weak bag labels, and an instance classifier is used as the student network, which is trained using the normalized attention scores obtained from the teacher network as soft pseudo labels for the instances in positive bags. An instance feature extractor is shared between the teacher and the student to further enhance the knowledge exchange between them. In addition, we propose a hard positive instance mining strategy based on the output of the student network to force the teacher network to keep mining hard positive instances. WENO is a plug-and-play framework that can be easily applied to any existing attention-based bag classification methods. Extensive experiments on five datasets demonstrate the efficiency of WENO. Code is available at https://***/miccaiif/WENO. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Motion Classification Based on sEMG Signals Using Deep Learning 4th

Motion Classification Based on sEMG Signals Using Deep Learn...

引用

4th International Conference on Machine Learning and Intelligent Communications, MLICOM 2019

作者： Shen, Shu Gu, Kang Chen, Xinrong Wang, Ruchuan School of Computer Science Nanjing University of Posts and Telecommunications Nanjing210023 China Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks Nanjing210023 China Academy for Engineering and Technology Fudan University Shanghai200433 China Shanghai Key Laboratory of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China

ISBN: (纸本)9783030323875

Nowadays, surface electromyography (sEMG) signal plays an important role in helping physically disabled people during daily life. The development of electronic information technology has also led to the emergence of low-cost, multi-channel, wearable sEMG signal acquisition devices. Therefore, this paper proposes a new motion recognition model based on deep learning to improve the accuracy of motion recognition of sEMG signals. The model uses architecture including 6 convolutional layers and 6 pooling layers which enables the Batch Normalization layer to enhance network performance and prevent overfitting. In the experiment, NinaPro DB5 data set was used for training and testing. The data set consists of sEMG signal data collected by the double Myo armbands which contains data of 52 movements for 10 subjects. The results show that the accuracy of about 90% can be achieved when using 52 sEMG signal data from every single subject or all subjects. © 2019, ICST Institute for computer Sciences, Social Informatics and Telecommunications Engineering.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

TransFuse: A Unified Transformer-based image Fusion Framework using Self-supervised Learning

arXiv

引用

arXiv 2022年

作者： Qu, Linhao Liu, Shaolei Wang, Manning Li, Shiman Yin, Siqi Qiao, Qin Song, Zhijian Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai200032 China

image fusion is a technique to integrate information from multiple source images with complementary information to improve the richness of a single image. Due to insufficient task-specific training data and corresponding ground truth, most existing end-to-end image fusion methods easily fall into overfitting or tedious parameter optimization processes. Two-stage methods avoid the need of large amount of task-specific training data by training encoder-decoder network on large natural image datasets and utilizing the extracted features for fusion, but the domain gap between natural images and different fusion tasks results in limited performance. In this study, we design a novel encoder-decoder based image fusion framework and propose a destruction-reconstruction based self-supervised training scheme to encourage the network to learn task-specific features. Specifically, we propose three destruction-reconstruction self-supervised auxiliary tasks for multi-modal image fusion, multi-exposure image fusion and multi-focus image fusion based on pixel intensity non-linear transformation, brightness transformation and noise transformation, respectively. In order to encourage different fusion tasks to promote each other and increase the generalizability of the trained network, we integrate the three self-supervised auxiliary tasks by randomly choosing one of them to destroy a natural image in model training. In addition, we design a new encoder that combines CNN and Transformer for feature extraction, so that the trained model can exploit both local and global information. Extensive experiments on multi-modal image fusion, multi-exposure image fusion and multi-focus image fusion tasks demonstrate that our proposed method achieves the state-of-the-art performance in both subjective and objective evaluations. The code will be publicly available soon. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

DGMIL: Distribution Guided Multiple Instance Learning for Whole Slide image Classification

arXiv

引用

arXiv 2022年

作者： Qu, Linhao Luo, Xiaoyuan Liu, Shaolei Wang, Manning Song, Zhijian Digital Medical Research Center School of Basic Medical Science Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Fudan University Shanghai200032 China

Multiple Instance Learning (MIL) is widely used in analyzing histopathological Whole Slide images (WSIs). However, existing MIL methods do not explicitly model the data distribution, and instead they only learn a bag-level or instance-level decision boundary discriminatively by training a classifier. In this paper, we propose DGMIL: a feature distribution guided deep MIL framework for WSI classification and positive patch localization. Instead of designing complex discriminative network architectures, we reveal that the inherent feature distribution of histopathological image data can serve as a very effective guide for instance classification. We propose a cluster-conditioned feature distribution modeling method and a pseudo label-based iterative feature space refinement strategy so that in the final feature space the positive and negative instances can be easily separated. Experiments on the CAMELYON16 dataset and the TCGA Lung Cancer dataset show that our method achieves new SOTA for both global classification and positive patch localization tasks. Copyright © 2022, The Authors. All rights reserved.

关键词： image classification

来源：评论

学校读者我要写书评

暂无评论

Rethinking Multi-Exposure image Fusion with Extreme and Diverse Exposure Levels: A Robust Framework Based on Fourier Transform and Contrastive Learning

SSRN

引用

SSRN 2022年

作者： Qu, Linhao Liu, Shaolei Wang, Manning Song, Zhijian Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai200032 China

Multi-exposure image fusion (MEF) is an important technique for generating high dynamic range images. However, most existing MEF studies focus on fusing a moderately over-exposed image and a moderately under-exposed image, and they are not robust in fusing images with extreme and diverse exposure levels. In this paper, we propose a robust MEF framework based on Fourier transform and contrastive learning. Specifically, we develop a Fourier transform-based pixel intensity transfer strategy to synthesize images with diverse exposure levels from normally exposed natural images and train an encoder-decoder network to reconstruct the original natural image. In this way, the encoder and decoder can learn to extract features from images with diverse exposure levels and generate fused images with normal exposure. We propose a contrastive regularization loss to further enhance the capability of the network in recovering normal exposure levels. In addition, we construct an extreme MEF benchmark dataset and a random MEF benchmark dataset for a more comprehensive evaluation of MEF algorithms. We extensively compare our method with nine competitive traditional and deep learning-based MEF algorithms on three benchmark datasets, and our method outperforms the other methods in both subjective visual effects and objective evaluation metrics. Our code, datasets and all fused images will be released. © 2022, The Authors. All rights reserved.

关键词： Fourier transforms

来源：评论

学校读者我要写书评

暂无评论

Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological image Analysis

arXiv

引用

arXiv 2022年

作者： Qu, Linhao Liu, Siyu Liu, Xiaoyu Wang, Manning Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China

Histopathological images contain abundant phenotypic information and pathological patterns, which are the gold standards for disease diagnosis and essential for the prediction of patient prognosis and treatment outcome. In recent years, computer-automated analysis techniques for histopathological images have been urgently required in clinical practice, and deep learning methods represented by convolutional neural networks have gradually become the mainstream in the field of digital pathology. However, obtaining large numbers of fine-grained annotated data in this field is a very expensive and difficult task, which hinders the further development of traditional supervised algorithms based on large numbers of annotated data. More recent studies have started to liberate from the traditional supervised paradigm, and the most representative ones are the studies on weakly supervised learning paradigm based on weak annotation, semi-supervised learning paradigm based on limited annotation, and self-supervised learning paradigm based on pathological image representation learning. These new methods have led a new wave of automatic pathological image diagnosis and analysis targeted at annotation efficiency. With a survey of over 130 papers, we present a comprehensive and systematic review of the latest studies on weakly supervised learning, semi-supervised learning, and self-supervised learning in the field of computational pathology from both technical and methodological perspectives. Finally, we present the key challenges and future trends for these techniques. Copyright © 2022, The Authors. All rights reserved.

关键词： Surveys

来源：评论

学校读者我要写书评

暂无评论

Transfuse: A Unified Transformer-Based image Fusion Framework Using Self-Supervised Learning

SSRN

引用

SSRN 2022年

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：