检索结果-内蒙古大学图书馆

Organ at risk segmentation in head and neck CT images by using a two-stage segmentation framework based on 3D U-Net

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Wang, Yueyue Zhao, Liang Song, Zhijian Wang, Manning School of Basic Medical Science Fudan University Shanghai200032 China Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention Digital Medical Research Center Fudan University Shanghai200032 China

Accurate segmentation of organ at risk (OAR) play a critical role in the treatment planning of image guided radiation treatment of head and neck cancer. This segmentation task is challenging for both human and automatic algorithms because of the relatively large number of OARs to be segmented, the large variability of the size and morphology across different OARs, and the low contrast of between some OARs and the background. In this paper, we proposed a two-stage segmentation framework based on 3D U-Net. In this framework, the segmentation of each OAR is decomposed into two sub-tasks: locating a bounding box of the OAR and segment it from a small volume within the bounding box, and each sub-tasks is fulfilled by a dedicated 3D U-Net. The decomposition makes each of the two sub-tasks much easier, so that they can be better completed. We evaluated the proposed method and compared it to state-of-the-art methods by using the MICCAI 2015 Challenge dataset. In terms of the boundary-based metric 95HD, the proposed method ranked first in eight of all nine OARs and ranked second in the other OAR. In terms of the area-based metric DSC, the proposed method ranked first in six of the nine OARs and ranked second in the other three OARs with small difference with the first one. Copyright © 2018, The Authors. All rights reserved.

关键词： computerized tomography

Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signals

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hu, Qihan Wang, Daomiao Wu, Hong Liu, Jian Yang, Cuiwei Center for Biomedical Engineering School of Information Science and Technology Fudan University Shanghai200433 China Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention Shanghai200093 China

The progression of deep learning and the widespread adoption of sensors have facilitated automatic multi-view fusion (MVF) about the cardiovascular system (CVS) signals. However, prevalent MVF model architecture often amalgamates CVS signals from the same temporal step but different views into a unified representation, disregarding the asynchronous nature of cardiovascular events and the inherent heterogeneity across views, leading to catastrophic view confusion. Efficient training strategies specifically tailored for MVF models to attain comprehensive representations need simultaneous consideration. Crucially, real-world data frequently arrives with incomplete views, an aspect rarely noticed by researchers. Thus, the View-Centric Transformer (VCT) and Multitask Masked Autoencoder (M2AE) are specifically designed to emphasize the centrality of each view and harness unlabeled data to achieve superior fused representations. Additionally, we systematically define the missing-view problem for the first time and introduce prompt techniques to aid pretrained MVF models in flexibly adapting to various missing-view scenarios. Rigorous experiments involving atrial fibrillation detection, blood pressure estimation, and sleep staging-typical health monitoring tasks-demonstrate the remarkable advantage of our method in MVF compared to prevailing methodologies. Notably, the prompt technique requires finetuning less than 3% of the entire model's data, substantially fortifying the model's resilience to view missing while circumventing the need for complete retraining. The results demonstrate the effectiveness of our approaches, highlighting their potential for practical applications in cardiovascular health monitoring. Codes and models are released at URL. Copyright © 2024, The Authors. All rights reserved.

关键词： Electrocardiograms

Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Qu, Linhao Luo, Xiaoyuan Wang, Manning Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention China

computer-aided pathology diagnosis based on the classification of Whole Slide Image (WSI) plays an important role in clinical practice, and it is often formulated as a weakly-supervised Multiple Instance Learning (MIL) problem. Existing methods solve this problem from either a bag classification or an instance classification perspective. In this paper, we propose an end-to-end weakly supervised knowledge distillation framework (WENO) for WSI classification, which integrates a bag classifier and an instance classifier in a knowledge distillation framework to mutually improve the performance of both classifiers. Specifically, an attention-based bag classifier is used as the teacher network, which is trained with weak bag labels, and an instance classifier is used as the student network, which is trained using the normalized attention scores obtained from the teacher network as soft pseudo labels for the instances in positive bags. An instance feature extractor is shared between the teacher and the student to further enhance the knowledge exchange between them. In addition, we propose a hard positive instance mining strategy based on the output of the student network to force the teacher network to keep mining hard positive instances. WENO is a plug-and-play framework that can be easily applied to any existing attention-based bag classification methods. Extensive experiments on five datasets demonstrate the efficiency of WENO. Code is available at https://***/miccaiif/WENO. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

FANCL: Feature-Guided Attention Network with Curriculum Learning for Brain Metastases Segmentation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Zijiang Liu, Xiaoyu Qu, Linhao Shi, Yonghong Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai200032 China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China

Accurate segmentation of brain metastases (BMs) in MR image is crucial for the diagnosis and followup of patients. Methods based on deep convolutional neural networks (CNNs) have achieved high segmentation performance. However, due to the loss of critical feature information caused by convolutional and pooling operations, CNNs still face great challenges in small BMs segmentation. Besides, BMs are irregular and easily confused with healthy tissues, which makes it difficult for the model to effectively learn tumor structure during training. To address these issues, this paper proposes a novel model called feature-guided attention network with curriculum learning (FANCL). Based on CNNs, FANCL utilizes the input image and its feature to establish the intrinsic connections between metastases of different sizes, which can effectively compensate for the loss of high-level feature from small tumors with the information of large tumors. Furthermore, FANCL applies the voxel-level curriculum learning strategy to help the model gradually learn the structure and details of BMs. And baseline models of varying depths are employed as curriculum-mining networks for organizing the curriculum progression. The evaluation results on the BraTS-METS 2023 dataset indicate that FANCL significantly improves the segmentation performance, confirming the effectiveness of our method. Copyright © 2024, The Authors. All rights reserved.

关键词： Curricula

Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Shiman Wang, Haoran Meng, Yucong Zhang, Chenxi Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai200032 China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China

Precise delineation of multiple organs or abnormal regions in the human body from medical images plays an essential role in computer-aided diagnosis, surgical simulation, image-guided interventions, and especially in radiotherapy treatment planning. Thus, it is of great significance to explore automatic segmentation approaches, among which deep learning-based approaches have evolved rapidly and witnessed remarkable progress in multi-organ segmentation. However, obtaining an appropriately sized and fine-grained annotated dataset of multiple organs is extremely hard and expensive. Such scarce annotation limits the development of high-performance multi-organ segmentation models but promotes many annotation-efficient learning paradigms. Among these, studies on transfer learning leveraging external datasets, semi-supervised learning using unannotated datasets and partially-supervised learning integrating partially-labeled datasets have led the dominant way to break such dilemma in multi-organ segmentation. We first review the traditional fully supervised method, then present a comprehensive and systematic elaboration of the 3 abovementioned learning paradigms in the context of multi-organ segmentation from both technical and methodological perspectives, and finally summarize their challenges and future trends. Copyright © 2023, The Authors. All rights reserved.

关键词： computer aided diagnosis

Deep Mutual Learning among Partially labeled Datasets for Multi-Organ Segmentation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Xiaoyu Qu, Linhao Xie, Ziyue Shi, Yonghong Song, Zhijian Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai200032 China Shanghai Key Lab of Medical Image Computing and Computer Assisted Intervention Shanghai200032 China

The task of labeling multiple organs for segmentation is a complex and time-consuming process, resulting in a scarcity of comprehensively labeled multi-organ datasets while the emergence of numerous partially labeled datasets. Current methods are inadequate in effectively utilizing the supervised information available from these datasets, thereby impeding the progress in improving the segmentation accuracy. This paper proposes a two-stage multi-organ segmentation method based on mutual learning, aiming to improve multi-organ segmentation performance by complementing information among partially labeled datasets. In the first stage, each partial-organ segmentation model utilizes the non-overlapping organ labels from different datasets and the distinct organ features extracted by different models, introducing additional mutual difference learning to generate higher quality pseudo labels for unlabeled organs. In the second stage, each full-organ segmentation model is supervised by fully labeled datasets with pseudo labels and leverages true labels from other datasets, while dynamically sharing accurate features across different models, introducing additional mutual similarity learning to enhance multi-organ segmentation performance. Extensive experiments were conducted on nine datasets that included the head and neck, chest, abdomen, and pelvis. The results indicate that our method has achieved SOTA performance in segmentation tasks that rely on partial labels, and the ablation studies have thoroughly confirmed the efficacy of the mutual learning mechanism. © 2024, CC BY.

关键词： Deep learning

RNA splicing alterations in lung cancer pathogenesis and therapy

学校读者我要写书评

暂无评论

Cancer Pathogenesis and Therapy 2023年第4期1卷 272-283页

作者： Yueren Yan Yunpeng Ren Yufang Bao Yongbo Wang Department of Thoracic Surgery Fudan University Shanghai Cancer CenterShanghai 200032China Department of Cellular and Genetic Medicine Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted InterventionSchool of Basic Medical SciencesFudan UniversityShanghai 200032China

RNA splicing alterations are widespread and play critical roles in cancer pathogenesis and *** cancer is highly heterogeneous and causes the most cancer-related deaths ***-scale multi-omics studies have not only characterized the mutational landscapes but also discovered a plethora of transcriptional and post-transcriptional changes in lung *** resources have greatly facilitated the development of new diagnostic markers and therapeutic options over the past two ***,altered RNA splicing has emerged as an important molecular feature and therapeutic target of lung *** this review,we provide a brief overview of splicing dysregulation in lung cancer and summarize the recent progress on key splicing events and splicing factors that contribute to lung cancer ***,we describe the general strategies targeting splicing alterations in lung cancer and highlight the potential of combining splicing modulation with currently approved therapies to combat this deadly *** review provides new mechanistic and therapeutic insights into splicing dysregulation in cancer.

关键词： RNA splicing Splicing factors Splicing alterations Lung cancer

Boosting Point-BERT by Multi-choice Tokens

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fu, Kexue Yuan, Mingzhi Wang, Manning Digital Medical Research Center School of Basic Medical Science Fudan University Shanghai China Shanghai Key Laboratory of Medical Image Computing and Computer Assisted Intervention Shanghai China

Masked language modeling (MLM) has become one of the most successful self-supervised pre-training task. Inspired by its success, Point-BERT, as a pioneer work in point cloud, proposed masked point modeling (MPM) to pre-train point transformer on large scale unanotated dataset. Despite its great performance, we find the inherent difference between language and point cloud tends to cause ambiguous tokenization for point cloud. For point cloud, there doesn’t exist a gold standard for point cloud tokenization. Point-BERT use a discrete Variational AutoEncoder (dVAE) as tokenizer, but it might generate different token ids for semantically-similar patches and generate the same token ids for semantically-dissimilar patches. To tackle above problem, we propose our McP-BERT, a pre-training framework with multi-choice tokens. Specifically, we ease the previous single-choice constraint on patch token ids in Point-BERT, and provide multi-choice token ids for each patch as supervision. Moreover, we utilitze the high-level semantics learned by transformer to further refine our supervision signals. Extensive experiments on point cloud classification, few-shot classification and part segmentation tasks demonstrate the superiority of our method, e.g., the pre-trained transformer achieves 94.1% accuracy on ModelNet40, 84.28% accuracy on the hardest setting of ScanObjectNN and new state-of-the-art performance on few-shot learning. We also demonstrate that our method not only improves the performance of Point-BERT on all downstream tasks, but also incurs almost no extra computational overhead. The code will be released in https://***/fukexue/McP-BERT. Copyright © 2022, The Authors. All rights reserved.

关键词： Large dataset

POS-BERT: Point Cloud One-Stage BERT Pre-Training

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fu, Kexue Gao, Peng Liu, Shaolei Zhang, Renrui Qiao, Yu Wang, Manning Digital Medical Research Center School of Basic Medical Sciences Fudan University China Shanghai AI Lab China Shanghai Key Laboratory of Medical Image Computing and Computer Assisted Intervention China

Recently, the pre-training paradigm combining Transformer and masked language modeling has achieved tremendous success in NLP, images, and point clouds, such as BERT. However, directly extending BERT from NLP to point clouds requires training a fixed discrete Variational AutoEncoder (dVAE) before pre-training, which results in a complex two-stage method called Point-BERT. Inspired by BERT and MoCo, we propose POS-BERT, a one-stage BERT pre-training method for point clouds. Specifically, we use the mask patch modeling (MPM) task to perform point cloud pre-training, which aims to recover masked patches information under the supervision of the corresponding tokenizer output. Unlike Point-BERT, its tokenizer is extra-trained and frozen. We propose to use the dynamically updated momentum encoder as the tokenizer, which is updated and outputs the dynamic supervision signal along with the training process. Further, in order to learn high-level semantic representation, we combine contrastive learning to maximize the class token consistency between different transformation point clouds. Extensive experiments have demonstrated that POS-BERT can extract high-quality pre-training features and promote downstream tasks to improve performance. Using the pretraining model without any fine-tuning to extract features and train linear SVM on ModelNet40, POS-BERT achieves the state-of-the-art classification accuracy, which exceeds Point-BERT by 3.5%. In addition, our approach has significantly improved many downstream tasks, such as fine-tuned classification, few-shot classification, part segmentation. The code and trained-models will be available at: https://***/fukexue/POS-BERT. Copyright © 2022, The Authors. All rights reserved.

关键词： Natural language processing systems