检索结果-内蒙古大学图书馆

Group shift pointwise convolution for volumetric medical image segmentation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： He, Junjun Ye, Jin Li, Cheng Song, Diping Chen, Wanli Wang, Shanshan Gu, Lixu Qiao, Yu School of Biomedical Engineering Shanghai Jiao Tong University Shanghai China Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China Shanghai AI Lab Shanghai China Paul C. Lauterbur Research Center for Biomedical Imaging Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China The Chinese University of Hong Kong Hong Kong Peng Cheng Laboratory Guangdong Shenzhen China Pazhou Lab Guangdong Guangzhou China

Recent studies have witnessed the effectiveness of 3D convolutions on segmenting volumetric medical images. Compared with the 2D counterparts, 3D convolutions can capture the spatial context in three dimensions. Nevertheless, models employing 3D convolutions introduce more trainable parameters and are more computationally complex, which may lead easily to model overfitting especially for medical applications with limited available training data. This paper aims to improve the effectiveness and efficiency of 3D convolutions by introducing a novel Group Shift Pointwise Convolution (GSP-Conv). GSP-Conv simplifies 3D convolutions into pointwise ones with 1 × 1 × 1 kernels, which dramatically reduces the number of model parameters and FLOPs (e.g. 27× fewer than 3D convolutions with 3 × 3 × 3 kernels). Naïve pointwise convolutions with limited receptive fields cannot make full use of the spatial image context. To address this problem, we propose a parameter-free operation, Group Shift (GS), which shifts the feature maps along different spatial directions in an elegant way. With GS, pointwise convolutions can access features from different spatial locations, and the limited receptive fields of pointwise convolutions can be compensated. We evaluate the proposed methods on two datasets, PROMISE12 and BraTS18. Results show that our method, with substantially decreased model complexity, achieves comparable or even better performance than models employing 3D convolutions. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Pan, Liang Wu, Tong Cai, Zhongang Liu, Ziwei Yu, Xumin Rao, Yongming Lu, Jiwen Zhou, Jie Xu, Mingye Luo, Xiaoyuan Fu, Kexue Gao, Peng Wang, Manning Wang, Yali Qiao, Yu Zhou, Junsheng Wen, Xin Xiang, Peng Liu, Yu-Shen Han, Zhizhong Yan, Yuanjie An, Junyi Zhu, Lifa Lin, Changwei Liu, Dongrui Li, Xin Gómez-Fernández, Francisco Wang, Qinlong Yang, Yang S-Lab Nanyang Technological University Singapore SenseTime-CUHK Joint Lab The Chinese University of Hong Kong Hong Kong Sensetime Research Shanghai AI Laboratory China Department of Automation Tsinghua University China University of Chinese Academy of Sciences China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences China Digital Medical Research Center School of Basic Medical Science Fudan University China School of Software BNRist Tsinghua University China *** Wayne State University State Key Laboratory for Novel Software Technology Nanjing University China DeepGlint Shanghai Jiao Tong University China Sichuan University China Xi'an Jiaotong University China

As real-scanned point clouds are mostly partial due to occlusions and viewpoints, reconstructing complete 3D shapes based on incomplete observations becomes a fundamental problem for computer vision. With a single incomplete point cloud, it becomes the partial point cloud completion problem. Given multiple different observations, 3D reconstruction can be addressed by performing partial-to-partial point cloud registration. Recently, a large-scale Multi-View Partial (MVP) point cloud dataset has been released, which consists of over 100,000 high-quality virtual-scanned partial point clouds. Based on the MVP dataset, this paper reports methods and results in the Multi-View Partial Point Cloud Challenge 2021 on Completion and Registration. In total, 128 participants registered for the competition, and 31 teams made valid submissions. The top-ranked solutions will be analyzed, and then we will discuss future research directions. Copyright © 2021, The Authors. All rights reserved.

关键词： Surface measurement

A novel hybrid convolutional neural network for accurate organ segmentation in 3d head and neck CT images

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Chen, Zijie Li, Cheng He, Junjun Ye, Jin Song, Diping Wang, Shanshan Gu, Lixu Qiao, Yu Shenzhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China Shanghai AI Lab Shanghai China Shenzhen Yino Intelligence Techonology Co. Ltd. Guangdong Shenzhen China Co. Ltd. Guangdong Shenzhen China Paul C. Lauterbur Research Center for Biomedical Imaging Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen China School of Biomedical Engineering Shanghai Jiao Tong University Shanghai China Institute of Medical Robotics Shanghai Jiao Tong University Shanghai China Peng Cheng Laboratory Guangdong Shenzhen China Pazhou Lab Guangdong Guangzhou China

Radiation therapy (RT) is widely employed in the clinic for the treatment of head and neck (HaN) cancers. An essential step of RT planning is the accurate segmentation of various organs-at-risks (OARs) in HaN CT images. Nevertheless, segmenting OARs manually is time-consuming, tedious, and error-prone considering that typical HaN CT images contain tens to hundreds of slices. Automated segmentation algorithms are urgently required. Recently, convolutional neural networks (CNNs) have been extensively investigated on this task. Particularly, 3D CNNs are frequently adopted to process 3D HaN CT images. There are two issues with naïve 3D CNNs. First, the depth resolution of 3D CT images is usually several times lower than the in-plane resolution. Direct employment of 3D CNNs without distinguishing this difference can lead to the extraction of distorted image features and influence the final segmentation performance. Second, a severe class imbalance problem exists, and large organs can be orders of times larger than small organs. It is difficult to simultaneously achieve accurate segmentation for all the organs. To address these issues, we propose a novel hybrid CNN that fuses 2D and 3D convolutions to combat the different spatial resolutions and extract effective edge and semantic features from 3D HaN CT images. To accommodate large and small organs, our final model, named Organ-Net2.5D, consists of only two instead of the classic four downsampling operations, and hybrid dilated convolutions are introduced to maintain the respective field. Experiments on the MICCAI 2015 challenge dataset demonstrate that OrganNet2.5D achieves promising performance compared to state-of-the-art methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Convolution

HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation

学校读者我要写书评

暂无评论

HTML: Hybrid Temporal-scale Multimodal Learning Framework fo...

International Conference on computer vision (ICCV)

作者： Mingfei Han Yali Wang Zhihui Li Lina Yao Xiaojun Chang Yu Qiao ReLER AAII UTS Data61 CSIRO Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shanghai AI Laboratory Shanghai China Shandong Artificial Intelligence Qilu University of Technology Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence

Referring Video Object Segmentation (RVOS) is to segment the object instance from a given video, according to the textual description of this object. However, in the open world, the object descriptions are often diversified in contents and flexible in lengths. This leads to the key difficulty in RVOS, i.e., various descriptions of different objects are corresponding to different temporal scales in the video, which is ignored by most existing approaches with single stride of frame sampling. To tackle this problem, we propose a concise Hybrid Temporal-scale Multimodal Learning (HTML) framework, which can effectively align lingual and visual features to discover core object semantics in the video, by learning multimodal interaction hierarchically from different temporal scales. More specifically, we introduce a novel inter-scale multimodal perception module, where the language queries dynamically interact with visual features across temporal scales. It can effectively reduce complex object confusion by passing video context among different scales. Finally, we conduct extensive experiments on the widely used benchmarks, including Ref-Youtube-VOS, Ref-DAVIS17, A2D-Sentences and JHMDB-Sentences, where our HTML achieves state-of-the-art performance on all these datasets.

关键词：

UniFormer: Unifying Convolution and Self-attention for Visual recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Kunchang Wang, Yali Zhang, Junhao Gao, Peng Song, Guanglu Liu, Yu Li, Hongsheng Qiao, Yu ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China University of Chinese Academy of Sciences Beijing100049 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China National University of Singapore Singapore Shanghai Artificial Intelligence Laboratory China SenseTime Research China The Chinese University of Hong Kong Hong Kong

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have been two dominant frameworks in the past few years. Though CNNs can efficiently decrease local redundancy by convolution within a small neighborhood, the limited receptive field makes it hard to capture global dependency. Alternatively, ViTs can effectively capture long-range dependency via self-attention, while blind similarity comparisons among all the tokens lead to high redundancy. To resolve these problems, we propose a novel Unified transFormer (UniFormer), which can seamlessly integrate the merits of convolution and self-attention in a concise transformer format. Different from the typical transformer blocks, the relation aggregators in our UniFormer block are equipped with local and global token affinity respectively in shallow and deep layers, allowing tackling both redundancy and dependency for efficient and effective representation learning. Finally, we flexibly stack our blocks into a new powerful backbone, and adopt it for various vision tasks from image to video domain, from classification to dense prediction. Without any extra training data, our UniFormer achieves 86.3 top-1 accuracy on ImageNet-1K classification task. With only ImageNet-1K pre-training, it can simply achieve state-of-the-art performance in a broad range of downstream tasks. It obtains 82.9/84.8 top-1 accuracy on Kinetics-400/600, 60.9/71.2 top-1 accuracy on Something-Something V1/V2 video classification tasks, 53.8 box AP and 46.4 mask AP on COCO object detection task, 50.8 mIoU on ADE20K semantic segmentation task, and 77.4 AP on COCO pose estimation task. Moreover, we build an efficient UniFormer with a concise hourglass design of token shrinking and recovering, which achieves 2-4× higher throughput than the recent lightweight models. Code is av

关键词： Convolution

Author Correction: Development and clinical deployment of a smartphone-based visual field deep learning system for glaucoma detection

学校读者我要写书评

暂无评论

NPJ digital medicine 2022年第1期5卷 38页

作者： Fei Li Diping Song Han Chen Jian Xiong Xingyi Li Hua Zhong Guangxian Tang Sujie Fan Dennis S C Lam Weihua Pan Yajuan Zheng Ying Li Guoxiang Qu Junjun He Zhe Wang Ling Jin Rouxi Zhou Yunhe Song Yi Sun Weijing Cheng Chunman Yang Yazhi Fan Yingjie Li Hengli Zhang Ye Yuan Yang Xu Yunfan Xiong Lingfei Jin Aiguo Lv Lingzhi Niu Yuhong Liu Shaoli Li Jiani Zhang Linda M Zangwill Alejandro F Frangi Tin Aung Ching-Yu Cheng Yu Qiao Xiulan Zhang Daniel S W Ting State Key Laboratory of Ophthalmology Zhongshan Ophthalmic Center Sun Yat-Sen University Guangzhou People's Republic of China. ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institutes of Advanced Technology The Chinese Academy of Sciences Shenzhen People's Republic of China. University of Chinese Academy of Sciences Beijing People's Republic of China. Department of Ophthalmology The First Affiliated Hospital of Kunming Medical University Kunming People's Republic of China. The First Hospital of Shijiazhuang City Shijiazhuang People's Republic of China. gxtykyy@***. Handan City Eye Hospital Handan People's Republic of China. C-MER (Shenzhen) Dennis Lam Eye Hospital International Eye Research Institute of The Chinese University of Hong Kong (Shenzhen) Shenzhen People's Republic of China. The Eye Hospital WMU at Hangzhou Hangzhou People's Republic of China. Department of Ophthalmology The Second Hospital of Jilin University Changchun People's Republic of China. SenseTime Group Limited Hong Kong People's Republic of China. Department of Ophthalmology The Second Affiliated Hospital of Guizhou Medical University Kaili People's Republic of China. Department of Ophthalmology The Second Affiliated Hospital of Xi'an Jiaotong University Xi'an People's Republic of China. Department of Ophthalmology The Third Affiliated Hospital of Nanchang University Nanchang People's Republic of China. The First Hospital of Shijiazhuang City Shijiazhuang People's Republic of China. Hamilton Glaucoma Center Shiley Eye Institute Viterbi Family Department of Ophthalmology UC San Diego La Jolla CA United States. CISTIB Center for Computational Imaging and Simulation Technologies in Biomedicine Schools of Computing and Medicine University of Leeds Leeds UK. Singapore Eye Research Institute and Singapore National Eye Centre Singapore Singapore. ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institutes of Advanced Technology The Chinese Academy of Sci