检索结果-内蒙古大学图书馆

A comprehensive study on temporal modeling for online action detection

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Wen Peng, Xiaojiang Qiao, Yu Cheng, Jian School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu Sichuan611731 China ShenZhen Key Lab of Computer Vision and Pattern Recognition SIAT-SenseTime Joint Lab Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences SIAT Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences

—Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years. A typical OAD system mainly consists of three modules: a frame-level feature extractor which is usually based on pre-trained deep Convolutional Neural Networks (CNNs), a temporal modeling module, and an action classifier. Among them, the temporal modeling module is crucial which aggregates discriminative information from historical and current features. Though many temporal modeling methods have been developed for OAD and other topics, their effects are lack of investigation on OAD fairly. This paper aims to provide a comprehensive study on temporal modeling for OAD including four meta types of temporal modeling methods, i.e. temporal pooling, temporal convolution, recurrent neural networks, and temporal attention, and uncover some good practices to produce a state-of-the-art OAD system. Many of them are explored in OAD for the first time, and extensively evaluated with various hyper parameters. Furthermore, based on our comprehensive study, we present several hybrid temporal modeling methods, which outperform the recent state-of-the-art methods with sizable margins on THUMOS-14 and TVSeries. Copyright © 2020, The Authors. All rights reserved.

关键词： Convolution

Multiple sclerosis lesion synthesis in MRI using an encoder-decoder U-NET

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Salem, Mostafa Valverde, Sergi Cabezas, Mariano Pareto, Deborah Oliver, Arnau Salvi, Joaquim Rovira, Alex Llado, Xavier Research Institute of Computer Vision and Robotics University of Girona Girona17003 Spain Computer Science Department Faculty of Computers and Information Assiut University Egypt Magnetic Resonance Unit Dept of Radiology Vall d'Hebron University Hospital Spain

In this paper, we propose generating synthetic multiple sclerosis (MS) lesions on MRI images with the final aim to improve the performance of supervised machine learning algorithms, therefore avoiding the problem of the lack of available ground truth. We propose a two-input two-output fully convolutional neural network model for MS lesion synthesis in MRI images. The lesion information is encoded as discrete binary intensity level masks passed to the model and stacked with the input images. The model is trained end-to-end without the need for manually annotating the lesions in the training set. We then perform the generation of synthetic lesions on healthy images via registration of patient images, which are subsequently used for data augmentation to increase the performance for supervised MS lesion detection algorithms. Our pipeline is evaluated on MS patient data from an in-house clinical dataset and the public ISBI2015 challenge dataset. The evaluation is based on measuring the similarities between the real and the synthetic images as well as in terms of lesion detection performance by segmenting both the original and synthetic images individually using a state-of-the-art segmentation framework. We also demonstrate the usage of synthetic MS lesions generated on healthy images as data augmentation. We analyze a scenario of limited training data (one-image training) to demonstrate the effect of the data augmentation on both datasets. Our results significantly show the effectiveness of the usage of synthetic MS lesion images. For the ISBI2015 challenge, our one-image model trained using only a single image plus the synthetic data augmentation strategy showed a performance similar to that of other CNN methods that were fully trained using the entire training set, yielding a comparable human expert rater performance. Copyright © 2019, The Authors. All rights reserved.

关键词： Magnetic resonance imaging

SocNav1: A dataset to benchmark and learn social navigation conventions∗

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Manso, Luis J. Núñez, Pedro Calderita, Luis V. Faria, Diego R. Bachiller, Pilar Computer Science Department School of Engineering and Applied Science Aston University Birmingham United Kingdom Robotics and Artificial Vision Laboratory - RoboLab Caceres School of Technology Universidad de Extremadura Caceres Extremadura

Survival prediction using ensemble tumor segmentation and transfer learning

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Cabezas, Mariano Valverde, Sergi González-Villà, Sandra Clérigues, Albert Salem, Mostafa Kushibar, Kaisar Bernal, Jose Oliver, Arnau Lladó, Xavier Research Institute of Computer Vision and Robotics University of Girona Spain

Segmenting tumors and their subregions is a challenging task as demonstrated by the annual BraTS challenge. Moreover, predicting the survival of the patient using mainly imaging features, while being a desirable outcome to evaluate the treatment of the patient, it is also a difficult task. In this paper, we present a cascaded pipeline to segment the tumor and its subregions and then we use these results and other clinical features together with image features coming from a pretrained VGG-16 network to predict the survival of the patient. Preliminary results with the training and validation dataset show a promising start in terms of segmentation, while the prediction values could be improved with further testing on the feature extraction part of the network. Copyright © 2018, The Authors. All rights reserved.

关键词： Forecasting

REFUGE2 CHALLENGE: A TREASURE TROVE FOR MULTI-DIMENSION ANALYSIS AND EVALUATION IN GLAUCOMA SCREENING

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fang, Huihui Li, Fei Wu, Junde Fu, Huazhu Sun, Xu Son, Jaemin Yu, Shuang Zhang, Menglu Yuan, Chenglang Bian, Cheng Lei, Baiying Zhao, Benjian Xu, Xinxing Li, Shaohua Fumero, Francisco Sigut, José Almubarak, Haidar Bazi, Yakoub Guo, Yuanhao Zhou, Yating Baid, Ujjwal Innani, Shubham Guo, Tianjiao Yang, Jie Orlando, José Ignacio Bogunović, Hrvoje Zhang, Xiulan Xu, Yanwu The REFUGE2 Challenge Australia State Key Laboratory of Ophthalmology Zhongshan Ophthalmic Center Sun Yat-Sen University Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science Guangzhou China Intelligent Healthcare Unit Baidu Inc. Beijing China The Institute of High Performance Computing Agency for Science Technology and Research Singapore Yatiris Group PLADEMA Institute CONICET UNICEN Tandil Argentina Christian Doppler Lab for Artificial Intelligence in Retina Department of Ophthalmology and Optometry Medical University of Vienna Vienna Austria VUNO Inc Seoul Korea Republic of Tencent HealthCare Tencent Shenzhen China Computer Vision Institute College of Computer Science and Software Engineering of Shenzhen University Shenzhen China School of Biomedical Engineering Health Science Center Shenzhen University China Xiaohe Healthcare ByteDance Guangdong Guangzhou510000 China School of Biomedical Engineering Shenzhen University China College of Computer Science & Software Engineering Shenzhen University China Department of Computer Science and Systems Engineering Universidad de La Laguna Spain Saudi Electronic University Saudi Arabia King Saud University Saudi Arabia Institute of Automation Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China SGGS Institute of Engineering and Technology India Institute of Medical Robotics Shanghai Jiao Tong University China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China

With the rapid development of artificial intelligence (AI) in medical image processing, deep learning in color fundus photography (CFP) analysis is also evolving. Although there are some open-source, labeled datasets of CFPs in the ophthalmology community, large-scale datasets for screening only have labels of disease categories, and datasets with annotations of fundus structures are usually small in size. In addition, labeling standards are not uniform across datasets, and there is no clear information on the acquisition device. Here we release a multi-annotation, multi-quality, and multi-device color fundus image dataset for glaucoma analysis on an original challenge-Retinal Fundus Glaucoma Challenge 2nd Edition (REFUGE2). The REFUGE2 dataset contains 2000 color fundus images with annotations of glaucoma classification, optic disc/cup segmentation, as well as fovea localization. Meanwhile, the REFUGE2 challenge sets three sub-tasks of automatic glaucoma diagnosis and fundus structure analysis and provides an online evaluation framework. Based on the characteristics of multi-device and multi-quality data, some methods with strong generalizations are provided in the challenge to make the predictions more robust. This shows that REFUGE2 brings attention to the characteristics of real-world multi-domain data, bridging the gap between scientific research and clinical application. © 2022, CC BY-NC-ND.

关键词： Color

MyoPS: A Benchmark of Myocardial Pathology Segmentation Combining Three-Sequence Cardiac Magnetic Resonance Images

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Lei Wu, Fuping Wang, Sihan Luo, Xinzhe Martín-Isla, Carlos Zhai, Shuwei Zhang, Jianpeng Liu, Yanfei Zhang, Zhen Ankenbrand, Markus J. Jiang, Haochuan Zhang, Xiaoran Wang, Linhong Arega, Tewodros Weldebirhan Altunok, Elif Zhao, Zhou Li, Feiyan Ma, Jun Yang, Xiaoping Puybareau, Elodie Oksuz, Ilkay Bricq, Stephanie Li, Weisheng Punithakumar, Kumaradevan Tsaftaris, Sotirios A. Schreiber, Laura M. Yang, Mingjing Liu, Guocai Xia, Yong Wang, Guotai Escalera, Sergio Zhuang, Xiahai School of Data Science Fudan University Shanghai China School of Biomedical Engineering Shanghai Jiao Tong University Shanghai China Departament de Matemàtiques & Informàtica Universitat de Barcelona Barcelona Spain Computer Vision Center Universitat Autònoma de Barcelona Spain School of Mechanical and Electrical Engineering University of Electronic Science and Technology of China Chengdu China School of Computer Science and Engineering Northwestern Polytechnical University Xi'An China College of Electrical and Information Engineering Hunan University Changsha China National Engineering Laboratory for Robot Visual Perception and Control Technology Changsha China College of Physics and Information Engineering Fuzhou University Fuzhou China Comprehensive Heart Failure Center Wuerzburg University Hospitals Wuerzburg Germany School of Engineering University of Edinburgh Edinburgh United Kingdom School of Robotics Xi'an Jiaotong-Liverpool University Suzhou China Department of Electrical and Computer Engineering University of California Los Angeles United States Department of Radiology and Diagnostic Imaging University of Alberta Edmonton Canada Chongqing Key Laboratory of Image Cognition Chongqing University of Posts and Telecomm-Unications Chongqing China ImViA Laboratory Université Bourgogne Franche-Comté Dijon France Computer Engineering Department Istanbul Technical University Istanbul Turkey Le Kremlin-Bicêtre France Department of Mathematics Nanjing University of Science and Technology Nanjing China Department of Mathematics Nanjing University Nanjing China

Assessment of myocardial viability is essential in diagnosis and treatment management of patients suffering from myocardial infarction, and classification of pathology on myocardium is the key to this assessment. This work defines a new task of medical image analysis, i.e., to perform myocardial pathology segmentation (MyoPS) combining three-sequence cardiac magnetic resonance (CMR) images, which was first proposed in the MyoPS challenge, in conjunction with MICCAI 2020. The challenge provided 45 paired and pre-aligned CMR images, allowing algorithms to combine the complementary information from the three CMR sequences for pathology segmentation. In this article, we provide details of the challenge, survey the works from fifteen participants and interpret their methods according to five aspects, i.e., preprocessing, data augmentation, learning strategy, model architecture and post-processing. In addition, we analyze the results with respect to different factors, in order to examine the key obstacles and explore potential of solutions, as well as to provide a benchmark for future research. We conclude that while promising results have been reported, the research is still in the early stage, and more in-depth exploration is needed before a successful application to the clinics. Note that MyoPS data and evaluation tool continue to be publicly available upon registration via its homepage (***/zhuangxiahai/0/myops20/). © 2022, CC BY-NC-SA.

关键词： Magnetic resonance imaging

Apple vision Pro for Healthcare: "The Ultimate Display"? Entering the Wonderland of Precision Medicine

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Egger, Jan Gsaxner, Christina Chen, Xiaojun Bian, Jiang Kleesiek, Jens Puladi, Behrus Girardetstraße 2 Essen45131 Germany Hufelandstraße 55 Essen45147 Germany Hufelandstraße 55 Essen45147 Germany Department of Oral and Maxillofacial Surgery University Hospital RWTH Aachen Pauwelsstraße 30 Aachen52074 Germany Institute of Computer Graphics and Vision Graz University of Technology Inffeldgasse 16/II Graz8010 Austria Institute of Biomedical Manufacturing and Life Quality Engineering State Key Laboratory of Mechanical System and Vibration School of Mechanical Engineering Shanghai Jiao Tong University Dongchuan Road 800 Minhang District Shanghai200240 China Institute of Medical Robotics Shanghai Jiao Tong University Dongchuan Road 800 Minhang District Shanghai200240 China Health Outcomes & Biomedical Informatics College of Medicine University of Florida GainesvilleFL32610 United States Partner Site Essen Hufelandstraße 55 Essen45147 Germany Department of Physics TU Dortmund University August-Schmidt-Str. 4 Dortmund44227 Germany Institute of Medical Informatics University Hospital RWTH Aachen Pauwelsstraße 30 Aachen52074 Germany

At the Worldwide Developers Conference (WWDC) in June 2023, Apple introduced the vision Pro. The vision Pro is a Mixed Reality (MR) headset, more specifically it is a Virtual Reality (VR) device with an additional Video See-Through (VST) capability. The VST capability turns the vision Pro also into an Augmented Reality (AR) device. The AR feature is enabled by streaming the real world via cameras to the (VR) screens in front of the user’s eyes. This is of course not unique and similar to other devices, like the Varjo XR-3. Nevertheless, the vision Pro has some interesting features, like an inside-out screen that can show the headset wearers’ eyes to "outsiders" or a button on the top, called "Digital Crown", that allows you to seamlessly blend digital content with your physical space by turning it. In addition, it is untethered, except for the cable to the battery, which makes the headset more agile, compared to the Varjo XR-3. This could actually come closer to the "Ultimate Display", which Ivan Sutherland had already sketched in 1965. Not available to the public yet, like the Ultimate Display, we want to take a look into the crystal ball in this perspective to see if it can overcome some clinical challenges that - especially - AR still faces in the medical domain, but also go beyond and discuss if the vision Pro could support clinicians in essential tasks to spend more time with their patients. © 2023, CC BY.

关键词： Augmented reality

Learning to avoid poor images: Towards task-aware C-arm cone-beam CT trajectories

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Zaech, Jan-Nico Gao, Cong Bier, Bastian Taylor, Russell Maier, Andreas Navab, Nassir Unberath, Mathias Laboratory for Computational Sensing and Robotics Johns Hopkins University Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Computer Vision Laboratory Eidgenössische Technische Hochschule Zürich

Metal artifacts in computed tomography (CT) arise from a mismatch between physics of image formation and idealized assumptions during tomographic reconstruction. These artifacts are particularly strong around metal implants, inhibiting widespread adoption of 3D cone-beam CT (CBCT) despite clear opportunity for intra-operative verification of implant positioning, e. g. in spinal fusion surgery. On synthetic and real data, we demonstrate that much of the artifact can be avoided by acquiring better data for reconstruction in a task-aware and patient-specific manner, and describe the first step towards the envisioned task-aware CBCT protocol. The traditional short-scan CBCT trajectory is planar, with little room for scene-specific adjustment. We extend this trajectory by autonomously adjusting out-of-plane angulation. This enables C-arm source trajectories that are scene-specific in that they avoid acquiring"poor images", characterized by beam hardening, photon starvation, and noise. The recommendation of ideal out-of-plane angulation is performed on-the-fly using a deep convolutional neural network that regresses a detectability-rank derived from imaging physics. Copyright © 2019, The Authors. All rights reserved.

关键词： Trajectories

Object Recognition and Pose Estimation using Laser scans For Advanced Underwater Manipulation

学校读者我要写书评

暂无评论

Object Recognition and Pose Estimation using Laser scans For...

Symposium on Autonomous Underwater Vehicle Technology (AUV)

作者： Khadidja Himri Roger Pi Pere Ridao Nuno Gracias Albert Palomer Narcis Palomeras Computer Vision and Robotics Institute Universitat de Girona Girona Spain

ISBN: (纸本)9781728102542

3D object recognition is an active research area in computer vision and robotics. The integration of spatial information with semantic knowledge has become an important task for robots in order to successfully perform autonomous intervention missions. This paper presents an approach for the recognition and pose estimation of underwater objects, with the goal of enabling autonomous underwater intervention in man-made structures. The methods are developed to be used with raw data consisting of 3D colorless point clouds collected by a fast laser scanner. The proposed approach contains two main phases: Object recognition from range data, and feature-based semantic SLAM. The first goal consists of recognizing different objects present in the scene. For this purpose, a recognition and pose estimation pipeline was developed enclosing different steps such as segmentation, identification, and estimation of the position and orientation for each targeted object. The second goal aims at improving the AUV navigation in an underwater environment by using the result of the recognition and pose estimation pipeline to feed a feature based SLAM algorithm. As the AUV moves along the trajectory, the SLAM algorithm builds a map, recognizes targeted objects and integrates them into this map, and localizes its position with respect to it. Compared to previous experimental results performed in a water tank, this paper emphasizes the importance of estimating the pose of the objects (namely the orientation), as a way of promoting the accuracy of the robot localization.

关键词： Three-dimensional displays Object recognition Simultaneous localization and mapping Databases Lasers Pipelines