检索结果-内蒙古大学图书馆

Is the aspect ratio of cells important in deep learning? A robust comparison of deep learning methods for multi-scale cytopathology cell image classification: From convolutional neural networks to visual transformers

arXiv

引用

arXiv 2021年

作者： Liu, Wanli Li, Chen Rahaman, Md Mamunur Jiang, Tao Sun, Hongzan Wu, Xiangchen Hu, Weiming Chen, Haoyuan Sun, Changhao Yao, Yudong Grzegorzek, Marcin Microscopic Image and Medical Image Analysis Group College of Medicine and Biological Information Engineering Northeastern University Shenyang110169 China School of Control Engineering Chengdu University of Information Technology Chengdu610225 China Shengjing Hospital China Medical University Shenyang110001 China Suzhou Ruiguan Technology Company Ltd. Suzhou215000 China Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110169 China Department of Electrical and Computer Engineering Stevens Institute of Technology HobokenNJ07030 United States Institute of Medical Informatics University of Luebeck Luebeck Germany

Cervical cancer is a very common and fatal type of cancer in women. Cytopathology images are often used to screen for this cancer. Given that there is a possibility that many errors can occur during manual screening, a computer-aided diagnosis system based on deep learning has been developed. Deep learning methods require a fixed dimension of input images, but the dimensions of clinical medical images are inconsistent. The aspect ratios of the images suffer while resizing them directly. Clinically, the aspect ratios of cells inside cytopathological images provide important information for doctors to diagnose cancer. Therefore, it is difficult to resize directly. However, many existing studies have resized the images directly and have obtained highly robust classification results. To determine a reasonable interpretation, we have conducted a series of comparative experiments. First, the raw data of the SIPaKMeD dataset are pre-processed to obtain standard and scaled datasets. Then, the datasets are resized to 224 × 224 pixels. Finally, 22 deep learning models are used to classify the standard and scaled datasets. The results of the study indicate that deep learning models are robust to changes in the aspect ratio of cells in cervical cytopathological images. This conclusion is also validated via the Herlev dataset. Copyright © 2021, The Authors. All rights reserved.

关键词： Aspect ratio

来源：评论

学校读者我要写书评

暂无评论

QUBIQ: Uncertainty Quantification for Biomedical image Segmentation Challenge

arXiv

引用

arXiv 2024年

作者： Li, Hongwei Bran Navarro, Fernando Ezhov, Ivan Bayat, Amirhossein Das, Dhritiman Kofler, Florian Shit, Suprosanna Waldmannstetter, Diana Paetzold, Johannes C. Hu, Xiaobin Wiestler, Benedikt Zimmer, Lucas Amiranashvili, Tamaz Prabhakar, Chinmay Berger, Christoph Weidner, Jonas Alonso-Basanta, Michelle Rashid, Arif Baid, Ujjwal Adel, Wesam Alis, Deniz Baheti, Bhakti Bai, Yingbin Bhat, Ishaan Cetindag, Sabri Can Chen, Wenting Cheng, Li Dutande, Prasad Dular, Lara Elattar, Mustafa A. Feng, Ming Gao, Shengbo Huisman, Henkjan Hu, Weifeng Innani, Shubham Ji, Wei Karimi, Davood Kuijf, Hugo J. Kwak, Jin Tae Le, Hoang Long Li, Xiang Lin, Huiyan Liu, Tongliang Ma, Jun Ma, Kai Ma, Ting Oksuz, Ilkay Holland, Robbie Oliveira, Arlindo L. Pal, Jimut Bahan Pei, Xuan Qiao, Maoying Saha, Anindo Selvan, Raghavendra Shen, Linlin Silva, Joao Lourenco Spiclin, Ziga Talbar, Sanjay Wang, Dadong Wang, Wei Wang, Xiong Wang, Yin Xi, Ruiling Xu, Kele Yang, Yanwu Yergin, Mert Yu, Shuang Zeng, Lingxi Zhang, YingLin Zhao, Jiachen Zheng, Yefeng Zukovec, Martin Do, Richard Becker, Anton Simpson, Amber Konukoglu, Ender Jakab, Andras Bakas, Spyridon Joskowicz, Leo Menze, Bjoern Department of Informatics Technical University of Munich Germany Athinoula A. Martinos Center for Biomedical Imaging Massachusetts General Hospital Harvard Medical School United States Department of Quantitative Biomedicine University of Zurich Switzerland University Children’s Hospital Zurich University of Zurich Switzerland Department of Radioncology and Radiation Theraphy Klinikum rechts der Isar Technical University of Munich Germany Department of Information Technology and Electrical Engineering ETH-Zurich Switzerland Department of Radiology Memorial Sloan Kettering Cancer Center New York City United States Department of Biomedical and Molecular Sciences Queen’s University Canada TranslaTUM - Central Institute for Translational Cancer Research Technical University of Munich Germany McGovern Institute Massachusetts Institute of Technology United States Institute for Diagnostic and Interventional Radiology Unveristy Zurich Hospital Switzerland BioMedIA Imperial College London United Kingdom Department of Radiation Oncology University of Pennsylvania PA United States University of Pennsylvania PA United States Department of Radiation Oncology Winship Cancer Institute of Emory University Georgia United States Nile University Cairo Egypt Department of Medical Sciences Acibadem University Istanbul Turkey Shri Guru Gobind Singhji Institute of Engineering and Technology Maharashtra Nanded India Trustworthy Machine Learning Lab University of Sydney Australia Image Sciences Institute University Medical Center Utrecht Netherlands Computer Engineering Department Istanbul Technical University Istanbul Turkey School of Computer Science Shenzhen University Shenzhen China University of Alberta United States University of Ljubljana Faculty of Electrical Engineering Ljubljana Slovenia Tongji University Shanghai China OPPO Research Institute Shanghai China School of Biological and Medical Engineering Beihang University Beijing China Harvard Medical School Boston

Uncertainty in medical image segmentation tasks, especially inter-rater variability, arising from differences in interpretations and annotations by various experts, presents a significant challenge in achieving consistent and reliable image segmentation. This variability not only reflects the inherent complexity and subjective nature of medical image interpretation but also directly impacts the development and evaluation of automated segmentation algorithms. Accurately modeling and quantifying this variability is essential for enhancing the robustness and clinical applicability of these algorithms. We report the set-up and summarize the benchmark results of the Quantification of Uncertainties in Biomedical image Quantification Challenge (QUBIQ), which was organized in conjunction with International Conferences on Medical image Computing and computer-Assisted Intervention (MICCAI) 2020 and 2021. The challenge focuses on the uncertainty quantification of medical image segmentation which considers the omnipresence of inter-rater variability in imaging datasets. The large collection of images with multi-rater annotations features various modalities such as MRI and CT;various organs such as the brain, prostate, kidney, and pancreas;and different image dimensions 2D-vs-3D. A total of 24 teams submitted different solutions to the problem, combining various baseline models, Bayesian neural networks, and ensemble model techniques. The obtained results indicate the importance of the ensemble models, as well as the need for further research to develop efficient 3D methods for uncertainty quantification methods in 3D segmentation tasks. © 2024, CC BY-NC-ND.

关键词： image segmentation

来源：评论

学校读者我要写书评

暂无评论

MONAI: An open-source framework for deep learning in healthcare

arXiv

引用

arXiv 2022年

作者： Cardoso, M. Jorge Li, Wenqi Brown, Richard Ma, Nic Kerfoot, Eric Wang, Yiheng Murrey, Benjamin Myronenko, Andriy Zhao, Can Yang, Dong Nath, Vishwesh He, Yufan Xu, Ziyue Hatamizadeh, Ali Zhu, Wentao Liu, Yun Zheng, Mingxin Tang, Yucheng Yang, Isaac Zephyr, Michael Hashemian, Behrooz Alle, Sachidanand Darestani, Mohammad Zalbagi Budd, Charlie Modat, Marc Vercauteren, Tom Wang, Guotai Li, Yiwen Hu, Yipeng Fu, Yunguan Gorman, Benjamin Johnson, Hans Genereaux, Brad Erdal, Barbaros S. Gupta, Vikash Diaz-Pinto, Andres Dourson, Andre Maier-Hein, Lena Jaeger, Paul F. Baumgartner, Michael Kalpathy-Cramer, Jayashree Flores, Mona Kirby, Justin Cooper, Lee A.D. Roth, Holger R. Xu, Daguang Bericat, David Floca, Ralf Zhou, S. Kevin Shuaib, Haris Farahani, Keyvan Maier-Hein, Klaus H. Aylward, Stephen Dogra, Prerna Ourselin, Sebastien Feng, Andrew School of Biomedical Engineering & Imaging Sciences King’s College London London United Kingdom NVIDIA Corporation Santa Clara and Bethesda United States School of Electrical and Computer Engineering Rice University Houston United States Department of Engineering Science University of Oxford Oxford United Kingdom Department of Medical Physics and Biomedical Engineering University College London London United Kingdom Department of BioAI InstaDeep Ltd London United Kingdom Department of Electrical & Computer Engineering University of Iowa Iowa City United States Mayo Clinic Jacksonville United States Mars Incorporated United States Div. Intelligent Medical Systems German Cancer Research Center Heidelberg Germany Division of Medical Image Computing German Cancer Research Center Heidelberg Germany Pattern Analysis and Learning Group Department of Radiation Oncology Heidelberg University Hospital Heidelberg Germany School of Biomedical Engineering Suzhou Institute for Advanced Research University of Science and Technology of China Suzhou China Department of Medical Physics Guy’s & St Thomas’ NHS Foundation Trust London United Kingdom National Cancer Institute Bethesda United States Kitware Inc. Clifton Park United States Department of Ophthalmology University of Colorado Aurora United States Frederick National Laboratory for Cancer Research Frederick United States Department of Pathology Northwestern University Chicago United States

Artificial Intelligence (AI) is having a tremendous impact across most areas of science. Applications of AI in healthcare have the potential to improve our ability to detect, diagnose, prognose, and intervene on human disease. For AI models to be used clinically, they need to be made safe, reproducible and robust, and the underlying software framework must be aware of the particularities (e.g. geometry, physiology, physics) of medical data being processed. This work introduces MONAI, a freely available, community-supported, and consortium-led PyTorch-based framework for deep learning in healthcare. MONAI extends PyTorch to support medical data, with a particular focus on imaging, and provide purpose-specific AI model architectures, transformations and utilities that streamline the development and deployment of medical AI models. MONAI follows best practices for software-development, providing an easy-to-use, robust, well-documented, and well-tested software framework. MONAI preserves the simple, additive, and compositional approach of its underlying PyTorch libraries. MONAI is being used by and receiving contributions from research, clinical and industrial teams from around the world, who are pursuing applications spanning nearly every aspect of healthcare. © 2022, CC BY.

关键词： Clinical research

来源：评论

学校读者我要写书评

暂无评论

Mitosis domain generalization in histopathology images - The MIDOG challenge

arXiv

引用

arXiv 2022年

作者： Aubreville, Marc Stathonikos, Nikolas Bertram, Christof A. Klopfleisch, Robert ter Hoeve, Natalie Ciompi, Francesco Wilm, Frauke Marzahl, Christian Donovan, Taryn A. Maier, Andreas Breen, Jack Ravikumar, Nishant Chung, Youjin Park, Jinah Nateghi, Ramin Pourakpour, Fattaneh Fick, Rutger H.J. Hadj, Saima Ben Jahanifar, Mostafa Rajpoot, Nasir Dexl, Jakob Wittenberg, Thomas Kondo, Satoshi Lafarge, Maxime W. Koelzer, Viktor H. Liang, Jingtang Wang, Yubo Long, Xi Liu, Jingxin Razavi, Salar Khademi, April Yang, Sen Wang, Xiyue Veta, Mitko Breininger, Katharina Technische Hochschule Ingolstadt Ingolstadt Germany Pathology Department UMC Utrecht Netherlands Institute of Pathology University of Veterinary Medicine Vienna Austria Institute of Veterinary Pathology Freie Universität Berlin Berlin Germany Computational Pathology Group Radboud UMC Nijmegen Netherlands Pattern Recognition Lab Friedrich-Alexander-Universität Erlangen-Nürnberg Germany Department of Anatomic Pathology Schwarzman Animal Medical Center New York United States CISTIB Center for Computational Imaging and Simulation Technologies in Biomedicine School of Computing University of Leeds United Kingdom Korea Advanced Institute of Science and Technology Daejeon Korea Republic of Electrical and Electronics Engineering Department Shiraz University of Technology Shiraz Iran Tehran Iran Tribun Health Paris France Tissue Image Analytics Centre Department of Computer Science University of Warwick United Kingdom Fraunhofer-Institute for Integrated Circuits IIS Erlangen Germany Muroran Institute of Technology Hokkaido Japan Department of Pathology and Molecular Pathology University Hospital University of Zurich Zurich Switzerland School of Life Science and Technology Xidian University Shannxi China Histo Pathology Diagnostic Center Shanghai China Xi'an Jiaotong-Liverpool University Suzhou China Electrical Computer and Biomedical Engineering Ryerson University TorontoON Canada Tencent AI Lab Shenzhen518057 China College of Computer Science Sichuan University Chengdu610065 China Medical Image Analysis Group TU Eindhoven Netherlands Department of Artificial Intelligence in Biomedical Engineering Friedrich-Alexander-Universität Erlangen-Nürnberg Germany

The density of mitotic figures within tumor tissue is known to be highly correlated with tumor proliferation and thus is an important marker in tumor grading. Recognition of mitotic figures by pathologists is known to be subject to a strong inter-rater bias, which limits the prognostic value. State-of-the-art deep learning methods can support the expert in this assessment but are known to strongly deteriorate when applied in a different clinical environment than was used for training. One decisive component in the underlying domain shift has been identified as the variability caused by using different whole slide scanners. The goal of the MICCAI MIDOG 2021 challenge has been to propose and evaluate methods that counter this domain shift and derive scanner-agnostic mitosis detection algorithms. The challenge used a training set of 200 cases, split across four scanning systems. As a test set, an additional 100 cases split across four scanning systems, including two previously unseen scanners, were given. The best approaches performed on an expert level, with the winning algorithm yielding an F1 score of 0.748 (CI95: 0.704-0.781). In this paper, we evaluate and compare the approaches that were submitted to the challenge and identify methodological factors contributing to better performance. Copyright © 2022, The Authors. All rights reserved.

关键词： Scanning

来源：评论

学校读者我要写书评

暂无评论

Understanding metric-related pitfalls in image analysis validation

arXiv

引用

arXiv 2023年

作者： Reinke, Annika Tizabi, Minu D. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Kavur, A. Emre Rädsch, Tim Sudre, Carole H. Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Buettner, Florian Cardoso, M. Jorge Cheplygina, Veronika Chen, Jianxu Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kleesiek, Jens Kofler, Florian Kooi, Thijs Kopp-Schneider, Annette Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Riegler, Michael A. Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. van Calster, Ben Varoquaux, Gaël Yaniv, Ziv R. Jäger, Paul F. Maier-Hein, Lena Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany NCT Heidelberg A Partnership Between DKFZ University Medical Center Heidelberg Germany Heidelberg Division of Medical Image Computing Germany Heidelberg Division of Intelligent Medical Systems Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montreal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Leuven Belgium partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany and Frankfurt Cancer Insititute Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for Statistics in Medicine University of Oxford Oxford United Kingdom Center for Biomedical In

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately. While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. While focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation. © 2023, CC BY.

关键词： computer vision

来源：评论

学校读者我要写书评

暂无评论

The medical algorithmic audit (vol 4, pg e384, 2022)

引用

LANCET DIGITAL HEALTH 2022年第6期4卷 E405-E405页

作者： Liu, X. Glocker, B. McCradden, M. M. Ghassemi, M. Denniston, A. K. Oakden-Rayner, L. Academic Unit of Ophthalmology Institute of Inflammation and Ageing College of Medical and Dental Sciences University of Birmingham UK Department of Ophthalmology University Hospitals Birmingham NHS Foundation Trust Birmingham UK Moorfields Eye Hospital NHS Foundation Trust London UK Health Data Research UK London UK Birmingham Health Partners Centre for Regulatory Science and Innovation University of Birmingham Birmingham UK Biomedical Image Analysis Group Department of Computing Imperial College London London UK The Hospital for Sick Children Toronto ON Canada Dalla Lana School of Public Health Toronto ON Canada Institute for Medical Engineering and Science and Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology Cambridge MA USA National Institute of Health Research Biomedical Research Centre for Ophthalmology Moorfields Hospital London NHS Foundation Trust London UK University College London Institute of Ophthalmology London UK Australian Institute for Machine Learning University of Adelaide Adelaide SA Australia. lauren.oakden-rayner@adelaide.edu.au

Artificial intelligence systems for health care, like any other medical device, have the potential to fail. However, specific qualities of artificial intelligence systems, such as the tendency to learn spurious correlates in training data, poor generalisability to new deployment settings, and a paucity of reliable explainability mechanisms, mean they can yield unpredictable errors that might be entirely missed without proactive investigation. We propose a medical algorithmic audit framework that guides the auditor through a process of considering potential algorithmic errors in the context of a clinical task, mapping the components that might contribute to the occurrence of errors, and anticipating their potential consequences. We suggest several approaches for testing algorithmic errors, including exploratory error analysis, subgroup testing, and adversarial testing, and provide examples from our own work and previous studies. The medical algorithmic audit is a tool that can be used to better understand the weaknesses of an artificial intelligence system and put in place mechanisms to mitigate their impact. We propose that safety monitoring and medical algorithmic auditing should be a joint responsibility between users and developers, and encourage the use of feedback mechanisms between these groups to promote learning and maintain safe deployment of artificial intelligence *** © 2022 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY 4.0 license. Published by Elsevier Ltd.. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Why is the Winner the Best?

Why is the Winner the Best?

引用

Conference on computer Vision and Pattern Recognition (CVPR)

作者： M. Eisenmann A. Reinke V. Weru M. D. Tizabi F. Isensee T. J. Adler S. Ali V. Andrearczyk M. Aubreville U. Baid S. Bakas N. Balu S. Bano J. Bernal S. Bodenstedt A. Casella V. Cheplygina M. Daum M. De Bruijne A. Depeursinge R. Dorent J. Egger D. G. Ellis S. Engelhardt M. Ganz N. Ghatwary G. Girard P. Godau A. Gupta L. Hansen K. Harada M. Heinrich N. Heller A. Hering A. Huaulmé P. Jannin A. E. Kavur O. Kodym M. Kozubek J. Li H. Li J. Ma C. Martín-Isla B. Menze A. Noble V. Oreiller N. Padoy S. Pati K. Payette T. Rädsch J. Rafael-Patiño V. Singh Bawa S. Speidel C. H. Sudre K. Van Wijnen M. Wagner D. Wei A. Yamlahi M. H. Yap C. Yuan M. Zenk A. Zia D. Zimmerer D. Aydogan B. Bhattarai L. Bloch R. Brüngel J. Cho C. Choi Q. Dou I. Ezhov C. M. Friedrich C. Fuller R. R. Gaire A. Galdran Á. García Faura M. Grammatikopoulou S. Hong M. Jahanifar I. Jang A. Kadkhodamohammadi I. Kang F. Kofler S. Kondo H. Kuijf M. Li M. Luu T. Martinčič P. Morais M. A. Naser B. Oliveira D. Owen S. Pang J. Park S. Park S. Płotka E. Puybareau N. Rajpoot K. Ryu N. Saeed A. Shephard P. Shi D. Štepec R. Subedi G. Tochon H. R. Torres H. Urien J. L. Vilaça K. A. Wahid H. Wang J. Wang L. Wang X. Wang B. Wiestler M. Wodzinski F. Xia J. Xie Z. Xiong S. Yang Y. Yang Z. Zhao K. Maier-Hein P. F. Jäger A. Kopp-Schneider L. Maier-Hein Division of Intelligent Medical Systems German Cancer Research Center (DKFZ) Heidelberg Germany Helmholtz Imaging German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Division of Biostatistics German Cancer Research Center (DKFZ) Heidelberg Germany Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Engineering and Physical Sciences School of Computing University of Leeds Leeds UK Institute of Informatics School of Management HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland Sierre Switzerland Department of Nuclear Medicine and Molecular Imaging Lausanne University Hospital Lausanne Switzerland Technische Hochschule Ingolstadt Ingolstadt Germany Center for Artificial Intelligence and Data Science for Integrated Diagnostics (AI2D) and Center for Biomedical Image Computing and Analytics (CBICA) University of Pennsylvania Philadelphia PA USA Department of Pathology and Laboratory Medicine Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology University of Washington Seattle WA USA Department of Computer Science Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) University College London London UK Universitat Autònoma de Barcelona & Computer Vision Center Barcelona Spain Division of Translational Surgical Oncology National Center for Tumor Diseases (NCT/UCC) Dresden Dresden Germany Department of Advanced Robotics Istituto Italiano di Tecnologia Italy Department of Electronics Information and Bioengineering Politecnico di Milano Milan Italy IT University of Copenhagen Copenhagen Denmark Department of General Visceral and Transplantation Surgery Heidelberg University Hospital Heidelberg Germany Department of Radiology and Nuc

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multicenter study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and post-processing (66%). The “typical” lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Benchmarking the CoW with the TopCoW Challenge: Topology-Aware Anatomical Segmentation of the Circle of Willis for CTA and MRA

arXiv

引用

arXiv 2023年

作者： Yang, Kaiyuan Musio, Fabio Ma, Yihui Juchler, Norman Paetzold, Johannes C. Al-Maskari, Rami Höher, Luciano Li, Hongwei Bran Hamamci, Ibrahim Ethem Sekuboyina, Anjany Shit, Suprosanna Huang, Houjing Prabhakar, Chinmay de la Rosa, Ezequiel Waldmannstetter, Diana Kofler, Florian Navarro, Fernando Menten, Martin Ezhov, Ivan Rueckert, Daniel Vos, Iris Ruigrok, Ynte Velthuis, Birgitta Kuijf, Hugo Hämmerli, Julien Wurster, Catherine Bijlenga, Philippe Westphal, Laura Bisschop, Jeroen Colombo, Elisa Baazaoui, Hakim Makmur, Andrew Hallinan, James Wiestler, Bene Kirschke, Jan S. Wiest, Roland Montagnon, Emmanuel Letourneau-Guillon, Laurent Galdran, Adrian Galati, Francesco Falcetta, Daniele Zuluaga, Maria A. Lin, Chaolong Zhao, Haoran Zhang, Zehan Ra, Sinyoung Hwang, Jongyun Park, Hyunjin Chen, Junqiang Wodzinski, Marek Müller, Henning Shi, Pengcheng Liu, Wei Ma, Ting Yalçin, Cansu Hamadache, Rachika E. Salvi, Joaquim Llado, Xavier Estrada, Uma Maria Lal-Trehan Abramova, Valeriia Giancardo, Luca Oliver, Arnau Liu, Jialu Huang, Haibin Cui, Yue Lin, Zehang Liu, Yusheng Zhu, Shunzhi Patel, Tatsat R. Tutino, Vincent M. Orouskhani, Maysam Wang, Huayu Mossa-Basha, Mahmud Zhu, Chengcheng Rokuss, Maximilian R. Kirchhoff, Yannick Disch, Nico Holzschuh, Julius Isensee, Fabian Maier-Hein, Klaus Sato, Yuki Hirsch, Sven Wegener, Susanne Menze, Bjoern Department of Quantitative Biomedicine University of Zurich Zurich Switzerland Center for Computational Health Zurich University of Applied Sciences Zurich Switzerland Department of Neuroradiology University Hospital of Zurich Zurich Switzerland Department of Neurosurgery Zhongnan Hospital of Wuhan University Wuhan China Department of Computing Imperial College London London United Kingdom Helmholtz Center Munich Germany Athinoula A. Martinos Center for Biomedical Imaging Harvard Medical School Boston United States School of Medicine Technical University of Munich Munich Germany Department of Informatics Technical University of Munich Munich Germany Helmholtz AI Helmholtz Munich Munich Germany Image Sciences Institute UMC Utrecht Utrecht Netherlands Department of Neurology UMC Utrecht Utrecht Netherlands Department of Radiology UMC Utrecht Utrecht Netherlands Department of Clinical Neurosciences Division of Neurosurgery Geneva University Hospitals Geneva Switzerland Department of Neurology University Hospital of Zurich Zurich Switzerland Department of Physiology University of Toronto Toronto Canada Department of Neurosurgery University Hospital of Zurich Zurich Switzerland Department of Diagnostic Imaging National University Hospital Singapore Department of Diagnostic and Interventional Neuroradiology University Hospital Berne University of Berne Berne Switzerland Montreal Canada Universitat Pompeu Fabra Barcelona Spain EURECOM Biot France Institute of Medical Technology Peking University Health Science Center Beijing China Hangzhou Genlight Medtech Co. Ltd. Hangzhou China Department of Artificial Intelligence Sungkyunkwan University Seoul Korea Republic of Department of Electrical and Computer Engineering Sungkyunkwan University Seoul Korea Republic of Shanghai MediWorks Precision Instruments Co. Ltd. Shanghai China Institute of Informatics HES-SO Valais-Wallis Switzerland Department of Measurement and Electronics AGH University

The Circle of Willis (CoW) is an important network of arteries connecting major circulations of the brain. Its vascular architecture is believed to affect the risk, severity, and clinical outcome of serious neuro-vascular diseases. However, characterizing the highly variable CoW anatomy is still a manual and time-consuming expert task. The CoW is usually imaged by two angiographic imaging modalities, magnetic resonance angiography (MRA) and computed tomography angiography (CTA), but there exist limited public datasets with annotations on CoW anatomy, especially for CTA. Therefore we organized the TopCoW Challenge in 2023 with the release of an annotated CoW dataset. The TopCoW dataset was the first public dataset with voxel-level annotations for thirteen possible CoW vessel components, enabled by virtual-reality (VR) technology. It was also the first large dataset with paired MRA and CTA from the same patients. TopCoW challenge formalized the CoW characterization problem as a multiclass anatomical segmentation task with an emphasis on topological metrics. We invited submissions worldwide for the CoW segmentation task, which attracted over 140 registered participants from four continents. The top performing teams managed to segment many CoW components to Dice scores around 90%, but with lower scores for communicating arteries and rare variants. There were also topological mistakes for predictions with high Dice scores. Additional topological analysis revealed further areas for improvement in detecting certain CoW components and matching CoW variant topology accurately. TopCoW represented a first attempt at benchmarking the CoW anatomical segmentation task for MRA and CTA, both morphologically and topologically. © 2023, CC BY-NC-ND.

关键词： Large datasets

来源：评论

学校读者我要写书评

暂无评论

Metrics Reloaded: Recommendations for image analysis validation

arXiv

引用

arXiv 2022年

作者： Maier-Hein, Lena Reinke, Annika Godau, Patrick Tizabi, Minu D. Buettner, Florian Christodoulou, Evangelia Glocker, Ben Isensee, Fabian Kleesiek, Jens Kozubek, Michal Reyes, Mauricio Riegler, Michael A. Wiesenfarth, Manuel Emre Kavur, A. Sudre, Carole H. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Rädsch, Tim Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Jorge Cardoso, M. Cheplygina, Veronika Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian Ginneken, Bram Van Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kofler, Florian Kopp-Schneider, Annette Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rajpoot, Nasir Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Smeden, Maarten Van Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben Van Varoquaux, Gaël Jäger, Paul F. Heidelberg Division of Intelligent Medical Systems and HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg a partnership between DKFZ University Medical Center Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt-Marburg Germany Heidelberg Goethe University Frankfurt Germany Department of Medicine Goethe University Frankfurt Germany Department of Informatics Frankfurt Cancer Insititute Germany Department of Computing Imperial College London London United Kingdom Heidelberg Division of Medical Image Computing and HI Applied Computer Vision Lab Germany Institute for AI in Medicine University Medicine Essen Essen Germany Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic ARTORG Center for Biomedical Engineering Research University of Bern Bern Switzerland Department of Radiation Oncology University Hospital Bern University of Bern Bern Switzerland Simula Metropolitan Center for Digital Engineering Oslo Norway UiT The Arctic University of Norway Romsø Norway Heidelberg Division of Biostatistics Germany Heidelberg Division of Intelligent Medical Systems Division of Medical Image Computing HI Applied Computer Vision Lab Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Heidelberg Division of Medical Image Computing Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. It was developed by a large international consortium in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint – a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases. © 2022, CC BY.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Benchmarking quality-dependent and cost-sensitive score-level multimodal biometric fusion algorithms

arXiv

引用

arXiv 2021年

作者： Poh, Norman Bourlai, Thirimachos Kittler, Josef Allano, Lorene Alonso-Fernandez, Fernando Ambekar, Onkar Baker, John Dorizzi, Bernadette Fatukasi, Omolara Fierrez, Julian Ganster, Harald Ortega-Garcia, Javier Maurer, Donald Salah, Albert Ali Scheidat, Tobias Vielhauer, Claus Centre for Vision Speech and Signal Processing School of Electronics and Physical Sciences University of Surrey Guildford SurreyGU2 7XH United Kingdom Biometrics Center Lane Department of Computer Science and Electrical Engineering College of Engineering and Mineral Resources West Virginia University MorgantownWV26506-6109 United States Institut Telecom Telecom and Management SudParis Evry91011 France Biometric Recognition Group – ATVS Escuela Politecnica Superior Universidad Autonoma de Madrid Madrid28049 Spain Amsterdam1098 XG Netherlands Applied Physics Laboratory Johns Hopkins University LaurelMD20723 United States Electronics and Physics Department Institut Telecom Telecom and Management SudParis Evry91011 France Institute of Digital Image Processing Joanneum Research Graz8010 Austria ISLA-ISIS University of Amsterdam Amsterdam1098 XG Netherlands Department of Informatics and Media Brandenburg University of Applied Sciences Brandenburg an der HavelD-14770 Germany Research Group Multimedia and Security Department of Technical and Business Information Systems Faculty of Computer Science Otto-von-Guericke-University of Magdeburg MagdeburgD-39106 Germany

Automatically verifying the identity of a person by means of biometrics (e.g., face and fingerprint) is an important application in our day-to-day activities such as accessing banking services and security control in airports. To increase the system reliability, several biometric devices are often used. Such a combined system is known as a multimodal biometric system. This paper reports a benchmarking study carried out within the framework of the BioSecure DS2 (Access Control) evaluation campaign organized by the University of Surrey, involving face, fingerprint, and iris biometrics for person authentication, targeting the application of physical access control in a medium-size establishment with some 500 persons. While multimodal biometrics is a well-investigated subject in the literature, there exists no benchmark for a fusion algorithm comparison. Working towards this goal, we designed two sets of experiments: quality-dependent and cost-sensitive evaluation. The quality-dependent evaluation aims at assessing how well fusion algorithms can perform under changing quality of raw biometric images principally due to change of devices. The cost-sensitive evaluation, on the other hand, investigates how well a fusion algorithm can perform given restricted computation and in the presence of software and hardware failures, resulting in errors such as failure-to-acquire and failure-to-match. Since multiple capturing devices are available, a fusion algorithm should be able to handle this nonideal but nevertheless realistic scenario. In both evaluations, each fusion algorithm is provided with scores from each biometric comparison subsystem as well as the quality measures of both the template and the query data. The response to the call of the evaluation campaign proved very encouraging, with the submission of 22 fusion systems. To the best of our knowledge, this campaign is the first attempt to benchmark quality-based multimodal fusion algorithms. In the presence of changing

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：