检索结果-内蒙古大学图书馆

arXiv 2022年

作者： Maier-Hein, Lena Reinke, Annika Godau, Patrick Tizabi, Minu D. Buettner, Florian Christodoulou, Evangelia Glocker, Ben Isensee, Fabian Kleesiek, Jens Kozubek, Michal Reyes, Mauricio Riegler, Michael A. Wiesenfarth, Manuel Emre Kavur, A. Sudre, Carole H. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Rädsch, Tim Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Jorge Cardoso, M. Cheplygina, Veronika Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian Ginneken, Bram Van Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kofler, Florian Kopp-Schneider, Annette Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rajpoot, Nasir Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Smeden, Maarten Van Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben Van Varoquaux, Gaël Jäger, Paul F. Heidelberg Division of Intelligent Medical Systems and HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg a partnership between DKFZ University Medical Center Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt-Marburg Germany Heidelberg Goethe University Frankfurt Germany Department of Medicine Goethe University Frankfurt Germany Department of Informatics Frankfurt Cancer Insititute Germany Department of Computing Imperial College London London United Kingdom Heidelberg Division of Medical Image Computing and HI Applied Computer Vision Lab Germany Institute for AI in Medicine University Medicine Essen Essen Germany Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic ARTORG Center for Biomedical Engineering Research University of Bern Bern Switzerland Department of Radiation Oncology University Hospital Bern University of Bern Bern Switzerland Simula Metropolitan Center for Digital Engineering Oslo Norway UiT The Arctic University of Norway Romsø Norway Heidelberg Division of Biostatistics Germany Heidelberg Division of Intelligent Medical Systems Division of Medical Image Computing HI Applied Computer Vision Lab Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Heidelberg Division of Medical Image Computing Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. It was developed by a large international consortium in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint – a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases. © 2022, CC BY.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Understanding metric-related pitfalls in image analysis validation

arXiv

引用

arXiv 2023年

作者： Reinke, Annika Tizabi, Minu D. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Kavur, A. Emre Rädsch, Tim Sudre, Carole H. Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Buettner, Florian Cardoso, M. Jorge Cheplygina, Veronika Chen, Jianxu Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kleesiek, Jens Kofler, Florian Kooi, Thijs Kopp-Schneider, Annette Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Riegler, Michael A. Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. van Calster, Ben Varoquaux, Gaël Yaniv, Ziv R. Jäger, Paul F. Maier-Hein, Lena Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany NCT Heidelberg A Partnership Between DKFZ University Medical Center Heidelberg Germany Heidelberg Division of Medical Image Computing Germany Heidelberg Division of Intelligent Medical Systems Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montreal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Leuven Belgium partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany and Frankfurt Cancer Insititute Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for Statistics in Medicine University of Oxford Oxford United Kingdom Center for Biomedical In

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately. While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. While focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation. © 2023, CC BY.

关键词： computer vision

来源：评论

学校读者我要写书评

暂无评论

Common Limitations of Image Processing Metrics: A Picture Story

arXiv

引用

arXiv 2021年

作者： Reinke, Annika Tizabi, Minu D. Sudre, Carole H. Eisenmann, Matthias Rädsch, Tim Baumgartner, Michael Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Bankhead, Peter Benis, Arriel Blaschko, Matthew Buettner, Florian Cardoso, M. Jorge Chen, Jianxu Cheplygina, Veronika Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Engelhardt, Sandy Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hamprecht, Fred Hashimoto, Daniel A. Heckmann-Nötzel, Doreen Hirsch, Peter Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kavur, A. Emre Kenngott, Hannes Kleesiek, Jens Kleppe, Andreas Koehler, Sven Kofler, Florian Kopp-Schneider, Annette Kooi, Thijs Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moher, David Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Noyan, M. Alican Petersen, Jens Polat, Gorkem Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Rieke, Nicola Riegler, Michael A. Rivaz, Hassan Saez-Rodriguez, Julio Sánchez, Clara I. Schroeter, Julien Saha, Anindo Selver, M. Alper Sharan, Lalith Shetty, Shravya Smeden, Maarten V.A.N. Stieltjes, Bram Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben V.A.N. Varoquaux, Gaël Wiesenfarth, Manuel Yaniv, Ziv R. Jäger, Paul Maier-Hein, Lena Division of Intelligent Medical Systems and HI Helmholtz Imaging Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Division of Intelligent Medical Systems Heidelberg Germany NCT Heidelberg DKFZ University Medical Center Heidelberg Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Division of Medical Image Computing Heidelberg Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Institute of Genetics and Cancer University of Edinburgh Edinburgh United Kingdom Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Kasteelpark Arenberg 10 - box 2441 Leuven3001 Belgium Frankfurt/Mainz DKFZ UCT Frankfurt-Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany Frankfurt Cancer Insititute Germany Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for St

While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using specific metrics for a given image analysis task. These are typically related to (1) the disregard of inherent metric properties, such as the behaviour in the presence of class imbalance or small target structures, (2) the disregard of inherent data set properties, such as the non-independence of the test cases, and (3) the disregard of the actual biomedical domain interest that the metrics should reflect. This living dynamically document has the purpose to illustrate important limitations of performance metrics commonly applied in the field of image analysis. In this context, it focuses on biomedical image analysis problems that can be phrased as image-level classification, semantic segmentation, instance segmentation, or object detection task. The current version is based on a Delphi process on metrics conducted by an international consortium of image analysis experts from more than 60 institutions worldwide. © 2021, CC BY.

关键词： Medical imaging

来源：评论

学校读者我要写书评

暂无评论

Author Correction: The challenge of mapping the human connectome based on diffusion tractography

引用

Nature communications 2019年第1期10卷 5059页

作者： Klaus H Maier-Hein Peter F Neher Jean-Christophe Houde Marc-Alexandre Côté Eleftherios Garyfallidis Jidan Zhong Maxime Chamberland Fang-Cheng Yeh Ying-Chia Lin Qing Ji Wilburn E Reddick John O Glass David Qixiang Chen Yuanjing Feng Chengfeng Gao Ye Wu Jieyan Ma Renjie He Qiang Li Carl-Fredrik Westin Samuel Deslauriers-Gauthier J Omar Ocegueda González Michael Paquette Samuel St-Jean Gabriel Girard François Rheault Jasmeen Sidhu Chantal M W Tax Fenghua Guo Hamed Y Mesri Szabolcs Dávid Martijn Froeling Anneriet M Heemskerk Alexander Leemans Arnaud Boré Basile Pinsard Christophe Bedetti Matthieu Desrosiers Simona Brambati Julien Doyon Alessia Sarica Roberta Vasta Antonio Cerasa Aldo Quattrone Jason Yeatman Ali R Khan Wes Hodges Simon Alexander David Romascano Muhamed Barakovic Anna Auría Oscar Esteban Alia Lemkaddem Jean-Philippe Thiran H Ertan Cetingul Benjamin L Odry Boris Mailhe Mariappan S Nadar Fabrizio Pizzagalli Gautam Prasad Julio E Villalon-Reina Justin Galvis Paul M Thompson Francisco De Santiago Requejo Pedro Luque Laguna Luis Miguel Lacerda Rachel Barrett Flavio Dell'Acqua Marco Catani Laurent Petit Emmanuel Caruyer Alessandro Daducci Tim B Dyrby Tim Holland-Letz Claus C Hilgetag Bram Stieltjes Maxime Descoteaux Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg 69120 Germany. k.maier-hein@dkfz.de. Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg 69120 Germany. Sherbrooke Connectivity Imaging Lab (SCIL) Université de Sherbrooke Sherbrooke QC J1K 0A5 QC Canada. Department of Intelligent Systems Engineering School of Informatics and Computing Indiana University Bloomington IN 47408 USA. Krembil Research Institute University Health Network Toronto Canada M5G 2C4. Department of Neurological Surgery University of Pittsburgh School of Medicine Pittsburgh PA 15213 USA. IMT-Institute for Advanced Studies Lucca 55100 Italy. Department of Diagnostic Imaging St. Jude Children's Research Hospital Memphis TN 38105 USA. University of Toronto Institute of Medical Science Toronto Canada M5S 1A8. Institute of Information Processing and Automation Zhejiang University of Technology Hangzhou 310023 Zhejiang China. United Imaging Healthcare Co Shanghai 201807 China. Shanghai Advanced Research Institute Shanghai 201210 China. Laboratory of Mathematics in Imaging Harvard Medical School Boston MA 02215 USA. Center for Research in Mathematics Guanajuato 36023 Mexico. PROVIDI Lab Image Sciences Institute University Medical Center Utrecht Utrecht 3508 The Netherlands. Cardiff University Brain Research Imaging Centre School of Psychology Cardiff University Maindy Road Cardiff CF24 4HQ UK. Department of Radiology University Medical Center Utrecht Utrecht 3508 The Netherlands. Centre de recherche institut universitaire de geriatrie de Montreal (CRIUGM) Université de Montréal Montreal QC Canada H3W 1W5. Sorbonne Universités UPMC Univ Paris 06 CNRS INSERM Laboratoire d'Imagerie Biomédicale (LIB) 75013 Paris France. Center for Advanced Research in Sleep Medicine Hôpital du Sacré-Coeur de Montréal Montreal Canada H4J 1C5. Neuroimaging Unit Institute of Bioimaging and Molecular Physiology (IBFM) Nat

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：