检索结果-内蒙古大学图书馆

NTIRE 2023 HR NonHomogeneous Dehazing Challenge Report

学校读者我要写书评

暂无评论

NTIRE 2023 HR NonHomogeneous Dehazing Challenge Report

2023 IEEE/CVF Conference on computer vision and Pattern Recognition Workshops, CVPRW 2023

作者： Ancuti, Codruta O. Ancuti, Cosmin Vasluianu, Florin-Alexandru Timofte, Radu Zhou, Han Dong, Wei Liu, Yangyi Chen, Jun Liu, Huan Li, Liangyan Wu, Zijun Dong, Yubo Li, Yuyan Qiu, Tian He, Yu Lu, Yonghong Wu, Yinwei Jiang, Zhenxiang Liu, Songhua Yang, Xingyi Jing, Yongcheng Benjdira, Bilel Ali, Anas M. Koubaa, Anis Yang, Hao-Hsiang Chen, I-Hsiang Chen, Wei-Ting Huang, Zhi-Kai Chen, Yi-Chung Hsieh, Chia-Hsuan Chang, Hua-En Chiang, Yuan-Chun Kuo, Sy-Yen Guo, Yu Gao, Yuan Liu, Ryan Wen Lu, Yuxu Qu, Jingxiang He, Shengfeng Ren, Wenqi Hoang, Trung Zhang, Haichuan Yazdani, Amirsaeed Monga, Vishal Yang, Lehan Wu, Alex Jiahao Mai, Tiancheng Cong, Xiaofeng Yin, Xuemeng Yin, Xuefei Emad, Hazim Abdallah, Ahmed Yasser, Yahya Elshahat, Dalia Elbaz, Esraa Li, Zhan Kuang, Wenqing Luo, Ziwei Gustafsson, Fredrik K. Zhao, Zheng Sjölund, Jens Schön, Thomas B. Zhang, Zhao Wei, Yanyan Wang, Junhu Zhao, Suiyi Zheng, Huan Guo, Jin Sun, Yangfan Liu, Tianli Hao, Dejun Jiang, Kui Sarvaiya, Anjali Prajapati, Kalpesh Patra, Ratnadeep Barik, Pragnesh Rathod, Chaitanya Upla, Kishor Raja, Kiran Ramachandra, Raghavendra Busch, Christoph ETcTI Universitatea Politehnica Timisoara Romania ICTEAM UCL Belgium Computer Vision Lab University of Wuerzburg Germany Computer Vision Lab ETH Zurich Switzerland Department of Electrical and Computer Engineering McMaster University Canada Department of Electrical and Computer Engineering University of Alberta Canada McMaster University Canada Xidian University China Research Institute Singapore National University of Singapore Singapore University of Sydney Australia Robotics and Internet-of-Things Laboratory Prince Sultan University Riyadh12435 Saudi Arabia Department of Electrical Engineering National Taiwan University Taiwan Graduate Institute of Electronics Engineering National Taiwan University Taiwan Graduate Institute of Communication Engineering National Taiwan University Taiwan Wuhan University of Technology China Singapore Management University Singapore Singapore Sun Yat-sen University China Electrical Engineering Department Pennsylvania State University United States The University of Sydney Australia Southeast University China University of California Los Angeles United States Beijing Jiaotong University China Mansoura Univeristy Egypt College of Information Science and Technology Jinan University China Department of Information Technology Uppsala University Sweden Hefei University of Technology China Zhejiang Dahua Technology China Sardar Vallabhbhai National Institute of Technology India Norwegian University of Science and Technology Norway

ISBN: (纸本)9798350302493

This study assesses the outcomes of the NTIRE 2023 Challenge on Non-Homogeneous Dehazing, wherein novel techniques were proposed and evaluated on new image dataset called HD-NH-HAZE. The HD-NH-HAZE dataset contains 50 high resolution pairs of real-life outdoor images featuring nonhomogeneous hazy images and corresponding haze-free images of the same scene. The nonhomogeneous haze was simulated using a professional setup that replicated real-world conditions of hazy scenarios. The competition had 246 participants and 17 teams submitted solutions for the final testing phase. The proposed solutions demonstrated the cutting-edge in image dehazing technology. © 2023 IEEE.

关键词： Demulsification

Fast perception, planning, and execution for a robotic butler: Wheeled humanoid m-hubo

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Lee, Moonyoung Heo, Yujin Park, Jinyong Yang, Hyun-Dae Jang, Ho-Deok Benz, Philipp Park, Hyunsub Kweon, In So Oh, Jun-Ho Humanoid Robot Research Center Department of Mechanical Engineering Korea Advanced Institute of Science and Technology 291 Daehak-ro Yuseong-gu Daejeon34141 Korea Republic of Robotics and Computer Vision Laboratory Department of Electrical Engineering Korea Advanced Institute of Science and Technology 291 Daehak-ro Yuseong-gu Daejeon34141 Korea Republic of

As the aging population grows at a rapid rate, there is an ever growing need for service robot platforms that can provide daily assistance at practical speed with reliable performance. In order to assist with daily tasks such as fetching a beverage, a service robot must be able to perceive its environment and generate corresponding motion trajectories. This becomes a challenging and computationally complex problem when the environment is unknown and thus the path planner must sample numerous trajectories that often are sub-optimal, extending the execution time. To address this issue, we propose a unique strategy of integrating a 3D object detection pipeline with a kinematically optimal manipulation planner to significantly increase speed performance at runtime. In addition, we develop a new robotic butler system for a wheeled humanoid that is capable of fetching requested objects at 24% of the speed a human needs to fulfill the same task. The proposed system was evaluated and demonstrated in a real-world environment setup as well as in public exhibition. Copyright © 2020, The Authors. All rights reserved.

关键词： Mobile robots

Efficient MedSAMs: Segment Anything in Medical Images on Laptop

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ma, Jun Li, Feifei Kim, Sumin Asakereh, Reza Le, Bao-Hiep Nguyen-Vu, Dang-Khoa Pfefferle, Alexander Wei, Muxin Gao, Ruochen Lyu, Donghang Yang, Songxiao Purucker, Lennart Marinov, Zdravko Staring, Marius Lu, Haisheng Dao, Thuy Thanh Ye, Xincheng Li, Zhi Brugnara, Gianluca Vollmuth, Philipp Foltyn-Dumitru, Martha Cho, Jaeyoung Mahmutoglu, Mustafa Ahmed Bendszus, Martin Pflüger, Irada Rastogi, Aditya Ni, Dong Yang, Xin Zhou, Guang-Quan Wang, Kaini Heller, Nicholas Papanikolopoulos, Nikolaos Weight, Christopher Tong, Yubing Udupa, Jayaram K. Patrick, Cahill J. Wang, Yaqi Zhang, Yifan Contijoch, Francisco McVeigh, Elliot Ye, Xin He, Shucheng Haase, Robert Pinetz, Thomas Radbruch, Alexander Krause, Inga Kobler, Erich He, Jian Tang, Yucheng Yang, Haichun Huo, Yuankai Luo, Gongning Kushibar, Kaisar Amankulov, Jandos Toleshbayev, Dias Mukhamejan, Amangeldi Egger, Jan Pepe, Antonio Gsaxner, Christina Luijten, Gijs Fujita, Shohei Kikuchi, Tomohiro Wiestler, Benedikt Kirschke, Jan S. de la Rosa, Ezequiel Bolelli, Federico Lumetti, Luca Grana, Costantino Xie, Kunpeng Wu, Guomin Puladi, Behrus Martín-Isla, Carlos Lekadir, Karim Campello, Victor M. Shao, Wei Brisbane, Wayne Jiang, Hongxu Wei, Hao Yuan, Wu Li, Shuangle Zhou, Yuyin Wang, Bo AI Collaborative Centre University Health Network Department of Laboratory Medicine and Pathobiology University of Toronto Vector Institute Toronto Canada Peter Munk Cardiac Centre University Health Network Toronto Canada Toronto General Hospital Research Institute University Health Network Department of Computer Science University of Toronto University Health Network Vector Institute Toronto Canada University of Science Vietnam National University Ho Chi Minh City Viet Nam Institute of Computer Science University of Freiburg Freiburg Germany School of Medicine and Health Harbin Institute of Technology Harbin China Division of Image Processing Department of Radiology Leiden University Medical Center Leiden Netherlands Department of System and Control Engineering School of Engineering Institute of Science Tokyo Formerly Tokyo Institute of Technology Tokyo Japan Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe Germany School of Information and Communication Engineering University of Electronic Science and Technology of China Chengdu China School of Electrical Engineering and Computer Science University of Queensland Brisbane Australia School of Cyberspace Hangzhou Dianzi University Hangzhou China Division for Computational Radiology and Clinical AI The Department of Neuroradiology University Hospital Bonn Germany Division for Computational Radiology and Clinical AI The Department of Neuroradiology University Hospital Bonn Germany Department of Neuroradiology Heidelberg University Hospital Heidelberg Germany Division for Computational Radiology and Clinical AI Department of Neuroradiology University Hospital Bonn Germany School of Biomedical Engineering Shenzhen University Shenzhen China School of Biological Science and Medical Engineering Southeast University Nanjing China Department of Urology Cleveland Clinic Cleveland United States Department of Computer Science University of Minnesota Minneapolis United St

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical practice. In this work, we organized the first international competition dedicated to promptable medical image segmentation, featuring a large-scale dataset spanning nine common imaging modalities from over 20 different institutions. The top teams developed lightweight segmentation foundation models and implemented an efficient inference pipeline that substantially reduced computational requirements while maintaining state-of-the-art segmentation accuracy. Moreover, the post-challenge phase advanced the algorithms through the design of performance booster and reproducibility tasks, resulting in improved algorithms and validated reproducibility of the winning solution. Furthermore, the best-performing algorithms have been incorporated into the open-source software with a user-friendly interface to facilitate clinical adoption. The data and code are publicly available to foster the further development of medical image segmentation foundation models and pave the way for impactful real-world applications. © 2024, CC BY-NC-SA.

关键词： Open source software

Vehicular Multi-Camera Sensor System for Automated Visual Inspection of Electric Power Distribution Equipment

学校读者我要写书评

暂无评论

Vehicular Multi-Camera Sensor System for Automated Visual In...

2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Jinsun Park Ukcheol Shin Gyumin Shim Kyungdon Joo Francois Rameau Junhyeok Kim Dong-Geol Choi In So Kweon Robotics and Computer Vision Laboratory School of Electrical Engineering KAIST Daejeon Republic of Korea Korea Electric Power Corporation Korea Electric Power Research Institute Daejeon Republic of Korea Department of Information and Communication Engineering Hanbat National University Daejeon Republic of Korea

In this paper, we present a multi-camera sensor system along with its control algorithm for automated visual inspection from a moving vehicle. To accomplish this task, we propose a unique hardware configuration consisting of a frontal stereo vision system, six lateral cameras motorized to tilt, and a GPS/IMU sensor mounted on the roof of a car. From the frontal stereo system, we detect electric poles and estimate their corresponding 3D positions. Based on this 3D estimation, the tilt angles of the motorized lateral cameras are controlled in real-time to capture high resolution images of the equipment - typically installed a few meters above the road surface. In addition, inertial odometry information from the GPS/IMU module is utilized for pose estimation, object localization, and re-identification among cameras. Experimental results demonstrate the efficiency and robustness of our system for automated electric equipment maintenance, which can reduce human effort significantly.

关键词：

Why is the Winner the Best?

学校读者我要写书评

暂无评论

Why is the Winner the Best?

Conference on computer vision and Pattern Recognition (CVPR)

作者： M. Eisenmann A. Reinke V. Weru M. D. Tizabi F. Isensee T. J. Adler S. Ali V. Andrearczyk M. Aubreville U. Baid S. Bakas N. Balu S. Bano J. Bernal S. Bodenstedt A. Casella V. Cheplygina M. Daum M. De Bruijne A. Depeursinge R. Dorent J. Egger D. G. Ellis S. Engelhardt M. Ganz N. Ghatwary G. Girard P. Godau A. Gupta L. Hansen K. Harada M. Heinrich N. Heller A. Hering A. Huaulmé P. Jannin A. E. Kavur O. Kodym M. Kozubek J. Li H. Li J. Ma C. Martín-Isla B. Menze A. Noble V. Oreiller N. Padoy S. Pati K. Payette T. Rädsch J. Rafael-Patiño V. Singh Bawa S. Speidel C. H. Sudre K. Van Wijnen M. Wagner D. Wei A. Yamlahi M. H. Yap C. Yuan M. Zenk A. Zia D. Zimmerer D. Aydogan B. Bhattarai L. Bloch R. Brüngel J. Cho C. Choi Q. Dou I. Ezhov C. M. Friedrich C. Fuller R. R. Gaire A. Galdran Á. García Faura M. Grammatikopoulou S. Hong M. Jahanifar I. Jang A. Kadkhodamohammadi I. Kang F. Kofler S. Kondo H. Kuijf M. Li M. Luu T. Martinčič P. Morais M. A. Naser B. Oliveira D. Owen S. Pang J. Park S. Park S. Płotka E. Puybareau N. Rajpoot K. Ryu N. Saeed A. Shephard P. Shi D. Štepec R. Subedi G. Tochon H. R. Torres H. Urien J. L. Vilaça K. A. Wahid H. Wang J. Wang L. Wang X. Wang B. Wiestler M. Wodzinski F. Xia J. Xie Z. Xiong S. Yang Y. Yang Z. Zhao K. Maier-Hein P. F. Jäger A. Kopp-Schneider L. Maier-Hein Division of Intelligent Medical Systems German Cancer Research Center (DKFZ) Heidelberg Germany Helmholtz Imaging German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Division of Biostatistics German Cancer Research Center (DKFZ) Heidelberg Germany Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Engineering and Physical Sciences School of Computing University of Leeds Leeds UK Institute of Informatics School of Management HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland Sierre Switzerland Department of Nuclear Medicine and Molecular Imaging Lausanne University Hospital Lausanne Switzerland Technische Hochschule Ingolstadt Ingolstadt Germany Center for Artificial Intelligence and Data Science for Integrated Diagnostics (AI2D) and Center for Biomedical Image Computing and Analytics (CBICA) University of Pennsylvania Philadelphia PA USA Department of Pathology and Laboratory Medicine Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology University of Washington Seattle WA USA Department of Computer Science Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) University College London London UK Universitat Autònoma de Barcelona & Computer Vision Center Barcelona Spain Division of Translational Surgical Oncology National Center for Tumor Diseases (NCT/UCC) Dresden Dresden Germany Department of Advanced Robotics Istituto Italiano di Tecnologia Italy Department of Electronics Information and Bioengineering Politecnico di Milano Milan Italy IT University of Copenhagen Copenhagen Denmark Department of General Visceral and Transplantation Surgery Heidelberg University Hospital Heidelberg Germany Department of Radiology and Nuc

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multicenter study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and post-processing (66%). The “typical” lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work.

关键词：

Understanding metric-related pitfalls in image analysis validation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Reinke, Annika Tizabi, Minu D. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Kavur, A. Emre Rädsch, Tim Sudre, Carole H. Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Buettner, Florian Cardoso, M. Jorge Cheplygina, Veronika Chen, Jianxu Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kleesiek, Jens Kofler, Florian Kooi, Thijs Kopp-Schneider, Annette Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Riegler, Michael A. Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. van Calster, Ben Varoquaux, Gaël Yaniv, Ziv R. Jäger, Paul F. Maier-Hein, Lena Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany NCT Heidelberg A Partnership Between DKFZ University Medical Center Heidelberg Germany Heidelberg Division of Medical Image Computing Germany Heidelberg Division of Intelligent Medical Systems Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montreal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Leuven Belgium partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany and Frankfurt Cancer Insititute Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for Statistics in Medicine University of Oxford Oxford United Kingdom Center for Biomedical In

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately. While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. While focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation. © 2023, CC BY.

关键词： computer vision

Metrics Reloaded: Recommendations for image analysis validation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Maier-Hein, Lena Reinke, Annika Godau, Patrick Tizabi, Minu D. Buettner, Florian Christodoulou, Evangelia Glocker, Ben Isensee, Fabian Kleesiek, Jens Kozubek, Michal Reyes, Mauricio Riegler, Michael A. Wiesenfarth, Manuel Emre Kavur, A. Sudre, Carole H. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Rädsch, Tim Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Jorge Cardoso, M. Cheplygina, Veronika Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian Ginneken, Bram Van Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kofler, Florian Kopp-Schneider, Annette Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rajpoot, Nasir Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Smeden, Maarten Van Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben Van Varoquaux, Gaël Jäger, Paul F. Heidelberg Division of Intelligent Medical Systems and HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg a partnership between DKFZ University Medical Center Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt-Marburg Germany Heidelberg Goethe University Frankfurt Germany Department of Medicine Goethe University Frankfurt Germany Department of Informatics Frankfurt Cancer Insititute Germany Department of Computing Imperial College London London United Kingdom Heidelberg Division of Medical Image Computing and HI Applied Computer Vision Lab Germany Institute for AI in Medicine University Medicine Essen Essen Germany Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic ARTORG Center for Biomedical Engineering Research University of Bern Bern Switzerland Department of Radiation Oncology University Hospital Bern University of Bern Bern Switzerland Simula Metropolitan Center for Digital Engineering Oslo Norway UiT The Arctic University of Norway Romsø Norway Heidelberg Division of Biostatistics Germany Heidelberg Division of Intelligent Medical Systems Division of Medical Image Computing HI Applied Computer Vision Lab Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Heidelberg Division of Medical Image Computing Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. It was developed by a large international consortium in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint – a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases. © 2022, CC BY.

关键词： Semantic Segmentation

QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Mehta, Raghav Filos, Angelos Baid, Ujjwal Sako, Chiharu McKinley, Richard Rebsamen, Michael Dätwyler, Katrin Meier, Raphael Radojewski, Piotr Murugesan, Gowtham Krishnan Nalawade, Sahil Ganesh, Chandan Wagner, Ben Yu, Fang F. Fei, Baowei Madhuranthakam, Ananth J. Maldjian, Joseph A. Daza, Laura Gómez, Catalina Arbeláez, Pablo Dai, Chengliang Wang, Shuo Reynaud, Hadrien Mo, Yuanhan Angelini, Elsa Guo, Yike Bai, Wenjia Banerjee, Subhashis Pei, Linmin Murat, A.K. Rosas-González, Sarahi Zemmoura, Ilyess Tauber, Clovis Vu, Minh H. Nyholm, Tufve Löfstedt, Tommy Ballestar, Laura Mora Vilaplana, Veronica McHugh, Hugh Talou, Gonzalo Maso Wang, Alan Patel, Jay Chang, Ken Hoebel, Katharina Gidwani, Mishka Arun, Nishanth Gupta, Sharut Aggarwal, Mehak Singh, Praveer Gerstner, Elizabeth R. Kalpathy-Cramer, Jayashree Boutry, Nicolas Huard, Alexis Vidyaratne, Lasitha Rahman, Md Monibor Iftekharuddin, Khan M. Chazalon, Joseph Puybareau, Elodie Tochon, Guillaume Ma, Jun Cabezas, Mariano Llado, Xavier Oliver, Arnau Valencia, Liliana Valverde, Sergi Amian, Mehdi Soltaninejad, Mohammadreza Myronenko, Andriy Hatamizadeh, Ali Feng, Xue Dou, Quan Tustison, Nicholas Meyer, Craig Shah, Nisarg A. Talbar, Sanjay Weber, Marc-André Mahajan, Abhishek Jakab, Andras Wiest, Roland Fathallah-Shaykh, Hassan M. Nazeri, Arash Milchenko, Mikhail Marcus, Daniel Kotrotsou, Aikaterini Colen, Rivka Freymann, John Kirby, Justin Davatzikos, Christos Menze, Bjoern Bakas, Spyridon Gal, Yarin Arbel, Tal McGill University MontrealQC Canada Group University of Oxford Oxford United Kingdom University of Pennsylvania PhiladelphiaPA United States Department of Radiology Perelman School of Medicine The University of Pennsylvania PhiladelphiaPA United States Department of Pathology and Laboratory Medicine Perelman School of Medicine University of Pennsylvania PhiladelphiaPA United States University Institute of Diagnostic and Interventional Neuroradiology University of Bern Inselspital Bern University Hospital Bern Switzerland Department of Radiology University of Texas Southwestern Medical Center DallasTX United States Department of Bioengineering University of Texas DallasTX United States Advanced Imaging Research Center University of Texas Southwestern Medical Center DallasTX United States Universidad de los Andes Bogotá Colombia Data Science Institute Imperial College London London United Kingdom NIHR Imperial BRC ITMAT Data Science Group Imperial College London London United Kingdom Department of Brain Sciences Imperial College London London United Kingdom Machine Intelligence Unit Indian Statistical Institute Kolkata India Department of CSE University of Calcutta Kolkata India Department of Information Technology Uppsala University Uppsala Sweden Department of Diagnostic Radiology The University of Pittsburgh Medical Center PittsburghPA United States UMR U1253 iBrain Université de Tours Inserm Tours France Department of Radiation Sciences Umeå University Umeå Sweden Department of Computing Science Umeå University Umeå Sweden Signal Theory and Communications Department Universitat Politècnica de Catalunya Barcelona Tech Barcelona Spain Faculty of Medical and Health Sciences University of Auckland Auckland New Zealand Radiology Department Auckland City Hospital Auckland New Zealand Auckland Bioengineering Institute University of Auckland New Zealand Athinoula A. Martinos Center for Biomedical Imaging Department of Radiology

Deep learning (DL) models have provided state-of-the-art performance in various medical imaging benchmarking challenges, including the Brain Tumor Segmentation (BraTS) challenges. However, the task of focal pathology multi-compartment segmentation (e.g., tumor and lesion sub-regions) is particularly challenging, and potential errors hinder translating DL models into clinical workflows. Quantifying the reliability of DL model predictions in the form of uncertainties could enable clinical review of the most uncertain regions, thereby building trust and paving the way toward clinical translation. Several uncertainty estimation methods have recently been introduced for DL medical image segmentation tasks. Developing scores to evaluate and compare the performance of uncertainty measures will assist the end-user in making more informed decisions. In this study, we explore and evaluate a score developed during the BraTS 2019 and BraTS 2020 task on uncertainty quantification (QU-BraTS) and designed to assess and rank uncertainty estimates for brain tumor multi-compartment segmentation. This score (1) rewards uncertainty estimates that produce high confidence in correct assertions and those that assign low confidence levels at incorrect assertions, and (2) penalizes uncertainty measures that lead to a higher percentage of under-confident correct assertions. We further benchmark the segmentation uncertainties generated by 14 independent participating teams of QU-BraTS 2020, all of which also participated in the main BraTS segmentation task. Overall, our findings confirm the importance and complementary value that uncertainty estimates provide to segmentation algorithms, highlighting the need for uncertainty quantification in medical image analyses. Finally, in favor of transparency and reproducibility, our evaluation code is made publicly available at https://***/RagMeh11/QU-BraTS. © 2021, CC BY.

关键词： Benchmarking

Common Limitations of Image Processing Metrics: A Picture Story

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Reinke, Annika Tizabi, Minu D. Sudre, Carole H. Eisenmann, Matthias Rädsch, Tim Baumgartner, Michael Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Bankhead, Peter Benis, Arriel Blaschko, Matthew Buettner, Florian Cardoso, M. Jorge Chen, Jianxu Cheplygina, Veronika Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Engelhardt, Sandy Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hamprecht, Fred Hashimoto, Daniel A. Heckmann-Nötzel, Doreen Hirsch, Peter Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kavur, A. Emre Kenngott, Hannes Kleesiek, Jens Kleppe, Andreas Koehler, Sven Kofler, Florian Kopp-Schneider, Annette Kooi, Thijs Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moher, David Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Noyan, M. Alican Petersen, Jens Polat, Gorkem Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Rieke, Nicola Riegler, Michael A. Rivaz, Hassan Saez-Rodriguez, Julio Sánchez, Clara I. Schroeter, Julien Saha, Anindo Selver, M. Alper Sharan, Lalith Shetty, Shravya Smeden, Maarten V.A.N. Stieltjes, Bram Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben V.A.N. Varoquaux, Gaël Wiesenfarth, Manuel Yaniv, Ziv R. Jäger, Paul Maier-Hein, Lena Division of Intelligent Medical Systems and HI Helmholtz Imaging Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Division of Intelligent Medical Systems Heidelberg Germany NCT Heidelberg DKFZ University Medical Center Heidelberg Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Division of Medical Image Computing Heidelberg Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Institute of Genetics and Cancer University of Edinburgh Edinburgh United Kingdom Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Kasteelpark Arenberg 10 - box 2441 Leuven3001 Belgium Frankfurt/Mainz DKFZ UCT Frankfurt-Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany Frankfurt Cancer Insititute Germany Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for St

While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using specific metrics for a given image analysis task. These are typically related to (1) the disregard of inherent metric properties, such as the behaviour in the presence of class imbalance or small target structures, (2) the disregard of inherent data set properties, such as the non-independence of the test cases, and (3) the disregard of the actual biomedical domain interest that the metrics should reflect. This living dynamically document has the purpose to illustrate important limitations of performance metrics commonly applied in the field of image analysis. In this context, it focuses on biomedical image analysis problems that can be phrased as image-level classification, semantic segmentation, instance segmentation, or object detection task. The current version is based on a Delphi process on metrics conducted by an international consortium of image analysis experts from more than 60 institutions worldwide. © 2021, CC BY.

关键词： Medical imaging