检索结果-内蒙古大学图书馆

Machine Learning based Reduced Kernel PCA for Nonlinear Process Monitoring

学校读者我要写书评

暂无评论

Machine Learning based Reduced Kernel PCA for Nonlinear Proc...

International Conference on Internet of Things, Embedded Systems and Communications (IINTEC)

作者： Khaled Dhibi Radhia Fezai Majdi Mansouri Abdelmalek Kouadri Kais Bouzrara Laboratory of Automatic Signal and Image Processing National School of Engineers of Monastir University of Monastir Tunisia Electrical and Computer Engineering Program Texas A&M University at Qatar Doha QATAR

ISBN: (数字)9781728151847

ISBN: (纸本)9781728151854

Process monitoring is an essential part of industrial systems. It requires higher product quality and safety operations. Therefore, a nonlinear data-driven approach based reduced KPCA (RKPCA) for statistical monitoring of industrial processes is developed. RKPCA is a novel machine learning tool which merges dimensionality reduction and supervised learning. The use of classical KPCA for modeling and monitoring purposes can impose a high computational load when a large number of measurements are recorded. The main idea of the proposed RKPCA approach is to reduce the number of observations (samples) in the data matrix using the Euclidean distance between samples as dissimilarity metric so that only one observation is kept in case of redundancy. The Tennessee Eastman Process (TEP) is used to evaluate the fault detection abilities of the proposed RKPCA technique. The performance of the proposed method is evaluated and compared to the classical KPCA in terms of false alarms rates (FAR), missed detection rates (MDR) and computation times (CT).

关键词：

Understanding metric-related pitfalls in image analysis validation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Reinke, Annika Tizabi, Minu D. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Kavur, A. Emre Rädsch, Tim Sudre, Carole H. Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Buettner, Florian Cardoso, M. Jorge Cheplygina, Veronika Chen, Jianxu Christodoulou, Evangelia Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian van Ginneken, Bram Glocker, Ben Godau, Patrick Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Isensee, Fabian Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kleesiek, Jens Kofler, Florian Kooi, Thijs Kopp-Schneider, Annette Kozubek, Michal Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rafelski, Susanne M. Rajpoot, Nasir Reyes, Mauricio Riegler, Michael A. Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. van Calster, Ben Varoquaux, Gaël Yaniv, Ziv R. Jäger, Paul F. Maier-Hein, Lena Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany NCT Heidelberg A Partnership Between DKFZ University Medical Center Heidelberg Germany Heidelberg Division of Medical Image Computing Germany Heidelberg Division of Intelligent Medical Systems Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montreal Canada Division of Computational Pathology Dept of Pathology & Laboratory Medicine Indiana University School of Medicine IU Health Information and Translational Sciences Building Indianapolis United States University of Pennsylvania Richards Medical Research Laboratories FL7 PhiladelphiaPA United States Department of Digital Medical Technologies Holon Institute of Technology Holon Israel European Federation for Medical Informatics Le Mont-sur-Lausanne Switzerland Center for Processing Speech and Images Department of Electrical Engineering KU Leuven Leuven Belgium partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt Marburg Germany Heidelberg Germany Goethe University Frankfurt Department of Medicine Germany Goethe University Frankfurt Department of Informatics Germany and Frankfurt Cancer Insititute Germany Department of Computer Science IT University of Copenhagen Copenhagen Denmark Leibniz-Institut für Analytische Wissenschaften – ISAS – e.V. Dortmund Germany Imaging Platform Broad Institute of MIT and Harvard CambridgeMA United States Centre for Statistics in Medicine University of Oxford Oxford United Kingdom Center for Biomedical In

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately. While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. While focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation. © 2023, CC BY.

关键词： computer vision

94 GHz Three-Dimensional Imaging Radar for Environmental Detection 8

学校读者我要写书评

暂无评论

94 GHz Three-Dimensional Imaging Radar for Environmental Det...

8th Asia-Pacific Conference on Antennas and Propagation, APCAP 2019

作者： Wu, HongMing Qi, Feng Wang, Jinkuan Northeastern University College of Information Science and Engineering Shenyang110819 China Chinese Academy of Sciences Shenyang Institute of Automation Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110016 China Key Laboratory of Opto-Electronic Information Processing Chinese Academy of Sciences Shenyang110016 China Key Lab of Image Understanding and Computer Vision Liaoning Province Shenyang110016 China

ISBN: (纸本)9781665400541

At present, With the development of technology, the high resolution of millimeter wave (terahertz) can be applied to environmental sensing imaging. In this paper, Using the frequency-modulated continuous-wave (FMCW) radar technique with a 1GHz bandwidth, we show experimentally that a high-resolution real time imaging radar operating at 93.5-94.5GHz is capable of detecting different car models at standoff ranges of 12 m. We also achieved 3D high-resolution imaging of the building. at 140 meters. © 2019 IEEE.

关键词： Millimeter waves

Enhanced Machine Learning Approaches for Diagnosing Building Systems

学校读者我要写书评

暂无评论

Enhanced Machine Learning Approaches for Diagnosing Building...

International Conference on Internet of Things, Embedded Systems and Communications (IINTEC)

作者： Sondes Gharsellaoui Majdi Mansouri Shady S. Refaat Haitham Abu-Rub Hassani Messaoud National Higher Engineering School of Tunis Monfleury Tunisia Electrical and Computer Engineering Program Texas A&M University at Qatar Doha Qatar National Engineering School of Monastir Laboratory of Automatic Signal and Image Processing Monastir Tunisia

ISBN: (数字)9781728151847

ISBN: (纸本)9781728151854

Fault Detection and Classification (FDC) in Heating, Ventilation, and Air Conditioning (HVAC) systems is an important approach to guarantee the human safety of these systems. Therefore, the implementation of a FDC framework is the focus in this paper. The developed approach aims at reducing the energy needs for buildings and improving indoor environment quality. It merges the benefits of multiscale representation, Principal Component Analysis (PCA), and Machine Learning (ML) classifiers in order to improve the efficiency of FDC in heating systems. Firstly, a multiscale decomposition is used to extract the dynamics of the systems at different scales. The multiscale representation gives several advantages for monitoring heating systems generally driven by events in different time and frequency responses. Secondly, the multiscaled data-sets are then introduced into the PCA model to extract more efficient characteristics. Thirdly, the ML algorithms are applied to the extracted and selected characteristics to deal with the problem of fault diagnosis. The FDC efficiency of the developed technique is evaluated using a simulated data extracted from heating systems.

关键词：

Performance Comparison Between SURF and SIFT for Content-Based image Retrieval

学校读者我要写书评

暂无评论

Performance Comparison Between SURF and SIFT for Content-Bas...

IEEE International Conference on Signal and image processing Applications (ICSIPA)

作者： Najeeb Ur Rehman Malik Awais Gul Airij Sheeraz Ahmed Memon Yasmeen Naz Panhwar Syed A.R. Abu-Bakar Mohamed A. El-Khoreby University of Wollongong New South Wales Australia Computer Vision Video and Image Processing Research Lab School of Electrical Engineering Universiti Teknologi Malaysia UTM Johor Bahru Campus Johor Malaysia Mehran University of Engineering & Technology Jamshoro Sindh Pakistan

Speeded-Up Robust Feature (SURF) and Scale Invariant Feature Transform (SIFT) have been two well-known methods used in extracting features. This paper presents and analyzes performance comparison between the SURF approach and the SIFT technique for content-based image retrieval (CBIR) application. In particular, we are interested in comparing the accuracy and the response time between these two methods. For the testing purposes, we make use sample images obtained for the Pennsylvania State College of Information Science and Technology database. As it turns out, in this paper, we will demonstrate that in terms of accuracy and speed, SURF shows superior performance compared to SIFT.

关键词：

Benchmarking quality-dependent and cost-sensitive score-level multimodal biometric fusion algorithms

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Poh, Norman Bourlai, Thirimachos Kittler, Josef Allano, Lorene Alonso-Fernandez, Fernando Ambekar, Onkar Baker, John Dorizzi, Bernadette Fatukasi, Omolara Fierrez, Julian Ganster, Harald Ortega-Garcia, Javier Maurer, Donald Salah, Albert Ali Scheidat, Tobias Vielhauer, Claus Centre for Vision Speech and Signal Processing School of Electronics and Physical Sciences University of Surrey Guildford SurreyGU2 7XH United Kingdom Biometrics Center Lane Department of Computer Science and Electrical Engineering College of Engineering and Mineral Resources West Virginia University MorgantownWV26506-6109 United States Institut Telecom Telecom and Management SudParis Evry91011 France Biometric Recognition Group – ATVS Escuela Politecnica Superior Universidad Autonoma de Madrid Madrid28049 Spain Amsterdam1098 XG Netherlands Applied Physics Laboratory Johns Hopkins University LaurelMD20723 United States Electronics and Physics Department Institut Telecom Telecom and Management SudParis Evry91011 France Institute of Digital Image Processing Joanneum Research Graz8010 Austria ISLA-ISIS University of Amsterdam Amsterdam1098 XG Netherlands Department of Informatics and Media Brandenburg University of Applied Sciences Brandenburg an der HavelD-14770 Germany Research Group Multimedia and Security Department of Technical and Business Information Systems Faculty of Computer Science Otto-von-Guericke-University of Magdeburg MagdeburgD-39106 Germany

Automatically verifying the identity of a person by means of biometrics (e.g., face and fingerprint) is an important application in our day-to-day activities such as accessing banking services and security control in airports. To increase the system reliability, several biometric devices are often used. Such a combined system is known as a multimodal biometric system. This paper reports a benchmarking study carried out within the framework of the BioSecure DS2 (Access Control) evaluation campaign organized by the University of Surrey, involving face, fingerprint, and iris biometrics for person authentication, targeting the application of physical access control in a medium-size establishment with some 500 persons. While multimodal biometrics is a well-investigated subject in the literature, there exists no benchmark for a fusion algorithm comparison. Working towards this goal, we designed two sets of experiments: quality-dependent and cost-sensitive evaluation. The quality-dependent evaluation aims at assessing how well fusion algorithms can perform under changing quality of raw biometric images principally due to change of devices. The cost-sensitive evaluation, on the other hand, investigates how well a fusion algorithm can perform given restricted computation and in the presence of software and hardware failures, resulting in errors such as failure-to-acquire and failure-to-match. Since multiple capturing devices are available, a fusion algorithm should be able to handle this nonideal but nevertheless realistic scenario. In both evaluations, each fusion algorithm is provided with scores from each biometric comparison subsystem as well as the quality measures of both the template and the query data. The response to the call of the evaluation campaign proved very encouraging, with the submission of 22 fusion systems. To the best of our knowledge, this campaign is the first attempt to benchmark quality-based multimodal fusion algorithms. In the presence of changing

关键词： Benchmarking

NTIRE 2020 Challenge on image and Video Deblurring

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Seungjun, Nah Sanghyun, Son Radu, Timofte Kyoung Mu, Lee Tseng, Yu Xu, Yu-Syuan Chiang, Cheng-Ming Tsai, Yi-Min Brehm, Stephan Scherer, Sebastian Xu, Dejia Chu, Yihao Sun, Qingyan Jiang, Jiaqin Duan, Lunhao Yao, Jian Purohit, Kuldeep Suin, Maitreya Rajagopalan, A.N. Ito, Yuichi Hrishikesh, P.S. Puthussery, Densen Akhil, K.A. Jiji, C.V. Kim, Guisik Deepa, P.L. Xiong, Zhiwei Huang, Jie Liu, Dong Kim, Sangmin Nam, Hyungjoon Kim, Jisu Jeong, Jechang Huang, Shihua Fan, Yuchen Yu, Jiahui Yu, Haichao Huang, Thomas S. Zhou, Ya Li, Xin Liu, Sen Chen, Zhibo Dutta, Saikat Das, Sourya Dipta Garg, Shivam Sprague, Daniel Patel, Bhrij Huck, Thomas Department of ECE ASRI SNU Korea Republic of Computer Vision Lab ETH Zurich Switzerland MediaTek Inc University of Augsburg Chair for Multimedia Computing and Computer Vision Lab Germany Peking University China Beijing University of Posts and Telecommunications China Beijing Jiaotong University China Wuhan University China Indian Institute of Technology Madras India Vermilion College of Engineering Trivandrum India CVML Chung-Ang University Korea Republic of APJ Abdul Kalam Technological University India University of Science and Technology of China China Image Communication Signal Processing Laboratory Hanyang University Korea Republic of Southern University of Science and Technology China University of Illinois at Urbana-Champaign United States CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China China IIT Madra Jadavpur University India University of Texas Austin United States Duke University Computer Science Department United States

Motion blur is one of the most common degradation artifacts in dynamic scene photography. This paper reviews the NTIRE 2020 Challenge on image and Video Deblurring. In this challenge, we present the evaluation results from 3 competition tracks as well as the proposed solutions. Track 1 aims to develop single-image deblurring methods focusing on restoration quality. On Track 2, the image deblurring methods are executed on a mobile platform to find the balance of the running speed and the restoration accuracy. Track 3 targets developing video deblurring methods that exploit the temporal relation between input frames. In each competition, there were 163, 135, and 102 registered participants and in the final testing phase, 9, 4, and 7 teams competed. The winning methods demonstrate the state-of-the-art performance on image and video deblurring tasks. Copyright © 2020, The Authors. All rights reserved.

关键词： image enhancement

Metrics Reloaded: Recommendations for image analysis validation

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Maier-Hein, Lena Reinke, Annika Godau, Patrick Tizabi, Minu D. Buettner, Florian Christodoulou, Evangelia Glocker, Ben Isensee, Fabian Kleesiek, Jens Kozubek, Michal Reyes, Mauricio Riegler, Michael A. Wiesenfarth, Manuel Emre Kavur, A. Sudre, Carole H. Baumgartner, Michael Eisenmann, Matthias Heckmann-Nötzel, Doreen Rädsch, Tim Acion, Laura Antonelli, Michela Arbel, Tal Bakas, Spyridon Benis, Arriel Blaschko, Matthew B. Jorge Cardoso, M. Cheplygina, Veronika Cimini, Beth A. Collins, Gary S. Farahani, Keyvan Ferrer, Luciana Galdran, Adrian Ginneken, Bram Van Haase, Robert Hashimoto, Daniel A. Hoffman, Michael M. Huisman, Merel Jannin, Pierre Kahn, Charles E. Kainmueller, Dagmar Kainz, Bernhard Karargyris, Alexandros Karthikesalingam, Alan Kenngott, Hannes Kofler, Florian Kopp-Schneider, Annette Kreshuk, Anna Kurc, Tahsin Landman, Bennett A. Litjens, Geert Madani, Amin Maier-Hein, Klaus Martel, Anne L. Mattson, Peter Meijering, Erik Menze, Bjoern Moons, Karel G.M. Müller, Henning Nichyporuk, Brennan Nickel, Felix Petersen, Jens Rajpoot, Nasir Rieke, Nicola Saez-Rodriguez, Julio Sánchez, Clara I. Shetty, Shravya Smeden, Maarten Van Summers, Ronald M. Taha, Abdel A. Tiulpin, Aleksei Tsaftaris, Sotirios A. Calster, Ben Van Varoquaux, Gaël Jäger, Paul F. Heidelberg Division of Intelligent Medical Systems and HI Helmholtz Imaging Germany Faculty of Mathematics and Computer Science and Medical Faculty Heidelberg University Heidelberg Germany NCT Heidelberg a partnership between DKFZ University Medical Center Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Heidelberg Division of Intelligent Medical Systems Germany partner site Frankfurt/Mainz a partnership between DKFZ and UCT Frankfurt-Marburg Germany Heidelberg Goethe University Frankfurt Germany Department of Medicine Goethe University Frankfurt Germany Department of Informatics Frankfurt Cancer Insititute Germany Department of Computing Imperial College London London United Kingdom Heidelberg Division of Medical Image Computing and HI Applied Computer Vision Lab Germany Institute for AI in Medicine University Medicine Essen Essen Germany Centre for Biomedical Image Analysis Faculty of Informatics Masaryk University Brno Czech Republic ARTORG Center for Biomedical Engineering Research University of Bern Bern Switzerland Department of Radiation Oncology University Hospital Bern University of Bern Bern Switzerland Simula Metropolitan Center for Digital Engineering Oslo Norway UiT The Arctic University of Norway Romsø Norway Heidelberg Division of Biostatistics Germany Heidelberg Division of Intelligent Medical Systems Division of Medical Image Computing HI Applied Computer Vision Lab Germany MRC Unit for Lifelong Health and Ageing UCL Centre for Medical Image Computing Department of Computer Science University College London London United Kingdom School of Biomedical Engineering and Imaging Science King’s College London London United Kingdom Heidelberg Division of Medical Image Computing Germany Instituto de Cálculo CONICET – Universidad de Buenos Aires Buenos Aires Argentina Centre for Medical Image Computing University College London London United Kingdom McGill University Montréal

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. It was developed by a large international consortium in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint – a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases. © 2022, CC BY.

关键词： Semantic Segmentation

Why is the Winner the Best?

学校读者我要写书评

暂无评论

Why is the Winner the Best?

Conference on computer vision and Pattern Recognition (CVPR)

作者： M. Eisenmann A. Reinke V. Weru M. D. Tizabi F. Isensee T. J. Adler S. Ali V. Andrearczyk M. Aubreville U. Baid S. Bakas N. Balu S. Bano J. Bernal S. Bodenstedt A. Casella V. Cheplygina M. Daum M. De Bruijne A. Depeursinge R. Dorent J. Egger D. G. Ellis S. Engelhardt M. Ganz N. Ghatwary G. Girard P. Godau A. Gupta L. Hansen K. Harada M. Heinrich N. Heller A. Hering A. Huaulmé P. Jannin A. E. Kavur O. Kodym M. Kozubek J. Li H. Li J. Ma C. Martín-Isla B. Menze A. Noble V. Oreiller N. Padoy S. Pati K. Payette T. Rädsch J. Rafael-Patiño V. Singh Bawa S. Speidel C. H. Sudre K. Van Wijnen M. Wagner D. Wei A. Yamlahi M. H. Yap C. Yuan M. Zenk A. Zia D. Zimmerer D. Aydogan B. Bhattarai L. Bloch R. Brüngel J. Cho C. Choi Q. Dou I. Ezhov C. M. Friedrich C. Fuller R. R. Gaire A. Galdran Á. García Faura M. Grammatikopoulou S. Hong M. Jahanifar I. Jang A. Kadkhodamohammadi I. Kang F. Kofler S. Kondo H. Kuijf M. Li M. Luu T. Martinčič P. Morais M. A. Naser B. Oliveira D. Owen S. Pang J. Park S. Park S. Płotka E. Puybareau N. Rajpoot K. Ryu N. Saeed A. Shephard P. Shi D. Štepec R. Subedi G. Tochon H. R. Torres H. Urien J. L. Vilaça K. A. Wahid H. Wang J. Wang L. Wang X. Wang B. Wiestler M. Wodzinski F. Xia J. Xie Z. Xiong S. Yang Y. Yang Z. Zhao K. Maier-Hein P. F. Jäger A. Kopp-Schneider L. Maier-Hein Division of Intelligent Medical Systems German Cancer Research Center (DKFZ) Heidelberg Germany Helmholtz Imaging German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Mathematics and Computer Science Heidelberg University Heidelberg Germany Division of Biostatistics German Cancer Research Center (DKFZ) Heidelberg Germany Division of Medical Image Computing German Cancer Research Center (DKFZ) Heidelberg Germany Faculty of Engineering and Physical Sciences School of Computing University of Leeds Leeds UK Institute of Informatics School of Management HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland Sierre Switzerland Department of Nuclear Medicine and Molecular Imaging Lausanne University Hospital Lausanne Switzerland Technische Hochschule Ingolstadt Ingolstadt Germany Center for Artificial Intelligence and Data Science for Integrated Diagnostics (AI2D) and Center for Biomedical Image Computing and Analytics (CBICA) University of Pennsylvania Philadelphia PA USA Department of Pathology and Laboratory Medicine Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology Perelman School of Medicine University of Pennsylvania Philadelphia PA USA Department of Radiology University of Washington Seattle WA USA Department of Computer Science Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) University College London London UK Universitat Autònoma de Barcelona & Computer Vision Center Barcelona Spain Division of Translational Surgical Oncology National Center for Tumor Diseases (NCT/UCC) Dresden Dresden Germany Department of Advanced Robotics Istituto Italiano di Tecnologia Italy Department of Electronics Information and Bioengineering Politecnico di Milano Milan Italy IT University of Copenhagen Copenhagen Denmark Department of General Visceral and Transplantation Surgery Heidelberg University Hospital Heidelberg Germany Department of Radiology and Nuc

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multicenter study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and post-processing (66%). The “typical” lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work.

关键词：