检索结果-内蒙古大学图书馆

learning Embeddings for Image Clustering: An Empirical Study of Triplet Loss Approaches

学校读者我要写书评

暂无评论

Learning Embeddings for Image Clustering: An Empirical Study...

International Conference on Pattern Recognition

作者： Kalun Ho Janis Keuper Franz-Josef Pfreundt Margret Keuper Data and Web Science Group University of Mannheim Germany Institute for Machine Learning and Analytics (IMLA) Offenburg University Germany Competence Center High Performance Computing Fraunhofer ITWM Kaiserslautern Germany

In this work, we evaluate two different image clustering objectives, k-means clustering and correlation clustering, in the context of Triplet Loss induced feature space embeddings. Specifically, we train a convolutional neural network to learn discriminative features by optimizing two popular versions of the Triplet Loss in order to study their clustering properties under the assumption of noisy labels. Additionally, we propose a new, simple Triplet Loss formulation, which shows desirable properties with respect to formal clustering objectives and outperforms the existing methods. We evaluate all three Triplet loss formulations for K-means and correlation clustering on the CIFAR-10 image classification dataset.

关键词： Correlation Pattern recognition Noise measurement Convolutional neural networks Image classification

Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyond

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Hedström, Anna Weber, Leander Bareeva, Dilyara Krakowczyk, Daniel Motzkus, Franz Samek, Wojciech Lapuschkin, Sebastian Höhne, Marina M.-C. Understandable Machine Intelligence Lab TU Berlin Berlin10587 Germany Department of Electrical Engineering and Computer Science TU Berlin Berlin10587 Germany Department of Artificial Intelligence Fraunhofer Heinrich-Hertz-Institute Berlin10587 Germany Department of Computer Science University of Potsdam Potsdam14476 Germany BIFOLD - Berlin Institute for the Foundations of Learning and Data Berlin10587 Germany

The evaluation of explanation methods is a research topic that has not yet been explored deeply, however, since explainability is supposed to strengthen trust in artificial intelligence, it is necessary to systematically review and compare explanation methods in order to confirm their correctness. Until now, no tool with focus on XAI evaluation exists that exhaustively and speedily allows researchers to evaluate the performance of explanations of neural network predictions. To increase transparency and reproducibility in the field, we therefore built Quantus-a comprehensive, evaluation toolkit in Python that includes a growing, wellorganised collection of evaluation metrics and tutorials for evaluating explainable methods. The toolkit has been thoroughly tested and is available under an open-source license on PyPi (or on https://***/understandable-machine-intelligence-lab/Quantus/). © 2022, CC BY-NC-SA.

关键词： Python

Estimating the robustness of classification models by the structure of the learned feature-space

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Ho, Kalun Pfreundt, Franz-Josef Keuper, Janis Keuper, Margret CC-HPC Fraunhofer ITWM Fraunhofer-Platz 1 Kaiserslautern67663 Germany Institute for Machine Learning and Analytics Offenburg University Germany Data and Web Science Group University of Mannheim Germany

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this focus has been expanded by the notion of model robustness, i.e. the generalization abilities of models towards previously unseen changes in the data distribution. While new benchmarks, like ImageNet-C, have been introduced to measure robustness properties, we argue that fixed testsets are only able to capture a small portion of possible data variations and are thus limited and prone to generate new overfitted solutions. To overcome these drawbacks, we suggest to estimate the robustness of a model directly from the structure of its learned feature-space. We introduce robustness indicators which are obtained via unsupervised clustering of latent representations from a trained classifier and show very high correlations to the model performance on corrupted test data. © 2021, CC BY.

关键词： Classification (of information)

Touchstone benchmark: are we on the right way for evaluating AI algorithms for medical segmentation? 24

学校读者我要写书评

暂无评论

Touchstone benchmark: are we on the right way for evaluating...

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Pedro R. A. S. Bassi Wenxuan Li Yucheng Tang Fabian Isensee Zifu Wang Jieneng Chen Yu-Cheng Chou Saikat Roy Yannick Kirchhoff Maximilian Rokuss Ziyan Huang Jin Ye Junjun He Tassilo Wald Constantin Ulrich Michael Baumgartner Klaus H. Maier-Hein Paul Jaeger Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Yong Xia Zhaohu Xing Lei Zhu Yousef Sadegheih Afshin Bozorgpour Pratibha Kumari Reza Azad Dorit Merhof Pengcheng Shi Ting Ma Yuxin Du Fan Bai Tiejun Huang Bo Zhao Haonan Wang Xiaomeng Li Hanxue Gu Haoyu Dong Jichen Yang Maciej A. Mazurowski Saumya Gupta Linshan Wu Jiaxin Zhuang Hao Chen Holger Roth Daguang Xu Matthew B. Blaschko Sergio Decherchi Andrea Cavalli Alan L. Yuille Zongwei Zhou Department of Computer Science Johns Hopkins University and Department of Pharmacy and Biotechnology University of Bologna and Center for Biomolecular Nanotechnologies Istituto Italiano di Tecnologia Department of Computer Science Johns Hopkins University NVIDIA Division of Medical Image Computing German Cancer Research Center (DKFZ) and Helmholtz Imaging German Cancer Research Center (DKFZ) ESAT-PSI KU Leuven Division of Medical Image Computing German Cancer Research Center (DKFZ) and Faculty of Mathematics and Computer Science Heidelberg University Division of Medical Image Computing German Cancer Research Center (DKFZ) and Faculty of Mathematics and Computer Science Heidelberg University and HIDSS4Health - Helmholtz Information and Data Science School for Health Shanghai Jiao Tong University Shanghai Artificial Intelligence Laboratory Division of Medical Image Computing German Cancer Research Center (DKFZ) Division of Medical Image Computing German Cancer Research Center (DKFZ) and Pattern Analysis and Learning Group Department of Radiation Oncology Heidelberg University Hospital Helmholtz Imaging German Cancer Research Center (DKFZ) and Interactive Machine Learning Group (IML) DKFZ School of Computer Science and Engineering Northwestern Polytechnical University Australian Institute for Machine Learning The University of Adelaide College of Computer Science and Technology Zhejiang University Hong Kong University of Science and Technology (Guangzhou) Hong Kong University of Science and Technology (Guangzhou) and Hong Kong University of Science and Technology Faculty of Informatics and Data Science University of Regensburg Faculty of Electrical Engineering and Information Technology RWTH Aachen University Faculty of Informatics and Data Science University of Regensburg and Fraunhofer Institute for Digital Medicine MEVIS Electronic & Information Engineering School Harbin Institute of Technology (Shenzhen) Shanghai Jiao Tong University and Beijing Academy of Artificial Intelligence (BAAI) S

ISBN: (纸本)9798331314385

How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks does not guarantee success in real-world scenarios. To address these problems, we present Touchstone, a large-scale collaborative segmentation benchmark of 9 types of abdominal organs. This benchmark is based on 5,195 training CT scans from 76 hospitals around the world and 5,903 testing CT scans from 11 additional hospitals. This diverse test set enhances the statistical significance of benchmark results and rigorously evaluates AI algorithms across out-of-distribution scenarios. We invited 14 inventors of 19 AI algorithms to train their algorithms, while our team, as a third party, independently evaluated these algorithms. In addition, we also evaluated pre-existing AI frameworks—which, differing from algorithms, are more flexible and can support different algorithms—including MONAI from NVIDIA, nnU-Net from DKFZ, and numerous other open-source frameworks. We are committed to expanding this benchmark to encourage more innovation of AI algorithms for the medical domain.

关键词：

Myocarditis Diagnosis: A Method using Mutual learning-Based ABC and Reinforcement learning

学校读者我要写书评

暂无评论

Myocarditis Diagnosis: A Method using Mutual Learning-Based ...

International Symposium on Computational Intelligence and Informatics

作者： Saba Danaei Arsam Bostani Seyed Vahid Moravvej Fardin Mohammadi Roohallah Alizadehsani Afshin Shoeibi Hamid Alinejad-Rokny Saeid Nahavandi Adiban Institute of Higher Education Semnan Iran Department of mechanical engineering of biosystems Urmia university Department of exercise physiology & health science University of tehran Internship in UNSW BioMedical Machine Learning Lab Sydney NSW Australia Institute for Intelligent Systems Research and Innovation (IISRI) Deakin University Waurn Ponds Victoria Australia UNSW Data Science Hub The University of New South Wales (UNSW Sydney) Sydney New South Wales Australia BioMedical Machine Learning Lab The Graduate School of Biomedical Engineering UNSW Sydney Sydney NSW Australia

ISBN: (纸本)9798350398830

Myocarditis occurs when the heart muscle becomes inflamed and inflammation occurs when your body’s immune system responds to infections. It can be diagnosed using cardiac magnetic resonance image (MRI), a non-invasive imaging technique with the possibility of operator bias. This paper proposes a hybrid method of deep reinforcement learning-based algorithms and meta-heuristics algorithms. A mutual learning-based artificial bee colony (ML-ABC) is employed for initial weight, which adjusts the candidate food source generated with the higher fitness between two individuals determined by a mutual learning factor. Moreover, a sequential decision-making process investigates the imbalanced classification issue, in which a convolutional neural network (CNN) is used as the foundation for policy architecture. At first, initial weights are produced using the ML-ABC algorithm. After that, the agent receives a sample at each phase and classifies it, obtaining environmental rewards. The minority class receives more rewards than the majority class. Eventually, the agent discovers an ideal strategy with the aid of a specific reward function and a beneficial learning environment. We evaluate our proposed approach on the Z-Alizadeh Sani myocarditis dataset based on standard criteria and demonstrate that the proposed method gives superior myocarditis diagnosis performance.

关键词： Mechatronics Computational modeling Metaheuristics Reinforcement learning Myocardium Markov processes Classification algorithms

Ultrasound-Based Kidney Disease Detection: Resampling Cubature Kalman Filter and Physics-Guided VGG Cross-Contextual Network

学校读者我要写书评

暂无评论

Ultrasound-Based Kidney Disease Detection: Resampling Cubatu...

International Conference on Inventive Computation Technologies (ICICT)

作者： Padmanayana N.S.L. Kumar Kurumeti Veena S Ch. Raja Vijay Jagdish Upadhye Ramya Maranan Department of Artificial Intelligence and Data Science Engineering AJ Institute of Engineering and Technology Mangaluru Karnataka India Department of Artificial Intelligence and Machine Learning Aditya University Surampalem Andhra Pradesh India Department of Electronics and Communication Engineering SJC Institute of Technology Chikkaballapur Karnataka India Department of Electronics and Communication Engineering Mahatma Gandhi Institute of Technology Hyderabad Telangana India Department of Microbiology Dept of Microbiology Research and Development Cell (RDC) Parul Institute of Applied Sciences (PIAS) Parul University Post Limda Waghodia Gujarat India Department of Research and Innovation Saveetha School of Engineering SIMATS Chennai Tamil Nadu India

ISBN: (数字)9798331512248

ISBN: (纸本)9798331512255

Limitations of ultrasound-based identification of kidney disease include poor image resolution, operator reliance, and lack of detection of small tissue anomalies. Diagnostic accuracy may be affected by artefacts or noise, or changes in patient anatomy. It may also have difficulty detecting microscopic structural changes or renal disease in its incipiency. The limitations are overcome by the analysis of the Resampling Cubature Kalman Filter and Physics-Guided VGG Cross-Contextual Networks (RCKF-PG-VGG-CCNet) for kidney disease detection from ultrasound images based on the Kidney Ultrasound Image dataset. The initial use of the Resampling Cubature Kalman Filter and the first use of Physics-Guided VGG Cross-Contextual Networks is to enhance image quality. Through identifying regions through deviations, the Scale-Aware Meet Transformer (SAMT) performs segmentation. While the Synergistic Fibroblast Optimization (SFO) enhances classification performance through optimization of the search for diseased regions, the Physics-Guided VGG Cross-Contextual Networks (PG-VGG-CCNet) classify kidney disease and identify features. Experimental output from a Python-based experiment demonstrates that RCKF-PG-VGG-CCNet is more efficient than other methods with 99.9% efficiency and 99.8% sensitivity and may enhance the accuracy of kidney disease detection.

关键词： Ultrasonic imaging Accuracy Sensitivity Noise Fibroblasts Transformers Kalman filters Kidney Optimization Diseases

Automatic Diagnosis of Myocarditis Disease in Cardiac MRI Modality using Deep Transformers and Explainable Artificial Intelligence

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Jafari, Mahboobeh Shoeibi, Afshin Ghassemi, Navid Heras, Jonathan Ling, Sai Ho Beheshti, Amin Zhang, Yu-Dong Wang, Shui-Hua Alizadehsani, Roohallah Gorriz, Juan M. Acharya, U. Rajendra Rokny, Hamid Alinejad Internship in BioMedical Machine Learning Lab The Graduate School of Biomedical Engineering UNSW Sydney SydneyNSW2052 Australia Data Science and Computational Intelligence Institute University of Granada Spain Department of Mathematics and Computer Science University of La Rioja La Rioja Spain Australia Data Analytics Lab Department of Computing Macquarie University SydneyNSW2109 Australia School of Computing and Mathematical Sciences University of Leicester Leicester United Kingdom Deakin University VIC3217 Australia Department of Psychiatry University of Cambridge United Kingdom School of Mathematics Physics and Computing University of Southern Queensland Springfield Australia BioMedical Machine Learning Lab The Graduate School of Biomedical Engineering UNSW Sydney SydneyNSW2052 Australia UNSW Data Science Hub The University of New South Wales SydneyNSW2052 Australia Research Centre Macquarie University Sydney2109 Australia

Myocarditis is a significant cardiovascular disease (CVD) that poses a threat to the health of many individuals by causing damage to the myocardium. The occurrence of microbes and viruses, including the likes of HIV, plays a crucial role in the development of myocarditis disease (MCD). The images produced during cardiac magnetic resonance imaging (CMRI) scans are low contrast, which can make it challenging to diagnose cardiovascular diseases. In other hand, checking numerous CMRI slices for each CVD patient can be a challenging task for medical doctors. To overcome the existing challenges, researchers have suggested the use of artificial intelligence (AI)-based computer-aided diagnosis systems (CADS). The presented paper outlines a CADS for the detection of MCD from CMR images, utilizing deep learning (DL) methods. The proposed CADS consists of several steps, including dataset, preprocessing, feature extraction, classification, and post-processing. First, the Z-Alizadeh dataset was selected for the experiments. Subsequently, the CMR images underwent various preprocessing steps, including denoising, resizing, as well as data augmentation (DA) via CutMix and MixUp techniques. In the following, the most current deep pre-trained and transformer models are used for feature extraction and classification on the CMR images. The findings of our study reveal that transformer models exhibit superior performance in detecting MCD as opposed to pre-trained architectures. In terms of DL architectures, the Turbulence Neural Transformer (TNT) model exhibited impressive accuracy, reaching 99.73% utilizing a 10-fold cross-validation approach. Additionally, to pinpoint areas of suspicion for MCD in CMRI images, the Explainable-based Grad Cam method was employed. © 2022, CC BY-NC-ND.

关键词： Diseases

Protocol to explain support vector machine predictions via exact Shapley value computation

学校读者我要写书评

暂无评论

STAR Protocols 2024年第2期5卷 103010页

作者： Mastropietro, Andrea Bajorath, Jürgen Deparment of Computer Control and Management Engineering “Antonio Ruberti” Sapienza University of Rome Via Ariosto 25 Rome 00185 Italy Department of Life Science Informatics and Data Science B-IT LIMES Program Unit Chemical Biology and Medicinal Chemistry Rheinische Friedrich-Wilhelms-Universität Friedrich-Hirzebruch-Allee 5/6 Bonn 53115 Germany Lamarr Institute for Machine Learning and Artificial Intelligence Friedrich-Hirzebruch-Allee 5/6 Bonn 53115 Germany

Shapley values from cooperative game theory are adapted for explaining machine learning predictions. For large feature sets used in machine learning, Shapley values are approximated. We present a protocol for two techniques for explaining support vector machine predictions with exact Shapley value computation. We detail the application of these algorithms and provide ready-to-use Python scripts and custom code. The final output of the protocol includes quantitative feature analysis and mapping of important features for visualization. For complete details on the use and execution of this protocol, please refer to Feldmann and Bajorath¹ and Mastropietro et al.² © 2024 The Author(s)

关键词： Bioinformatics Chemistry Computer sciences

Transition State Search and Geometry Relaxation throughout Chemical Compound Space with Quantum machine learning

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Heinen, Stefan Von Rudorff, Guido Falk Von Lilienfeld, O. Anatole University of Vienna Faculty of Physics Kolingasse 14-16 WienAT-1090 Austria Vector Institute for Artificial Intelligence ON TorontoM5S 1M1 Canada Departments of Chemistry Materials Science and Engineering and Physics University of Toronto St. George Campus ON Toronto Canada Machine Learning Group Technische Universität Berlin Institute for the Foundations of Learning and Data Berlin10587 Germany

We use energies and forces predicted within response operator based quantum machine learning (OQML) to perform geometry optimization and transition state search calculations with legacy optimizers. For randomly sampled initial coordinates of small organic query molecules we report systematic improvement of equilibrium and transition state geometry output as training set sizes increase. Out-of-sample SN2 reactant complexes and transition state geometries have been predicted using the LBFGS and the QST2 algorithm with an RMSD of 0.16 and 0.4 Å - after training on up to 200 reactant complexes relaxations and transition state search trajectories from the QMrxn20 data-set, respectively. For geometry optimizations, we have also considered relaxation paths up to 5'500 constitutional isomers with sum formula C7H10O2from the QM9-database. Using the resulting OQML models with an LBFGS optimizer reproduces the minimum geometry with an RMSD of 0.14 Å. For converged equilibrium and transition state geometries subsequent vibrational normal mode frequency analysis indicates deviation from MP2 reference results by on average 14 and 26 cm-1, respectively. While the numerical cost for OQML predictions is negligible in comparison to DFT or MP2, the number of steps until convergence is typically larger in either case. The success rate for reaching convergence, however, improves systematically with training set size, underscoring OQML's potential for universal applicability. © 2022, CC BY.

关键词： machine learning