检索结果-内蒙古大学图书馆

Transformer-based Annotation Bias-aware Medical Image Segmentation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liao, Zehui Xie, Yutong Hu, Shishuai Xia, Yong National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology School of Computer Science and Engineering Northwestern Polytechnical University Xi’an710072 China Australian Institute for Machine Learning The University of Adelaide AdelaideSA Australia Ningbo Institute of Northwestern Polytechnical University Ningbo315048 China Research and Development Institute Northwestern Polytechnical University in Shenzhen Shenzhen518057 China

Manual medical image segmentation is subjective and suffers from annotator-related bias, which can be mimicked or amplified by deep learning methods. Recently, researchers have suggested that such bias is the combination of the annotator preference and stochastic error, which are modeled by convolution blocks located after decoder and pixel-wise independent Gaussian distribution, respectively. It is unlikely that convolution blocks can effectively model the varying degrees of preference at the full resolution level. Additionally, the independent pixel-wise Gaussian distribution disregards pixel correlations, leading to a discontinuous boundary. This paper proposes a Transformer-based Annotation Bias-aware (TAB) medical image segmentation model, which tackles the annotator-related bias via modeling annotator preference and stochastic errors. TAB employs the Transformer with learnable queries to extract the different preference-focused features. This enables TAB to produce segmentation with various preferences simultaneously using a single segmentation head. Moreover, TAB takes the multivariant normal distribution assumption that models pixel correlations, and learns the annotation distribution to disentangle the stochastic error. We evaluated our TAB on an OD/OC segmentation benchmark annotated by six annotators. Our results suggest that TAB outperforms existing medical image segmentation models which take into account the annotator-related bias. © 2023, CC BY-NC-ND.

关键词： Gaussian distribution

Giant Trevally Optimizer (GTO): Enhancing HVDC Transmission Capacity with Optimized Fault Current Limiters and HVDC Circuit Breaker Parameters

学校读者我要写书评

暂无评论

Giant Trevally Optimizer (GTO): Enhancing HVDC Transmission ...

Electronics and Renewable Systems (ICEARS), International Conference on

作者： M. Siva Ramkumar Saranya. N Gokul Gopan Rahmath Ulla Baig Josha Daniel S Babu M Department of ECE SNS College of Technology India Department of Artificial Intelligence and Data Science Karpagam College of Engineering India Department of Mechanical Engineering Saveetha School of Engineering Saveetha Institute of Medical and Technical Sciences (SIMATS) Saveetha University Chennai India Department of Artificial Intelligence and Machine Learning Cambridge Institute of Technology K R Puram Bangalore Department of EEE Hindustan College of Engineering and Technology India Master of Engineering in Embedded Systems Hindusthan College of Engineering and Technology India

ISBN: (数字)9798331509675

ISBN: (纸本)9798331509682

The multi-terminal HVDC system relies heavily on circuit breakers (CBs) and fault current limiters (FCLs) for protection and performance reliability. This research describes a new Giant Trevally optimizer-based strategy for improving the performance of 4-terminal HVDC systems by optimizing crucial circuit breakers and fault current limiters. The proposed method uses time domain estimation to correctly capture fault dynamics, such as traveling waves and reflection coefficients and finds the worst-case fault locations. The multi-objective optimization seeks to optimize the overcurrent, overvoltage handling, fault clearance time, and energy absorption in arresters. This technology provides an effective, dependable protection solution that reduces fault recovery time and increases system stability. The output pulse of the HVDC system shows very low THD results 1.98% for the minimum load condition, 0.87% for median load, and 0.04% for peak load conditions. The results established the simulation of the model in a MATLAB environment.

关键词： HVDC transmission Circuit breakers Stability analysis Circuit faults Fault current limiters Time-domain analysis Protection Voltage control Integrated circuit reliability Optimization

Customer Segmentation Using Clustering Analysis

学校读者我要写书评

暂无评论

Customer Segmentation Using Clustering Analysis

Information Technology, Electronics and Intelligent Communication Systems (ICITEICS), IEEE International Conference on

作者： Moses Makuei Jiet Aahash Kamble Chetan Puri Prajyot Yesankar Prateek Verma Rajendra Rewatkar Department of Computer Science & Design Faculty of Engineering and Technology Datta Meghe Institute of Higher Education & Research (DU) Wardha Maharashtra India Department of Artificial Intelligence & Data Science Faculty of Engineering and Technology Datta Meghe Institute of Higher Education & Research (DU) Wardha Maharashtra India Department of Artificial Intelligence & Machine Learning Faculty of Engineering and Technology Datta Meghe Institute of Higher Education & Research (DU) Wardha Maharashtra India Department of Biomedical Engineering Faculty of Engineering and Technology Datta Meghe Institute of Higher Education & Research (DU) Wardha Maharashtra India

ISBN: (数字)9798350382693

ISBN: (纸本)9798350382709

This research focuses on the crucial role of the clustering technique in data mining, specifically in market forecasting and planning. The study presents a comprehensive report on utilizing the k-means clustering technique and data visualization tools to develop a real- time system for a supermarket, predicting sales across various annual cycles. An open-source dataset of a mall with n = 200 customers divided into k = 3 groups, demonstrated high accuracy in predicting day-to-day sales statistics when compared with actual results. The research highlights the effectiveness of the clustering technique in real-time sales prediction for supermarkets.

关键词： Sociology Refining Decision making data visualization Prediction algorithms Real-time systems Planning

Enhancing Brain Source Reconstruction through Physics-Informed 3D Neural Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Morik, Marco Hashemi, Ali Müller, Klaus-Robert Haufe, Stefan Nakajima, Shinichi The Berlin Institute for the Foundations of Learning and Data Berlin Germany Machine Learning Group Department of Computer Science TU Berlin Berlin Germany Department of Artificial Intelligence Korea University Seoul136-713 Korea Republic of Max Planck Institut für Informatik Saarbrücken Germany Bernstein Center for Computational Neuroscience Berlin Germany Physikalisch-Technische Bundesanstalt Berlin Germany Berlin Center for Advanced Neuroimaging Charité-Universitätsmedizin Berlin Germany RIKEN AIP Tokyo Japan

Reconstructing brain sources is a fundamental challenge in neuroscience, crucial for understanding brain function and dysfunction. Electroencephalography (EEG) signals have a high temporal resolution. However, identifying the correct spatial location of brain sources from these signals remains difficult due to the ill-posed structure of the problem. Traditional methods predominantly rely on manually crafted priors, missing the flexibility of data-driven learning, while recent deep learning approaches focus on end-to-end learning, typically using the physical information of the forward model only for generating training data. We propose the novel hybrid method 3D-PIUNet for EEG source localization that effectively integrates the strengths of traditional and deep learning techniques. 3D-PIUNet starts from an initial physics-informed estimate by using the pseudo inverse to map from measurements to source space. Secondly, by viewing the brain as a 3D volume, we use a 3D convolutional U-Net to capture spatial dependencies and refine the solution according to the learned data prior. Training the model relies on simulated pseudo-realistic brain source data, covering different source distributions. Trained on this data, our model significantly improves spatial accuracy, demonstrating superior performance over both traditional and end-to-end data-driven methods. Additionally, we validate our findings with real EEG data from a visual task, where 3D-PIUNet successfully identifies the visual cortex and reconstructs the expected temporal behavior, thereby showcasing its practical applicability. Copyright © 2024, The Authors. All rights reserved.

关键词： Inverse problems

QUANTIFYING TRAINING DIFFICULTY AND ACCELERATING CONVERGENCE IN NEURAL NETWORK-BASED PDE SOLVERS

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Chuqi Zhou, Qixuan Yang, Yahong Xiang, Yang Luo, Tao Department of Mathematics Hong Kong University of Science and Technology Clear Water Bay Hong Kong School of Mathematical Sciences Shanghai Jiao Tong University Shanghai China Department of Mathematics The Pennsylvania State University University Park State CollegePA United States Algorithms of Machine Learning and Autonomous Driving Research Lab HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute Futian Shenzhen China School of Mathematical Sciences Institute of Natural Sciences MOE-LSC Shanghai Jiao Tong University CMA-Shanghai Shanghai Artificial Intelligence Laboratory Shanghai China

Neural network-based methods have emerged as powerful tools for solving partial differential equations (PDEs) in scientific and engineering applications, particularly when handling complex domains or incorporating empirical data. These methods leverage neural networks as basis functions to approximate PDE solutions. However, training such networks can be challenging, often resulting in limited accuracy. In this paper, we investigate the training dynamics of neural network-based PDE solvers with a focus on the impact of initialization techniques. We assess training difficulty by analyzing the eigenvalue distribution of the kernel and apply the concept of effective rank to quantify this difficulty, where a larger effective rank correlates with faster convergence of the training error. Building upon this, we discover through theoretical analysis and numerical experiments that two initialization techniques, partition of unity (PoU) and variance scaling (VS), enhance the effective rank, thereby accelerating the convergence of training error. Furthermore, comprehensive experiments using popular PDE-solving frameworks, such as PINN, Deep Ritz, and the operator learning framework DeepOnet, confirm that these initialization techniques consistently speed up convergence, in line with our theoretical findings. Copyright © 2024, The Authors. All rights reserved.

关键词： Eigenvalues and eigenfunctions

Heat flux for semi-local machine-learning potentials

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Langer, Marcel F. Knoop, Florian Carbogno, Christian Scheffler, Matthias Rupp, Matthias Machine Learning Group Technische Universität Berlin Berlin10587 Germany Bifold - Berlin Institute for the Foundations of Learning and Data Berlin Germany The Nomad Laboratory The Fhi of the Max-Planck-Gesellschaft Iris Adlershof The Humboldt Universität zu Berlin Germany Linköping University LinköpingSE-581 83 Sweden Department of Computer and Information Science University of Konstanz Konstanz78464 Germany Belvaux Luxembourg

The Green-Kubo (GK) method is a rigorous framework for heat transport simulations in materials. However, it requires an accurate description of the potential-energy surface and carefully converged statistics. machine-learning potentials can achieve the accuracy of first-principles simulations while allowing to reach well beyond their simulation time and length scales at a fraction of the cost. In this paper, we explain how to apply the GK approach to the recent class of message-passing machine-learning potentials, which iteratively consider semi-local interactions beyond the initial interaction cutoff. We derive an adapted heat flux formulation that can be implemented using automatic differentiation without compromising computational efficiency. The approach is demonstrated and validated by calculating the thermal conductivity of zirconium dioxide across temperatures. Copyright © 2023, The Authors. All rights reserved.

关键词： machine learning

Empowering Optimal Control with machine learning: A Perspective from Model Predictive Control

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Weinan, E. Han, Jiequn Long, Jihao AI for Science Institute Beijing China Center for Machine Learning Research School of Mathematical Sciences Peking University Beijing China Center for Computational Mathematics Flatiron Institute New York10010 United States Program of Applied and Computational Mathematics Princeton University Princeton08544 United States

Solving complex optimal control problems have confronted computational challenges for a long time. Recent advances in machine learning have provided us with new opportunities to address these challenges. This paper takes model predictive control, a popular optimal control method, as the primary example to survey recent progress that leverages machine learning techniques to empower optimal control solvers. We also discuss some of the main challenges encountered when applying machine learning to develop more robust optimal control algorithms. Copyright © 2022, The Authors. All rights reserved.

关键词： machine learning

Overcoming Rare-Language Discrimination in Multi-Lingual Sentiment Analysis

学校读者我要写书评

暂无评论

Overcoming Rare-Language Discrimination in Multi-Lingual Sen...

IEEE International Conference on Big data

作者： Jasmin Lampert Christoph H. Lampert Competence Unit Data Science & Artificial Intelligence AIT Austrian Institute of Technology Vienna Austria Machine Learning and Computer Vision Group Institute of Science and Technology Austria (IST Austria) Klosterneuburg Austria

ISBN: (纸本)9781665445993

The digitalization of almost all aspects of our everyday lives has led to unprecedented amounts of data being freely available on the Internet. In particular social media platforms provide rich sources of user-generated data, though typically in unstructured form, and with high diversity, such as written in many different *** identifying meaningful information in such big data resources and extracting it efficiently is one of the ongoing challenges of our time. A common step for this is sentiment analysis, which forms the foundation for tasks such as opinion mining or trend prediction. Unfortunately, publicly available tools for this task are almost exclusively available for English-language texts. Consequently, a large fraction of the Internet users, who do not communicate in English, are ignored in automatized studies, a phenomenon called rare-language *** this work we propose a technique to overcome this problem by a truly multi-lingual model, which can be trained automatically without linguistic knowledge or even the ability to read the many target languages. The main step is to combine self-annotation, specifically the use of emoticons as a proxy for labels, with multi-lingual sentence *** evaluate our method we curated several large datasets from data obtained via the free Twitter streaming API. The results show that our proposed multi-lingual training is able to achieve sentiment predictions at the same quality level for rare languages as for frequent ones, and in particular clearly better than what mono-lingual training achieves on the same data. 1

关键词： Training Sentiment analysis Social networking (online) Soft sensors Blogs Predictive models Big data

An Enhanced Traffic Incident Detection using Factor Analysis and Weighted Random Forest Algorithm

学校读者我要写书评

暂无评论

An Enhanced Traffic Incident Detection using Factor Analysis...

IoT Based Control Networks and Intelligent Systems (ICICNIS), International Conference on

作者： P. Rajesh Kanna S. Vanithamani P. Karunakaran P. Pandiaraja N. Tamilarasi P. Nithin Department of Computer Science and Engineering Bannari Amman Institute of Technology Erode Tamil Nadu India Department of Master of Computer Applications M. Kumarasamy College of Engineering Karur Tamil Nadu India Department of Artificial Intelligence and Data Science Nandha Engineering College Erode Tamil Nadu India Department of Computer Science and Engineering Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology Chennai Tamil Nadu India Department of Electronics and Communication Engineering Nehru Institute of Technology Coimbatore Tamil Nadu India Department of Artificial Intelligence and Machine Learning Bannari Amman Institute of Technology Erode Tamil Nadu India

ISBN: (数字)9798331518097

ISBN: (纸本)9798331518103

Efficient and precise traffic incident detection is essential to reduce casualties and property damage. To address the issue of unbalanced event data, this work offers a novel methodology known as FA-WRF (Factor Analysis and Weighted Random Forest). This approach combines dimensionality reduction through factor analysis with classification using weighted random forests, data preparation through the Synthetic Minority Over-Sampling Technique (SMOTE), and data preparation with SMOTE. The included feature of severity detection is highlighted, as are the performance metrics of the FA-WRF model using well-established metrics such as detection level rate, number of false count alarm rate, classification type rate, and area specification under the receiver operating characteristic curve (AUC). The superiority of the FA-WRF model is illustrated using real-world expressway traffic data represented by imbalanced incidents through thorough comparisons with various machine learning-based algorithms such as Support Vector machine, k-nearest neighbours algorithms, Logistic Regression algorithms, and decision-making trees. In addition to advancing incident detection, this technique has encouraging prospects for enhancing traffic management procedures and well-informed decision-making procedures in transportation networks.

关键词： Measurement Support vector machines Logistic regression machine learning algorithms Decision making Transportation Receivers data models Classification algorithms Random forests