检索结果-内蒙古大学图书馆

machine learning With data Assimilation and Uncertainty Quantification for Dynamical Systems:A Review

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2023年第6期10卷 1361-1387页

作者： Sibo Cheng César Quilodrán-Casas Said Ouala Alban Farchi Che Liu Pierre Tandeo Ronan Fablet Didier Lucor Bertrand Iooss Julien Brajard Dunhui Xiao Tijana Janjic Weiping Ding Yike Guo Alberto Carrassi Marc Bocquet Rossella Arcucci Data Science Institute Department of ComputingImperial College LondonSW72AZ London Department of Earth Science and Engineering Imperial College LondonSW72AZ London Department of Computer Science and Engineering Hong Kong University of Science and TechnologyHong Kong 999077China the IMT Atlantique Lab-STICCUMR CNRS 6285France and OdysseyInria/IMTFrance.P.Tandeo is also with RIKEN Center for Computational ScienceKobeJapan the CEREA École des Ponts and EDF R&Dîle-de-FranceFrance the Laboratoire Interdisciplinaire des Sciences du Numérique CNRSParis-Saclay UniversityF-91403OrsayFrance the Electricitéde France(EDF) 78401 ChatouFranceInstitut de Mathématiques de Toulouse31062 ToulouseFrance and SINCLAIR AI LabSaclayFrance the Sorbonne University ParisFranceand also with Nansen Environmental and Remote Sensing Center(NERSC)BergenNorway the School of Mathematical Sciences Tongji UniversityShanghai 200092China the Mathematical Institute for Machine Learning and Data Science KU Eichstaett-IngolstadtBavariaGermany the School of Information Science and Technology Nantong UniversityNantong 226019China the Department of Physics and Astronomy“Augusto Righi” University of Bologna40124 BolognaItaly

data assimilation(DA)and uncertainty quantification(UQ)are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal *** applications span from computational fluid dynamics(CFD)to geoscience and climate ***,much effort has been given in combining DA,UQ and machine learning(ML)*** research efforts seek to address some critical challenges in high-dimensional dynamical systems,including but not limited to dynamical system identification,reduced order surrogate modelling,error covariance specification and model error correction.A large number of developed techniques and methodologies exhibit a broad applicability across numerous domains,resulting in the necessity for a comprehensive *** paper provides the first overview of state-of-the-art researches in this interdisciplinary field,covering a wide range of *** review is aimed at ML scientists who attempt to apply DA and UQ techniques to improve the accuracy and the interpretability of their models,but also at DA and UQ experts who intend to integrate cutting-edge ML approaches to their ***,this article has a special focus on how ML methods can overcome the existing limits of DA and UQ,and vice *** exciting perspectives of this rapidly developing research field are also *** Terms-data assimilation(DA),deep learning,machine learning(ML),reduced-order-modelling,uncertainty quantification(UQ).

关键词： assimilation overcome apply

Next-Gen Dermatology: Revolutionizing Dermatological Diagnostics with AI and Emergency Care Solutions

学校读者我要写书评

暂无评论

Next-Gen Dermatology: Revolutionizing Dermatological Diagnos...

Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE), International Conference

作者： Yashas D M Shivani Kashyap Charan PR Hemanth Kumar GP Abhishek BK Deekshith C Dept of Artificial Intelligence and Machine Learning New Horizon College of Engineering Bengaluru Dept of Information Science and Engineering New Horizon College of Engineering Bengaluru Dept of Artificial Intelligence and Machine Learning BNM Institute of Technology Bengaluru Dept of Artificial Intelligence and Data Science Siddaganga Institute of Technology Tumkur Dept of Computer Science and Engineering Vidyavardhaka College of Engineering Mysore

ISBN: (数字)9798331515911

ISBN: (纸本)9798331515928

Skin health conditions should be diagnosed and treated on time so as to prevent complications and promote better health results. This paper presents an AI-based system that makes use of Convolutional Neural Networks with the InceptionV3 Architecture for predicting skin diseases at higher levels. The model, which is based on the large DermaNet dataset, classifies skin disorders fast and effectively. The system is coupled with a simple Telegram based application for the users to get a complete solution. A user can upload a photo of the affected skin area and get a diagnosis within seconds, an explanation of the disease and how severe it is in percentage. The bot also has a location and contact sharing feature that assists users in finding nearby doctors and clinics that can provide further assistance. It further provides on the spot appropriate cures for the particular condition diagnosed. Moreover, this makes it possible for the customer to fill the healthcare void in particular the neglected ones by making it easy for them to access real time high quality services. By equipping users with relevant information and appropriate actions required at the right time, this project has showcased how AI has the ability to transform the dermatological field.

关键词： Deep learning Dermatology Medical services Transforms Chatbots Skin Real-time systems Convolutional neural networks Artificial intelligence Diseases

ANCHOR FUNCTION: A TYPE OF BENCHMARK FUNCTIONS FOR STUDYING LANGUAGE MODELS

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Zhongwang Wang, Zhiwei Yao, Junjie Zhou, Zhangchen Li, Xiaolong Weinan, E. Xu, Zhi-Qin John Institute of Natural Sciences School of Mathematical Sciences MOE-LSC and Qing Yuan Research Institute Shanghai Jiao Tong University China AI for Science Institute China Center for Machine Learning Research School of Mathematical Sciences Peking University China

Understanding transformer-based language models is becoming increasingly crucial, particularly as they play pivotal roles in advancing towards artificial general intelligence. However, language model research faces significant challenges, especially for academic research groups with constrained resources. These challenges include complex data structures, unknown target functions, high computational costs and memory requirements, and a lack of interpretability in the inference process, etc. Drawing a parallel to the use of simple models in scientific research, we propose the concept of an anchor function. This is a type of benchmark function designed for studying language models in learning tasks that follow an "anchor-key" pattern. By utilizing the concept of an anchor function, we can construct a series of functions to simulate various language tasks. The anchor function plays a role analogous to that of mice in diabetes research, particularly suitable for academic research. We demonstrate the utility of the anchor function with an example, revealing two basic operations by attention structures in language models: shifting tokens and broadcasting one token from one position to many positions. These operations are also commonly observed in large language models. The anchor function framework, therefore, opens up a series of valuable and accessible research questions for further exploration, especially for theoretical study. Copyright © 2024, The Authors. All rights reserved.

关键词： Mammals

Automated quality assessment using appearance-based simulations and hippocampus segmentation on Low-field paediatric brain MR images

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sundaresan, Vaanathi Dinsdale, Nicola K. Department of Computational and Data Sciences Indian Institute of Science Bangalore560012 India Oxford Machine Learning in NeuroImaging Lab Department of Computer Science University of Oxford Oxford United Kingdom

Understanding the structural growth of paediatric brains is a key step in the identification of various neuro-developmental disorders. However, our knowledge is limited by many factors, including the lack of automated image analysis tools, especially in Low and Middle Income Countries from the lack of high field MR images available. Low-field systems are being increasingly explored in these countries, and, therefore, there is a need to develop automated image analysis tools for these images. In this work, as a preliminary step, we consider two tasks: 1) automated quality assurance and 2) hippocampal segmentation, where we compare multiple approaches. For the automated quality assurance task a DenseNet combined with appearance-based transformations for synthesising artefacts produced the best performance, with a weighted accuracy of 82.3%. For the segmentation task, registration of an average atlas performed the best, with a final Dice score of 0.61. Our results show that although the images can provide understanding of large scale pathologies and gross scale anatomical development, there still remain barriers for their use for more granular analyses. © 2024, CC BY.

关键词： Magnetic resonance imaging

On the origins of linear representations in large language models 24

学校读者我要写书评

暂无评论

On the origins of linear representations in large language m...

Proceedings of the 41st International Conference on machine learning

作者： Yibo Jiang Goutham Rajendran Pradeep Ravikumar Bryon Aragam Victor Veitch Department of Computer Science University of Chicago Machine Learning Department Carnegie Mellon University Booth School of Business University of Chicago Department of Statistics and Data Science Institute University of Chicago

Recent works have argued that high-level semantic concepts are encoded "linearly" in the representation space of large language models. In this work, we study the origins of such linear representations. To that end, we introduce a simple latent variable model to abstract and formalize the concept dynamics of the next token prediction. We use this formalism to show that the next token prediction objective (softmax with cross-entropy) and the implicit bias of gradient descent together promote the linear representation of concepts. Experiments show that linear representations emerge when learning from data matching the latent variable model, confirming that this simple structure already suffices to yield linear representations. We additionally confirm some predictions of the theory using the LLaMA-2 large language model, giving evidence that the simplified model yields generalizable insights.

关键词：

Regularity and positivity of solutions of the Consensus-Based Optimization equation: unconditional global convergence

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Fornasier, Massimo Sun, Lukang Technical University of Munich School of Computation Information and Technology Department of Mathematics Munich Germany Munich Center for Machine Learning Munich Germany Munich Data Science Institute Germany

Introduced in 2017 [28], Consensus-Based Optimization (CBO) has rapidly emerged as a significant breakthrough in global optimization. This straightforward yet powerful multi-particle, zero-order optimization method draws inspiration from Simulated Annealing and Particle Swarm Optimization. Using a quantitative mean-field approximation, CBO dynamics can be described by a nonlinear Fokker-Planck equation with degenerate diffusion, which does not follow a gradient flow structure. In this paper, we demonstrate that solutions to the CBO equation remain positive and maintain full support. Building on this foundation, we establish the unconditional global convergence of CBO methods to global minimizers. Our results are derived through an analysis of solution regularity and the proof of existence for smooth, classical solutions to a broader class of drift-diffusion equations, despite the challenges posed by degenerate diffusion. © 2025, CC BY.

关键词： Particle swarm optimization (PSO)

Conformal Prediction in Hierarchical Classification

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Mortier, Thomas Javanmardi, Alireza Sale, Yusuf Hüllermeier, Eyke Waegeman, Willem Department of Environment Ghent University Ghent Belgium Department of Data Analysis and Mathematical Modelling Ghent University Ghent Belgium Institute of Informatics LMU Munich Munich Germany Munich Center for Machine Learning Munich Germany

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical classification, where prediction sets are commonly restricted to internal nodes of a predefined hierarchy, and propose two computationally efficient inference algorithms. The first algorithm returns internal nodes as prediction sets, while the second relaxes this restriction, using the notion of representation complexity, yielding a more general and combinatorial inference problem, but smaller set sizes. Empirical evaluations on several benchmark datasets demonstrate the effectiveness of the proposed algorithms in achieving nominal coverage. © 2025, CC BY.

关键词： Prediction models

MambaLRP: Explaining Selective State Space Sequence Models 38

学校读者我要写书评

暂无评论

MambaLRP: Explaining Selective State Space Sequence Models

38th Conference on Neural Information Processing Systems, NeurIPS 2024

作者： Jafari, Farnoush Rezaei Montavon, Grégoire Müller, Klaus-Robert Eberle, Oliver Machine Learning Group Technische Universität Berlin Berlin10587 Germany BIFOLD - Berlin Institute for the Foundations of Learning and Data Berlin10587 Germany Department of Mathematics and Computer Science Freie Universität Berlin Arnimallee 14 Berlin14195 Germany Department of Artificial Intelligence Korea University Seoul136-713 Korea Republic of Max Planck Institute for Informatics Stuhlsatzenhausweg 4 Saarbrücken66123 Germany Google DeepMind Berlin Germany

Recent sequence modeling approaches using selective state space sequence models, referred to as Mamba models, have seen a surge of interest. These models allow efficient processing of long sequences in linear time and are rapidly being adopted in a wide range of applications such as language modeling, demonstrating promising performance. To foster their reliable use in real-world scenarios, it is crucial to augment their transparency. Our work bridges this critical gap by bringing explainability, particularly Layer-wise Relevance Propagation (LRP), to the Mamba architecture. Guided by the axiom of relevance conservation, we identify specific components in the Mamba architecture, which cause unfaithful explanations. To remedy this issue, we propose MambaLRP, a novel algorithm within the LRP framework, which ensures a more stable and reliable relevance propagation through these components. Our proposed method is theoretically sound and excels in achieving state-of-the-art explanation performance across a diverse range of models and datasets. Moreover, MambaLRP facilitates a deeper inspection of Mamba architectures, uncovering various biases and evaluating their significance. It also enables the analysis of previous speculations regarding the long-range capabilities of Mamba models. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

Estimating fish weight growth in aquaponic farming through machine learning techniques

学校读者我要写书评

暂无评论

Estimating fish weight growth in aquaponic farming through m...

Intelligent Technologies (CONIT), International Conference on

作者： Purushottam Kumar Pranav Tiwari U Srinivasulu Reddy CoE in Artificial Intelligence Machine Learning & Data Analytics Lab National Institute of Technology Trichy India Computer Science and Engineering Indian Institute of Information Technology Tiruchirappalli Trichy India Department of Computer Applications Machine Learning & Data Analytics Lab National Institute of Technology Trichy India

Due to the ever-growing population, rapid urbanization, unusual environmental change, and dwindling water supply, the food production from conventional farming techniques won’t be able to keep up with increasing food demand for long, leading to severe food scarcity. Aquaponics is emerging as a viable alternative to food cultivation techniques but lacks efficiency, hindering its adoption on a large-scale production basis. The adoption of Artificial Intelligence (AI) techniques in smart aquaponic farming can further contribute to increasing the yield in aquaponics. In the study, both linear and non-linear regression algorithms such as linear regression, lasso regression, ridge regression, KNN regression, SVR, and decision tree regression were trained on aquaponic fish pond dataset, evaluated on the basis of multiple metrics like MAE, MSE, RMSE, and RMSLE, and a competitive analysis was done to determine the best algorithm for predicting the harvest weight of the fish in aquaponic ponds. The results showed that KNN regression and decision tree regression algorithms have lowest error and highest accuracy of 99.15% and 99.1% respectively, for predicting the harvest weight of the fish. The results obtained could be scaled up to commercial levels and used in regulating nutrient concentration and aquatic environmental conditions

关键词：