检索结果-内蒙古大学图书馆

Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI 41

学校读者我要写书评

暂无评论

Position: Bayesian Deep Learning is Needed in the Age of Lar...

41st International Conference on Machine Learning, ICML 2024

作者： Papamarkou, Theodore Skoularidou, Maria Palla, Konstantina Aitchison, Laurence Arbel, Julyan Dunson, David Filippone, Maurizio Fortuin, Vincent Hennig, Philipp Hernández-Lobato, José Miguel Hubin, Aliaksandr Immer, Alexander Karaletsos, Theofanis Khan, Mohammad Emtiyaz Kristiadi, Agustinus Li, Yingzhen Mandt, Stephan Nemeth, Christopher Osborne, Michael A. Rudner, Tim G.J. Rügamer, David Teh, Yee Whye Welling, Max Wilson, Andrew Gordon Zhang, Ruqi Department of Mathematics The University of Manchester Manchester United Kingdom Eric and Wendy Schmidt Center Broad Institute of MIT and Harvard Cambridge United States Spotify London United Kingdom Computational Neuroscience Unit University of Bristol Bristol United Kingdom Centre Inria de l'Université Grenoble Alpes Grenoble France Department of Statistical Science Duke University United States Statistics Program KAUST Saudi Arabia Helmholtz AI Munich Germany Department of Computer Science Technical University of Munich Munich Germany Munich Center for Machine Learning Munich Germany Tübingen AI Center University of Tübingen Tübingen Germany Department of Engineering University of Cambridge Cambridge United Kingdom Department of Mathematics University of Oslo Oslo Norway Bioinformatics and Applied Statistics Norwegian University of Life Sciences Ås Norway Department of Computer Science ETH Zurich Switzerland Chan Zuckerberg Initiative CA United States Center for Advanced Intelligence Project RIKEN Tokyo Japan Vector Institute Toronto Canada Department of Computing Imperial College London London United Kingdom Department of Computer Science UC Irvine Irvine United States Department of Mathematics and Statistics Lancaster University Lancaster United Kingdom Department of Engineering Science University of Oxford Oxford United Kingdom Center for Data Science New York University New York United States Department of Statistics LMU Munich Munich Germany DeepMind London United Kingdom Department of Statistics University of Oxford Oxford United Kingdom Informatics Institute University of Amsterdam Amsterdam Netherlands Courant Institute of Mathematical Sciences Center for Data Science Computer Science Department New York University New York United States Department of Computer Science Purdue University West Lafayette United States

In the current landscape of deep learning research, there is a predominant emphasis on achieving high predictive accuracy in supervised tasks involving large image and language datasets. However, a broader perspective reveals a multitude of overlooked metrics, tasks, and data types, such as uncertainty, active and continual learning, and scientific data, that demand attention. Bayesian deep learning (BDL) constitutes a promising avenue, offering advantages across these diverse settings. This paper posits that BDL can elevate the capabilities of deep learning. It revisits the strengths of BDL, acknowledges existing challenges, and highlights some exciting research avenues aimed at addressing these obstacles. Looking ahead, the discussion focuses on possible ways to combine large-scale foundation models with BDL to unlock their full potential. Copyright 2024 by the author(s)

关键词： Contrastive Learning

A deep potential model with long-range electrostatic interactions

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhang, Linfeng Wang, Han Muniz, Maria Carolina Panagiotopoulos, Athanassios Z. Car, Roberto Weinan, E. DP Technology Beijing China Laboratory of Computational Physics Institute of Applied Physics and Computational Mathematics Fenghao East Road 2 Beijing100094 China HEDPS CAPT College of Engineering Peking University Beijing100871 China Department of Chemical and Biological Engineering Princeton University PrincetonNJ08544 United States Department of Chemistry Department of Physics Program in Applied and Computational Mathematics Princeton Institute for the Science and Technology of Materials Princeton University PrincetonNJ08544 United States School of Mathematical Sciences Peking University Beijing100871 China AI for Science Institute Beijing China Department of Mathematics and Program in Applied and Computational Mathematics Princeton University PrincetonNJ08544 United States

Machine learning models for the potential energy of multi-atomic systems, such as the deep potential (DP) model, make possible molecular simulations with the accuracy of quantum mechanical density functional theory, at a cost only moderately higher than that of empirical force fields. However, the majority of these models lack explicit long-range interactions and fail to describe properties that derive from the Coulombic tail of the forces. To overcome this limitation we extend the DP model by approximating the long-range electrostatic interaction between ions (nuclei+core electrons) and valence electrons with that of distributions of spherical Gaussian charges located at ionic and electronic sites. The latter are rigorously defined in terms of the centers of the maximally localized Wannier distributions, whose dependence on the local atomic environment is modeled accurately by a deep neural network. In the deep potential long-range (DPLR) model, the electrostatic energy of the Gaussian charge system is added to short-range interactions that are represented as in the standard DP model. The resulting potential energy surface is smooth and possesses analytical forces and virial. Missing effects in the standard DP scheme are recovered, improving on accuracy and predictive power. By including long-range electrostatics, DPLR correctly extrapolates to large systems the potential energy surface learned from quantum mechanical calculations on smaller systems. We illustrate the approach with three examples, the potential energy profile of the water dimer, the free energy of interaction of a water molecule with a liquid water slab, and the phonon dispersion curves of the NaCl crystal. © 2021, CC BY.

关键词： Electrostatics

DeePN2: A deep learning-based non-Newtonian hydrodynamic model

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Fang, Lidong Ge, Pei Zhang, Lei Weinan, E. Lei, Huan Department of Computational Mathematics Science and Engineering Michigan State University MI48824 United States School of Mathematical Sciences Institute of Natural Sciences and MOE-LSC Shanghai Jiao Tong University 800 Dongchuan Road Shanghai200240 China Center for Machine Learning Research School of Mathematical Sciences Peking University Beijing100871 China AI for Science Institute Beijing100080 China Department of Mathematics and Program in Applied and Computational Mathematics Princeton University NJ08544 United States Department of Statistics and Probability Michigan State University MI48824 United States

A long standing problem in the modeling of non-Newtonian hydrodynamics of polymeric flows is the availability of reliable and interpretable hydrodynamic models that faithfully encode the underlying micro-scale polymer dynamics. The main complication arises from the long polymer relaxation time, the complex molecular structure and heterogeneous interaction. DeePN2, a deep learning-based non-Newtonian hydrodynamic model, has been proposed and has shown some success in systematically passing the micro-scale structural mechanics information to the macro-scale hydrodynamics for suspensions with simple polymer conformation and bond potential. The model retains a multi-scaled nature by mapping the polymer configurations into a set of symmetry-preserving macro-scale features. The extended constitutive laws for these macro-scale features can be directly learned from the kinetics of their micro-scale counterparts. In this paper, we develop DeePN2 using more complex micro-structural models. We show that DeePN2 can faithfully capture the broadly overlooked viscoelastic differences arising from the specific molecular structural mechanics without human intervention. © 2021, CC BY.

关键词： Non Newtonian flow

Tuning cooperative behavior in games with nonlinear opinion dynamics

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Park, Shinkyu Bizyaeva, Anastasia Kawakatsu, Mari Franci, Alessio Leonard, Naomi Ehrich Computer Electrical and Mathematical Science and Engineering Division Thuwal23955-6900 Saudi Arabia Department of Mechanical and Aerospace Engineering Princeton University PrincetonNJ08544 United States Program in Applied and Computational Mathematics Princeton University PrincetonNJ08544 United States Mathematics Department National Autonomous University of Mexico Mexico City04510 Mexico

We examine the tuning of cooperative behavior in repeated multi-agent games using an analytically tractable, continuous-time, nonlinear model of opinion dynamics. Each modeled agent updates its real-valued opinion about each available strategy in response to payoffs and other agent opinions, as observed over a network. We show how the model provides a principled and systematic means to investigate behavior of agents that select strategies using rationality and reciprocity, key features of human decision-making in social dilemmas. For two-strategy games, we use bifurcation analysis to prove conditions for the bistability of two equilibria and conditions for the first (second) equilibrium to reflect all agents favoring the first (second) strategy. We prove how model parameters, e.g., level of attention to opinions of others (reciprocity), network structure, and payoffs, influence dynamics and, notably, the size of the region of attraction to each stable equilibrium. We provide insights by examining the tuning of the bistability of mutual cooperation and mutual defection and their regions of attraction for the repeated prisoner's dilemma and the repeated multi-agent public goods game. Our results generalize to games with more strategies, heterogeneity, and additional feedback dynamics, such as those designed to elicit cooperation. Copyright © 2021, The Authors. All rights reserved.

关键词： Bifurcation (mathematics)

International Workshop on Applications of Probability and Statistics to Biology,July 11-13,2019--In Honor of Professor Minping Qian’s 80th Birthday

学校读者我要写书评

暂无评论

Quantitative Biology 2020年第2期8卷 177-186页

作者： Minghua Deng Jianfeng Feng Hong Qian Lin Wan Fengzhu Sun Center for Quantitative Biology Peking UniversityBeijing 100871China LMAM Center for Statistical ScienceSchool of Mathematical SciencesPeking UniversityBeijing 100871China Institute of Science and Technology for Brain-inspired Intelligence Fudan UniversityShanghai 200433China School of Mathematical Sciences Fudan UniversityShanghai 200433China Centre for Computational Systems Biology Fudan UniversityShanghai 200433China Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence at Fudan University Ministry of EducationShanghai 200433China Department of Computer Science University of WarwickCoventryCV47ALUnited Kingdom Department of Applied Mathematics University of WashingtonSeattleWA 98195USA NCMIS Academy of Mathematics and Systems ScienceChinese Academy of SciencesBeijing 100190China School of Mathematical Sciences University of Chinese Academy of SciencesBeijing 100049China Quantitative and Computational Biology Program University of Southern CaliforniaLos AngelesCA 90089USA

The International Workshop on Applications of Probability and Statistics to Biology(APSB)was successfully held in Shanghai,China,July 11-13,*** workshop was hosted by the Institute of science and Technology for Brain-inspired Intelligence(ISTBI)at Fudan University,and in honor of the 80th birthday of *** Qian of Peking *** of the twenty eight speakers were former students or close collaborators of ***;and there were over eighty participants from all over China and United States.

关键词： Probability speakers ping

Widely Tunable Berry Curvature in the Magnetic Semimetal Cr1+δTe2

学校读者我要写书评

暂无评论

Advanced Materials 2023年第12期35卷 2207121-2207121页

作者： Fujisawa, Yuita Pardo-Almanza, Markel Hsu, Chia-Hsiu Mohamed, Atwa Yamagami, Kohei Krishnadas, Anjana Chang, Guoqing Chuang, Feng-Chuan Khoo, Khoong Hong Zang, Jiadong Soumyanarayanan, Anjan Okada, Yoshinori Okinawa904-0495 Japan Department of Physics National Sun Yat-sen University Kaohsiung80424 Taiwan Physics Division National Center for Theoretical Sciences Taipei10617 Taiwan Division of Physics and Applied Physics School of Physical and Mathematical Sciences Nanyang Technological University Singapore637371 Singapore Center for Theoretical and Computational Physics National Sun Yat-sen University Kaohsiung80424 Taiwan Institute of High Performance Computing Agency for Science Technology and Research Singapore138632 Singapore Department of Physics and Astronomy University of New Hampshire DurhamNH 03824 United States Materials Science Program University of New Hampshire DurhamNH 03824 United States Department of Physics National University of Singapore Singapore117551 Singapore Institute of Materials Research and Engineering Agency for Science Technology and Research Singapore138634 Singapore

Magnetic semimetals have increasingly emerged as lucrative platforms hosting spin-based topological phenomena in real and momentum spaces. Cr1+δTe2 is a self-intercalated magnetic transition metal dichalcogenide (TMD), which exhibits topological magnetism and tunable electron filling. While recent studies have explored real-space Berry curvature effects, similar considerations of momentum-space Berry curvature are lacking. Here, the electronic structure and transport properties of epitaxial Cr1+δTe2 thin films are systematically investigated over a range of doping, δ (0.33 – 0.71). Spectroscopic experiments reveal the presence of a characteristic semi-metallic band region, which shows a rigid like energy shift with δ. Transport experiments show that the intrinsic component of the anomalous Hall effect (AHE) is sizable and undergoes a sign flip across δ. Finally, density functional theory calculations establish a link between the doping evolution of the band structure and AHE: the AHE sign flip is shown to emerge from the sign change of the Berry curvature, as the semi-metallic band region crosses the Fermi energy. These findings underscore the increasing relevance of momentum-space Berry curvature in magnetic TMDs and provide a unique platform for intertwining topological physics in real and momentum spaces. © 2023 The Authors. Advanced Materials published by Wiley-VCH GmbH.

关键词： Density functional theory

An optimal algorithm for strict circular seriation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Armstrong, Santiago Guzmán, Cristóbal Long, Carlos A. Sing Institute for Mathematical and Computational Engineering Pontificia Universidad Católica de Chile Santiago Chile Anid - Millennium Science Initiative Program Millennium Nucleus Center for the Discovery of Structures in Complex Data Santiago Chile Department of Applied Mathematics University of Twente Netherlands Institute for Biological and Medical Engineering Pontificia Universidad Católica de Chile Santiago Chile

We study the problem of circular seriation, where we are given a matrix of pairwise dissimilarities between n objects, and the goal is to find a circular order of the objects in a manner that is consistent with their dissimilarity. This problem is a generalization of the classical linear seriation problem where the goal is to find a linear order, and for which optimal O(n2) algorithms are known. Our contributions can be summarized as follows. First, we introduce circular Robinson matrices as the natural class of dissimilarity matrices for the circular seriation problem. Second, for the case of strict circular Robinson dissimilarity matrices we provide an optimal O(n2) algorithm for the circular seriation problem. Finally, we propose a statistical model to analyze the well-posedness of the circular seriation problem for large n. In particular, we establish O(log(n)/n) rates on the distance between any circular ordering found by solving the circular seriation problem to the underlying order of the model, in the Kendall-tau *** Codes 68R01, 05C85, 05C50, 05C25, 65C20 Copyright © 2021, The Authors. All rights reserved.

关键词： Trees (mathematics)

Position: Bayesian deep learning is needed in the age of large-scale AI 24

学校读者我要写书评

暂无评论

Position: Bayesian deep learning is needed in the age of lar...

Proceedings of the 41st International Conference on Machine Learning

作者： Theodore Papamarkou Maria Skoularidou Konstantina Palla Laurence Aitchison Julyan Arbel David Dunson Maurizio Filippone Vincent Fortuin Philipp Hennig José Miguel Hernández-Lobato Aliaksandr Hubin Alexander Immer Theofanis Karaletsos Mohammad Emtiyaz Khan Agustinus Kristiadi Yingzhen Li Stephan Mandt Christopher Nemeth Michael A. Osborne Tim G. J. Rudner David Rügamer Yee Whye Teh Max Welling Andrew Gordon Wilson Ruqi Zhang Department of Mathematics The University of Manchester Manchester UK Eric and Wendy Schmidt Center Broad Institute of MIT and Harvard Cambridge Spotify London UK Computational Neuroscience Unit University of Bristol Bristol UK Centre Inria de l'Université Grenoble Alpes Grenoble France Department of Statistical Science Duke University Statistics Program KAUST Saudi Arabia Helmholtz AI Munich Germany and Department of Computer Science Technical University of Munich Munich Germany and Munich Center for Machine Learning Munich Germany Tübingen AI Center University of Tübingen Tübingen Germany Department of Engineering University of Cambridge Cambridge UK Department of Mathematics University of Oslo Oslo Norway and Bioinformatics and Applied Statistics Norwegian University of Life Sciences Ås Norway Department of Computer Science ETH Zurich Switzerland Chan Zuckerberg Initiative California Center for Advanced Intelligence Project RIKEN Tokyo Japan Vector Institute Toronto Canada Department of Computing Imperial College London London UK Department of Computer Science UC Irvine Irvine Department of Mathematics and Statistics Lancaster University Lancaster UK Department of Engineering Science University of Oxford Oxford UK Center for Data Science New York University New York Munich Center for Machine Learning Munich Germany and Department of Statistics LMU Munich Munich Germany DeepMind London UK and Department of Statistics University of Oxford Oxford UK Informatics Institute University of Amsterdam Amsterdam Netherlands Courant Institute of Mathematical Sciences and Center for Data Science Computer Science Department New York University New York Department of Computer Science Purdue University West Lafayette

关键词：

Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Papamarkou, Theodore Skoularidou, Maria Palla, Konstantina Aitchison, Laurence Arbel, Julyan Dunson, David Filippone, Maurizio Fortuin, Vincent Hennig, Philipp Hernández-Lobato, José Miguel Hubin, Aliaksandr Immer, Alexander Karaletsos, Theofanis Khan, Mohammad Emtiyaz Kristiadi, Agustinus Li, Yingzhen Mandt, Stephan Nemeth, Christopher Osborne, Michael A. Rudner, Tim G.J. Rügamer, David Teh, Yee Whye Welling, Max Wilson, Andrew Gordon Zhang, Ruqi Department of Mathematics The University of Manchester Manchester United Kingdom Eric and Wendy Schmidt Center Broad Institute of MIT and Harvard Cambridge United States Spotify London United Kingdom Computational Neuroscience Unit University of Bristol Bristol United Kingdom Centre Inria de l'Université Grenoble Alpes Grenoble France Department of Statistical Science Duke University United States Statistics Program KAUST Saudi Arabia Helmholtz AI Munich Germany Department of Computer Science Technical University of Munich Munich Germany Munich Center for Machine Learning Munich Germany Tübingen AI Center University of Tübingen Tübingen Germany Department of Engineering University of Cambridge Cambridge United Kingdom Department of Mathematics University of Oslo Oslo Norway Bioinformatics and Applied Statistics Norwegian University of Life Sciences Ås Norway Department of Computer Science ETH Zurich Switzerland Chan Zuckerberg Initiative CA United States Center for Advanced Intelligence Project RIKEN Tokyo Japan Vector Institute Toronto Canada Department of Computing Imperial College London London United Kingdom Department of Computer Science UC Irvine Irvine United States Department of Mathematics and Statistics Lancaster University Lancaster United Kingdom Department of Engineering Science University of Oxford Oxford United Kingdom Center for Data Science New York University New York United States Department of Statistics LMU Munich Munich Germany DeepMind London United Kingdom Department of Statistics University of Oxford Oxford United Kingdom Informatics Institute University of Amsterdam Amsterdam Netherlands Courant Institute of Mathematical Sciences Center for Data Science Computer Science Department New York University New York United States Department of Computer Science Purdue University West Lafayette United States

关键词： Large datasets