检索结果-内蒙古大学图书馆

Ethereum smart contract security research:survey and future research opportunities

Frontiers of Computer Science 2021年第2期15卷 143-160页

作者： Zeli WANG Hai JIN Weiqi DAI Kim-Kwang Raymond CHOO Deqing ZOU National Engineering Research Center for Big Data Technology and System Services Computing Technology and System LabClusters and Grid Computing LabHubei Engineering Research Center on Big Data SecurityWuhan430074China School of Computer Science and Technology Huazhong University of Science and TechnologyWuhan430074China School of Cyber Science and Engineering Huazhong University of Science and TechnologyWuhan430074China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen518057China Department of Information Systems and Cyber Security University of Texas at San AntonioSan AntonioTX78249-0631USA

Blockchain has recently emerged as a research trend,with potential applications in a broad range of industries and *** particular successful Blockchain technology is smart contract,which is widely used in commercial settings(e.g.,high value financial transactions).This,however,has security implications due to the potential to financially benefit from a security incident(e.g.,identification and exploitation of a vulnerability in the smart contract or its implementation).Among,Ethereum is the most active and ***,in this paper,we systematically review existing research efforts on Ethereum smart contract security,published between 2015 and ***,we focus on how smart contracts can be maliciously exploited and targeted,such as security issues of contract program model,vulnerabilities in the program and safety consideration introduced by program execution *** also identify potential research opportunities and future research agenda.

关键词： smart contract security blockchain vulnerability unreliable data

来源：评论

学校读者我要写书评

暂无评论

AI-Assisted Ethics? Considerations of AI Simulation for the Ethical Assessment and Design of Assistive Technologies

arXiv

引用

arXiv 2023年

作者： Schicktanz, Silke Welsch, Johannes Schweda, Mark Hein, Andreas Rieger, Jochem W. Kirste, Thomas University Medical Center Göttingen Dept. for Medical Ethics and History of Medicine Germany University of Oldenburg Department of Health Services Research Division for Ethics in Medicine Germany University of Oldenburg Department of Health Services Research Division Assistance Systems and Medical Device Technology Germany University of Oldenburg Applied Neurocognitive Psychology Lab Germany University of Rostock Institute for Visual and Analytic Computing Germany Hanse-Wissenschaftskolleg Institute of Advance Studies Germany

Current ethical debates on the use of artificial intelligence (AI) in health care treat AI as a product of technology in three ways. First, by assessing risks and potential benefits of currently developed AI-enabled products with ethical checklists;second, by proposing ex ante lists of ethical values seen as relevant for the design and development of assisting technology, and third, by promoting AI technology to use moral reasoning as part of the automation process. The dominance of these three perspectives in the discourse is demonstrated by a brief summary of the literature and by findings our own expert interviews regarding their views on intelligent assistive technology in dementia care which is a particular focus of our approach. Subsequently, we propose a fourth approach to AI, namely as a methodological tool to assist ethical reflection. We provide a concept of an AI-simulation informed by three separate elements: 1) stochastic human behavior models based on behavioral data for simulating realistic settings, 2) qualitative empirical data on value statements regarding internal policy, and 3) visualization components that aid in understanding the impact of changes in these variables. The potential of this approach is to inform an interdisciplinary field about anticipated ethical challenges or ethical trade-offs in concrete settings and, hence, to spark a re-evaluation of design and implementation plans. This may be particularly useful for applications that deal with extremely complex values and behavior or with limitations on the communication resources of affected persons (e.g., persons with dementia care or for care of persons with cognitive impairment). Simulation does not replace ethical reflection but does allow for detailed, context-sensitive analysis during the design process and prior to implementation. Finally, we discuss the inherently quantitative methods of analysis afforded by stochastic simulations as well as the potential for ethical discussions

关键词： Stochastic systems

来源：评论

学校读者我要写书评

暂无评论

Dfier: A Directed Vulnerability Verifier for Ethereum Smart Contracts

SSRN

引用

SSRN 2023年

作者： Wang, Zeli Dai, Weiqi Li, Ming Choo, Kim-Kwang Raymond Zou, Deqing Chongqing Key Laboratory of Computational Intelligence Key Laboratory of Big Data Intelligent Computing Key Laboratory of Cyberspace Big Data Intelligent Security Ministry of Education College of Computer Science and Technology Chongqing University of Posts and Telecommunications Chongqing40065 China National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab Hubei Engineering Research Center on Big Data Security Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan430074 China Department of Information Systems and Cyber Security University of Texas at San Antonio San Antonio United States

Existing smart contract vulnerability identification approaches mainly focus on complete program detection. Consequently, lots of known potentially vulnerable locations need manual verification, which is energy-exhaustive and error-prone. Fuzzing is an effective way to detect vulnerabilities. However, current fuzzers cannot effectively probe these suspicious targets because they overlook two key factors: exploring all paths toward the targets and providing high-quality directed seed inputs. This paper presents a Directed vulnerability veriFier (DFier), elaborating effective transaction sequences with directed inputs for the fuzzer, to focus on analyzing target paths and automatically detect whether the given locations are vulnerable. Specifically, DFier fuses the effectiveness of static analysis and the efficiency of fuzzing. The static analysis helps locate target paths and generate directed inputs for the fuzzer under three heuristic strategies. The first prefers inputs with the larger possibility of triggering potential vulnerabilities based on target features. The second guides the value mutation to satisfy the path constraints. The third adequately leverages execution information to help find exploits faster. Extensive experiments demonstrate that DFier is effective in verifying contract security, compared with three existing contract fuzzers (i.e., contractFuzzer, sFuzz, and conFuzzius). And the performance losses are in an acceptable range. © 2023, The Authors. All rights reserved.

关键词： Smart contract

来源：评论

学校读者我要写书评

暂无评论

Knowledge-Informed Machine Learning for Cancer Diagnosis and Prognosis: A review

arXiv

引用

arXiv 2024年

作者： Mao, Lingchao Wang, Hairong Hu, Leland S. Tran, Nhan L. Canoll, Peter D. Swanson, Kristin R. Li, Jing H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology AtlantaGA30332 United States Mathematical NeuroOncology Lab Precision Neurotherapeutics Innovation Program Mayo Clinic Arizona 5777 East Mayo Blvd Support Services Building Suite 2-700 PhoenixAZ85054 United States Department of Radiology Mayo Clinic Arizona 5777 E. Mayo Blvd PhoenixAZ85054 United States School of Computing Informatics and Decision Systems Engineering Arizona State University 699 S Mill Ave TempeAZ85281 United States Department of Neurosurgery Mayo Clinic Arizona 5777 E. Mayo Blvd PhoenixAZ85054 United States Department of Cancer Biology Mayo Clinic Arizona 5777 E. Mayo Blvd PhoenixAZ85054 United States Department of Pathology and Cell Biology Columbia University Medical Center 630 West 168th Street New YorkNY10032 United States

Cancer remains one of the most challenging diseases to treat in the medical field. Machine learning has enabled in-depth analysis of rich multi-omics profiles and medical imaging for cancer diagnosis and prognosis. Despite these advancements, machine learning models face challenges stemming from limited labeled sample sizes, the intricate interplay of high-dimensionality data types, the inherent heterogeneity observed among patients and within tumors, and concerns about interpretability and consistency with existing biomedical knowledge. One approach to surmount these challenges is to integrate biomedical knowledge into data-driven models, which has proven potential to improve the accuracy, robustness, and interpretability of model results. Here, we review the state-of-the-art machine learning studies that adopted the fusion of biomedical knowledge and data, termed knowledge-informed machine learning, for cancer diagnosis and prognosis. Emphasizing the properties inherent in four primary data types including clinical, imaging, molecular, and treatment data, we highlight modeling considerations relevant to these contexts. We provide an overview of diverse forms of knowledge representation and current strategies of knowledge integration into machine learning pipelines with concrete examples. We conclude the review article by discussing future directions to advance cancer research through knowledge-informed machine *** Codes 92B99 Copyright © 2024, The Authors. All rights reserved.

关键词： Knowledge representation

来源：评论

学校读者我要写书评

暂无评论

Optimizing network resource allocation with graph pointer neural network in large-scale AI systems

引用

Digital Communications and Networks 2024年

作者： Peiying Zhang Yilin Li Athanasios V. Vasilakos Konstantin Igorevich Kostromitin Jianyong Zhang Mohsen Guizani Qingdao Institute of Software College of Computer Science and Technology China University of Petroleum (East China) Qingdao 266580 China State Key Laboratory of Integrated Services Networks Xidian University Xi'an 710071 China Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences) Jinan 250013 China Department of Networks and Communications College of Computer Science and Information Technology Imam Abdulrahman Bin Faisal University P.O. Box 1982 Dammam 31441 Saudi Arabia Department of Physics of Nanoscale Systems South Ural State University Chelyabinsk 454080 the Russian Federation Institute of Lightwave Technology Beijing Jiaotong University Beijing 100044 China Key Lab of All Optical Network and Advanced Telecommunication of EMC Institute of Lightwave Technology Beijing Jiaotong University Beijing 100044 China Machine Learning Department Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi 999041 United Arab Emirates

For increasingly complex communication demands of large-scale AI communication systems, the Space-Air-Ground Integrated Network (SAGIN) better caters to demands but also raises concerns about resource scarcity and diversity. This paper innovatively combines Graph Pointer Neural Networks (GPNN) and Reinforcement Learning (RL) to enhance resource allocation efficiency. The method leverages the advantages of GPNN in handling graph data and RL in optimizing decisions in dynamic environments. It also targets the optimization goal of maximizing resource allocation while minimizing deployment latency. This paper begins by modeling SAGIN and elucidating the SAGIN logical architecture based on Software-defined Networking (SDN). Subsequently, it introduces an SFC deployment algorithm aimed at joint optimization of resource allocation and latency. The algorithm leverages GPNN and RL to deploy virtual nodes and links, with the goal of optimizing resource allocation and deployment latency. Experiment findings conclusively demonstrate that the efficacy of proposed algorithm in effectively weighing limited heterogeneous resources and minimum mapping delay. Notably, when compared to three other SFC mapping algorithms MLRL, NFVdeep, and RL, the proposed algorithm consistently outperforms them, with an average improvement of 10.17% in long-term average reward/cost, 11.21% in link resource utilization ratio, 15.34% in node resource utilization ratio, and 16.38% in acceptance ratio.

关键词： Space-air-ground integrated network Topological structure Reinforcement learning Service function chain Graph pointer neural network

来源：评论

学校读者我要写书评

暂无评论

Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

IEEE Transactions on Technology and Society

引用

IEEE Transactions on technology and Society 2022年第4期3卷 272-289页

作者： Allahabadi, Himanshi Amann, Julia Balot, Isabelle Beretta, Andrea Binkley, Charles Bozenhard, Jonas Bruneault, Frederick Brusseau, James Candemir, Sema Cappellini, Luca Alessandro Chakraborty, Subrata Cherciu, Nicoleta Cociancig, Christina Coffee, Megan Ek, Irene Espinosa-Leal, Leonardo Farina, Davide Fieux-Castagnet, Genevieve Frauenfelder, Thomas Gallucci, Alessio Giuliani, Guya Golda, Adam Van Halem, Irmhild Hildt, Elisabeth Holm, Sune Kararigas, Georgios Krier, Sebastien A. Kuhne, Ulrich Lizzi, Francesca Madai, Vince I. Markus, Aniek F. Masis, Serg Mathez, Emilie Wiinblad Mureddu, Francesco Neri, Emanuele Osika, Walter Ozols, Matiss Panigutti, Cecilia Parent, Brendan Pratesi, Francesca Moreno-Sanchez, Pedro A. Sartor, Giovanni Savardi, Mattia Signoroni, Alberto Sormunen, Hanna-Maria Spezzatti, Andy Srivastava, Adarsh Stephansen, Annette F. Theng, Lau Bee Tithi, Jesmin Jahan Tuominen, Jarno Umbrello, Steven Vaccher, Filippo Vetter, Dennis Westerlund, Magnus Wurth, Renee Zicari, Roberto V. Ey Netherlands Enterprise Intelligence Department Amsterdam1083 HP Netherlands Eth Zurich Health Ethics and Policy Lab Department of Health Sciences and Technology Zürich8092 Switzerland Center for Diplomatic and Strategic Studies Postgraduate Studies in Diplomacy and International Relations Paris75015 France Pisa56124 Italy Hackensack Meridian Health Bioethics Center EdisonNJ08820 United States University of Oxford Faculty of Philosophy OxfordOX2 6GG United Kingdom Collège André- Laurendeau Philosophie Department MontrealQCH8N 2J4 Canada Université du Québec À Montréal École des Médias MontrealQCH2L 2C4 Canada Pace University Philosophy Department New YorkNY10038 United States The Ohio State University Wexner Medical Center Department of Radiology ColumbusOH43210 United States Humanitas Research Hospital Department of Radiology Milan20089 Italy Humanitas University Department of Biomedical Sciences Milan20089 Italy University of New England Faculty of Science Agriculture Business and Law ArmidaleNSW2351 Australia University of Technology Sydney Faculty of Engineering and Information Technology SydneyNSW2007 Australia Scuola Superiore Sant'Anna European Centre of Excellence on the Regulation of Robotics and Ai Pisa56127 Italy University of Bremen Group of Computer Architecture Bremen28359 Germany New York University Grossman School of Medicine Division of Infectious Diseases and Immunology Department of Medicine New YorkNY10016 United States Digital Institute Ai Research Section Stockholm16731 Sweden Arcada University of Applied Sciences Department of Business Management and Analytics Helsinki00550 Finland University of Brescia Radiological Sciences and Public Health Department of Medical and Surgical Specialties Brescia25121 Italy Sncf Reseau Sa Ethique Groupe La Plaine93418 France Institute of Diagnostic and Interventional Radiology University Hospital Zurich Zürich8091 Switzerland Eindhoven University of Tech

This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert Group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does 'trustworthy AI' mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic. © 2020 IEEE.

关键词： COVID-19

来源：评论

学校读者我要写书评

暂无评论

INTRODUCTION

引用

Bulletin of the American Meteorological Society 2024年第8期105卷 S1-S11页

作者： Boyer, T. Blunden, J. Dunn, R.J.H. NOAA/NESDIS National Centers for Environmental Information Silver Spring Maryland NOAA/NESDIS National Centers for Environmental Information Asheville North Carolina Met Office Hadley Centre Exeter United Kingdom European Centre for Medium-Range Weather Forecasts Reading United Kingdom University of Maryland College Park Maryland Scripps Institution of Oceanography University of California San Diego La Jolla California NOAA/NWS National Centers for Environmental Prediction Climate Prediction Center College Park Maryland Brandenburg University of Technology (BTU) Cottbus-Senftenberg Germany Servicio Meteorológico Nacional Buenos Aires Argentina NOAA/OAR Physical Sciences Laboratory Boulder Colorado European Centre for Medium-Range Weather Forecasts Bonn Germany Center for Geophysical Research and School of Physics University of Costa Rica San José Costa Rica Department of Meteorology and National Centre for Earth Observation University of Reading Reading United Kingdom Centro Nacional de Monitoramento e Alertas de Desastres Naturais CEMADEN São Paulo Brazil Université Grenoble Alpes Institut des Géosciences de l’Environnement IRD CNRS Grenoble INP Grenoble France Hampton University Hampton Virginia Seychelles Meteorological Authority Mahe Seychelles Section for Glaciers Ice and Snow Norwegian Water Resources and Energy Directorate Oslo Norway National Research Institute for Agriculture Food and Environment (INRAE) CARRTEL Université Savoie Mont Blanc Thonon les Bains France Graduate School of Agriculture Osaka Metropolitan University Sakai Japan Science Faculty Universidad Nacional de Colombia Bogotá Colombia University of Bremen Bremen Germany NOAA Global Monitoring Laboratory Boulder Colorado Servicio Nacional de Meteorología e Hidrología del Perú Lima Perú Centro de Investigaciones sobre Desertificación – Spanish National Research Council (CSIC-UV-GVA) Valencia Spain Hydro-Climate Extremes Lab (H-CEL) Ghent University Ghent Belgium Department o

In 2023, La Niña conditions that generally prevailed in the eastern Pacific Ocean from mid-2020 into early 2023 gave way to a strong El Niño by October. Atmospheric concentrations of Earth’s major greenhouse gases—carbon dioxide, methane, and nitrous oxide—all increased to record-high levels. The annual global average carbon dioxide concentration in the atmosphere rose to 419.3±0.1 ppm, which is 50% greater than the pre-industrial level. The growth from 2022 to 2023 was 2.8 ppm, the fourth highest in the record since the 1960s. The combined short-term effects of El Niño and the long-term effects of increasing levels of heat-trapping gases in the atmosphere contributed to new records for many essential climate variables reported here. The annual global temperature across land and oceans was the highest in records dating as far back as 1850, with the last seven months (June–December) having each been record warm. Over land, the globally averaged temperature was also record high. Dozens of countries reported record or near-record warmth for the year, including China and continental Europe as a whole (warmest on record), India and Russia (second warmest), and Canada (third warmest). Intense and widespread heatwaves were reported around the world. In Vietnam, an all-time national maximum temperature record of 44.2°C was observed at Tuong Duong on 7 May, surpassing the previous record of 43.4°C at Huong Khe on 20 April 2019. In Brazil, the air temperature reached 44.8°C in Araçuaí in Minas Gerais on 20 November, potentially a new national record and 12.8°C above normal. The effect of rising temperatures was apparent in the cryosphere, where snow cover extent by June 2023 was the smallest in the 56-year record for North America and seventh smallest for the Northern Hemisphere overall. Heatwaves contributed to the greatest average mass balance loss for Alpine glaciers around the world since the start of the record in 1970. Due to rapid volume loss beginning in 2021, St. A

关键词：

来源：评论

学校读者我要写书评

暂无评论

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

引用

Nature methods 2023年第6期20卷 824-835页

作者： Linus Manubens-Gil Zhi Zhou Hanbo Chen Arvind Ramanathan Xiaoxiao Liu Yufeng Liu Alessandro Bria Todd Gillette Zongcai Ruan Jian Yang Miroslav Radojević Ting Zhao Li Cheng Lei Qu Siqi Liu Kristofer E Bouchard Lin Gu Weidong Cai Shuiwang Ji Badrinath Roysam Ching-Wei Wang Hongchuan Yu Amos Sironi Daniel Maxim Iascone Jie Zhou Erhan Bas Eduardo Conde-Sousa Paulo Aguiar Xiang Li Yujie Li Sumit Nanda Yuan Wang Leila Muresan Pascal Fua Bing Ye Hai-Yan He Jochen F Staiger Manuel Peter Daniel N Cox Michel Simonneau Marcel Oberlaender Gregory Jefferis Kei Ito Paloma Gonzalez-Bellido Jinhyun Kim Edwin Rubel Hollis T Cline Hongkui Zeng Aljoscha Nern Ann-Shyn Chiang Jianhua Yao Jane Roskams Rick Livesey Janine Stevens Tianming Liu Chinh Dang Yike Guo Ning Zhong Georgia Tourassi Sean Hill Michael Hawrylycz Christof Koch Erik Meijering Giorgio A Ascoli Hanchuan Peng Institute for Brain and Intelligence Southeast University Nanjing China. Microsoft Corporation Redmond WA USA. Tencent AI Lab Bellevue WA USA. Computing Environment and Life Sciences Directorate Argonne National Laboratory Lemont IL USA. Kaya Medical Seattle WA USA. University of Cassino and Southern Lazio Cassino Italy. Center for Neural Informatics Structures and Plasticity Krasnow Institute for Advanced Study George Mason University Fairfax VA USA. Faculty of Information Technology Beijing University of Technology Beijing China. Beijing International Collaboration Base on Brain Informatics and Wisdom Services Beijing China. Nuctech Netherlands Rotterdam the Netherlands. Janelia Research Campus Howard Hughes Medical Institute Ashburn VA USA. Department of Electrical and Computer Engineering University of Alberta Edmonton Alberta Canada. Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing Anhui University Hefei China. Paige AI New York NY USA. Scientific Data Division and Biological Systems and Engineering Division Lawrence Berkeley National Lab Berkeley CA USA. Helen Wills Neuroscience Institute and Redwood Center for Theoretical Neuroscience UC Berkeley Berkeley CA USA. RIKEN AIP Tokyo Japan. Research Center for Advanced Science and Technology (RCAST) The University of Tokyo Tokyo Japan. School of Computer Science University of Sydney Sydney New South Wales Australia. Texas A&M University College Station TX USA. Cullen College of Engineering University of Houston Houston TX USA. Graduate Institute of Biomedical Engineering National Taiwan University of Science and Technology Taipei Taiwan. National Centre for Computer Animation Bournemouth University Poole UK. PROPHESEE Paris France. Department of Neuroscience Columbia University New York NY USA. Mortimer B. Zuckerman Mind Brain Behavior Institute Columbia University New York NY USA. Department of Computer Science Northern Illinois Universit

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. We observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

arXiv

引用

arXiv 2022年

作者： Srivastava, Aarohi Rastogi, Abhinav Rao, Abhishek Shoeb, Abu Awal Md Abid, Abubakar Fisch, Adam Brown, Adam R. Santoro, Adam Gupta, Aditya Garriga-Alonso, Adrià Kluska, Agnieszka Lewkowycz, Aitor Agarwal, Akshat Power, Alethea Ray, Alex Warstadt, Alex Kocurek, Alexander W. Safaya, Ali Tazarv, Ali Xiang, Alice Parrish, Alicia Nie, Allen Hussain, Aman Askell, Amanda Dsouza, Amanda Slone, Ambrose Rahane, Ameet Iyer, Anantharaman S. Andreassen, Anders Madotto, Andrea Santilli, Andrea Stuhlmüller, Andreas Dai, Andrew La, Andrew Lampinen, Andrew Zou, Andy Jiang, Angela Chen, Angelica Vuong, Anh Gupta, Animesh Gottardi, Anna Norelli, Antonio Venkatesh, Anu Gholamidavoodi, Arash Tabassum, Arfa Menezes, Arul Kirubarajan, Arun Mullokandov, Asher Sabharwal, Ashish Herrick, Austin Efrat, Avia Erdem, Aykut Karakaş, Ayla Ryan Roberts, B. Loe, Bao Sheng Zoph, Barret Bojanowski, Bartlomiej Özyurt, Batuhan Hedayatnia, Behnam Neyshabur, Behnam Inden, Benjamin Stein, Benno Ekmekci, Berk Lin, Bill Yuchen Howald, Blake Orinion, Bryan Diao, Cameron Dour, Cameron Stinson, Catherine Argueta, Cedrick Ramírez, César Ferri Singh, Chandan Rathkopf, Charles Meng, Chenlin Baral, Chitta Wu, Chiyu Callison-Burch, Chris Waites, Chris Voigt, Christian Manning, Christopher D. Potts, Christopher Ramirez, Cindy Rivera, Clara E. Siro, Clemencia Raffel, Colin Ashcraft, Courtney Garbacea, Cristina Sileo, Damien Garrette, Dan Hendrycks, Dan Kilman, Dan Roth, Dan Freeman, Daniel Khashabi, Daniel Levy, Daniel González, Daniel Moseguí Perszyk, Danielle Hernandez, Danny Chen, Danqi Ippolito, Daphne Gilboa, Dar Dohan, David Drakard, David University of Notre Dame United States Google United States Rutgers University United States Stanford University United States MIT United States DeepMind United Kingdom University of Cambridge United Kingdom University of Amsterdam Netherlands Google Research Blueshift Team NeuralSpace New York University United States Cornell University United States Koç University Turkey University of California Irvine United States Duke Kunshan University China Anthropic United States Georgia Tech United States KNC Neural Calculus National Public School - HSR Layout HKUST Hong Kong Sapienza University of Rome Italy Ought Google Research United States UC Berkeley United States Thapar University India Amazon United States Microsoft United States University of Pennsylvania United States Imperial College London United Kingdom Allen Instituite for AI Tel Aviv University Yale University United States Wroclaw University of Science and Technology Poland Blueshift Max Planck Institute for Mathematics in the Sciences Germany Bauhaus-Universität Weimar Germany Thomson Reuters Special Services University of Southern California United States Rice University United States Queen's University Kingston Canada Princeton University United States Universitat Politècnica de València Spain Juelich Research Center Germany Arizona State University United States Carnegie Mellon University United States Karlsruhe Institute of Technology Germany UNC Chapel Hill United States University of Michigan United States KU Leuven Belgium Harvard University United States ML Collective University of Virginia United States University of Edinburgh United Kingdom Research Institutes of Sweden Sweden University of Washington United States Facebook AI Research United States Mila Canada Landskape AI Umeå University Sweden Brain Team OpenAI Brown University United States MIT Media Lab United States Hacettepe University Turkey Saarland University Germany National University of Singapore Singapore Strathmore University

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models. We evaluate the behavior of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters. In addition, a team of human expert raters performed all tasks in order to provide a strong baseline. Findings include: model performance and calibration both improve with scale, but are poor in absolute terms (and when compared with rater performance);performance is remarkably similar across model classes, though with benefits from sparsity;tasks that improve gradually and predictably commonly involve a large knowledge or memorization component, whereas tasks that exhibit "breakthrough" behavior at a critical scale often involve multiple steps or components, or brittle metrics;social bias typically increases with scale in settings with ambiguous context, but this can be improved with prompting. Copyright © 2022, The Authors. All rights reserved.

关键词： Software design

来源：评论

学校读者我要写书评

暂无评论

Author Correction: BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

引用

Nature methods 2024年第10期21卷 1959页

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：