检索结果-内蒙古大学图书馆

Fine-grained quotation detection and attribution in German news articles 20

学校读者我要写书评

暂无评论

Fine-grained quotation detection and attribution in German n...

20th Conference on Natural language Processing, KONVENS 2024

作者： Petersen-Frey, Fynn Biemann, Chris Hub of Computing and Data Science Language Technology Group Universität Hamburg Germany

The task of quotation detection and attribution deals with identifying quotation spans together with their associated role spans such as the speaker. We describe an approach to solve the task of fine-grained quotation detection and attribution using a sequence-to-sequence transformer model with constrained decoding. Our model improves vastly upon the existing baselines on the German news articles quotation dataset, thereby making it feasible for a first time to automatically extract attributed quotations from German news articles. We provide an extensive description of our method, discuss alternative approaches, performed experiments using multiple foundation language models and method variants, and analyzed our model’s prediction errors. Our source code and trained models are available1,. ©2024 Association for Computational Linguistics.

关键词： Computational linguistics

UHH at AVeriTeC: RAG for Fact-Checking with Real-World Claims 7

学校读者我要写书评

暂无评论

UHH at AVeriTeC: RAG for Fact-Checking with Real-World Claim...

7th Fact Extraction and VERification Workshop, FEVER 2024

作者： Sevgili, Özge Nikishina, Irina Yimam, Seid Muhie Semmann, Martin Biemann, Chris Language Technology Group Dept. of Informatics & Hub of Computing and Data Science Universität Hamburg Germany

ISBN: (纸本)9798891761728

This paper presents UHH’s approach developed for the AVeriTeC shared task. The goal of the challenge is to verify given real-world claims with evidences from the Web. In this shared task, we investigate a Retrieval-Augmented Generation (RAG) model, which mainly contains retrieval, generation, and augmentation components. We start with the selection of the top 10k evidences via BM25 scores, and continue with two approaches to retrieve the most similar evidences: (1) to retrieve top 10 evidences through vector similarity, generate questions for them, and rerank them or (2) to generate questions for the claim and retrieve the most similar evidence, again, through vector similarity. After retrieving the top evidences, a Large language Model (LLM) is prompted using the claim along with either all evidences or individual evidence to predict the label. Our system submission, UHH, using the first approach and individual evidence prompts, ranks 6th out of 23 systems. © 2024 Association for Computational Linguistics.

关键词： Computational linguistics

dataset of Quotation Attribution in German News Articles

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Petersen-Frey, Fynn Biemann, Chris House of Computing and Data Science Language Technology Group Universität Hamburg Germany

Extracting who says what to whom is a crucial part in analyzing human communication in today’s abundance of data such as online news articles. Yet, the lack of annotated data for this task in German news articles severely limits the quality and usability of possible systems. To remedy this, we present a new, freely available, creative-commons-licensed dataset for quotation attribution in German news articles based on WIKINEWS. The dataset provides curated, high-quality annotations across 1000 documents (250,000 tokens) in a fine-grained annotation schema enabling various downstream uses for the dataset. The annotations not only specify who said what but also how, in which context, to whom and define the type of quotation. We specify our annotation schema, describe the creation of the dataset and provide a quantitative analysis. Further, we describe suitable evaluation metrics, apply two existing systems for quotation attribution, discuss their results to evaluate the utility of our dataset and outline use cases of our dataset in downstream tasks. © 2024, CC BY-NC-ND.

关键词：

Classification-based self-learning for weakly supervised bilingual lexicon induction 58

学校读者我要写书评

暂无评论

Classification-based self-learning for weakly supervised bil...

58th Annual Meeting of the Association for Computational Linguistics, ACL 2020

作者： Karan, Mladen Vulić, Ivan Korhonen, Anna Glavaš, Goran TakeLab Faculty of Electrical Engineering and Computing University of Zagreb Language Technology Lab TAL University of Cambridge Data and Web Science Group University of Mannheim

ISBN: (纸本)9781952148255

Effective projection-based cross-lingual word embedding (CLWE) induction critically relies on the iterative self-learning procedure. It gradually expands the initial small seed dictionary to learn improved cross-lingual mappings. In this work, we present CLASSYMAP, a classification-based approach to self-learning, yielding a more robust and a more effective induction of projection-based CLWEs. Unlike prior self-learning methods, our approach allows for integration of diverse features into the iterative process. We show the benefits of CLASSYMAP for bilingual lexicon induction: we report consistent improvements in a weakly supervised setup (500 seed translation pairs) on a benchmark with 28 language pairs. © 2020 Association for Computational Linguistics

关键词： Iterative methods

Overview of the Tenth Dialog System technology Challenge: DSTC10

学校读者我要写书评

暂无评论

IEEE/ACM Transactions on Audio Speech and language Processing 2024年 32卷 765-778页

作者： Yoshino, Koichiro Chen, Yun-Nung Crook, Paul Kottur, Satwik Li, Jinchao Hedayatnia, Behnam Moon, Seungwhan Fei, Zhengcong Li, Zekang Zhang, Jinchao Feng, Yang Zhou, Jie Kim, Seokhwan Liu, Yang Jin, Di Papangelis, Alexandros Gopalakrishnan, Karthik Hakkani-Tur, Dilek Damavandi, Babak Geramifard, Alborz Hori, Chiori Shah, Ankit Zhang, Chen Li, Haizhou Sedoc, Joao D'haro, Luis F. Banchs, Rafael Rudnicky, Alexander Guardian Robot Project R-IH RIKEN 2-2-2 Hikaridai Seika Shoraku619-0288 Japan Information Science Nara Institute of Science and Technology Ikoma630-0101 Japan Computer Science and Information Engineering National Taiwan University Taipei10617 Taiwan Inc. Palo AltoCA95054 United States Alexa AI *** Inc. SunnyvaleCA94089 United States Meta Seattle RedmondWA98052 United States Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China Tencent AI Lab Beijing Beijing China Kexueyuan South Road Zhongguancun Beijing100190 China Beijing 100190 China Alexa AI *** Inc. SunnyvaleCA United States 1120 Enterprise way Sunnyvale94089 United States *** Inc. SeattleWA United States Menlo Park CA United States Audio and Speech Group Mitsubishi Electric Research Laboratories CambridgeMA02139-1955 United States Carnegie Mellon University Department of Language and Information Technologies or just Carnegie Mellon University Pittsburgh United States National University of Singapore Singapore Singapore Department of Electrical and Computer Engineering National University of Singapore Singapore Singapore Shenzhen Research Institute of Big Data School of Data Science Chinese University of Hong Kong Shenzhen518172 China New York University New YorkNY United States ETSI de Telecomunicacion - Speech Technology and Machine Learning Group Universidad Politecnica de Madrid Ciudad Universitaria Madrid28040 Spain Nanyang Technological University Singapore Singapore Carnegie Mellon University PittsburghPA United States

This article introduces the Tenth Dialog System technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks. © 2023 The Authors.

关键词： Job analysis

SemRel2024: A Collection of Semantic Textual Relatedness datasets for 13 languages

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ousidhoum, Nedjma Muhammad, Shamsuddeen Hassan Abdalla, Mohamed Abdulmumin, Idris Ahmad, Ibrahim Said Ahuja, Sanchit Aji, Alham Fikri Araujo, Vladimir Ayele, Abinew Ali Baswani, Pavan Beloucif, Meriem Biemann, Chris Bourhim, Sofia De Kock, Christine Dekebo, Genet Shanko Hourrane, Oumaima Kanumolu, Gopichand Madasu, Lokesh Rutunda, Samuel Shrivastava, Manish Solorio, Thamar Surange, Nirmal Tilaye, Hailegnaw Getaneh Vishnubhotla, Krishnapriya Winata, Genta Yimam, Seid Muhie Mohammad, Saif M. Cardiff University United Kingdom Imperial College London United Kingdom Data Science for Social Impact Research Group University of Pretoria South Africa Institute For Experiential AI Northeastern University United States BITS Pilani India MBZUAI United Arab Emirates KU Leuven Belgium Universität Hamburg Language Technology Group Germany Bahir Dar University Faculty of Computing Ethiopia IIIT Hyderabad India Uppsala University Sweden The University of Melbourne Australia Adama Science and Technology University Ethiopia Digital Umuganda Rwanda Kotebe University of Education Ethiopia University of Toronto Canada HKUST Hong Kong National Research Council Canada

Exploring and quantifying semantic relatedness is central to representing language and holds significant implications across various NLP tasks. While earlier NLP research primarily focused on semantic similarity, often within the English language context, we instead investigate the broader phenomenon of semantic relatedness. In this paper, we present SemRel, a new semantic relatedness dataset collection annotated by native speakers across 13 languages: Afrikaans, Algerian Arabic, Amharic, English, Hausa, Hindi, Indonesian, Kinyarwanda, Marathi, Moroccan Arabic, Modern Standard Arabic, Spanish, and Telugu. These languages originate from five distinct language families and are predominantly spoken in Africa and Asia – regions characterised by a relatively limited availability of NLP resources. Each instance in the SemRel datasets is a sentence pair associated with a score that represents the degree of semantic textual relatedness between the two sentences. The scores are obtained using a comparative annotation framework. We describe the data collection and annotation processes, challenges when building the datasets, baseline experiments, and their impact and utility in NLP. Copyright © 2024, The Authors. All rights reserved.

关键词： Natural language processing systems

Risk-based decision making: estimands for sequential prediction under interventions

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Luijken, Kim Morzywolek, Pawel van Amsterdam, Wouter Cinà, Giovanni Hoogland, Jeroen Keogh, Ruth Krijthe, Jesse Magliacane, Sara van Ommen, Thijs Peek, Niels Putter, Hein van Smeden, Maarten Sperrin, Matthew Wang, Junfeng Weir, Daniala Didelez, Vanessa van Geloven, Nan Department of Epidemiology Julius Center for Health Sciences and Primary Care University Medical Center Utrecht Utrecht Netherlands Department of Applied Mathematics Computer Science and Statistics Ghent University Ghent Belgium Department of Statistics University of Washington Seattle United States Department of Medical Informatics Amsterdam University Medical Centers Amsterdam Netherlands Institute for Logic Language and Computation University of Amsterdam Amsterdam Netherlands Pacmed Amsterdam Netherlands Department of Epidemiology and Data Science Amsterdam University Medical Centers Amsterdam Netherlands Department of Medical Statistics London School of Hygiene & Tropical Medicine Keppel Street London United Kingdom Pattern Recognition and Bio-Informatics Group EEMCS Delft University of Technology Delft Netherlands Amsterdam Machine Learning Lab University of Amsterdam Amsterdam Netherlands Department of Information and Computing Sciences Utrecht University Utrecht Netherlands Division of Informatics Imaging and Data Science Faculty of Biology Medicine and Health University of Manchester Manchester Academic Health Science Centre Manchester United Kingdom Department of Biomedical Data Sciences Leiden University Medical Center Leiden Netherlands Division of Pharmacoepidemiology and Clinical Pharmacology Department of Pharmaceutical Sciences Utrecht University Utrecht Netherlands Department of Biometry and Data Management Leibniz Institute for Prevention Research Epidemiology - BIPS Bremen Germany Faculty of Mathematics/Computer Science University of Bremen Bremen Germany

Prediction models are used amongst others to inform medical decisions on interventions. Typically, individuals with high risks of adverse outcomes are advised to undergo an intervention while those at low risk are advised to refrain from it. Standard prediction models do not always provide risks that are relevant to inform such decisions: e.g., an individual may be estimated to be at low risk because similar individuals in the past received an intervention which lowered their risk. Therefore, prediction models supporting decisions should target risks belonging to defined intervention strategies. Previous works on prediction under interventions assumed that the prediction model was used only at one time point to make an intervention decision. In clinical practice, intervention decisions are rarely made only once: they might be repeated, deferred and re-evaluated. This requires estimated risks under interventions that can be reconsidered at several potential decision moments. In the current work, we highlight key considerations for formulating estimands in sequential prediction under interventions that can inform such intervention decisions. We illustrate these considerations by giving examples of estimands for a case study about choosing between vaginal delivery and cesarean section for women giving birth. Our formalization of prediction tasks in a sequential, causal, and estimand context provides guidance for future studies to ensure that the right question is answered and appropriate causal estimation approaches are chosen to develop sequential prediction models that can inform intervention decisions. © 2023, CC BY.

关键词： Forecasting

Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

学校读者我要写书评

暂无评论

IEEE Transactions on Technology and Society

IEEE Transactions on technology and Society 2022年第4期3卷 272-289页

作者： Allahabadi, Himanshi Amann, Julia Balot, Isabelle Beretta, Andrea Binkley, Charles Bozenhard, Jonas Bruneault, Frederick Brusseau, James Candemir, Sema Cappellini, Luca Alessandro Chakraborty, Subrata Cherciu, Nicoleta Cociancig, Christina Coffee, Megan Ek, Irene Espinosa-Leal, Leonardo Farina, Davide Fieux-Castagnet, Genevieve Frauenfelder, Thomas Gallucci, Alessio Giuliani, Guya Golda, Adam Van Halem, Irmhild Hildt, Elisabeth Holm, Sune Kararigas, Georgios Krier, Sebastien A. Kuhne, Ulrich Lizzi, Francesca Madai, Vince I. Markus, Aniek F. Masis, Serg Mathez, Emilie Wiinblad Mureddu, Francesco Neri, Emanuele Osika, Walter Ozols, Matiss Panigutti, Cecilia Parent, Brendan Pratesi, Francesca Moreno-Sanchez, Pedro A. Sartor, Giovanni Savardi, Mattia Signoroni, Alberto Sormunen, Hanna-Maria Spezzatti, Andy Srivastava, Adarsh Stephansen, Annette F. Theng, Lau Bee Tithi, Jesmin Jahan Tuominen, Jarno Umbrello, Steven Vaccher, Filippo Vetter, Dennis Westerlund, Magnus Wurth, Renee Zicari, Roberto V. Ey Netherlands Enterprise Intelligence Department Amsterdam1083 HP Netherlands Eth Zurich Health Ethics and Policy Lab Department of Health Sciences and Technology Zürich8092 Switzerland Center for Diplomatic and Strategic Studies Postgraduate Studies in Diplomacy and International Relations Paris75015 France Pisa56124 Italy Hackensack Meridian Health Bioethics Center EdisonNJ08820 United States University of Oxford Faculty of Philosophy OxfordOX2 6GG United Kingdom Collège André- Laurendeau Philosophie Department MontrealQCH8N 2J4 Canada Université du Québec À Montréal École des Médias MontrealQCH2L 2C4 Canada Pace University Philosophy Department New YorkNY10038 United States The Ohio State University Wexner Medical Center Department of Radiology ColumbusOH43210 United States Humanitas Research Hospital Department of Radiology Milan20089 Italy Humanitas University Department of Biomedical Sciences Milan20089 Italy University of New England Faculty of Science Agriculture Business and Law ArmidaleNSW2351 Australia University of Technology Sydney Faculty of Engineering and Information Technology SydneyNSW2007 Australia Scuola Superiore Sant'Anna European Centre of Excellence on the Regulation of Robotics and Ai Pisa56127 Italy University of Bremen Group of Computer Architecture Bremen28359 Germany New York University Grossman School of Medicine Division of Infectious Diseases and Immunology Department of Medicine New YorkNY10016 United States Digital Institute Ai Research Section Stockholm16731 Sweden Arcada University of Applied Sciences Department of Business Management and Analytics Helsinki00550 Finland University of Brescia Radiological Sciences and Public Health Department of Medical and Surgical Specialties Brescia25121 Italy Sncf Reseau Sa Ethique Groupe La Plaine93418 France Institute of Diagnostic and Interventional Radiology University Hospital Zurich Zürich8091 Switzerland Eindhoven University of Tech

This article's main contributions are twofold: 1) to demonstrate how to apply the general European Union's High-Level Expert group's (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does 'trustworthy AI' mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient's lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic. © 2020 IEEE.

关键词： COVID-19

Explainable AI: Definition and attributes of a good explanation for health AI

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Kyrimi, Evangelia McLachlan, Scott Wohlgemut, Jared M. Perkins, Zane B. Lagnado, David A. Marsh, William Gimson, Alexander Shafti, Ali Ercole, Ari Banerjee, Amitava Glocker, Ben Schafer, Burkhard Gatsonis, Constantine Grosan, Crina Sent, Danielle Berman, David S. Glass, David O'Regan, Declan P. Letsios, Dimitrios Morrissey, Dylan Pisirir, Erhan Leofante, Francesco Soyel, Hamit Williamson, Jon Grieman, Keri Dube, Kudakwashe Mardsen, Max Nagendran, Myura Tai, Nigel Kostopoulou, Olga Jones, Owain Curzon, Paul Stoner, Rebecca S. Tandle, Sankalp Joshi, Shalmali Mossadegh, Somayyeh Buijsman, Stefan Miller, Tim Madai, Vince Istvan School of Electronic Engineering and Computer Science Queen Mary University of London London United Kingdom School of Nursing Midwifery and Palliative Care King's College London London United Kingdom Centre for Trauma Sciences Blizard Institute Queen Mary University of London London United Kingdom Royal London Hospital Barts Health NHS Trust London United Kingdom Department of Experiment Psychology University College London London United Kingdom Cambridge Liver Unit Addenbrooke's Hospital Cambridge University Hospitals Hills Road Box 210 Cambridge United Kingdom University of Cambridge United Kingdom Cambridge Consultants Ltd. United Kingdom Division of Anaesthesia Cambridge Centre for AI in Medicine University of Cambridge Cambridge United Kingdom Magdelene College University of Cambridge United Kingdom Institute of Health Informatics University College London London United Kingdom Department of Computing Imperial College London London United Kingdom SCRIPT Centre for IT and IP Law School of Law University of Edinburgh United Kingdom Center for Statistical Sciences School of Public Health Brown University Providence United States Research Group Artificial Intelligence HU University of Applied Sciences Utrecht Netherlands Jheronimus Academy of Data Science Tilburg University Eindhoven University of Technology s-Hertogenbosch Netherlands Centre for Theoretical Physics Queen Mary University of London London United Kingdom School of Computing Ulster University Belfast United Kingdom MRC Laboratory of Medical Sciences Imperial College London London United Kingdom Department of Informatics King's College London United Kingdom Physiotherapy Department Barts Health NHS Trust London United Kingdom Sport and Exercise Medicine Queen Mary University of London London United Kingdom School of Electronic Engineering and Computer Science Queen Mary University of London United Kingdom Department of Computing Imperial College London United Kingdom Departmen

Proposals of artificial intelligence (AI) solutions based on increasingly complex and accurate predictive models are becoming ubiquitous across many disciplines. As the complexity of these models grows, transparency and users' understanding often diminish. This suggests that accurate prediction alone is insufficient for making an AI-based solution truly useful. In the development of healthcare systems, this introduces new issues related to accountability and safety. Understanding how and why an AI system makes a recommendation may require complex explanations of its inner workings and reasoning processes. Although research on explainable AI (XAI) has significantly increased in recent years and there is high demand for XAI in medicine, defining what constitutes a good explanation remains ad hoc, and providing adequate explanations continues to be challenging. To fully realize the potential of AI, it is critical to address two fundamental questions about explanations for safety-critical AI applications, such as health-AI: (1) What is an explanation in health-AI? and (2) What are the attributes of a good explanation in health-AI? In this study, we examined published literature and gathered expert opinions through a two-round Delphi study. The research outputs include (1) a definition of what constitutes an explanation in health-AI and (2) a comprehensive list of attributes that characterize a good explanation in health-AI. © 2024, CC BY.

关键词：