检索结果-内蒙古大学图书馆

An Empirical Study on Information Extraction using Large Language Models

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Han, Ridong Yang, Chaohao Peng, Tao Tiwari, Prayag Wan, Xiang Liu, Lu Wang, Benyou College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Software Jilin University China Shenzhen Research Institute of Big Data The Chinese University of Hong Kong Shenzhen China School of Data Science The Chinese University of Hong Kong Shenzhen China School of Information Technology Halmstad University Sweden

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI’s GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been made to apply LLMs to information extraction (IE), which is a fundamental NLP task that involves extracting information from unstructured plain text. To demonstrate the latest representative progress in LLMs’ information extraction ability, we assess the information extraction ability of GPT-4 (the latest version of GPT at the time of writing this paper) from four perspectives: Performance, Evaluation Criteria, Robustness, and Error Types. Our results suggest a visible performance gap between GPT-4 and state-of-the-art (SOTA) IE methods. To alleviate this problem, considering the LLMs’ human-like characteristics, we propose and analyze the effects of a series of simple prompt-based methods, which can be generalized to other LLMs and NLP tasks. Rich experiments show our methods’ effectiveness and some of their remaining issues in improving GPT-4’s information extraction ability. Copyright © 2023, The Authors. All rights reserved.

关键词： Information retrieval

Reinforced iterative knowledge distillation for cross-lingual named entity recognition

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Liang, Shining Gong, Ming Pei, Jian Shou, Linjun Zuo, Wanli Zuo, Xianglin Jiang, Daxin College of Computer Science and Technology Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education STCA NLP Group Microsoft School of Computing Science Simon Fraser University

Named entity recognition (NER) is a fundamental component in many applications, such as Web Search and Voice Assistants. Although deep neural networks greatly improve the performance of NER, due to the requirement of large amounts of training data, deep neural networks can hardly scale out to many languages in an industry setting. To tackle this challenge, cross-lingual NER transfers knowledge from a rich-resource language to languages with low resources through pre-trained multilingual language models. Instead of using training data in target languages, cross-lingual NER has to rely on only training data in source languages, and optionally adds the translated training data derived from source languages. However, the existing cross-lingual NER methods do not make good use of rich unlabeled data in target languages, which is relatively easy to collect in industry applications. To address the opportunities and challenges, in this paper we describe our novel practice in Microsoft to leverage such large amounts of unlabeled data in target languages in real production settings. To effectively extract weak supervision signals from the unlabeled data, we develop a novel approach based on the ideas of semi-supervised learning and reinforcement learning. The empirical study on three benchmark data sets verifies that our approach establishes the new state-of-the-art performance with clear edges. Now, the NER techniques reported in this paper are on their way to become a fundamental component for Web ranking, Entity Pane, Answers Triggering, and Question Answering in the Microsoft Bing search engine. Moreover, our techniques will also serve as part of the Spoken Language Understanding module for a commercial voice assistant. We plan to open source the code of the prototype framework after deployment. © 2021, CC BY-NC-SA.

关键词： Deep neural networks

Dataset-Level Color Augmentation and Multi-Scale Exploration Methods for Polyp Segmentation

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Chen, Haipeng Ju, Honghong Qin, Jun Song, Jincai Lyu, Yingda Liu, Xianzhu College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computer Science and Technology Changchun University of Science and Technology Changchun130022 China Public Computer Education and Research Center Jilin University Changchun130012 China National and Local Joint Engineering Research Center of Space Optoelectronics Technology Changchun University of Science and Technology Changchun130022 China College of Opto-Electronic Engineering Changchun University of Science and Technology Changchun130022 China

Automatic segmentation of polyps from colonoscopy images plays a critical role in early screening and treatment of colorectal cancer. Although deep learning methods have made significant progress, precise polyp segmentation faces two challenges: (1) the imbalance of color appearances in the limited training dataset hinders the generalization of the model, and (2) polyps have the diverse scales, locations and shapes with blurred boundary. To address the issues, Dataset-Level Color Augmentation (DLCA) and Convolutional Multi-scale Attention Module (CMAM) are proposed. DLCA employs the dataset-level color knowledge and generate new color appearances, to avoid the model learning false associations with colors. Meanwhile, CMAM simultaneously explores the region and boundary clues and model multi-scale context, which improves the accuracy of polyp localization and fine-grained segmentation. We conduct comprehensive experiments and compare our network with state-of-the-art methods. The proposed model is superior on multiple polyp datasets, especially on ETIS, where mDice and mIoU reach 0.839 and 0.766. Furthermore, it's validated that DLCA can be widely applied to most polyp segmentation methods, and CMAM is practical and plug-and-play. Finally, the model demonstrates promising generalization to breast ultrasound and skin lesion segmentation. © 2024, The Authors. All rights reserved.

关键词： Color

IInfoGAN: Improved Information Maximizing Generative Adversarial Networks

学校读者我要写书评

暂无评论

IInfoGAN: Improved Information Maximizing Generative Adversa...

International Conference on Mechanical, Control and Computer engineering (ICMCCE)

作者： Yan Wang Pujia Wang Boyang Sun Kai He Lan Huang School of Artificial Intelligence Jilin University Changchun China Key Laboratory of Symbol Computation and Knowledge Engineering College of Computer Science and Technology Jilin University Ministry of Education Changchun China

Generative Adversarial Networks (GANs) have achieved huge success in some unsupervised learning fields. There is no doubt that clustering takes a lot of weight in unsupervised algorithm. And in this paper, we raise the Improved Information Maximizing Generative Adversarial Networks (IInfoGAN) algorithm for learning discriminative classifiers from unlabeled data. The basis of our method is an math function that contains the Mutual Information (MI) and Cross Entropy of the observed examples and their predicted classification category distribution, thus enhancing the robustness of the classifier to adversarial generative models. Experiments show that the interpretable representation learned by IInfoGAN is competitive with the representation learned by existing unsupervised methods.

关键词： Training Time series analysis Clustering algorithms Predictive models Generative adversarial networks Prediction algorithms Entropy

Elucidating Spatial Complex Structures from Mass Spectrometry Imaging with Deep Multimodal Model

学校读者我要写书评

暂无评论

Elucidating Spatial Complex Structures from Mass Spectrometr...

Medical Artificial Intelligence (MedAI), IEEE International Conference on

作者： Jiangnan Cui Junjie Xia Xuan Li Yan Wang Fufang Qiu Yaochen Xu Keren Xu Chunman Zuo School of Computer Science and Technology Institute of Artificial Intelligence Donghua University Shanghai China Institute of Artificial Intelligence Donghua University Shanghai China College of Computer Science and Technology Jilin University Changchun China Department of Neurosurgery Huashan Hospital Shanghai China CAS Key Laboratory of Systems Biology Shanghai Institute of Biochemistry and Cell Biology Center for Excellence in Molecular Cell Science Chinese Academy of Sciences Shanghai China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun China

Spatial mass spectrometry imaging (SMSI) technology has enabled the characterization of biomolecule patterns within the tissue microenvironment, yet its analyses suffer from substantial noise. The lack of effective methods for exploiting multi-view features (e.g., spatial location) has hindered their elucidation ability for tissue heterogeneity. Here, we propose MSG, a multimodal modal that integrates histology, spatial location, and MSI data, in deciphering tissue structure by graph neural network. Specifically, MSG learns low-dimensional representations by aggregating histomorphological features from neighboring tiles via graph attention autoencoder. MSG outperforms other methods in identifying spatial domains and denoising data. The subsequent domain-guided differential expression analysis of the denoised data enables the identification of ions with significantly enriched patterns within the recognized domains. MSG exhibits its versatility in handling SMSI data from various platforms.

关键词：

UNIQUE DETERMINATION BY A SINGLE FAR-FIELD MEASUREMENT FOR AN INVERSE ELASTIC PROBLEM

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Diao, Huaian Tang, Ruixiang Liu, Hongyu Tang, Jiexin School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun China School of Mathematics Jilin University Jilin Changchun130012 China Department of Mathematics City University of Hong Kong Kowloon Hong Kong The No. 3 Junior High School of Yantai Economic and Technological Development Zone No. 1 Changzhou Street Shandong Yantai265503 China

This paper is concerned with the unique identification of the shape of a scatterer through a single far-field pattern in an inverse elastic medium scattering problem with a generalized transmission boundary condition. The uniqueness issue by a single far-field measurement is a challenging problem in inverse scattering theory, which has a long and colorful history. In this paper, we demonstrate the well-posedness of the direct problem by the variational approach. We establish the uniqueness results by a single far-field measurement under a generic scenario when dealing with underlying elastic scatterers exhibiting polygonal-nest or polygonal-cell structures. Furthermore, for a polygonal-nest or polygonal-cell structure scatterer associated with density and boundary impedance parameters as piecewise constants, we show that these physical quantities can be uniquely determined simultaneously by a single far-field measurement. The corresponding proof relies heavily on examining the singular behaviour of a coupled PDE system near a corner in a microlocal *** Codes 35R30, 74J20, 86A22 © 2023, CC BY.

关键词： Boundary conditions

Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Xiao, Yubin Wang, Di Li, Boyang Wang, Mingzhao Wu, Xuan Zhou, Changliang Zhou, You Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education College of Computer Science and Technology Jilin University China Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly Nanyang Technological University Singapore WeBank-NTU Joint Research Institute on Fintech Nanyang Technological University Singapore School of Computer Science and Engineering Nanyang Technological University Singapore School of System Design and Intelligent Manufacturing Southern University of Science and Technology China

Neural construction models have shown promising performance for Vehicle Routing Problems (VRPs) by adopting either the Autoregressive (AR) or Non-Autoregressive (NAR) learning approach. While AR models produce high-quality solutions, they generally have a high inference latency due to their sequential generation nature. Conversely, NAR models generate solutions in parallel with a low inference latency but generally exhibit inferior performance. In this paper, we propose a generic Guided Non-Autoregressive knowledge Distillation (GNARKD) method to obtain high-performance NAR models having a low inference latency. GNARKD removes the constraint of sequential generation in AR models while preserving the learned pivotal components in the network architecture to obtain the corresponding NAR models through knowledge distillation. We evaluate GNARKD by applying it to three widely adopted AR models to obtain NAR VRP solvers for both synthesized and real-world instances. The experimental results demonstrate that GNARKD significantly reduces the inference time (4∼5× faster) with acceptable performance drop (2∼3%). To the best of our knowledge, this study is first-of-its-kind to obtain NAR VRP solvers from AR ones through knowledge distillation. Copyright © 2023, The Authors. All rights reserved.

关键词： Distillation

Traffic Jam Prediction Based on Analysis of Residents Spatial Activities

学校读者我要写书评

暂无评论

Traffic Jam Prediction Based on Analysis of Residents Spatia...

Computer Information and Big Data Applications (CIBDA), International Conference on

作者： Zhijin Lv Hao Fu Wei Tang Xiaoxu Chen College of Software Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Changchun

ISBN: (数字)9781728198378

ISBN: (纸本)9781728198385

The prediction of urban traffic congestion has always been one of the important contents in the research of intelligent transportation systems. The difficulty in predicting urban traffic congestion is that urban traffic operation is essentially a collection of spatial activity planning for residents under certain conditions. The huge group of residents themselves has great complexity and uncertainty. Traditional neural networks mostly focus on road characteristic data and road condition data, and lack of in-depth exploration of the fundamental factors of traffic congestion for residents' travel. So we propose a traffic congestion prediction model based on the analysis of residents' spatial activities. Starting from the residents' activities, the simulation of urban traffic operation conditions can more realistically reflect the traffic congestion situation of the city at specific times and roads, and quickly generate model results. The experimental results show that the model analyzed by residents' spatial activities runs fast and has high prediction accuracy. The results are in line with the actual situation and have strong practical value.

关键词： Data models Traffic congestion Big Data applications Logistics

A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Zhiwei Ma, Jing Chen, Hechang Lin, Hongzhan Luo, Ziyang Chang, Yi College of Computer Science and Technology Jilin University Changchun China Department of Computer Science Hong Kong Baptist University Hong Kong School of Artificial Intelligence Jilin University China International Center of Future Science Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China

Existing fake news detection methods aim to classify a piece of news as true or false and provide veracity explanations, achieving remarkable performances. However, they often tailor automated solutions on manual fact-checked reports, suffering from limited news coverage and debunking delays. When a piece of news has not yet been fact-checked or debunked, certain amounts of relevant raw reports are usually disseminated on various media outlets, containing the wisdom of crowds to verify the news claim and explain its verdict. In this paper, we propose a novel Coarse-to-fine Cascaded Evidence-Distillation (CofCED) neural network for explainable fake news detection based on such raw reports, alleviating the dependency on fact-checked ones. Specifically, we first utilize a hierarchical encoder for web text representation, and then develop two cascaded selectors to select the most explainable sentences for verdicts on top of the selected top-K reports in a coarse-to-fine manner. Besides, we construct two explainable fake news datasets, which are publicly available. Experimental results demonstrate that our model significantly outperforms state-of-the-art baselines and generates high-quality explanations from diverse evaluation perspectives. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation