检索结果-内蒙古大学图书馆

An Empirical Study on Information Extraction using Large Language Models

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Han, Ridong Yang, Chaohao Peng, Tao Tiwari, Prayag Wan, Xiang Liu, Lu Wang, Benyou College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Software Jilin University China Shenzhen Research Institute of Big Data The Chinese University of Hong Kong Shenzhen China School of Data Science The Chinese University of Hong Kong Shenzhen China School of Information Technology Halmstad University Sweden

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI’s GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been made to apply LLMs to information extraction (IE), which is a fundamental NLP task that involves extracting information from unstructured plain text. To demonstrate the latest representative progress in LLMs’ information extraction ability, we assess the information extraction ability of GPT-4 (the latest version of GPT at the time of writing this paper) from four perspectives: Performance, Evaluation Criteria, Robustness, and Error Types. Our results suggest a visible performance gap between GPT-4 and state-of-the-art (SOTA) IE methods. To alleviate this problem, considering the LLMs’ human-like characteristics, we propose and analyze the effects of a series of simple prompt-based methods, which can be generalized to other LLMs and NLP tasks. Rich experiments show our methods’ effectiveness and some of their remaining issues in improving GPT-4’s information extraction ability. Copyright © 2023, The Authors. All rights reserved.

关键词： Information retrieval

Understanding the Runtime Overheads of Deep Learning Inference on Edge Devices

学校读者我要写书评

暂无评论

Understanding the Runtime Overheads of Deep Learning Inferen...

IEEE International Conference on Big Data and Cloud computing (BdCloud)

作者： Xiu Ma Guangli Li Lei Liu Huaxiao Liu Xiaobing Feng College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China SKL of Computer Architecture Institute of Computing Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China

With the growing ubiquity of the Internet of Things, in-the-edge inference of deep neural network models has been a major driver for promoting the widespread use of intelligent applications. As model inference characteristics are crucial for optimizing and deploying deep neural networks on hardware platforms, many studies focus on analyzing the performance of neural networks such as latency, accuracy, throughput, and energy consumption. However, few existing works have ever discussed the runtime overheads hidden in neural network inference, despite the overheads are non-negligible for edge applications. The lack of in-depth analysis of the overheads hinders the understanding of how hardware designs and model structures impact on-device inference performance. In this paper, we characterize the runtime overheads of deep learning inference on representative edge devices by leveraging state-of-the-art neural network models, performing a systematical analysis from the perspective of end-to-end performance, hardware platforms, memory bandwidth, and neural network model structures. Based on experimental results, the crucial insights are offered to facilitate the design and configure of resource-efficient networks and pick appropriate models on the specific platform, which provides a comprehensive view of runtime overheads of in-the- edge neural network inference for architects and developers.

关键词： Deep learning Performance evaluation Analytical models Runtime Roads Neural networks Throughput

A Multi-Task-Based Deep Multi-Scale Information Fusion Method for Intelligent Diagnosis of Bearing Faults

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Xin, Ruihao Wang, Tiantian Miao, Fengbo Yu, Cuinan Feng, Xin College of Information and Control Engineering Jilin Institute of Chemical Technology Jilin Jilin132000 China College of Computer Science and Technology Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China School of Science Jilin Institute of Chemical Technology Jilin Jilin132000 China

The use of deep learning for fault diagnosis is already a commonly used method. However, complex operating conditions under different working conditions significantly impact bearing vibration signals. Integrating the discriminative information of fault type and size into the deep learning model to achieve rich multi-task fault feature diagnosis still deserves attention. This study proposes a deep multi-task-based multi-scale feature fusion network MEAT(multi-task-based deep multi-scale feature fusion network) model to address these issues. Solve the limitations and poor adaptability of traditional convolutional neural network models under complex work. This model considers two sub-tasks, fault scale discrimination, and fault type discrimination, in the fault diagnosis multi-classification task through multi-task mapping decomposition. First, multi-dimensional features are extracted by convolution at different scales to obtain multi-dimensional fault information at different levels. Then these features are weighted and fused using a multi-layer attention mechanism to get accurate diagnosis results of bearing faults. © 2022, The Authors. All rights reserved.

关键词： Failure analysis

Dataset-Level Color Augmentation and Multi-Scale Exploration Methods for Polyp Segmentation

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Chen, Haipeng Ju, Honghong Qin, Jun Song, Jincai Lyu, Yingda Liu, Xianzhu College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computer Science and Technology Changchun University of Science and Technology Changchun130022 China Public Computer Education and Research Center Jilin University Changchun130012 China National and Local Joint Engineering Research Center of Space Optoelectronics Technology Changchun University of Science and Technology Changchun130022 China College of Opto-Electronic Engineering Changchun University of Science and Technology Changchun130022 China

Automatic segmentation of polyps from colonoscopy images plays a critical role in early screening and treatment of colorectal cancer. Although deep learning methods have made significant progress, precise polyp segmentation faces two challenges: (1) the imbalance of color appearances in the limited training dataset hinders the generalization of the model, and (2) polyps have the diverse scales, locations and shapes with blurred boundary. To address the issues, Dataset-Level Color Augmentation (DLCA) and Convolutional Multi-scale Attention Module (CMAM) are proposed. DLCA employs the dataset-level color knowledge and generate new color appearances, to avoid the model learning false associations with colors. Meanwhile, CMAM simultaneously explores the region and boundary clues and model multi-scale context, which improves the accuracy of polyp localization and fine-grained segmentation. We conduct comprehensive experiments and compare our network with state-of-the-art methods. The proposed model is superior on multiple polyp datasets, especially on ETIS, where mDice and mIoU reach 0.839 and 0.766. Furthermore, it's validated that DLCA can be widely applied to most polyp segmentation methods, and CMAM is practical and plug-and-play. Finally, the model demonstrates promising generalization to breast ultrasound and skin lesion segmentation. © 2024, The Authors. All rights reserved.

关键词： Color

Sample efficient imitation learning via reward function trained in advance

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Zhang, LiHua Liu, Quan School of Computer Science and Technology Soochow University Soochow China Provincial Key Laboratory for Computer Information Processing Technology Soochow University Soochow China Key Laboratory of Symbolic Computation Knowledge Engineering of Ministry of Education Jilin University Jilin China

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms of environment interaction, which severely limits their application to simulated domains. In industrial applications, learner usually have a high interaction cost, the more interactions with environment, the more damage it causes to the environment and the learner itself. In this article, we make an effort to improve sample efficiency by introducing a novel scheme of inverse reinforcement learning. Our method, which we call Model Reward Function Based Imitation Learning (MRFIL), uses an ensemble dynamic model as a reward function, what is trained with expert demonstrations. The key idea is to provide the agent with an incentive to match the demonstrations over a long horizon, by providing a positive reward upon encountering states in line with the expert demonstration distribution. In addition, we demonstrate the convergence guarantee for new objective function. Experimental results show that our algorithm reaches the competitive performance and significantly reducing the environment interactions compared to IL methods. Copyright © 2021, The Authors. All rights reserved.

关键词： Demonstrations

MLFuse: Multi-Scenario Feature Joint Learning for Multi-Modality Image Fusion

学校读者我要写书评

暂无评论

IEEE Transactions on Multimedia 2025年

作者： Lei, Jia Li, Jiawei Liu, Jinyuan Wang, Bin Zhou, Shihua Zhang, Qiang Wei, Xiaopeng Kasabov, Nikola K. Dalian University Key Laboratory of Advanced Design and Intelligent Computing Ministry of Education School of Software Engineering Dalian116622 China University of Science and Technology Beijing School of Computer and Communication Engineering Beijing100083 China Dalian University of Technology School of Mechanical Engineering Dalian116024 China Dalian University of Technology School of Computer Science and Technology Dalian116024 China Auckland University of Technology Knowledge Engineering and Discovery Research Institute Auckland1010 New Zealand Ulster University Intelligent Systems Research Center LondonderryBT52 1SA United Kingdom

Multi-modality image fusion (MMIF) entails synthesizing images with detailed textures and prominent objects. Existing methods tend to use general feature extraction to handle different fusion tasks. However, these methods have difficulty breaking fusion barriers across various modalities owing to the lack of targeted learning routes. In this work, we propose a multi-scenario feature joint learning architecture, MLFuse, that employs the commonalities of multi-modality images to deconstruct the fusion progress. Specifically, we construct a cross-modal knowledge reinforcing network that adopts a multipath calibration strategy to promote information communication between different images. In addition, two professional networks are developed to maintain the salient and textural information of fusion results. The spatial-spectral domain optimizing network can learn the vital relationship of the source image context with the help of spatial attention and spectral attention. The edge-guided learning network utilizes the convolution operations of various receptive fields to capture image texture information. The desired fusion results are obtained by aggregating the outputs from the three networks. Extensive experiments demonstrate the superiority of MLFuse for infrared-visible image fusion and medical image fusion. The excellent results of downstream tasks (i.e., object detection and semantic segmentation) further verify the high-quality fusion performance of our method. The code is publicly available at https://***/jialei-sc/MLFuse. © 1999-2012 IEEE.

关键词： Semantic Segmentation

A Coarse-to-fine Cascaded Evidence-Distillation Neural Network for Explainable Fake News Detection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Zhiwei Ma, Jing Chen, Hechang Lin, Hongzhan Luo, Ziyang Chang, Yi College of Computer Science and Technology Jilin University Changchun China Department of Computer Science Hong Kong Baptist University Hong Kong School of Artificial Intelligence Jilin University China International Center of Future Science Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China

Existing fake news detection methods aim to classify a piece of news as true or false and provide veracity explanations, achieving remarkable performances. However, they often tailor automated solutions on manual fact-checked reports, suffering from limited news coverage and debunking delays. When a piece of news has not yet been fact-checked or debunked, certain amounts of relevant raw reports are usually disseminated on various media outlets, containing the wisdom of crowds to verify the news claim and explain its verdict. In this paper, we propose a novel Coarse-to-fine Cascaded Evidence-Distillation (CofCED) neural network for explainable fake news detection based on such raw reports, alleviating the dependency on fact-checked ones. Specifically, we first utilize a hierarchical encoder for web text representation, and then develop two cascaded selectors to select the most explainable sentences for verdicts on top of the selected top-K reports in a coarse-to-fine manner. Besides, we construct two explainable fake news datasets, which are publicly available. Experimental results demonstrate that our model significantly outperforms state-of-the-art baselines and generates high-quality explanations from diverse evaluation perspectives. Copyright © 2022, The Authors. All rights reserved.

关键词： Distillation

GEOM-GCN: GEOMETRIC GRAPH CONVOLUTIONAL NETWORKS 8

学校读者我要写书评

暂无评论

GEOM-GCN: GEOMETRIC GRAPH CONVOLUTIONAL NETWORKS

8th International Conference on Learning Representations, ICLR 2020

作者： Pei, Hongbin Wei, Bingzhe Chang, Kevin Chen-Chuan Lei, Yu Yang, Bo College of Computer Science and Technology Jilin University China Department of Electrical and Computer Engineering University of Illinois Urbana-Champaign United States Department of Computer Science University of Illinois Urbana-Champaign United States Department of Computing Hong Kong Polytechnic University Hong Kong Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education China

Message-passing neural networks (MPNNs) have been successfully applied to representation learning on graphs in a variety of real-world applications. However, two fundamental weaknesses of MPNNs' aggregators limit their ability to represent graph-structured data: losing the structural information of nodes in neighborhoods and lacking the ability to capture long-range dependencies in disassortative graphs. Few studies have noticed the weaknesses from different perspectives. From the observations on classical neural network and network geometry, we propose a novel geometric aggregation scheme for graph neural networks to overcome the two weaknesses. The behind basic idea is the aggregation on a graph can benefit from a continuous space underlying the graph. The proposed aggregation scheme is permutation-invariant and consists of three modules, node embedding, structural neighborhood, and bi-level aggregation. We also present an implementation of the scheme in graph convolutional networks, termed Geom-GCN, to perform transductive learning on graphs. Experimental results show the proposed Geom-GCN achieved state-of-the-art performance on a wide range of open datasets of graphs. © 2020 8th International Conference on Learning Representations, ICLR 2020. All rights reserved.

关键词： Message passing

UNIQUE DETERMINATION BY A SINGLE FAR-FIELD MEASUREMENT FOR AN INVERSE ELASTIC PROBLEM

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Diao, Huaian Tang, Ruixiang Liu, Hongyu Tang, Jiexin School of Mathematics Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun China School of Mathematics Jilin University Jilin Changchun130012 China Department of Mathematics City University of Hong Kong Kowloon Hong Kong The No. 3 Junior High School of Yantai Economic and Technological Development Zone No. 1 Changzhou Street Shandong Yantai265503 China

This paper is concerned with the unique identification of the shape of a scatterer through a single far-field pattern in an inverse elastic medium scattering problem with a generalized transmission boundary condition. The uniqueness issue by a single far-field measurement is a challenging problem in inverse scattering theory, which has a long and colorful history. In this paper, we demonstrate the well-posedness of the direct problem by the variational approach. We establish the uniqueness results by a single far-field measurement under a generic scenario when dealing with underlying elastic scatterers exhibiting polygonal-nest or polygonal-cell structures. Furthermore, for a polygonal-nest or polygonal-cell structure scatterer associated with density and boundary impedance parameters as piecewise constants, we show that these physical quantities can be uniquely determined simultaneously by a single far-field measurement. The corresponding proof relies heavily on examining the singular behaviour of a coupled PDE system near a corner in a microlocal *** Codes 35R30, 74J20, 86A22 © 2023, CC BY.

关键词： Boundary conditions