Deep learning has made significant improvement in naturallanguageprocessing. Nowadays virtual assistants or chatbots attract attention of many researchers and are expected to be applied in more and more areas. We ha...
详细信息
In the field of multilingual naturallanguageprocessing (NLP), zero-shot cross-language transfer is an important research direction, which aims to enable models to effectively learn and reason without target language...
详细信息
Design reviews are critical for construction projects to reduce costly reworks and future conflicts. However, this is a challenging task due to uncertainties during the initial stages of a project, which can lead to n...
详细信息
ISBN:
(数字)9780784485224
ISBN:
(纸本)9780784485224
Design reviews are critical for construction projects to reduce costly reworks and future conflicts. However, this is a challenging task due to uncertainties during the initial stages of a project, which can lead to numerous requests for information (RFIs). With the recent advancements in language models and computer vision, a large volume of historical RFIs can be leveraged to aid design reviews. This study proposes a novel framework using naturallanguageprocessing, ChatGPT API, and computer vision techniques to identify the RFIs from previous projects that are more likely to reoccur in the project under review. The framework was tested using RFI data from 19 healthcare construction projects, and a web application was used to evaluate user experiences with the tool. Successful implementation of the proposed framework could reduce the number of RFIs, change orders, rework by contractors, and the likelihood of time and cost overruns for construction projects.
To address the time-consuming issue of finding relevant design knowledge in product design, this study proposes a context-based adaptive online design knowledge push method. This method constructs a multi-dimensional ...
详细信息
Large language models (LLMs) have demonstrated significant success across a range of naturallanguageprocessing tasks in general-purpose domains. However, due to limited specialized knowledge, LLMs sometimes generate...
详细信息
Given the low interpretability of large language models (LLMs) due to their extensive parameters and intricate features, this study aims to enhance the understandability and interpretability of automatic QA systems po...
详细信息
Sign language is a vital mode of communication for deaf individuals, yet it frequently proves challenging to convey messages to hearing people. The preceding two-way interaction system was found to be ineffective. Fur...
详细信息
Poisoning of data sets is a potential security threat to large language models that can lead to backdoored models. A description of the internal mechanisms of backdoored language models and how they process trigger in...
详细信息
ISBN:
(纸本)9798400704505
Poisoning of data sets is a potential security threat to large language models that can lead to backdoored models. A description of the internal mechanisms of backdoored language models and how they process trigger inputs, e.g., when switching to toxic language, has yet to be found. In this work, we study the internal representations of transformer-based backdoored language models and determine early-layer MLP modules as most important for the backdoor mechanism in combination with the initial embedding projection. We use this knowledge to remove, insert, and modify backdoor mechanisms with engineered replacements that reduce the MLP module outputs to essentials for the backdoor mechanism. To this end, we introduce PCP ablation, where we replace transformer modules with low-rank matrices based on the principal components of their activations. We demonstrate our results on backdoored toy, backdoored large, and non-backdoored open-source models. We show that we can improve the backdoor robustness of large language models by locally constraining individual modules during fine-tuning on potentially poisonous data sets. Trigger warning: Offensive language.
Requirements engineering is a critical part of the software lifecycle, describing what a given piece of software will do (functional) and how it will do it (non-functional). Requirements documents are often textual, a...
详细信息
ISBN:
(纸本)9798350324983
Requirements engineering is a critical part of the software lifecycle, describing what a given piece of software will do (functional) and how it will do it (non-functional). Requirements documents are often textual, and it is up to software engineers to extract the relevant domain models from the text, which is an error-prone and time-consuming task. Considering the recent attention gained by Large language Models (LLMs), we explored how they could support this task. This paper investigates how such models can be used to extract domain models from agile product backlogs and compare them to (i) a state-of-practice tool as well as (ii) a dedicated naturallanguageprocessing (NLP) approach, on top of a reference dataset of 22 products and 1, 679 user stories. Based on these results, this paper is a first step towards using LLMs and/or tailored NLP to support automated requirements engineering thanks to model extraction using artificial intelligence.
This study has conducted several activities to analyze and compare the performance of five naturallanguageprocessing (NLP) models: GPT-3, T5, ERNIE, BERT, and XLNet for generating academic content in universities lo...
详细信息
暂无评论