Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP)...
详细信息
Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning. These models, however, suffer from poor robustness and lack of interpretability. We refer to pre-trained language models with knowledge injection as knowledge-enhanced pre-trained language models (KEPLMs). These models demonstrate deep understanding and logical reasoning and introduce interpretability. In this survey, we provide a comprehensive overview of KEPLMs in NLP. We first discuss the advancements in pre-trained language models and knowledge representation learning. Then we systematically categorize existing KEPLMs from three different perspectives. Finally, we outline some potential directions of KEPLMs for future research.
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across t...
详细信息
ISBN:
(数字)9783031501517
ISBN:
(纸本)9783031501500
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across the planet. Objective is to celebrate “Research Novelty with Compassion and Wisdom” with researchers, scholars, experts, and investigators in Intelligent Computing and Optimization across the globe, to share knowledge, experience, and innovation—a marvelous opportunity for discourse and mutuality by novel research, invention, and creativity.
This proceedings book of the 6th ICO’2023 is published by Springer Nature—Quality Label of Enlightenment.
The rapid advancements in big data and the Internet of Things (IoT) have significantly accelerated the digital transformation of medical institutions, leading to the widespread adoption of Digital Twin Healthcare (DTH...
详细信息
The rapid advancements in big data and the Internet of Things (IoT) have significantly accelerated the digital transformation of medical institutions, leading to the widespread adoption of Digital Twin Healthcare (DTH). The Cloud DTH Platform (CDTH) serves as a cloud-based framework that integrates DTH models, healthcare resources, patient data, and medical services. By leveraging real-time data from medical devices, the CDTH platform enables intelligent healthcare services such as disease prediction and medical resource optimization. However, the platform functions as a system of systems (SoS), comprising interconnected yet independent healthcare services. This complexity is further compounded by the integration of both black-box AI models and domain-specific mechanistic models, which pose challenges in ensuring the interpretability and trustworthiness of DTH models. To address these challenges, we propose a Model-Based Systems Engineering (MBSE)-driven DTH modeling methodology derived from systematic requirement and functional analyses. To implement this methodology effectively, we introduce a DTH model development approach using the X language, along with a comprehensive toolchain designed to streamline the development process. Together, this methodology and toolchain form a robust framework that enables engineers to efficiently develop interpretable and trustworthy DTH models for the CDTH platform. By integrating domain-specific mechanistic models with AI algorithms, the framework enhances model transparency and reliability. Finally, we validate our approach through a case study involving elderly patient care, demonstrating its effectiveness in supporting the development of DTH models that meet healthcare and interpretability requirements.
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across t...
详细信息
ISBN:
(数字)9783031503306
ISBN:
(纸本)9783031503290
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across the planet. Objective is to celebrate “Research Novelty with Compassion and Wisdom” with researchers, scholars, experts, and investigators in Intelligent Computing and Optimization across the globe, to share knowledge, experience, and innovation—a marvelous opportunity for discourse and mutuality by novel research, invention, and creativity.;This proceedings book of the 6th ICO’2023 is published by Springer Nature—Quality Label of Enlightenment.
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across t...
详细信息
ISBN:
(数字)9783031362460
ISBN:
(纸本)9783031362453
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across the planet. Objective is to celebrate “Research Novelty with Compassion and Wisdom” with researchers, scholars, experts, and investigators in Intelligent Computing and Optimization across the globe, to share knowledge, experience, and innovation—a marvelous opportunity for discourse and mutuality by novel research, invention, and creativity.
This proceedings book of the 6th ICO’2023 is published by Springer Nature—Quality Label of Enlightenment.
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across t...
详细信息
ISBN:
(数字)9783031501586
ISBN:
(纸本)9783031501579
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across the planet. Objective is to celebrate “Research Novelty with Compassion and Wisdom” with researchers, scholars, experts, and investigators in Intelligent Computing and Optimization across the globe, to share knowledge, experience, and innovation—a marvelous opportunity for discourse and mutuality by novel research, invention, and creativity.;This proceedings book of the 6th ICO’2023 is published by Springer Nature—Quality Label of Enlightenment.
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across t...
详细信息
ISBN:
(数字)9783031503276
ISBN:
(纸本)9783031503269
The 6th edition of International Conference on Intelligent Computing and Optimization took place at G Hua Hin Resort & Mall on April 27–28, 2023, with tremendous support from the global research scholars across the planet. Objective is to celebrate “Research Novelty with Compassion and Wisdom” with researchers, scholars, experts, and investigators in Intelligent Computing and Optimization across the globe, to share knowledge, experience, and innovation—a marvelous opportunity for discourse and mutuality by novel research, invention, and creativity.;This proceedings book of the 6th ICO’2023 is published by Springer Nature—Quality Label of Enlightenment.
暂无评论