检索结果-内蒙古大学图书馆

2023 Asia-Pacific Conference on Image processing, Electronics and Computers, IPEC 2023

作者： Wang, Peng Gu, Jinguang Institute of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Hubei Prov. Key Laboratory of Intelligent Information Processing and Real Time Industrial Systems Wuhan University of Science and Technology Wuhan China

In the case of the specific task of identifying named entities within electronic medical record, it is hard to determine the boundary of nested entities, and existing NER systems have insufficient decoding performance. Based on the pre training model BERT, this paper introduces a novel network structure called Biaffine Layer using a bidirectional LSTM layer. The network uses a dual affine attention mechanism for semantic information learning, which can better interact with the semantic information of entity heads and entity tails, thereby achieving better recognition results for entities. Due to the sparsity of named entity datasets and the uneven distribution of entity categories, traditional binary cross entropy loss functions require multiple rounds of training to decode entities. In this paper, we have modified the binary cross entropy loss function to make the proposed model faster decode the entities that need to be identified. The model performs well, according to the experimental findings. The approach suggested in this paper offers a fresh approach to the NER issue raised by electronic medical records, and it is anticipated to considerably boost the effectiveness and caliber of clinical medical research. © Published under licence by IOP Publishing Ltd.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

Mind Modeling in Intelligence Science 4th

Mind Modeling in Intelligence Science

引用

4th IFIP TC 12 International Conference on Intelligence Science, ICIS 2020

作者： Shi, Zhongzhi Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences Beijing100190 China

ISBN: (纸本)9783030748258

Intelligence Science is an interdisciplinary subject which dedicates to joint research on basic theory and technology of intelligence by brain science, cognitive science, artificial intelligence and others. Mind modeling is the core of intelligence science. Here mind means a series of cognitive abilities, which enable individuals to have consciousness, sense the outside world, think, make judgment, and remember things. The mind model consciousness and memory (CAM) is proposed by the Intelligence Science laboratory. The CAM model is a framework for artificial general intelligence and will lead the development of a new generation of artificial intelligence. This paper will outline the age of intelligence, mind model CAM, brain computer integration. © 2021, IFIP International Federation for information processing.

关键词： Artificial intelligence

来源：评论

学校读者我要写书评

暂无评论

Improving Bert Fine-Tuning via Stabilizing Cross-Layer Mutual information 48

Improving Bert Fine-Tuning via Stabilizing Cross-Layer Mutua...

引用

48th IEEE International Conference on Acoustics, Speech and Signal processing, ICASSP 2023

作者： Li, Jicun Li, Xingjian Wang, Tianyang Wang, Shi Cao, Yanan Xu, Chengzhong Dou, Dejing Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China University of Chinese Academy of Sciences China Big Data Lab Baidu Research China University of Alabama Birmingham United States Institute of Information Engineering Chinese Academy of Sciences China State Key Lab of Iotsc University of Macau China

ISBN: (纸本)9781728163277

Fine-tuning pre-trained language models, such as BERT, has shown enormous success among various NLP tasks. Though simple and effective, the process of fine-tuning has been found unstable, which often leads to unexpected poor performance. To increase stability and generalizability, most existing works resort to maintaining the parameters or representations of pre-trained models during fine-tuning. Nevertheless, very little work explores mining the reliable part of pre-learned information that can help to stabilize fine-tuning. To address this challenge, we introduce a novel solution in which we fine-tune BERT with stabilized cross-layer mutual information. Our method aims to preserve the reliable behaviors of cross-layer information propagation, instead of preserving the information itself, of the pre-trained model. Therefore, our method circumvents the domain conflicts between pre-trained and target tasks. We conduct extensive experiments with popular pre-trained BERT variants on NLP datasets, demonstrating the universal effectiveness and robustness of our method. © 2023 IEEE.

关键词： Fine-tuning Stability Mutual information Pre-trained Language Model

来源：评论

学校读者我要写书评

暂无评论

ACT-MNMT: Auto-Constriction Turning for Multilingual Neural Machine Translation

arXiv

引用

arXiv 2024年

作者： Dai, Shaojie Liu, Xin Luo, Ping Yu, Yue Key Laboratory of Intelligent Information Processing Institute of Computing Technology Chinese Academy of Sciences China Peng Cheng Laboratory China University of Chinese Academy of Sciences China

Large language model (LLM) has achieved promising performance in multilingual machine translation tasks through zero/few-shot prompts or prompt-tuning. However, due to the mixture of multilingual data during the pre-training of LLM, the LLM-based translation models face the off-target issue in both prompt-based methods, including a series of phenomena, namely instruction misunderstanding, translation with wrong language and over-generation. For this issue, this paper introduces an Auto-Constriction Turning mechanism for Multilingual Neural Machine Translation (ACT-MNMT), which is a novel supervised fine-tuning mechanism and orthogonal to the traditional prompt-based methods. In this method, ACT-MNMT automatically constructs a constrained template in the target side by adding trigger tokens ahead of the ground truth. Furthermore, trigger tokens can be arranged and combined freely to represent different task semantics, and they can be iteratively updated to maximize the label likelihood. Experiments are performed on WMT test sets with multiple metrics, and the experimental results demonstrate that ACT-MNMT achieves substantially improved performance across multiple translation directions and reduce the off-target phenomena in the translation. © 2024, CC BY.

关键词： Neural machine translation

来源：评论

学校读者我要写书评

暂无评论

EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion

arXiv

引用

arXiv 2024年

作者： Sun, Yuchen Xu, Qianqian Wang, Zitai Yang, Zhiyong He, Junwei Key Laboratory of Intelligent Information Processing Institute of Computing Technology CAS Beijing China School of Computer Science and Technology University of Chinese Academy of Sciences Beijing China

Multi-label Out-Of-Distribution (OOD) detection aims to discriminate the OOD samples from the multi-label In-Distribution (ID) ones. Compared with its multiclass counterpart, it is crucial to model the joint information among classes. To this end, JointEnergy, which is a representative multi-label OOD inference criterion, summarizes the logits of all the classes. However, we find that JointEnergy can produce an imbalance problem in OOD detection, especially when the model lacks enough discrimination ability. Specifically, we find that the samples only related to minority classes tend to be classified as OOD samples due to the ambiguous energy decision boundary. Besides, imbalanced multi-label learning methods, originally designed for ID ones, would not be suitable for OOD detection scenarios, even producing a serious negative transfer effect. In this paper, we resort to auxiliary outlier exposure (OE) and propose an unknown-aware multi-label learning framework to reshape the uncertainty energy space layout. In this framework, the energy score is separately optimized for tail ID samples and unknown samples, and the energy distribution gap between them is expanded, such that the tail ID samples can have a significantly larger energy score than the OOD ones. What’s more, a simple yet effective measure is designed to select more informative OE datasets. Finally, comprehensive experimental results on multiple multi-label and OOD datasets reveal the effectiveness of the proposed method. © 2024, CC BY.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Sequential Topic Selection Model with Latent Variable for Topic-Grounded Dialogue

Sequential Topic Selection Model with Latent Variable for To...

引用

2022 Findings of the Association for Computational Linguistics: EMNLP 2022

作者： Wen, Xiaofei Wei, Wei Mao, Xian-Ling Cognitive Computing and Intelligent Information Processing Laboratory School of Computer Science and Technology Huazhong University of Science and Technology China Department of Computer Science and Technology Beijing Institute of Technology China

Recently, topic-grounded dialogue system has attracted significant attention due to its effectiveness in predicting the next topic to yield better responses via the historical context and given topic sequence. However, almost all existing topic prediction solutions focus on only the current conversation and corresponding topic sequence to predict the next conversation topic, without exploiting other topic-guided conversations which may contain relevant topic-transitions to current conversation. To address the problem, in this paper we propose a novel approach, named Sequential Global Topic Attention (SGTA) to exploit topic transition over all conversations in a subtle way for better modeling post-to-response topic-transition and guiding the response generation to the current conversation. Specifically, we introduce a latent space modeled as a Multivariate Skew-Normal distribution with hybrid kernel functions to flexibly integrate the global-level information with sequence-level information, and predict the topic based on the distribution sampling results. We also leverage a topic-aware prior-posterior approach for secondary selection of predicted topics, which is utilized to optimize the response generation task. Extensive experiments demonstrate that our model outperforms competitive baselines on prediction and generation tasks. © 2022 Association for Computational Linguistics.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Movie preference prediction based on EEG signal under high brain correlation 4

Movie preference prediction based on EEG signal under high b...

引用

4th International Conference on Signal processing and Computer Science, SPCS 2023

作者： Yue, Yuanhao Zhao, Xingcong Zhou, Wei Liu, Guangyuan School of Electronic and Information Engineering Southwest University Tiansheng Road Beibei Chongqing400715 China Institute of Affective Computing and Information Processing Southwest University Tiansheng Road Beibei Chongqing400715 China Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing Southwest University Tiansheng Road Beibei Chongqing400715 China

ISBN: (纸本)9781510672505

In this study, we recorded the electroencephalography (EEG) of human subjects when they watched a movie trailer. Based on the willingness preference from the subjects after finished the movie trailer watching, the EEG signals were analyzed to build regression models to predict the subjects' movie preferences. We proposed a new approach to rise the prediction accuracy. Specifically, the correlated component analysis (CCA) algorithm was used to calculate the inter-subject correlation (ISC) of each time segment in the movie trailer and the ISC of each channel in the EEG. These two states were selected to locate the moment when a specific area of the brain responds most strongly to the video stimulation, as an effective indicator for predicting individual movie preferences. The experimental results show that the method of selecting effective EEG signals at the level of ISC has achieved a better prediction effect on the GBDT regression model (R2 = 0.733, RMSE = 0.681). We also found that low-frequency EEG signals in the θ and δ bands of the parietal and occipital sites are more effective in predicting movie preferences than high-frequency EEG signals. © 2023 SPIE.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

Spatio-Temporal Context Modeling for Road Obstacle Detection 1

引用

4th International Conference on Machine Learning for Cyber Security, ML4CS 2022

作者： Wu, Xiuen Wang, Tao Liang, Lingyu Li, Zuoyong Ching, Fum Yew College of Computer and Data Science Fuzhou University Fuzhou350108 China Fujian Provincial Key Laboratory of Information Processing and Intelligent Control Minjiang University Fuzhou350108 China The Key Laboratory of Cognitive Computing and Intelligent Information Processing of Fujian Education Institutions Wuyi University Wuyishan354300 China School of Electronic and Information Engineering South China University of Technology Guangzhou510641 China Ministry of Education Key Laboratory of Computer Network and Information Integration Southeast University Nanjing211189 China Guangzhou510320 China Penang11800 Malaysia

ISBN: (数字)9783031200960

ISBN: (纸本)9783031200953

Road obstacle detection is an important problem for vehicle driving safety. In this paper, we aim to obtain robust road obstacle detection based on spatio-temporal context modeling. Firstly, a data-driven spatial context model of the driving scene is constructed with the layouts of the training data. Then, obstacles in the input image are detected via the state-of-the-art object detection algorithms, and the results are combined with the generated scene layout. In addition, to further improve the performance and robustness, temporal information in the image sequence is taken into consideration, and the optical flow is obtained in the vicinity of the detected objects to track the obstacles across neighboring frames. Qualitative and quantitative experiments were conducted on the Small Obstacle Detection (SOD) dataset and the Lost and Found dataset. The results indicate that our method with spatio-temporal context modeling is superior to existing methods for road obstacle detection. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

Domain-aware Node Representation Learning for Graph Out-of-Distribution Generalization

Domain-aware Node Representation Learning for Graph Out-of-D...

引用

International Conference on Acoustics, Speech, and Signal processing (ICASSP)

作者： Yi Qiao Yang Liu Qing He Xiang Ao Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS) Institute of Computing Technology CAS Beijing China University of Chinese Academy of Sciencs Beijing China Institute of Intelligent Computing Technology Suzhou CAS

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Graph Neural Networks (GNNs) have demonstrated impressive success across diverse fields when data satisfies in-distribution (ID) assumption. Nevertheless, GNN performance significantly declines in cases of distribution shifts between training and testing graph data. This degradation primarily stems from spurious correlations between irrelevant domain information and target labels in out-of-distribution (OOD) scenarios. Thus, maximizing the utilization of domain information becomes imperative. In light of this, we propose a novel approach named Domain-aware Node Representation Learning (DNRL), comprehensively incorporates domain information to bolster generalization capability. Specifically, DNRL selectively interpolates nodes with the same label but different domains, extending training data into unseen domains and alleviating the effects caused by domain-related spurious correlations. Futhermore, by introducing a domain-aware contrastive learning strategy, our method implicitly decouples domain information from node information to learn domain-independent node representations. Extensive experiments on graph out-of-distribution benchmarks demonstrate that DNRL can achieve effective OOD generalization performance across diverse domains.

关键词： Representation learning Training Degradation Interpolation Correlation Training data Signal processing Graph neural networks Data models Speech processing

来源：评论

学校读者我要写书评

暂无评论

Dual-Band HRRP Fusion Recognition via Wavelet Decomposition Embedded Autoencoder 2

Dual-Band HRRP Fusion Recognition via Wavelet Decomposition ...

引用

2nd IEEE International Conference on Signal, information and Data processing, ICSIDP 2024

作者： Wang, Weijia Qi, Zhuchang Wang, Lue Yang, Wei Zhang, Liang Wang, Yanhua Xi'an Institute of Modern Control Technology Xi'an710065 China Beijing Institute of Technology Zhengzhou Academy of Intelligent Technology Zhengzhou450000 China Radar Technology Research Institute Beijing Institute of Technology Beijing100081 China Beijing Key Laboratory of Embedded Real-Time Information: Processing Technology Beijing100081 China Beijing Institute of Technology Chongqing Innovation Center Chongqing401120 China

ISBN: (纸本)9798331515669

High-resolution range profile (HRRP) is a crucial technique for radar target recognition. Due to the coupling of azimuthal scattering information and aspect sensitivity, fine target recognition using HRRP remains challenging. One way to mitigate HRRP aspect sensitivity is through enhancing the dimensionality of radar information acquisition. Therefore, this paper proposes a Dual-Band HRRP Fusion Recognition Model via Wavelet Decomposition Embedded Autoencoder (DF-WD-AENet). The method we proposed mainly comprises two modules. Firstly, the autoencoder model based on wavelet decomposition (WD-AEM) achieves constraint on feature information, making it better suited for dual-band fusion. Next is the dual-band information fusion module (DFM), in which we achieved the interaction and fusion of feature information through convolutional block attention module (CBAM) and omni-dimensional dynamic convolution (ODConv), and used a fusion loss function to train the model. Experiment shows that the recognition rate of our method is 7.73% higher than that of single-band, proving the effectiveness of the proposed method. © 2024 IEEE.

关键词： Wavelet decomposition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：