检索结果-内蒙古大学图书馆

Computer Science and Blockchain (CCSB), International Conference on

作者： Guimin Huang Canjun Shi Guangxi Key Laboratory of Image and Graphic Intelligent Processing School of Computer Science and Information Security Guilin University of Electronic Technology Guilin China

ISBN: (数字)9798350356502

ISBN: (纸本)9798350356519

Short textual similarity has been more and more widely used in the field of natural language processing. However, people tend to pay more attention to the semantic similarity of sentences and ignore the word order similarity in sentences. For this reason, we propose a short text similarity computation model that fuses semantics and word order. In terms of semantics, we propose a adjacency-aware similarity model based on deep convolutional neural networks, which effectively exploits the adjacency relationship in sentences and extracts text features from multiple perspectives for similarity prediction. In terms of word order, a word order model incorporating an external knowledge base is proposed, which uses an external knowledge base with pointwise mutual information to construct word order dense vectors to assess word order similarity. Ultimately, we propose a comprehensive assessment model for short text similarity that incorporates semantic and word order information. We conducted experiments on the public dataset MRPC, and the experimental results show that our model outperforms existing models in terms of performance.

关键词： Computational modeling Semantics Knowledge based systems Syntactics Predictive models Feature extraction Vectors Natural language processing Convolutional neural networks Mutual information

来源：评论

学校读者我要写书评

暂无评论

Non-intrusive load monitoring based on a combination of Transformer and CNN

Non-intrusive load monitoring based on a combination of Tran...

引用

Energy, Power and Electrical Engineering (EPEE), International Conference on

作者： Yiqi Cheng Yanru Zhong College of Computer and Information Security Guilin University of Electronic Technology Guilin Guangxi China Guangxi Key Laboratory of Image And Graphic Intelligent Processing Guilin University of Electronic Technology Guilin Guangxi China

ISBN: (数字)9798331518066

ISBN: (纸本)9798331518073

Non-intrusive load monitoring (NILM) estimates the energy usage of individual devices by analyzing the total power meter data from a household. To address the issue of decreased monitoring accuracy with an increasing number of electricity meters, this paper proposes a solution for single appliance load monitoring (Tra-CNN). The solution uses the UK-DALE dataset, which contains high and low frequencies electricity consumption data of multiple households in the UK and the electricity consumption data of each household appliance, and uses the active power of the appliance as the input of the algorithm. The first part of the model consists of a convolutional layer, a normalization layer, and a dropout layer, with the primary task of capturing local dependencies in the data. The second part consists of a Transformer, whose self-attention mechanism associates features at different positions in the sequence to achieve modeling of long-term dependencies. The third part introduces a convolutional neural network, which uses a sliding window for convolution operations to extract local features from different positions and further extract features from sequence data. The final decoder consists of a transposed convolutional layer and a normalization layer, designed to revert the learned features to their original dimensions. Through experimental verification, the effectiveness and superiority of Tra-CNN are shown, which provides important ideas and methods for the further development of NILM technology.

关键词： Meters Home appliances Load monitoring Electricity Computational modeling Transformers Feature extraction Convolutional neural networks Data mining Load modeling

来源：评论

学校读者我要写书评

暂无评论

Spatiality-Aligned Graph Convolution Hashing for Unsupervised Cross-Modal Retrieval

Spatiality-Aligned Graph Convolution Hashing for Unsupervise...

引用

Signal, Information and Data processing (ICSIDP), IEEE International Conference on

作者： Fang Li Liulian Dai Rushi Lan Rui Yang Xiaonan Luo Center for Applied Mathematics of Guangxi(GUET) Guangxi Key Laboratory of Image and Graphic Intelligent Processing School of Computer Science and Information Security Guilin University of Electronic Technology Guilin China

ISBN: (数字)9798331515669

ISBN: (纸本)9798331515676

Unsupervised cross-modal retrieval leveraging hash learning has attracted a lot of interest from academics, primarily due to its minimal storage requirements, swift retrieval speeds, and label-free nature, making it a prime candidate for real-world applications. Nevertheless, the inherent "heterogeneous differences" and "semantic gap" within cross-modal data features pose significant challenges. Despite various attempts by scholars to address these issues, the existing solutions often fall short in terms of effectiveness. This can be attributed to several reasons: Firstly, image features, in contrast to text features, possess a plethora of attributes, making it challenging to extract features that possess strong expressive capabilities. Secondly, each modality of data exhibits not only inter-node correlations but also intricate relationships between individual nodes and their neighboring nodes. Consequently, a straightforward semantic correlation matrix is inadequate in capturing the intricate structural relationships within the data. Thirdly, the neglect of internal structural associations results in insufficient representation capabilities of binary hash codes in the Hamming space, hampering the learning of effective hash functions. To address these limitations, we introduce a Spatiality-Aligned Graph Convolution Hashing (SAGCH) algorithm. Extensive experiments demonstrate that our SAGCH method excels in both "image-to-text retrieval" and "text-to-image retrieval" tasks.

关键词： Hash functions Correlation Codes Convolution Graph convolutional networks Semantics Text to image Feature extraction Data processing Cross modal retrieval

来源：评论

学校读者我要写书评

暂无评论

HDMacBERT-FGM-CRF Model-Based Chinese Event Element Extraction 14th

HDMacBERT-FGM-CRF Model-Based Chinese Event Element Extracti...

引用

14th International Conference on Genetic and Evolutionary Computing, ICGEC 2021

作者： Chen, Peng Qiang, Baohua Wang, Yufeng Wang, Chen Chen, Ruidong Li, Baolian Peng, Bo Zhou, Xiangyu Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin University of Electronic Technology Guangxi Guilin541004 China The 54th Research Institute of China Electronics Technology Group Corporation Shijiazhuang050002 China

ISBN: (纸本)9789811684296

Because of the inaccuracy of event element extraction caused by long text, the errors of pre-training and fine-tuning stages, and the single sample of semantic features in the current Chinese event element extraction model, Hierarchical Decomposition MacBERT and Fast Gradient Method-based Chinese event element extraction algorithm by jointing Conditional Random Field (HDMacBERT-FGM-CRF) is proposed. This model extends absolute location encoding based on hierarchical decomposition so that the HDMacBERT model can directly process more than 512 Token texts. The HDMacBERT model based on the Mask strategy of similar words is used to mitigate errors. The FGM-based approach implements adversarial networks and increases the diversity of semantic feature samples. The P, R and F 1 of the HDMacBERT-FGM-CRF model proposed in this paper are 2.52%, 4.03% and 3.26% higher than those of the classical Chinese event element extraction model BERT-CRF on the DuEE dataset. The experimental results show that the proposed model can learn more comprehensive deep-level semantic information of text and improve Chinese event element extraction. © 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

关键词： Extraction

来源：评论

学校读者我要写书评

暂无评论

Research on auto focusing algorithm of microscopic imaging system

Research on auto focusing algorithm of microscopic imaging s...

引用

2022 IEEE International Conference on Advances in Electrical Engineering and Computer Applications, AEECA 2022

作者： Lv, Meini Yang, Qiuhui Ma, Wenjing Huang, Zeqiong College of Wuzhou Wuzhou China Wuzhou University Guangxi Colleges and Universities Key Lab. of Image Processing and Intelligent Information System Wuzhou China

ISBN: (数字)9781665480901

ISBN: (纸本)9781665480901

In the intelligent microscopic imaging system, the focusing evaluation function is one of the important core links in the automatic focusing system. In order to solve the problem that the focusing curve loses the characteristics of the ideal curve caused by illumination change, an automatic focusing algorithm based on Robert and wavelet transform is proposed in this paper. The algorithm extracts the maximum value of the high-frequency component wavelet coefficients decomposed by the wavelet transform, and uses the extracted wavelet coefficients to weight the Robert evaluation value coefficients, increases the sensitivity factor of the algorithm, and makes an experimental analysis with five traditional focusing functions under the condition of different illumination intensity to verify the feasibility of the algorithm. The experimental results show that the algorithm can overcome the change of illumination, has strong anti noise, sensitivity and stability, and is suitable for the fine focusing process in the microscopic imaging system. © 2022 IEEE.

关键词： Imaging systems

来源：评论

学校读者我要写书评

暂无评论

Chinese Summary Generation Algorithm Based on Contrastive Attention Mechanism 4

Chinese Summary Generation Algorithm Based on Contrastive At...

引用

4th International Symposium on Computer Engineering and intelligent Communications, ISCEIC 2023

作者： Guo, Liupeng Xiao, Yannan Wen, Yayuan Wen, Peizhi Guilin University of Electronic Technology School of Computer and Information Security Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin China Guilin University of Electronic Technology School of Computer and Information Security Guilin China Guangxi Normal University School of Electronic and Information Engineering School of Integrated Circuits Guilin China

ISBN: (纸本)9798350306323

Generative summarization based on the seq2seq model has gained widespread adoption due to the advancements and efficacy of the sequence-to-sequence framework. However, these models encounter challenges in handling out-of-vocabulary words and may produce summaries with factual inaccuracies. This paper addresses these issues by proposing a summarization generation model, MBC, which is built upon the Transformer as the baseline model. Additionally, it incorporates the BERT pre-trained model, pointer generation network, contrastive attention mechanism, and coverage loss. The model employs a pointer generation network to augment its vocabulary coverage capabilities by generating new terms. To enhance the representation of key information from the source text, a contrastive attention mechanism is employed during summary generation. In addition, by introducing coverage loss, the model can reduce repetitive content in the summary. To assess the model's performance, this paper employs ROUGE values as evaluation metrics and conducts comparative experiments with other models using the LCSTS dataset. The experimental results demonstrate that, in comparison with other models, this model is more adept at attending to salient information within the source text and generating summaries of greater accuracy. © 2023 IEEE.

关键词： BERT pre-training model contrastive attention mechanism coverage loss pointer generation network seq2seq model

来源：评论

学校读者我要写书评

暂无评论

Short-Term Smart Grid Load Forecasting Based on CNN-BiLSTM with Attention Mechanism

Short-Term Smart Grid Load Forecasting Based on CNN-BiLSTM w...

引用

Energy, Power and Grid (ICEPG), International Conference on

作者： Feihu Sun Yanru Zhong School of Computer Science and Information Security Guilin University of Electronic Technology Guilin Guangxi China Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin University of Electronic Technology Guilin Guangxi China

ISBN: (数字)9798350377798

ISBN: (纸本)9798350377804

The existing power load data exhibits complex multidimensionality, while existing techniques often focus on learning and forecasting from single load data. To fully exploit the complex multidimensionality of the existing power load data and enhance the accuracy of short-term load forecasting, a smart grid short-term load forecasting model based on attention mechanism and CNN-BiLSTM is proposed. Firstly, the one-dimensional convolutional network (1D-CNN) slides along the temporal dimension to extract multidimensional features such as temperature and humidity from the raw power load data. Secondly, the Bidirectional Long Short-Term Memory network (BiLSTM) captures both historical and future information of the data through gate mechanisms and the bidirectional network structure. Lastly, the attention mechanism allocates weights to focus on important parts of the load sequence data, enhancing the model’s ability to identify key information and further improving the accuracy of short-term power load forecasting. The method is experimented on a real-world multivariate load dataset and compared with existing learning methods. The proposed model achieved lower RMSE in 24-hour load forecasting compared to CNN-LSTM, CNN-BiLSTM, LSTM-Attention, BiLSTM-Attention and CNN-LSTM-Attention models by 13.2%, 10.6%, 6.7%, 5.7% and 5.9% respectively.

关键词： Attention mechanisms Accuracy Load forecasting Electricity Predictive models Feature extraction Data models Smart grids Convolutional neural networks Load modeling

来源：评论

学校读者我要写书评

暂无评论

A Lightweight Chinese Summarization Generation Method Based on Knowledge Distillation 4

A Lightweight Chinese Summarization Generation Method Based ...

引用

4th International Conference on Information Science, Parallel and Distributed Systems, ISPDS 2023

作者： Liu, Shiyue Xiao, Yannan Wang, Xueyong Huang, Wenming Deng, Zhenrong School of Computer and Information Security Guilin University of Electronic Technology Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin China School of Computer and Information Security Guilin University of Electronic Technology Guilin China Guilin Xintong Technology Co. Guilin China

ISBN: (纸本)9798350337181

In recent years, large-scale pretrained natural language processing models such as BERT, GPT3 have achieved good results in processing tasks. However, in daily applications, these large-scale language models usually exist large model size or long running time, and the model portability and application are not very convenient. To settle this problem, we come up with a lightweight summarization generation method based on knowledge distillation (LW-BERT-KD, abbreviated as LBK model) to prove that complex neural network knowledge (taking BERT model as an example) can be extracted to lightweight language processing models (taking BiLSTM model as an example), thus achieving the purpose of complex knowledge extraction and model compression. In this paper, the BERT model is regarded as the teacher model, and the BiLSTM is regarded as the student model. The knowledge distillation technology is the transfer of knowledge from teacher models to student models, so that the generated model is effective, lightweight, and easy to port. On the Chinese abstract generation dataset, the training effect of this model is significantly better than the basic Transformer baseline. The experimental results show that if the training parameters are increased by 100 times, the model achieves comparable results with complex preprocessing language models. © 2023 IEEE.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

MATL: A deep neural network using multi-scale convolutions and transformer for transcription factor binding site prediction

MATL: A deep neural network using multi-scale convolutions a...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Jinli Fan Ruyi Shen Xiaodi Huang Yanju Zhang Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin University of Electronic Technology Guilin China College of Computer Science and Technology Huaqiao University Xiamen China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

Transcription factors bind to specific sequences of DNA known as transcription factor binding sites (TFBSs) in order to regulate gene expression. Identifying TFBSs is crucial for deciphering gene expression mechanisms, understanding in vitro life characteristics, and drug design. In recent years, many deep learning methods that utilize only the sequence features or a combination of sequence and shape features have been developed to predict TFBSs. However, these methods have not fully considered the characteristics of TFBSs, and their encoding strategies are relatively simplistic, thereby failing to capture the complex dependencies hidden within TFBSs. To address these issues, we propose a novel deep neural network model called MATL, which integrates sequence and shape features for TFBSs prediction. The model employs techniques such as multi-scale convolution and Transformer, and combines different modules for feature extraction based on the distribution patterns of different feature matrices. Additionally, we introduce transfer learning to address the issue of unsatisfactory prediction results due to insufficient training data in some datasets. As the results indicate, MATL exhibits excellent predictive performance on 165 validated ChIP-seq datasets, surpassing state-of-the-art methods. We also conducted ablation experiments on sequence encoding, feature extraction, and shape modules used in this study, and demonstrated that these modules play a positive role in predicting TFBSs. Moreover, the results also indicated that transfer learning can improve prediction accuracy for some TFBSs datasets with small amounts of data. The source code of MATL is available at https://***/LittleWhiteKing/MATL.

关键词： Deep learning Shape Convolution Transfer learning Artificial neural networks Predictive models Feature extraction Transformers Data models Gene expression

来源：评论

学校读者我要写书评

暂无评论

Chinese Event Extraction Method Based on Roformer Model

引用

Wireless Communications and Mobile Computing 2023年第1期2023卷

作者： Qiang, Baohua Zhou, Xiangyu Wang, Yufeng Yang, Xianyi Wang, Yuemeng Tian, Jubo Chen, Peng Guangxi Key Laboratory of Image and Graphic Intelligent Processing Guilin University of Electronic Technology Guilin541004 China Hebei Key Laboratory of Intelligent Information Perception and Processing The 54th Research Institute of CETC Shijiazhuang050081 China

Event extraction is an important research direction in the field of natural language processing. The current Chinese event extraction field still suffers from errors in the pretraining and fine-tuning stages, inability to directly handle texts with more than 512 tokens, and inaccurate event extraction due to insufficient semantic sample diversity. In this paper, we propose a Chinese event extraction method RoformerFC (Roformer model with FGM and CRF) based on the Roformer model to address the above problems. Firstly, our method utilizes the Roformer model based on rotary position embedding, which both moderates the errors in the pretraining and fine-tuning phases and allows the model to directly handle texts with more than 512 tokens;then, the adversarial networks based on FGM (fast gradient method) are realized to increase the diversity of semantic feature samples;finally, the classical CRF (conditional random fields) model is used to decode and identify the event element entity and its corresponding event role and event type. On the short text DuEE dataset, the microP, microR, and microF of our method improved 1.26%, 4.01%, and 2.68%, respectively, over the classical Chinese event extraction method BERT-CRF. On the long text JsEE dataset, the microP, microR, and microF of our method improved 2.26%, 5.03%, and 3.72%, respectively, over the classical Chinese event extraction method BERT-CRF. © 2023 Baohua Qiang et al.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：