检索结果-内蒙古大学图书馆

International Joint Conference on Neural Networks (IJCNN)

作者： Xishan Ma Yushui Geng Jing Zhao Huanxiao Zhou Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Image-text retrieval is a basic cross-modal task, and the basic idea is to learn image-text matching. The key to this task is to accurately measure the similarity between these two modalities. However, most existing methods tend to measure image-text similarity based on highly correlated region-word pairs, which lacks the ability to capture complex cross-modal semantic associations, thereby resulting in failure to distinguish hard negative examples that are similar in semantic content. Furthermore, existing methods focus more on alignment of different modal features, thus neglecting deep reasoning about the semantic concepts within the modality. In this paper, we propose a new semantic information reasoning and multi-step cross-modal interaction (SRMCI) network to simultaneously explore intra-modal and inter-modal relationships. Specifically, we first propose a semantic information reasoning module to fully explore potential semantic relationships within modalities and focus on fragments with important semantic information. Then, we design a multi-step cross-modal interaction module that utilizes two different inter-modal interactive attentions and an effective gated fusion strategy to capture fragment-level and fragment-instance-level cross-modal semantic associations. In particular, this gated fusion strategy is used to learn better fine-grained feature representations to aid in understanding and establishing semantic associations between different modalities. Experiments on the benchmark datasets MS-COCO and Flickr30K demonstrate the effectiveness of our method.

关键词： Correlation Semantics Neural networks Logic gates Benchmark testing Cognition

来源：评论

学校读者我要写书评

暂无评论

Semantic Relation-Based Cross Attention Network for Image-Text Retrieval

Semantic Relation-Based Cross Attention Network for Image-Te...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Huanxiao Zhou Yushui Geng Jing Zhao Xishan Ma Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Image-text retrieval refers to querying the text or image of another modality given an image or text, and its key lies in the ability to accurately measure the similarity between text and image. Most of the existing retrieval methods only utilize the intramodal relations of each modality or the intermodal relations of the two modalities to perform the retrieval task. To address the above problems, we integrate the intra-modal and inter-modal relations and propose a Semantic Relation-based Cross Attention Network(SRCAN). In our proposed method, we first mine the possible intra-modal associations between regions in an image and between words in a text to obtain features with semantic relationships, and then capture the fine-grained associations between segments through the cross-attention mechanism. Finally, we balance the intra-modal and inter-modal relationships to improve the performance of the model. Our proposed method is experimentally validated on two datasets, Flickr30K and MS-COCO, and the experimental results show that our method achieves superior results.

关键词： Image segmentation Semantics Bidirectional control Feature extraction Cognition Feeds Cybernetics

来源：评论

学校读者我要写书评

暂无评论

SMGC-SBERT: A Multi-Feature Fusion Chinese Short Text Similarity Computation Model Based on Optimised SBERT

SMGC-SBERT: A Multi-Feature Fusion Chinese Short Text Simila...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Shuo Zhao Qiliang Gu Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Chinese short text similarity computation stands as a pivotal task within natural language processing, garnering significant attention. However, existing models grapple with limitations in handling intricate semantic relationships, such as the challenge of discerning subtle semantic nuances in text, inadequacies in effectively integrating diverse levels of semantic information, and the struggle to capture polysemous meanings accurately. In addressing these issues, this paper introduces an innovative Chinese short text similarity computation model, SMGC-SBERT. This model addresses shortcomings of the existing models by employing a multi-module fusion strategy, thereby enabling a more precise measurement of semantic similarity between texts. Primarily, the model incorporates SAT embedding to acquire phrase-level semantic information and leverages the MS-BERT model to encode text, improving the model's comprehension of textual polysemy and obtaining richer semantic representation. Then, the fusion of module features, including multi-branch convolutional networks and mix pooling, enables the extraction of textual features from varied levels, bolstering the model's representational capacity. Additionally, to further reduce overfitting risks while improving accuracy and other performance, a multi-layer feature adjustment network is utilized for short text similarity calculation. The final resultant experimental findings showcase the superiority of the SMGC-SBERT model over other neural network models, demonstrating significant advancements across both Chinese-SNLI and CCKS2018_Task3 Chinese short text datasets.

关键词： Deep learning Computational modeling Semantics Neural networks Feature extraction Natural language processing Multilingual Convolutional neural networks Cybernetics Overfitting

来源：评论

学校读者我要写书评

暂无评论

FERI: Feature Enhancement and Relational Interaction for Image-text Matching

FERI: Feature Enhancement and Relational Interaction for Ima...

引用

International Conference on Parallel and Distributed Systems (ICPADS)

作者： Yu Zhang Jianqiang Zhang Gongpeng Song Qin Lu Shuo Zhao Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798331515966

ISBN: (纸本)9798331515973

Image-text matching is an important problem at the intersection of computer vision and natural language processing. It aims to establish the semantic link between image and text to achieve high-quality semantic alignment between the two modalities. However, the existing methods have the problem that the meaning expressed in the image or the complex narrative in the text cannot be fully understood due to insufficient feature extraction. Moreover, due to the essential modal differences between images and texts, how to effectively and accurately align the semantic contents in images and texts has become the key of research. In order to solve the above problems, this paper proposes a method based on feature enhancement and relationship interaction. When processing images, the proposed method fuses labeled features, region features and location features to represent images. When processing text, a combination of Bi-GRU and self-attention mechanism is used to represent the text. In order to further align the semantic content in images and texts accurately, this paper improves two relational interaction mechanisms by identifying connection relationships and learning association relationships. Thus, the relation enhanced embedding is obtained. Finally, it calculated the similarity of the enhanced embedding to judge the matching degree of the image and text. Extensive experiments on the public datasets Flickr30K and MSCOCO demonstrate the effectiveness of our method.

关键词： Computer vision Fuses Image matching Semantics Feature extraction Natural language processing

来源：评论

学校读者我要写书评

暂无评论

Cross-modal retrieval based on Attention Embedded Variational Auto-Encoder

Cross-modal retrieval based on Attention Embedded Variationa...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Kaili Zhou Yiyun Xing Yushui Geng Jing Zhao Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

This study proposes a cross-modal retrieval technique, which employs an Attention Embedded Variational AutoEncoder (AE-VAE) to tackle the problem of reduced retrieval accuracy resulting from data noise and data absence in cross-modal retrieval tasks. First, the variational auto-encoder(VAE) is used as an infrastructure to transform modal data into latent variables by encoding and decoding different modal features, thus preserving the semantic structure of the raw modal data and suppressing noise and missing information in the data. Secondly, to better capture the important semantic features of image and text modalities, an improved multi-attention module is introduced in the encoder. In addition, a cross-modal alignment module is designed to further align the latent variables of different modalities in the latent space to solve the confusion problem and improve the accuracy and robustness of cross-modal retrieval. Finally, experiments are conducted on four public datasets, CUB, SUN, AwA1 and AwA2, and the experimental results show that our proposed model is effective in improving the accuracy and robustness of retrieval.

关键词： Accuracy Uncertainty Noise Semantics Transforms Probabilistic logic Robustness

来源：评论

学校读者我要写书评

暂无评论

MFFLEN: Multi-Label Text Classification Based on Multi-Feature Fusion and Label Embedding

MFFLEN: Multi-Label Text Classification Based on Multi-Featu...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Qiliang Gu Shuo Zhao Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Shandong Engineering Research Center of Big Data Applied Technology Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

To address the challenges associated with insufficiently extracting and utilizing features at different levels, overlooking the connection between label meanings and text, and facing problems of over-compression or information loss when extracting global information using recurrent neural networks in the field of multi-label text categorization, this paper introduces an innovative model known as MFFLEN (MultiFeature Fusion and Label Embedding Neural Network). First, a back-translated enhanced label set is constructed by back-translated splicing enhancement of the original label set. This set, together with the text, is then input into the embedding layer, which consists of the pre-trained model of bert-baseChinese, thus establishing the initial connection between the text and the labels within the same vector space. Then, to comprehensively extract multi-level semantic features, the model uses a convolutional layer to extract local features and an embedding layer to extract sentence-level features. A bidirectional attention embedded GRU (BAE-GRU) layer is used to extract hybrid finegrained features, which are then fed into the attention layer to further extract hybrid labeled features based on labeling information. Finally, these three different types of features are fused and multi-label text classification results are obtained using a classifier. The experiments proved that the MFFLEN model achieved 73.82% and 88.44% macro-F1 and 88.00% and 88.86% micro-F1 on the two datasets CAIL 2018 Small and CAIL 2018 Split, respectively, which is better than other baseline models.

关键词： Measurement Recurrent neural networks Splicing Text categorization Semantics Multi label classification Logic gates Feature extraction Vectors data mining

来源：评论

学校读者我要写书评

暂无评论

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similarity Computation Model with Attention Mechanism

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similar...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Shuo Zhao Yiyun Xing Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Text semantic similarity is a crucial research area in Natural Language Processing (NLP). However, traditional methods for calculating the similarity of short Chinese texts often fall short in accuracy and other crucial aspects. The Bidirectional Long Short-Term Memory Network (BiLSTM) has demonstrated remarkable performance in computing the similarity of short Chinese texts by effectively capturing long-range dependencies and semantic information. Additionally, the multi-head attention mechanism considers the interaction between different text locations and semantic information, enhancing the model’s representative capacity. Building upon this foundation, our paper proposes an enhanced model known as SCTbilstmAttRdrop (SCTAR). This model is constructed based on a multilayer BiLSTM architecture and incorporates an SE-gated convolutional module and a convolutional multi-head attention-aware model. We conducted extensive evaluations using two Chinese short text datasets, Chinese-SNLI and CCKS2018_Task3. The experimental results unequivocally demonstrate that our SCTAR model surpasses other common methods in terms of accuracy, precision, recall, and F1 scores when tasked with computing the similarity of Chinese short texts.

关键词： Accuracy Attention mechanisms Computational modeling Semantics Bidirectional control Feature extraction Nonhomogeneous media

来源：评论

学校读者我要写书评

暂无评论

A Novel Text Matching Model Based on Multilayer Coding and Feature Enhancement

A Novel Text Matching Model Based on Multilayer Coding and F...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Yu Zhang Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

With the rapid development of Natural Language Processing (NLP), text matching has become the basis of many downstream tasks in NLP, and the study of text matching is of great research significance for solving tasks such as question and answer and information retrieval in NLP. Most of the current text matching methods tend to have problems such as mismatch of grammatical structures and insufficient interaction information in sentences. In order to solve the problems of insufficient interaction information and lack of features and ability to capture keyword and sequence information in text matching, this paper proposes a text matching method based on multi-layer coding and soft attention mechanism. The method first embeds the text and sends it to a gating module for processing, then sends the processed result to a module containing a combination of multilayer coding and soft attention mechanism for further operations such as multiple alignment, and finally sends it to a classifier containing a three-layer fully-connected network for predicting whether the input text pairs match or not. The two modules proposed in this paper are practically feasible, and comparison and ablation experiments have been conducted on the publicly available datasets LCQMC dataset and BQ dataset, and the experimental results show that the two modules improve the accuracy of text matching by 2.44% and 1.02%, respectively.

关键词： Attention mechanisms Accuracy Computational modeling Impedance matching Nonhomogeneous media Information retrieval Encoding

来源：评论

学校读者我要写书评

暂无评论

Climate Change and Ecological engineering Jointly Induced Vegetation Greening in Global Karst Regions From 2001 to 2020

Research Square

引用

Research Square 2021年

作者： Huang, Jing Ge, Zhongxi Huang, Yuqing Tang, Xuguang Shi, Zhan Lai, Peiyu Song, Zengjing Hao, Binfei Yang, Hong Ma, Mingguo Southwest University School of Geographical Sciences Chongqing Jinfo Mountain Field Scientific Observation and Research Station for Karst Ecosystem Ministry of Education Chongqing400715 China Chongqing Engineering Research Center for Remote Sensing Big Data Application School of Geographical Sciences Southwest University Tiansheng Road No.2 Beibei District Chongqing400715 China Chongqing Key Laboratory of Karst Environment School of Geographical Sciences Southwest University Chongqing400715 China Department of Geography and Environmental Science University of Reading Whiteknights Reading BerkshireRG6 6AB United Kingdom Key Laboratory of Beibu Gulf Environment Change and Resource Use Ministry of Education Nanning Normal University Nanning530000 China College of Electronics and Information Engineering Guangdong Ocean University Zhanjiang524088 China

Backgrounds Vegetation dynamic plays a dominant role in the global carbon cycle and climate, especially in vulnerable karst ecosystem. Many studies have examined past several decades changes in vegetation greenness and the associated with climate drivers. Yet, few studies have analyzed the vegetation change in global karst regions particularly in the last decades when climate change and anthropogenic disturbance widely occurred. Methods In this study, we investigated the spatio-temporal variations of vegetation dynamic using the Seasonally Integrated Normalized Difference Vegetation Index (SINDVI) and examined their relationship to climate changes by correlation analysis, the ordinary least squares method investigate the variation trends and the Mann-Kendal test to detect the turning point from 2001 to 2020. Results As expected, there have greening trend in global karst SINDVI from 2001 to 2020, with significant increasing trend in China (range = 0.836, P © 2021, CC BY.

关键词： Temperature

来源：评论

学校读者我要写书评

暂无评论

Semantic-Enhanced Attention Network for Image-Text Matching

Semantic-Enhanced Attention Network for Image-Text Matching

引用

International Conference on Computer Supported Cooperative Work in Design

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Image-text matching is an important task in cross-modal information processing, which consists of evaluating the similarity between images and text. However, the data of the two modalities have different distributions and representations, which cannot be directly compared. Therefore, the two modalities need to be processed separately. Most existing image-text matching methods extract image fragments and text fragments separately, using an attention mechanism to establish relationships between regions in the image and words in the text. Subsequently, they aggregate the similarity of these images and text fragments. Regardless, not all fragment alignment is meaningful, and irrelevant fragment alignment will bring redundancy and reduce retrieval accuracy. In addition to that, there are contextual relationships between image regions and between text words, which should also be taken into account. In this paper, we simultaneously consider these two aspects and propose a Semantic-Enhanced Attention Network (SEAN). It first focuses on each modality, mining contextual relationships between fragments within each modality and aggregating contextual information into visual and textual embeddings. Then, we compute the similarity between all image regions and text fragments, focusing all attention on the region-word pairs with the highest similarity. Finally, we summarize these to infer the similarity between the image and text. Our method achieves competitive results on two generalized image text retrieval datasets, Flickr30K and MS-COCO.

关键词： Visualization Attention mechanisms Federated learning Computational modeling Aggregates Semantics Redundancy

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：