检索结果-内蒙古大学图书馆

Congress on Evolutionary Computation

作者： Shengcai Liu Caishun Chen Xinghua Qu Ke Tang Yew-Soon Ong A*STAR Department of Computer Science and Engineering Centre for Frontier AI Research Southern University of Science and Technology Centre for Frontier AI Research A*STAR Tianqiao & Chrissy Chen Institute Department of Computer Science and Engineering Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Southern University of Science and Technology Centre for Frontier AI Research A*STAR College of Computing and Data Science Nanyang Technological University

ISBN: (数字)9798350308365

ISBN: (纸本)9798350308372

Evolutionary algorithms (EAs) have achieved remarkable success in tackling complex combinatorial optimization problems. However, EAs often demand carefully-designed operators with the aid of domain expertise to achieve satisfactory performance. In this work, we present the first study on large language models (LLMs) as evolutionary combinatorial optimizers. The main advantage is that it requires minimal domain knowledge and human efforts, as well as no additional training of the model. This approach is referred to as LLM-driven EA (LMEA). Specifically, in each generation of the evolutionary search, LMEA instructs the LLM to select parent solutions from current population, and perform crossover and mutation to generate offspring solutions. Then, LMEA evaluates these new solutions and include them into the population for the next generation. LMEA is equipped with a self-adaptation mechanism that controls the temperature of the LLM. This enables it to balance between exploration and exploitation and prevents the search from getting stuck in local optima. We investigate the power of LMEA on the classical traveling salesman problems (TSPs) widely used in combinatorial optimization research. Notably, the results show that LMEA performs competitively to traditional heuristics in finding high-quality solutions on TSP instances with up to 20 nodes. Additionally, we also study the effectiveness of LLM-driven crossover/mutation and the self- adaptation mechanism in evolutionary search. In summary, our results reveal the great potentials of LLMs as evolutionary optimizers for solving combinatorial problems. We hope our research shall inspire future explorations on LLM-driven EAs for complex optimization challenges.

关键词： Training Large language models Computational modeling Sociology Evolutionary computation Traveling salesman problems Temperature control

来源：评论

学校读者我要写书评

暂无评论

FERI: Feature Enhancement and Relational Interaction for Image-text Matching

FERI: Feature Enhancement and Relational Interaction for Ima...

引用

International Conference on Parallel and Distributed Systems (ICPADS)

作者： Yu Zhang Jianqiang Zhang Gongpeng Song Qin Lu Shuo Zhao Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798331515966

ISBN: (纸本)9798331515973

Image-text matching is an important problem at the intersection of computer vision and natural language processing. It aims to establish the semantic link between image and text to achieve high-quality semantic alignment between the two modalities. However, the existing methods have the problem that the meaning expressed in the image or the complex narrative in the text cannot be fully understood due to insufficient feature extraction. Moreover, due to the essential modal differences between images and texts, how to effectively and accurately align the semantic contents in images and texts has become the key of research. In order to solve the above problems, this paper proposes a method based on feature enhancement and relationship interaction. When processing images, the proposed method fuses labeled features, region features and location features to represent images. When processing text, a combination of Bi-GRU and self-attention mechanism is used to represent the text. In order to further align the semantic content in images and texts accurately, this paper improves two relational interaction mechanisms by identifying connection relationships and learning association relationships. Thus, the relation enhanced embedding is obtained. Finally, it calculated the similarity of the enhanced embedding to judge the matching degree of the image and text. Extensive experiments on the public datasets Flickr30K and MSCOCO demonstrate the effectiveness of our method.

关键词： Computer vision Fuses Image matching Semantics Feature extraction Natural language processing

来源：评论

学校读者我要写书评

暂无评论

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similarity Computation Model with Attention Mechanism

SCTAR: A Multi-Layer BiLSTM-Based Chinese Short Text Similar...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Shuo Zhao Yiyun Xing Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Text semantic similarity is a crucial research area in Natural Language Processing (NLP). However, traditional methods for calculating the similarity of short Chinese texts often fall short in accuracy and other crucial aspects. The Bidirectional Long Short-Term Memory Network (BiLSTM) has demonstrated remarkable performance in computing the similarity of short Chinese texts by effectively capturing long-range dependencies and semantic information. Additionally, the multi-head attention mechanism considers the interaction between different text locations and semantic information, enhancing the model’s representative capacity. Building upon this foundation, our paper proposes an enhanced model known as SCTbilstmAttRdrop (SCTAR). This model is constructed based on a multilayer BiLSTM architecture and incorporates an SE-gated convolutional module and a convolutional multi-head attention-aware model. We conducted extensive evaluations using two Chinese short text datasets, Chinese-SNLI and CCKS2018_Task3. The experimental results unequivocally demonstrate that our SCTAR model surpasses other common methods in terms of accuracy, precision, recall, and F1 scores when tasked with computing the similarity of Chinese short texts.

关键词： Accuracy Attention mechanisms Computational modeling Semantics Bidirectional control Feature extraction Nonhomogeneous media

来源：评论

学校读者我要写书评

暂无评论

Semantic-Enhanced Attention Network for Image-Text Matching

Semantic-Enhanced Attention Network for Image-Text Matching

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Huanxiao Zhou Yushui Geng Jing Zhao Xishan Ma Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Image-text matching is an important task in cross-modal information processing, which consists of evaluating the similarity between images and text. However, the data of the two modalities have different distributions and representations, which cannot be directly compared. Therefore, the two modalities need to be processed separately. Most existing image-text matching methods extract image fragments and text fragments separately, using an attention mechanism to establish relationships between regions in the image and words in the text. Subsequently, they aggregate the similarity of these images and text fragments. Regardless, not all fragment alignment is meaningful, and irrelevant fragment alignment will bring redundancy and reduce retrieval accuracy. In addition to that, there are contextual relationships between image regions and between text words, which should also be taken into account. In this paper, we simultaneously consider these two aspects and propose a Semantic-Enhanced Attention Network (SEAN). It first focuses on each modality, mining contextual relationships between fragments within each modality and aggregating contextual information into visual and textual embeddings. Then, we compute the similarity between all image regions and text fragments, focusing all attention on the region-word pairs with the highest similarity. Finally, we summarize these to infer the similarity between the image and text. Our method achieves competitive results on two generalized image text retrieval datasets, Flickr30K and MS-COCO.

关键词： Visualization Attention mechanisms Federated learning Computational modeling Aggregates Semantics Redundancy

来源：评论

学校读者我要写书评

暂无评论

FLARE: Towards Universal dataset Purification against Backdoor Attacks

arXiv

引用

arXiv 2024年

作者： Hou, Linshan Luo, Wei Hua, Zhongyun Chen, Songhua Yu Zhang, Leo Li, Yiming School of Computer Science and Technology Harbin Institute of Technology Guangdong Shenzhen518055 China School of Information Technology Deakin University Australia Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies Guangdong Shenzhen518055 China School of Information and Communication Technology Griffith University Southport Gold CoastQLD4215 Australia College of Computing and Data Science Nanyang Technological University 639798 Singapore

Deep neural networks (DNNs) are susceptible to backdoor attacks, where adversaries poison datasets with adversary-specified triggers to implant hidden backdoors, enabling malicious manipulation of model predictions. dataset purification serves as a proactive defense by removing malicious training samples to prevent backdoor injection at its source. We first reveal that the current advanced purification methods rely on a latent assumption that the backdoor connections between triggers and target labels in backdoor attacks are simpler to learn than the benign features. We demonstrate that this assumption, however, does not always hold, especially in all-to-all (A2A) and untargeted (UT) attacks. As a result, purification methods that analyze the separation between the poisoned and benign samples in the input-output space or the final hidden layer space are less effective. We observe that this separability is not confined to a single layer but varies across different hidden layers. Motivated by this understanding, we propose FLARE, a universal purification method to counter various backdoor attacks. FLARE aggregates abnormal activations from all hidden layers to construct representations for clustering. To enhance separation, FLARE develops an adaptive subspace selection algorithm to isolate the optimal space for dividing an entire dataset into two clusters. FLARE assesses the stability of each cluster and identifies the cluster with higher stability as poisoned. Extensive evaluations on benchmark datasets demonstrate the effectiveness of FLARE against 22 representative backdoor attacks, including all-to-one (A2O), all-to-all (A2A), and untargeted (UT) attacks, and its robustness to adaptive attacks. Copyright © 2024, The Authors. All rights reserved.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Semantic Information Reasoning and Multi-Step Cross-Modal Interaction Network for Image-Text Retrieval

Semantic Information Reasoning and Multi-Step Cross-Modal In...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Xishan Ma Yushui Geng Jing Zhao Huanxiao Zhou Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

Image-text retrieval is a basic cross-modal task, and the basic idea is to learn image-text matching. The key to this task is to accurately measure the similarity between these two modalities. However, most existing methods tend to measure image-text similarity based on highly correlated region-word pairs, which lacks the ability to capture complex cross-modal semantic associations, thereby resulting in failure to distinguish hard negative examples that are similar in semantic content. Furthermore, existing methods focus more on alignment of different modal features, thus neglecting deep reasoning about the semantic concepts within the modality. In this paper, we propose a new semantic information reasoning and multi-step cross-modal interaction (SRMCI) network to simultaneously explore intra-modal and inter-modal relationships. Specifically, we first propose a semantic information reasoning module to fully explore potential semantic relationships within modalities and focus on fragments with important semantic information. Then, we design a multi-step cross-modal interaction module that utilizes two different inter-modal interactive attentions and an effective gated fusion strategy to capture fragment-level and fragment-instance-level cross-modal semantic associations. In particular, this gated fusion strategy is used to learn better fine-grained feature representations to aid in understanding and establishing semantic associations between different modalities. Experiments on the benchmark datasets MS-COCO and Flickr30K demonstrate the effectiveness of our method.

关键词： Correlation Semantics Neural networks Logic gates Benchmark testing Cognition

来源：评论

学校读者我要写书评

暂无评论

MFFLEN: Multi-Label Text Classification Based on Multi-Feature Fusion and Label Embedding

MFFLEN: Multi-Label Text Classification Based on Multi-Featu...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Qiliang Gu Shuo Zhao Jianqiang Zhang Gongpeng Song Qin Lu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Shandong Engineering Research Center of Big Data Applied Technology Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Shandong Branch of China Mobile Communication Group Design Institute Co. Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

To address the challenges associated with insufficiently extracting and utilizing features at different levels, overlooking the connection between label meanings and text, and facing problems of over-compression or information loss when extracting global information using recurrent neural networks in the field of multi-label text categorization, this paper introduces an innovative model known as MFFLEN (MultiFeature Fusion and Label Embedding Neural Network). First, a back-translated enhanced label set is constructed by back-translated splicing enhancement of the original label set. This set, together with the text, is then input into the embedding layer, which consists of the pre-trained model of bert-baseChinese, thus establishing the initial connection between the text and the labels within the same vector space. Then, to comprehensively extract multi-level semantic features, the model uses a convolutional layer to extract local features and an embedding layer to extract sentence-level features. A bidirectional attention embedded GRU (BAE-GRU) layer is used to extract hybrid finegrained features, which are then fed into the attention layer to further extract hybrid labeled features based on labeling information. Finally, these three different types of features are fused and multi-label text classification results are obtained using a classifier. The experiments proved that the MFFLEN model achieved 73.82% and 88.44% macro-F1 and 88.00% and 88.86% micro-F1 on the two datasets CAIL 2018 Small and CAIL 2018 Split, respectively, which is better than other baseline models.

关键词： Measurement Recurrent neural networks Splicing Text categorization Semantics Multi label classification Logic gates Feature extraction Vectors data mining

来源：评论

学校读者我要写书评

暂无评论

Cross-modal retrieval based on Attention Embedded Variational Auto-Encoder

Cross-modal retrieval based on Attention Embedded Variationa...

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Kaili Zhou Yiyun Xing Yushui Geng Jing Zhao Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China Graduate School Qilu University of Technology (Shandong Academy of Sciences) Jinan China

ISBN: (数字)9798350359312

ISBN: (纸本)9798350359329

This study proposes a cross-modal retrieval technique, which employs an Attention Embedded Variational AutoEncoder (AE-VAE) to tackle the problem of reduced retrieval accuracy resulting from data noise and data absence in cross-modal retrieval tasks. First, the variational auto-encoder(VAE) is used as an infrastructure to transform modal data into latent variables by encoding and decoding different modal features, thus preserving the semantic structure of the raw modal data and suppressing noise and missing information in the data. Secondly, to better capture the important semantic features of image and text modalities, an improved multi-attention module is introduced in the encoder. In addition, a cross-modal alignment module is designed to further align the latent variables of different modalities in the latent space to solve the confusion problem and improve the accuracy and robustness of cross-modal retrieval. Finally, experiments are conducted on four public datasets, CUB, SUN, AwA1 and AwA2, and the experimental results show that our proposed model is effective in improving the accuracy and robustness of retrieval.

关键词： Accuracy Uncertainty Noise Semantics Transforms Probabilistic logic Robustness

来源：评论

学校读者我要写书评

暂无评论

Systematic Resource Allocation in Cloud RAN with Caching as a Service under Two Timescales

Systematic Resource Allocation in Cloud RAN with Caching as ...

引用

作者： Tang, Jianhua Quek, Tony Q. S. Chang, Tsung-Hui Shim, Byonghyo Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing College of Information Science and Engineering Hunan Normal University Changsha410081 China Institute of New Media and Communications Department of Electrical and Computer Engineering Seoul National University Seoul08826 Korea Republic of Information Systems Technology and Design Pillar Singapore University of Technology and Design Singapore487372 Singapore Department of Electronic Engineering Kyung Hee University Yongin17104 Korea Republic of School of Science and Engineering Chinese University of Hong Kong Shenzhen518172 China Shenzhen Research Institute of Big Data Shenzhen518172 China Department of Electrical and Computer Engineering Institute of New Media and Communications Seoul National University Seoul08826 Korea Republic of

Recently, cloud radio access network (C-RAN) with caching as a service (CaaS) was proposed to merge the functionalities of communication, computing, and caching (CCC) together. In this paper, we dissect the interactions of CCC in C-RAN with CaaS from two dimensions: physical resource dimension and time dimension. In the physical resource dimension, we identify how to segment the baseband unit (BBU) pool resources (i.e., computation and storage) into different types of virtual machines (VMs). In the time dimension, we address how the long-term resource segmentation in the BBU pool impacts on the short-term transmit beamforming at the remote radio heads. We formulate the problem as a stochastic mixed-integer nonlinear programming (SMINLP) to minimize the system cost, including the server cost, VM cost and wireless transmission cost. After a series of approximation, including sample average approximation, successive convex approximation, and semidefinite relaxation, the SMINLP is approximated as a global consensus problem. The alternating direction method of multipliers (ADMM) is utilized to obtain the solution in a parallel fashion. Simulation results verify the convergence of our proposed algorithm, and also confirm that the proposed scheme is more cost-saving than that without considering the integration of CCC. © 1972-2012 IEEE.

关键词： Integer programming

来源：评论

学校读者我要写书评

暂无评论

Social-enhanced recommendation using graph-based contrastive learning

Social-enhanced recommendation using graph-based contrastive...

引用

IEEE International Conference on High Performance computing and Communications (HPCC)

作者： Peng Xue Qian Gao Jun Fan Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan Shandong China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan Shandong China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan Shandong China China Telecom Digital Intelligence Techonology Co Ltd Jinan Shandong China

The social network-based recommendation model use social network information to mitigate data sparsity issues and improve the accuracy of recommendation models. However, In most social network-based recommendation algorithms, the social neighbors' contributions are difficult to distinguish from the central user's, neglecting hidden correlations in social infor-mation. In order to solve this problem, this paper presents a graph-based contrastive learning framework for social-enhanced recommendation (SoGCLR) that utilizes implicit social information captured by a new social relation attention mechanism, en-rich user representations, and improve model robustness through graph-based contrastive learning. Specifically, the paper captures the degree of contribution of each neighbor in the social graph to the central user through a social relation attention layer, thus obtaining hidden correlations in social information, and further integrates this with user information in the user-item interaction graph to enrich user representations. In addition, the paper incorporates graph-based contrastive learning into the recommendation task using cross-layer contrastive learning, calculating contrastive loss and mapping nodes with similar but different exposure rates to nearby regions to mitigate exposure bias issues. Results from Ciao and Epinions demonstrate that SoGCLR reduces RMSE and MAE by 1.33% to 1.84% compared with baseline models.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：