The Transformer architecture has recently gained considerable attention in the field of graph representation learning, as it naturally overcomes several limitations of Graph Neural Networks (GNNs) with customized atte...
详细信息
The Transformer architecture has recently gained considerable attention in the field of graph representation learning, as it naturally overcomes several limitations of Graph Neural Networks (GNNs) with customized attention mechanisms or positional and structural encodings. Despite making some progress, existing works tend to overlook external information of graphs, specifically the correlation between graphs. Intuitively, graphs with similar structures should have similar representations. Therefore, we propose Graph External Attention (GEA) - a novel attention mechanism that leverages multiple external node/edge key-value units to capture inter-graph correlations implicitly. On this basis, we design an effective architecture called Graph External Attention Enhanced Transformer (GEAET), which integrates local structure and global interaction information for more comprehensive graph representations. Extensive experiments on benchmark datasets demonstrate that GEAET achieves state-of-the-art empirical performance. The source code is available for reproducibility at: https://***/icm1018/GEAET. Copyright 2024 by the author(s)
Large language models cross-domain named entity recognition task in the face of the scarcity of large language labeled data in a specific domain,due to the entity bias arising from the variation of entity information ...
详细信息
Large language models cross-domain named entity recognition task in the face of the scarcity of large language labeled data in a specific domain,due to the entity bias arising from the variation of entity information between different domains,which makes large language models prone to spurious correlations problems when dealing with specific domains and *** order to solve this problem,this paper proposes a cross-domain named entity recognition method based on causal graph structure enhancement,which captures the cross-domain invariant causal structural representations between feature representations of text sequences and annotation sequences by establishing a causal learning and intervention module,so as to improve the utilization of causal structural features by the large languagemodels in the target domains,and thus effectively alleviate the false entity bias triggered by the false relevance problem;meanwhile,through the semantic feature fusion module,the semantic information of the source and target domains is effectively *** results show an improvement of 2.47%and 4.12%in the political and medical domains,respectively,compared with the benchmark model,and an excellent performance in small-sample scenarios,which proves the effectiveness of causal graph structural enhancement in improving the accuracy of cross-domain entity recognition and reducing false correlations.
1 Introduction The main idea of recommender system is how to learn accurate users’embeddings from behavior data[1].Each dimension of users’embeddings can reflect the interests of users in different potential *** rea...
详细信息
1 Introduction The main idea of recommender system is how to learn accurate users’embeddings from behavior data[1].Each dimension of users’embeddings can reflect the interests of users in different potential *** real-world scenarios,users’interests are drifting over time,which brings a challenge to learn accurate dynamic users’***,various time-aware recommendation methods have been proposed to tackle this problem by modeling the evolution process of users’interests[2−4].However,they usually assume that users’embeddings drift with the same range on all *** practice,users’embeddings should change diversely on different dimensions over ***,for the rapidly changing interests of the users,the corresponding dimensions should change *** the contrary,the dimensions representing stable interests may change slightly.
Multi-hop question answering (MHQA) aims to utilize multi-source intensive documents retrieved to derive the answer. However, it is very challenging to model the importance of knowledge retrieved. Previous approaches ...
详细信息
Event Causality Identification (ECI) aims to identify fine-grained causal relationships between events in an unstructured text. Existing ECI methods primarily rely on knowledge-enhanced and graph-based reasoning appro...
详细信息
Decision implication is an important form of knowledge representation and acquisition in Formal Concept Analysis. Decision implication reduces the redundancy of knowledge extracted from data. However, decision implica...
详细信息
The main challenges in face swapping are the preservation and adaptive superimposition of attributes of two *** this study,the Face Swapping Attention Network(FSA-Net)is proposed to generate photoreal-istic face *** e...
详细信息
The main challenges in face swapping are the preservation and adaptive superimposition of attributes of two *** this study,the Face Swapping Attention Network(FSA-Net)is proposed to generate photoreal-istic face *** existing face-swapping methods ignore the blending attributes or mismatch the facial keypoint(cheek,mouth,eye,nose,etc.),which causes artifacts and makes the generated face silhouette *** address this problem,a novel reinforced multi-aware attention module,referred to as RMAA,is proposed for handling facial fusion and expression occlusion *** framework includes two *** the first stage,a novel attribute encoder is proposed to extract multiple levels of target face attributes and integrate identities and attributes when synthesizing swapped *** the second stage,a novel Stochastic Error Refinement(SRE)module is designed to solve the problem of facial occlusion,which is used to repair occlusion regions in a semi-supervised way without any *** proposed method is then compared with the current state-of-the-art *** obtained results demonstrate the qualitative and quantitative outperformance of the proposed *** details are provided at the footnote link and at https://***/view/fsa-net-official.
Accurate detection of protein binding sites is critical for facilitating drug design. Most existing models rely on features at a single scale, leading to the loss of crucial global or local structural information. The...
详细信息
Represented by evolutionary algorithms and swarm intelligence algorithms, nature-inspired metaheuristics have been successfully applied to recommender systems and amply demonstrated effectiveness, in particular, for m...
详细信息
Fingerprint features,as unique and stable biometric identifiers,are crucial for identity ***,traditional centralized methods of processing these sensitive data linked to personal identity pose significant privacy risk...
详细信息
Fingerprint features,as unique and stable biometric identifiers,are crucial for identity ***,traditional centralized methods of processing these sensitive data linked to personal identity pose significant privacy risks,potentially leading to user data *** Learning allows multiple clients to collaboratively train and optimize models without sharing raw data,effectively addressing privacy and security ***,variations in fingerprint data due to factors such as region,ethnicity,sensor quality,and environmental conditions result in significant heterogeneity across *** heterogeneity adversely impacts the generalization ability of the global model,limiting its performance across diverse *** address these challenges,we propose an Adaptive Federated Fingerprint Recognition algorithm(AFFR)based on Federated *** algorithm incorporates a generalization adjustment mechanism that evaluates the generalization gap between the local models and the global model,adaptively adjusting aggregation weights to mitigate the impact of heterogeneity caused by differences in data quality and feature ***,a noise mechanism is embedded in client-side training to reduce the risk of fingerprint data leakage arising from weight disclosures during model *** conducted on three public datasets demonstrate that AFFR significantly enhances model accuracy while ensuring robust privacy protection,showcasing its strong application potential and competitiveness in heterogeneous data environments.
暂无评论