检索结果-内蒙古大学图书馆

Dual-level Mixup for Graph Few-shot Learning with Fewer Tasks 25

学校读者我要写书评

暂无评论

Dual-level Mixup for Graph Few-shot Learning with Fewer Task...

34th ACM Web Conference, WWW 2025

作者： Liu, Yonghao Li, Mengyu Giunchiglia, Fausto Huang, Lan Li, Ximing Feng, Xiaoyue Guan, Renchu College of Computer Science and Technology Jilin University Changchun China Department of Information Engineering and Computer Science University of Trento Trento Italy Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education China

ISBN: (纸本)9798400712746

Graph neural networks have been demonstrated as a powerful paradigm for effectively learning graph-structured data on the web and mining content from it. Current leading graph models require a large number of labeled samples for training, which unavoidably leads to overfitting in few-shot scenarios. Recent research has sought to alleviate this issue by simultaneously leveraging graph learning and meta-learning paradigms. However, these graph meta-learning models assume the availability of numerous meta-training tasks to learn transferable meta-knowledge. Such assumption may not be feasible in the real world due to the difficulty of constructing tasks and the substantial costs involved. Therefore, we propose a SiMple yet effectIve approach for graph few-shot Learning with fEwer tasks, named SMILE. We introduce a dual-level mixup strategy, encompassing both within-task and across-task mixup, to simultaneously enrich the available nodes and tasks in meta-learning. Moreover, we explicitly leverage the prior information provided by the node degrees in the graph to encode expressive node representations. Theoretically, we demonstrate that SMILE can enhance the model generalization ability. Empirically, SMILE consistently outperforms other competitive models by a large margin across all evaluated datasets with in-domain and cross-domain settings. Our anonymous code can be found here. © 2025 Copyright held by the owner/author(s).

关键词： Graph neural networks

A Simple Graph Contrastive Learning Framework for Short Text Classification

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Liu, Yonghao Giunchiglia, Fausto Huang, Lan Li, Ximing Feng, Xiaoyue Guan, Renchu Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Computer Science and Technology Jilin University China University of Trento Italy

Short text classification has gained significant attention in the information age due to its prevalence and real-world applications. Recent advancements in graph learning combined with contrastive learning have shown promising results in addressing the challenges of semantic sparsity and limited labeled data in short text classification. However, existing models have certain limitations. They rely on explicit data augmentation techniques to generate contrastive views, resulting in semantic corruption and noise. Additionally, these models only focus on learning the intrinsic consistency between the generated views, neglecting valuable discriminative information from other potential views. To address these issues, we propose a Simple graph contrastive learning framework for Short Text Classification (SimSTC). Our approach involves performing graph learning on multiple text-related component graphs to obtain multi-view text embeddings. Subsequently, we directly apply contrastive learning on these embeddings. Notably, our method eliminates the need for data augmentation operations to generate contrastive views while still leveraging the benefits of multi-view contrastive learning. Despite its simplicity, our model achieves outstanding performance, surpassing large language models on various datasets. Copyright © 2025, The Authors. All rights reserved.

关键词： Contrastive Learning

Enabling Generalized Zero-Shot Vulnerability Classification

学校读者我要写书评

暂无评论

IEEE Transactions on Dependable and Secure Computing 2025年

作者： Hu, Jinghao Guo, Jinsong Luo, Chen Hu, Yang Lanzinger, Matthias Li, Zhanshan Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education College of Software Changchun130012 China University College London Department of Computer Science United Kingdom Amazon United States United Kingdom University of Oxford Department of Computer Science United Kingdom Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education College of Computer Science and Technology Changchun130012 China

Regarding computer security, the growth of code vulnerability types presents a persistent challenge. These vulnerabilities, which may cause severe consequences, necessitate precise classification for effective mitigation. However, the rapid emergence of new vulnerability types complicates the classification process. Traditional methodologies, which often involve human expertise and the manual labeling or generation of example instances, are not only resource-intensive but also struggle to adapt to the dynamic nature of these vulnerabilities. This paper introduces VulnSense, an innovative method that harnesses the capabilities of Generalized Zero-Shot Learning (GZSL) to address the vulnerability classification problem. VulnSense learns about unseen vulnerability classes from the descriptions of these unseen classes, while not requiring to see any instances of these unseen classes. Specifically, VulnSense learns from three main resources: (1) seen classes with labeled code instances;(2) descriptions of these seen classes;and (3) descriptions of "unseen"classes which have no labeled instances. Our experiments underscore VulnSense's superiority over existing GZSL methods in classifying instances of unseen classes. Concurrently, it maintains a performance parity with traditional labeled-example based learning methods in classifying instances of seen vulnerabilities. VulnSense demonstrates the potential of using GZSL for vulnerability classification, while also highlighting challenges that inspire future work. © 2004-2012 IEEE.

关键词： Zero-shot learning

Stochastic Block Models for Complex Network Analysis: A Survey

学校读者我要写书评

暂无评论

ACM Transactions on knowledge Discovery from Data 2025年第3期19卷 1-35页

作者： Liu, Xueyan Song, Wenzhuo Musial, Katarzyna Li, Yang Zhao, Xuehua Yang, Bo College of Computer Science and Technology Jilin University Changchun China School of Information Science and Technology Northeast Normal University Changchun China Complex Adaptive Systems Lab Data Science Institute University of Technology Sydney Sydney Australia Aviation University of the Air Force Changchun China School of Digital Media Shenzhen Institute of Information Technology Shenzhen China Key Laboratory of Symbolic Computation and Knowledge Engineer Jilin University Ministry of Education Changchun China

Complex networks enable to represent and characterize the interactions between entities in various complex systems which widely exist in the real world and usually generate vast amounts of data about all the elements, their behaviors and interactions over time. The studies concentrating on new network analysis approaches and methodologies are vital because of the diversity and ubiquity of complex networks. The stochastic block model (SBM), based on Bayesian theory, is a statistical network model. SBMs are essential tools for analyzing complex networks since SBMs have the advantages of interpretability, expressiveness, flexibility and generalization. Thus, designing diverse SBMs and their learning algorithms for various networks has become an intensively researched topic in network analysis and data mining. In this article, we review, in a comprehensive and in-depth manner, SBMs for different types of networks (i.e., model extensions), existing methods (including parameter estimation and model selection) for learning optimal SBMs for given networks and SBMs combined with deep learning. Finally, we provide an outlook on the future research directions of SBMs. © 2025 Copyright held by the owner/author(s). Publication rights licensed to ACM.

关键词： Complex Networks Structural Pattern Discovery Stochastic Block models Learning Methods of SBMs

Efficient Sharing of Energy Consumption Data: A Privacy-Preserving Threshold Aggregation Approach

学校读者我要写书评

暂无评论

IEEE Internet of Things Journal 2025年

作者： Li, Guohao Zhou, Lu Lian, Jiale Liu, Siyi Yang, Li Zhong, Yantao Li, Qiang Xidian University School of Computer Science and Technology Xi’an China Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Changchun China Co. Ltd Guangdong Shenzhen China

Energy consumption data collected by smart meters is increasingly used by various subscribers in the smart grid for load management, energy monitoring, and policy planning. To protect user privacy, edge-assisted privacy-preserving data aggregation (PPDA) techniques are commonly employed. However, existing methods face several challenges: i) limited scalability, ii) strict trust requirements, and iii) the risk of revealing unique consumption patterns to data collectors. To address these challenges, we propose a privacy-preserving threshold aggregation method that is easily scalable and facilitates efficient energy data sharing under limited trust assumptions. Specifically, we design VFPNTRU, a quantum-resistant homomorphic proxy re-encryption scheme with fault tolerance and re-encryption verification. In VFP-NTRU, smart meters can encrypt data with a public key without the need for prior negotiation of decryption keys with multiple subscribers. Additionally, we develop a privacy threshold collection protocol that uses a verifiable oblivious pseudorandom function to provide privacy guarantees similar to k-anonymity for SM data collection. We further introduce an energy consumption model to determine optimal collection strategies, improving system responsiveness. We provide correctness analysis and prove the security of our scheme. Experimental results demonstrate that our approach outperforms existing PPDA methods, making it particularly suitable for resource-constrained smart meters and central servers managing large-scale energy data. © 2014 IEEE.

关键词： Differential privacy

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Li, Yangning Kang, Hui Li, Jiahui Sun, Geng Sun, Zemin Wang, Jiacheng Zhao, Changyuan Niyato, Dusit College of Computer Science and Technology Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computer Science and Technology Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computing and Data Science Nanyang Technological University 639798 Singapore College of Computing and Data Science Nanyang Technological University Singapore

An expansion of Internet of Things (IoTs) has led to significant challenges in wireless data harvesting, dissemination, and energy management due to the massive volumes of data generated by IoT devices. These challenges are exacerbated by data redundancy arising from spatial and temporal correlations. To address these issues, this paper proposes a novel data-driven collaborative beamforming (CB)-based communication framework for IoT networks. Specifically, the framework integrates CB with an overlap-based multi-hop routing protocol (OMRP) to enhance data transmission efficiency while mitigating energy consumption and addressing hot spot issues in remotely deployed IoT networks. Based on the data aggregation to a specific node by OMRP, we formulate a node selection problem for the CB stage, with the objective of optimizing uplink transmission energy consumption. Given the complexity of the problem, we introduce a softmax-based proximal policy optimization with long-short-term memory (SoftPPO-LSTM) algorithm to intelligently select CB nodes for improving transmission efficiency. Simulation results show that the proposed OMRP improves network lifetime by 17% compared to benchmark routing protocols, while the SoftPPO-LSTM method for CB node selection achieves an 8.3% increase in throughput over benchmark algorithms. The results also reveal that the combined OMRP with the SoftPPO- Copyright © 2025, The Authors. All rights reserved.

关键词： Deep reinforcement learning

AHMSA-Net: Adaptive Hierarchical Multi-Scale Attention Network for Micro-Expression Recognition

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Lijun Zhang, Yifan Tang, Weicheng Sun, Xinzhi Wang, Xiaomeng Li, Zhanshan College of Computer Science and Technology Jilin University Changchun Jilin130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun Jilin130012 China

Micro-expression recognition (MER) presents a significant challenge due to the transient and subtle nature of the motion changes involved. In recent years, deep learning methods based on attention mechanisms have made some breakthroughs in MER. However, these methods still suffer from the limitations of insufficient feature capture and poor dynamic adaptation when coping with the instantaneous subtle movement changes of micro-expressions. Therefore, in this paper, we design an Adaptive Hierarchical Multi-Scale Attention Network (AHMSA-Net) for MER. Specifically, we first utilize the onset and apex frames of the micro-expression sequence to extract threedimensional (3D) optical flow maps, including horizontal optical flow, vertical optical flow, and optical flow strain. Subsequently, the optical flow feature maps are inputted into AHMSA-Net, which consists of two parts: an adaptive hierarchical framework and a multi-scale attention mechanism. Based on the adaptive downsampling hierarchical attention framework, AHMSA-Net captures the subtle changes of micro-expressions from different granularities (fine and coarse) by dynamically adjusting the size of the optical flow feature map at each layer. Based on the multi-scale attention mechanism, AHMSA-Net learns micro-expression action information by fusing features from different scales (channel and spatial). These two modules work together to comprehensively improve the accuracy of MER. Additionally, rigorous experiments demonstrate that the proposed method achieves competitive results on major micro-expression databases, with AHMSA-Net achieving recognition accuracy of up to 78.21% on composite databases (SMIC, SAMM, CASMEII) and 77.08% on the CASME3 database. Copyright © 2025, The Authors. All rights reserved.

关键词： Deep learning

Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transport 25

学校读者我要写书评

暂无评论

Enhancing Unsupervised Graph Few-shot Learning via Set Funct...

Proceedings of the 31st ACM SIGKDD Conference on knowledge Discovery and Data Mining V.1

作者： Yonghao Liu Fausto Giunchiglia Ximing Li Lan Huang Xiaoyue Feng Renchu Guan Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Computer Science and Technology Jilin University Changchun China Department of Information Engineering and Computer Science University of Trento Trento Italy

ISBN: (纸本)9798400712456

Graph few-shot learning has garnered significant attention for its ability to rapidly adapt to downstream tasks with limited labeled data, sparking considerable interest among researchers. Recent advancements in graph few-shot learning models have exhibited superior performance across diverse applications. Despite their successes, several limitations still exist. First, existing models in the meta-training phase predominantly focus on instance-level features within tasks, neglecting crucial set-level features essential for distinguishing between different categories. Second, these models often utilize query sets directly on classifiers trained with support sets containing only a few labeled examples, overlooking potential distribution shifts between these sets and leading to suboptimal performance. Finally, previous models typically require necessitate abundant labeled data from base classes to extract transferable knowledge, which is typically infeasible in real-world scenarios. To address these issues, we propose a novel model named STAR, which leverages Set funcTions and optimAl tRansport for enhancing unsupervised graph few-shot learning. Specifically, STAR utilizes expressive set functions to obtain set-level features in an unsupervised manner and employs optimal transport principles to align the distributions of support and query sets, thereby mitigating distribution shift effects. Theoretical analysis demonstrates that STAR can capture more task-relevant information and enhance generalization capabilities. Empirically, extensive experiments across multiple datasets validate the effectiveness of STAR. Our code can be found https://***/KEAML-JLU/STAR here.

关键词： few-shot learning

Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Li, Kewei Kong, Yanwen Xu, Yiping Su, Jianlin Huang, Lan Zhang, Ruochi Zhou, Fengfeng College of Computer Science and Technology Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Jilin Changchun130012 China Moonshot AI Ltd. Beijing100086 China

Since the emergence of research on improving the length extrapolation capabilities of large models in 2021, some studies have made modifications to the scaling factor in the scaled dot-product attention mechanism as part of their proposed methods without rigorous theoretical justifications. To fill this gap, we propose two new scaled temperatures based on entropy invariance to enhance length extrapolation. First, a training-free method InfoScale is designed for dot-product attention, and preserves focus on original tokens during length extrapolation by ensuring consistent entropy. Second, we theoretically analyze the impact of scaling (CosScale) on cosine attention. Experimental data demonstrates that combining InfoScale and CosScale achieves state-of-the-art performance on the GAU-α model with a context window extended to 64 times the training length, and outperforms seven existing methods. Our analysis reveals that significantly increasing CosScale approximates the Windowed Attention, and highlights the significance of attention score dilution as a key challenge in long-range context handling. The code and data are available at https://***/HT-NEKO/InfoScale. © 2025, CC BY-NC-ND.

关键词： Data handling