检索结果-内蒙古大学图书馆

arXiv 2025年

作者： Hu, Yuxuan Zhang, Jing Chen, Xiaodong Zhao, Zhe Li, Cuiping Chen, Hong School of Information Renmin University of China Beijing China Key Laboratory of Data Engineering and Knowledge Engineering Beijing China Engineering Research Center of Database and Business Intelligence Beijing China Tencent AI Lab Beijing China

Existing low-rank adaptation (LoRA) methods face challenges on sparse large language models (LLMs) due to the inability to maintain sparsity. Recent works introduced methods that maintain sparsity by augmenting LoRA techniques with additional masking mechanisms. Despite these successes, such approaches suffer from an increased memory and computation overhead, which affects efficiency of LoRA methods. In response to this limitation, we introduce LoRS, an innovative method designed to achieve both memory and computation efficiency when fine-tuning sparse LLMs. To mitigate the substantial memory and computation demands associated with preserving sparsity, our approach incorporates strategies of weight recompute and computational graph rearrangement. In addition, we also improve the effectiveness of LoRS through better adapter initialization. These innovations lead to a notable reduction in memory and computation consumption during the fine-tuning phase, all while achieving performance levels that outperform existing LoRA approaches. © 2025, CC BY.

关键词： Problem oriented languages

来源：评论

学校读者我要写书评

暂无评论

Predicting microRNA-Disease Associations Through Multi-View Feature Fusion and Matrix Completion on Graph Convolutional Networks

IEEE Transactions on Computational Biology and Bioinformatic...

引用

IEEE Transactions on Computational Biology and Bioinformatics 2025年第1期22卷 151-159页

作者： Shifei Ding Chuangui Cao Fan Sun Xuan Li Xindong Wu School of Computer Science and Technology China University of Mining and Technology Xuzhou China Mine Digitization Engineering Research Center of Ministry of Education Xuzhou China Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China) Hefei University of Technology Hefei China

Since the regulatory roles of microRNAs in complex human diseases have been gradually demonstrated, more and more enlightening models were developed for predicting microRNA-disease associations. These models can inform bio-logical studies on the differential expression of microRNAs. In this paper, a graph convolutional network-based model using multi-view feature fusion and matrix completion, FMCGCN for brevity, is proposed. First of all, graph autoencoders are used to learn multiple embeddings from different networks. For convenience, attention mechanisms are used to fuse them. As a result, multi-view features constructed from different perspectives are aggregated. Then, the fused embedding is fed into the graph convolutional network to aggregate local information. This fused embedding is thought to facilitate feature extraction for graph convolutional networks. Finally, feature and nuclear norm minimization, a method for matrix completion, is used to obtain the prediction matrix. Additionally, evaluation results under 5-fold cross-validation prove that FMCGCN outperforms current models in several metrics. Furthermore, case studies for esophageal neoplasms and pancreatic neoplasms also demonstrate the validity of our model.

关键词： Diseases Semantics Predictive models Kernel Topology Graph convolutional networks Feature extraction Learning systems Biological system modeling Reliability

来源：评论

学校读者我要写书评

暂无评论

NI-GDBA: Non-Intrusive Distributed Backdoor Attack Based on Adaptive Perturbation on Federated Graph Learning 25

NI-GDBA: Non-Intrusive Distributed Backdoor Attack Based on ...

引用

Proceedings of the ACM on Web Conference 2025

作者： Ken Li Bin Shi Jiazhe Wei Bo Dong School of Computer Science and Technology Xi'an Jiaotong University Xi'an China and Ministry of Education Key Laboratory of Intelligent Networks and Network Security Xi'an Jiaotong University Xi'an China School of Computer Science and Technology Xi'an Jiaotong University Xi'an China and Shaanxi Province Key Laboratory of Big Data Knowledge Engineering Xi'an Jiaotong University Xi'an China School of Distance Education Xi'an Jiaotong University Xi'an China and Shaanxi Province Key Laboratory of Big Data Knowledge Engineering Xi'an Jiaotong University Xi'an China

ISBN: (纸本)9798400712746

Federated Graph Learning (FedGL) is an emerging Federated Learning (FL) framework that learns the graph data from various clients to train better Graph Neural Networks(GNNs) model. Owing to concerns regarding the security of such framework, numerous studies have attempted to execute backdoor attacks on FedGL, with a particular focus on distributed backdoor attacks. However, all existing methods posting distributed backdoor attack on FedGL only focus on injecting distributed backdoor triggers into the training data of each malicious client, which will cause model performance degradation on original task and is not always effective when confronted with robust federated learning defense algorithms, leading to low success rate of attack. What's more, the backdoor signals introduced by the malicious clients may be smoothed out by other clean signals from the honest clients, which potentially undermining the performance of the *** address the above significant shortcomings, we propose a non-intrusive graph distributed backdoor attack(NI-GDBA) that does not require backdoor triggers to be injected in the training data. Our attack trains an adaptive perturbation trigger generator model for each malicious client to learn the natural backdoor from the GNN model downloading from the server with the malicious client's local data. In contrast to traditional distributed backdoor attacks on FedGL via trigger injection in training data, our attack on different datasets such as Molecules and Bioinformatics have higher attack success rate, stronger persistence and stealth, and has no negative impact on the performance of the global GNN model. We also explore the robustness of NI-GDBA under different defense strategies, and based on our extensive experimental studies, we show that our attack method is robust to current federated learning defense methods, thus it is necessary to consider non-intrusive distributed backdoor attacks on FedGL as a novel threat that requires custom de

关键词： backdoor attacks

来源：评论

学校读者我要写书评

暂无评论

Effective Instruction Parsing Plugin for Complex Logical Query Answering on knowledge Graphs 25

Effective Instruction Parsing Plugin for Complex Logical Que...

引用

Proceedings of the ACM on Web Conference 2025

作者： Xingrui Zhuo Jiapu Wang Gongqing Wu Shirui Pan Xindong Wu The Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China) School of Computer Science and Information Engineering Hefei University of Technology Hefei Anhui China Beijing University of Technology Beijing China Griffith University Gold Coast Queensland Australia

ISBN: (纸本)9798400712746

knowledge Graph Query Embedding (KGQE) aims to embed First-Order Logic (FOL) queries in a low-dimensional KG space for complex reasoning over incomplete KGs. To enhance the generalization of KGQE models, recent studies integrate various external information (such as entity types and relation context) to better capture the logical semantics of FOL queries. The whole process is commonly referred to as Query Pattern Learning (QPL). However, current QPL methods typically suffer from the pattern-entity alignment bias problem, leading to the learned defective query patterns limiting KGQE models' performance. To address this problem, we propose an effective Query Instruction Parsing Plugin (QIPP) that leverages the context awareness of Pre-trained Language Models (PLMs) to capture latent query patterns from code-like query instructions. Unlike the external information introduced by previous QPL methods, we first propose code-like instructions to express FOL queries in an alternative format. This format utilizes textual variables and nested tuples to convey the logical semantics within FOL queries, serving as raw materials for a PLM-based instruction encoder to obtain complete query patterns. Building on this, we design a query-guided instruction decoder to adapt query patterns to KGQE models. To further enhance QIPP's effectiveness across various KGQE models, we propose a query pattern injection mechanism based on compressed optimization boundaries and an adaptive normalization component, allowing KGQE models to utilize query patterns more efficiently. Extensive experiments demonstrate that our plug-and-play method improves the performance of eight basic KGQE models and outperforms two state-of-the-art QPL methods.

关键词： complex query answering

来源：评论

学校读者我要写书评

暂无评论

Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL

arXiv

引用

arXiv 2025年

作者： Liu, Hanbing Li, Haoyang Zhang, Xiaokang Chen, Ruotong Xu, Haiyong Tian, Tian Qi, Qi Zhang, Jing Gaoling School of Artificial Intelligence Renmin University of China Beijing China School of Information Renmin University of China Beijing China Key Laboratory of Data Engineering and Knowledge Engineering Beijing China Engineering Research Center of Database and Business Intelligence Beijing China China Mobile Information Technology Center China

Direct Preference Optimization (DPO) has proven effective in complex reasoning tasks like math word problems and code generation. However, when applied to Text-to-SQL datasets, it often fails to improve performance and can even degrade it. Our investigation reveals the root cause: unlike math and code tasks, which naturally integrate Chain-of-Thought (CoT) reasoning with DPO, Text-to-SQL datasets typically include only final answers (gold SQL queries) without detailed CoT solutions. By augmenting Text-to-SQL datasets with synthetic CoT solutions, we achieve, for the first time, consistent and significant performance improvements using DPO. Our analysis shows that CoT reasoning is crucial for unlocking DPO’s potential, as it mitigates reward hacking, strengthens discriminative capabilities, and improves scalability. These findings offer valuable insights for building more robust Text-to-SQL models. To support further research, we publicly release the code and CoT-enhanced datasets © 2025, CC BY.

关键词： Chains

来源：评论

学校读者我要写书评

暂无评论

Offline Reinforcement Learning via Conservative Smoothing and Dynamics Controlling

Offline Reinforcement Learning via Conservative Smoothing an...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Haihong Guo Fengxin Li Jiao Li Hongyan Liu School of Information Renmin University of China China Chinese Academy of Medical Sciences / Peking Union Medical College Institute of Medical Information / Medical Library China Key Laboratory of Data Engineering and Knowledge Engineering Ministry of Education China School of Economics and Management Tsinghua University China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Offline Reinforcement Learning (RL) optimizes policy using pre-collected data instead of direct environment interaction, offering a safe and cost-effective solution for sequential decision-making in the real world. However, it faces challenges such as distribution shift issues and vulnerability under perturbations. Researchers have developed various conservative methods to improve the robustness of offline RL. Nevertheless, model-based methods can result in transition distribution shift issues, while model-free value-based uncertainty penalty methods may not be sufficiently robust. To address these problems, we propose a new method called Robust Offline RL via Conservative Smoothing and Dynamics Controlling (RCSD). To achieve reliable value estimation of out-of-distribution (OOD) actions, RCSD uses both model-free uncertainty penalty and model-based simulation methods. It introduces a new one-step simulation method with conservative dynamics controlling to avoid value overestimation caused by transition distribution shifts. Moreover, RCSD considers both current and next states when generating OOD states to ensure cautious value estimation and efficient data utilization. RCSD uses conservative Q-smoothing and policy smoothing to strengthen the policy against sudden changes under perturbations. Experiments on D4RL benchmark demonstrate that RCSD can achieve state-of-the-art performance compared to baselines in either benchmark or adversarial attack tests.

关键词： Uncertainty Smoothing methods Perturbation methods Estimation Reinforcement learning Benchmark testing Signal processing Robustness Speech processing Faces

来源：评论

学校读者我要写书评

暂无评论

KAN v.s. MLP for Offline Reinforcement Learning

KAN v.s. MLP for Offline Reinforcement Learning

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Haihong Guo Fengxin Li Jiao Li Hongyan Liu School of Information Renmin University of China China Institute of Medical Information / Medical Library Chinese Academy of Medical Sciences / Peking Union Medical College China Key Laboratory of Data Engineering and Knowledge Engineering Ministry of Education China School of Economics and Management Tsinghua University China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Kolmogorov-Arnold Networks (KAN) is an emerging neural network architecture in machine learning. It has greatly interested the research community about whether KAN can be a promising alternative to the commonly used Multi-Layer Perceptions (MLP). Experiments in various fields demonstrated that KAN-based machine learning can achieve comparable if not better performance than MLP-based methods, but with much smaller parameter scales and are more explainable. In this paper, we explore the incorporation of KAN into the actor and critic networks for offline reinforcement learning (RL). We evaluated the performance, parameter scales, and training efficiency of various KAN and MLP-based conservative Q-learning (CQL) on the classical D4RL benchmark for offline RL. Our study demonstrates that KAN can achieve performance close to the commonly used MLP with significantly fewer parameters. This allows us to choose the base networks according to the offline RL task requirements.

关键词： Training Performance evaluation Hands Q-learning Neural networks Memory management Signal processing Benchmark testing Splines (mathematics) Speech processing

来源：评论

学校读者我要写书评

暂无评论

Counterfactual Inference for Generalized Zero-shot Compound Fault Diagnosis

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Xu, Juan Kong, Hui Ding, Xu Yuan, Xiaohui Hefei University of Technology Ministry of Education Key Laboratory of Knowledge Engineering with Big Data School of Computer and Information Hefei 230601 China University of North Texas Department of Computer Science and Engineering Denton TX United States

Learning a model heavily depends on the training examples, which are sometimes difficult to obtain if not impossible. This a typically true for fault diagnosis in machinery, particularly for compound faults. The counterfactual inference reveals the causal components inherent in the fault data in an interpretable manner, divulging critical causes from the observable phenomena. This paper proposes a method to address the imbalance and interpretability issues of generalized zero-shot learning methods for compound fault diagnosis using counterfactual inference. Our method uses a structural causal model to decouple and generate fault features, which enhances the capabilities of the Variational Autoencoder and Generative Adversarial Network (VAE-GAN) through a strengthened discriminator, and reveals the intrinsic causal components in fault data, distinguishing key fault causes from accompanying phenomena. This enables the classification of both single and compound faults by learning from examples of single faults easing the dependence on the examples of compound faults. Extensive experimental results show that our method, trained solely with single fault samples, achieves a harmonic average of 87.40% accuracy for both single and compound faults, outperforming existing state-of-the-art methods. This significantly improves both the accuracy and interpretability of compound fault diagnosis. © 1963-2012 IEEE.

关键词： Counterfactual inference Fault diagnosis Generalized zero-shot learning Generative adversarial network Rolling bearing

来源：评论

学校读者我要写书评

暂无评论

DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models

引用

IEEE/CAA Journal of Automatica Sinica 2025年第5期12卷 841-858页

作者： Luolin Xiong Haofen Wang Xi Chen Lu Sheng Yun Xiong Jingping Liu Yanghua Xiao Huajun Chen Qing-Long Han Yang Tang Key Laboratory of Smart Manufacturing in Energy Chemical Process Ministry of Education and the Engineering Research Center of Process System Engineering Ministry of Education East China University of Science and Technology Shanghai China College of Design and Innovation Tongji University Shanghai China Shanghai Key Laboratory of Data Science School of Computer Science Fudan University Shanghai China School of Software Beihang University Beijing China School of Information Science and Engineering East China University of Science and Technology Shanghai China AZFT Joint Laboratory for Knowledge Engine Hangzhou Innovation Center College of Computer Science and Technology Zhejiang University Hangzhou China School of Science Computing and Engineering Technologies Swinburne University of Technology Melbourne VIC Australia

DeepSeek, a Chinese artificial intelligence (AI) startup, has released their V3 and R1 series models, which attracted global attention due to their low cost, high performance, and open-source advantages. This paper begins by reviewing the evolution of large AI models focusing on paradigm shifts, the mainstream large language model (LLM) paradigm, and the DeepSeek paradigm. Subsequently, the paper highlights novel algorithms introduced by DeepSeek, including multi-head latent attention (MLA), mixture-of-experts (MoE), multi-token prediction (MTP), and group relative policy optimization (GRPO). The paper then explores DeepSeek's engineering breakthroughs in LLM scaling, training, inference, and system-level optimization architecture. Moreover, the impact of DeepSeek models on the competitive AI landscape is analyzed, comparing them to mainstream LLMs across various fields. Finally, the paper reflects on the insights gained from DeepSeek's innovations and discusses future trends in the technical and engineering development of large AI models, particularly in data, training, and reasoning.

关键词： Training Technological innovation Foundation models Large language models Reinforcement learning Prediction algorithms Market research Cognition Inference algorithms Optimization

来源：评论

学校读者我要写书评

暂无评论

SwimVG: Step-wise Multimodal Fusion and Adaption for Visual Grounding

arXiv

引用

arXiv 2025年

作者： Shi, Liangtao Liu, Ting Hu, Xiantao Hu, Yue Yin, Quanjun Hong, Richang Key Laboratory of Knowledge Engineering with Big Data Hefei University of Technology Hefei230009 China Ministry of Education and School of Computer Science and Information Engineering Hefei University of Technology Hefei230009 China School of systems engineering National University of Defense Technology Hunan Province Changsha410073 China Department of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210014 China

Visual grounding aims to ground an image region through natural language, which heavily relies on cross-modal alignment. Most existing methods transfer visual/linguistic knowledge separately by fully fine-tuning uni-modal pre-trained models, followed by a simple stack of visual-language transformers for multimodal fusion. However, these approaches not only limit adequate interaction between visual and linguistic contexts, but also incur significant computational costs. Therefore, to address these issues, we explore a step-wise multimodal fusion and adaption framework, namely SwimVG. Specifically, SwimVG proposes step-wise multimodal prompts (Swip) and cross-modal interactive adapters (CIA) for visual grounding, replacing the cumbersome transformer stacks for multimodal fusion. Swip can improve the alignment between the vision and language representations step by step, in a token-level fusion manner. In addition, weight-level CIA further promotes multimodal fusion by cross-modal interaction. Swip and CIA are both parameter-efficient paradigms, and they fuse the cross-modal features from shallow to deep layers gradually. Experimental results on four widely-used benchmarks demonstrate that SwimVG achieves remarkable abilities and considerable benefits in terms of efficiency. Our code is available at https://***/liuting20/SwimVG. Copyright © 2025, The Authors. All rights reserved.

关键词： Visual languages

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：