检索结果-内蒙古大学图书馆

Boosting Weak-to-Strong Agents in Multiagent Reinforcement Learning via Balanced PPO

IEEE Transactions on Neural Networks and Learning Systems 2025年第5期36卷 9136-9149页

作者： Huang, Sili Chen, Hechang Piao, Haiyin Sun, Zhixiao Chang, Yi Sun, Lichao Yang, Bo Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineer of Ministry of Education School of Artificial Intelligence Changchun130012 China Jilin University School of Artificial Intelligence Changchun130012 China Northwestern Polytechnical University Unmanned System Research Institute Xi’an710068 China Lehigh University Department of Computer Science and Engineering BethlehemPA18015 United States Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineer of Ministry of Education School of Computer Science and Technology Changchun130012 China

Multiagent policy gradients (MAPGs), an essential branch of reinforcement learning (RL), have made great progress in both industry and academia. However, existing models do not pay attention to the inadequate training of individual policies, thus limiting the overall performance. We verify the existence of imbalanced training in multiagent tasks and formally define it as an imbalance between policies (IBPs). To address the IBP issue, we propose a dynamic policy balance (DPB) model to balance the learning of each policy by dynamically reweighting the training samples. In addition, current methods for better performance strengthen the exploration of all policies, which leads to disregarding the training differences in the team and reducing learning efficiency. To overcome this drawback, we derive a technique named weighted entropy regularization (WER), a team-level exploration with additional incentives for individuals who exceed the team. DPB and WER are evaluated in homogeneous and heterogeneous tasks, effectively alleviating the imbalanced training problem and improving exploration efficiency. Furthermore, the experimental results show that our models can outperform the state-of-the-art MAPG methods and boast over 12.1% performance gain on average. © 2012 IEEE.

关键词： Personnel training

来源：评论

学校读者我要写书评

暂无评论

Prompt-guided orthogonal multimodal fusion for cancer survival prediction

引用

Information sciences 2025年 715卷

作者： Huang, Lan Guo, Shuyu Bai, Tian Zhao, Ruihong Tao, Ke College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China Department of Gastroenterology The First Hospital of Jilin University Changchun130000 China

Cancer survival prediction can assist clinicians in developing personalized treatment plans for patients. Comprehensive cancer diagnosis and treatment require integrating macroscopic and microscopic imaging. However, significant discrepancies in the spatial resolution and anatomical scale between imaging modalities hinder existing multimodal fusion methods from effectively learning correlated semantic features with limited datasets. In this work, we introduce a prompt-guided orthogonal multimodal fusion strategy (POMF) for fusing multimodal medical images across anatomical scales. POMF utilizes modality-specific prompts to fine-tune pretrained models, facilitating bias adaptation to medical imaging features while ensuring more computationally efficient training. A modality consistency-discrepancy prototype is designed as the modality-inherent prompt in POMF, disentangling the multimodal features and bridging the potential correlations across the orthogonal modalities. POMF is validated on a glioma survival prediction task using paired radiology and pathology images. The experiment results suggest that POMF achieves superior C-index with existing full-tuning and prompt-tuning methods. Additionally, the ablation studies demonstrate that POMF is adaptable to various architectures of pretrained encoders and multiple multimodal fusion strategies on cross-scale medical images. © 2025 Elsevier Inc.

关键词： Mammography

来源：评论

学校读者我要写书评

暂无评论

Neurocomputational Modelling of EEG Connectivity: Links Between Depression, Inflammation, and Gut-Microbiome 17th

Neurocomputational Modelling of EEG Connectivity: Links Betw...

引用

17th International Conference on Brain Informatics, BI 2024

作者： Doborjeh, Zohreh lavin, Daniel Hunter, Kirsty Heym, Nadja Heasman, Bryony Doborjeh, Maryam Kasabov, Nikola Gibson, Glen Sumich, Alexander School of Engineering Computer and Mathematical Sciences Knowledge Engineering and Discovery Research Institute Auckland University of Technology Auckland New Zealand School of Population Health Faculty of Medical and Health Sciences The University of Auckland Auckland New Zealand Department of Sport Science School of Science and Technology Nottingham Trent University Nottingham United Kingdom NTU Psychology School of Social Sciences Nottingham Trent University Nottingham United Kingdom School of Software Engineering Dalian University Dalian China Institute for Information and Communication Technologies Bulgarian Academy of Sciences Sofia Bulgaria Department of Food and Nutritional Sciences The University of Reading Whiteknights Reading United Kingdom Department of Psychology and Neuroscience Auckland University of Technology Auckland New Zealand

ISBN: (纸本)9789819632930

The immune and enteric systems have been implicated in psychopathology, including depressive disorders. However, the precise neurocognitive mechanisms remain unclear. The present study uses Brain-Inspired Spiking Neural Network (SNN) technique to model electroencephalographic (EEG) data as a function of gut-microbiota, inflammation, and depressive symptoms. Forty-two participants (nonclinical cohort) were assessed for Bacteroides-Prevotella (BAC) colonization in faecal samples, Interleukin 6 (IL-6) in peripheral blood, depressive symptoms (self-report of cognitive and non-cognitive symptoms) and brain function (resting state EEG). SNN models were applied to EEG data to generate connection weight values across scalp regions. Connection weights were visualized as a function of 1) depression;2) inflammation;3) gut microbiome. Lower depression and higher BAC were associated with higher frontal connection weights (cognitive depression = bilateral, non-cognitive and BAC = left hemisphere only). Lower cognitive depression and lower IL-6 were associated with higher posterior connection weights. The SNN models achieved higher accuracy for theta and alpha EEG sub-bands, highlighting their relevance in differentiating between groups. These findings emphasize the potential of SNNs in predicting parameters from brain functional connectivity data and developing targeted diagnostic and intervention strategies. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

Low-altitude Friendly-Jamming for Satellite-Maritime Communications via Generative AI-enabled Deep Reinforcement Learning

arXiv

引用

arXiv 2025年

作者： Huang, Jiawei Wang, Aimin Sun, Geng Li, Jiahui Wang, Jiacheng Niyato, Dusit Leung, Victor C.M. College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computer Science and Technology Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore Artificial Intelligence Research Institute Shenzhen MSU-BIT University Shenzhen518115 China College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Department of Electrical and Computer Engineering The University of British Columbia VancouverV6T 1Z4 Canada

Low Earth Orbit (LEO) satellites can be used to assist maritime wireless communications for data transmission across wide-ranging areas. However, extensive coverage of LEO satellites, combined with openness of channels, can cause the communication process to suffer from security risks. This paper presents a low-altitude friendly-jamming LEO satellite-maritime communication system enabled by a unmanned aerial vehicle (UAV) to ensure data security at the physical layer. Since such a system requires trade-off policies that balance the secrecy rate and energy consumption of the UAV to meet evolving scenario demands, we formulate a secure satellite-maritime communication multi-objective optimization problem (SSMCMOP). In order to solve the dynamic and long-term optimization problem, we reformulate it into a Markov decision process. We then propose a transformer-enhanced soft actor critic (TransSAC) algorithm, which is a generative artificial intelligence-enable deep reinforcement learning approach to solve the reformulated problem, so that capturing global dependencies and diversely exploring weights. Simulation results demonstrate that the TransSAC outperforms various baselines, and achieves an optimal secrecy rate while effectively minimizing the energy consumption of the UAV. Moreover, the results find more suitable constraint values for the system. Copyright © 2025, The Authors. All rights reserved.

关键词： Multiobjective optimization

来源：评论

学校读者我要写书评

暂无评论

Fuzzy Preference Completion with Ranked and Unranked Preferences

引用

Cognitive Computation 2025年第3期17卷 1-21页

作者： Li, Lei Liu, Pan Zhang, Renjie Tao, Zhenchao Wu, Xindong Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China) Hefei University of Technology Hefei China School of Computer Science and Information Engineering Hefei University of Technology Hefei China Department of Radiation Oncology The First Affiliated Hospital of USTC Division of Life Sciences and Medicine University of Science and Technology of China Hefei China Department of Radiation Oncology Anhui Provincial Cancer Hospital Hefei China

As for social choice, all alternatives are ranked by agents to form preferences as linear orders. However, in applications, sometimes some alternatives cannot be ranked, or it is unnecessary to rank them, which leads to unranked alternatives. Hence, without loss of generality, by dividing the set of alternatives into three ranked and unranked subsets, including top-k alternatives, intermediate-r alternatives, and last-l alternatives, the Mallows model on ranked and unranked preferences can be analyzed systematically. Technically, a repeated insertion model is adopted during sampling, and probability distributions are derived for ranked and unranked preferences of alternatives. Experimental results verify the accuracy of the probability distributions for different ranked and unranked preferences of alternatives. Furthermore, in order to solve the preference completion problem where agents have multiple partial rankings, a fuzzy preference completion algorithm, Fuzzy-Multi-Rankings, is proposed, which introduces a fuzzy ranking to complete the target agent’s preference in addition to the traditional nearest-neighbor-based methods. Based on the three ranked and unranked preferences, seven cases can be classified and analyzed for fuzzy preference completion. Experiments on the synthetic datasets and MovieLens dataset confirm the effectiveness and efficiency of our proposed Fuzzy-Multi-Rankings algorithm and also verify the accuracy of the evaluated probability distributions for the proposed seven cases.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Adaptive Nussbaum Design for Nonholonomic Systems With Asymptotic Stabilization Against False Data Injection

引用

IEEE Transactions on Cybernetics 2025年

作者： Liu, Guilong Yang, Yongliang Gao, Weinan Wunsch, Donald C. University of Science and Technology Beijing Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education School of Automation and Electrical Engineering Beijing100083 China Northeastern University State Key Laboratory of Synthetical Automation for Process Industries Shenyang110819 China Missouri University of Science and Technology Department of Electrical and Computer Engineering RollaMO65409 United States

This article addresses the stabilization challenges of nonholonomic systems under the threat of false data injection (FDI) attacks, which compromise the integrity of state information. A novel adaptive control strategy using Nussbaum-type gains is proposed to ensure the asymptotic stability of the closed-loop system while maintaining signal boundedness. The approach extends conventional Nussbaum designs to handle multiple unknown control directions. It integrates online learning mechanisms to mitigate the impact of FDI attacks. Additionally, adaptive backstepping and fuzzy-logic systems are utilized to approximate and compensate for unknown nonlinear dynamics. The methodology transforms nonholonomic systems into equivalent cascade structures to address inherent constraints and enable secure control input design. Simulation studies validate the effectiveness and resilience of the proposed control strategy, demonstrating significant improvements in stability and robustness in the presence of FDI attacks. © 2013 IEEE.

关键词： Adaptive control systems

来源：评论

学校读者我要写书评

暂无评论

Deep learning multilayer architecture for analysis of three-dimensional Eyring-Powell nanofluid flow subject to viscous dissipation and joule heating

引用

Results in engineering 2025年 26卷

作者： Shah, Zahoor Alhazmi, Muflih Jawaid, Maryam Albasheir, Nafisa A. Zah, Mohammed M.A. Alma Othman, Nashwan Adnan Khan, Waqar Azeem Department of Mathematics COMSATS University Islamabad Islamabad Campus Pakistan Department of Mathematics College of Science Northern Border University Arar Saudi Arabia King Khalid University Magardah 61421 Saudi Arabia King Khalid University Muhyil 61421 Saudi Arabia Department of Computer Engineering College of Engineering Knowledge University Erbil 44001 Iraq Department of Computer Engineering Al-Kitab University Altun Kupri Iraq Department of Mathematics Mohi-ud-Din Islamic University Nerian Sharif Jammu & Kashmir Azad12010 China

Artificial intelligence has enhanced complex systems modeling by achieving exceptional precision and effectiveness. The purpose of this paper is to use the Deep Learning Multi-Layer Soft Computing paradigm (DLML-SCP) to evaluate the model 3D flow dynamics of Eyring-Powell nanofluids subject to viscous dissipation and joule heating (EPNF-3D-VJ). It can capture the complex behavior of a specialized fluid flow system with the changing of different physical parameters like Prandtl number, magnetic field parameter, radiation parameter, and Brownian motion parameter and the controlling parameters of non-Newtonian nature of the fluid, Ε, δ1, and δ2, make up the source parameters of Eyring-Powell fluid. Similarity transformation in the governing partial differential equations (PDEs) ultimately leads to a reduced set of ordinary differential equations (ODEs) along with boundary conditions. Not only does it simplify the computational process, but it also boosts the model's predictive abilities. The Adam numerical technique is employed to generate a comprehensive dataset across the fluid-dynamic spectrum that covers diverse EPNF-3D-VJ cases, offering critical insights into the system's behavior. The dataset is utilized to test, train, and validate the DLML-SCP, proving its accuracy in predicting fluid system behavior. Results show the effectiveness and reliability of the model and are well aligned to the dataset. Validation results demonstrate that the DLML-SCP framework accurately predicts fluid system behavior, achieving mean square error (MSE) values between E-09 to E-10. Important findings from the performance evaluations, it can be noted that the increase in both the Prandtl number and magnetic field coefficient has led to a decrease in the temperature and velocity profiles. With an increase in the Eyring-Powell fluid parameter, the velocity profile is likely to increase. present study utilized an advanced machine learning framework that has been proven to outperform the

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Improving Data Encoding for Enhanced AI Performance in Complex Datasets via Quantum Feature Space Mapping: Harnessing Quantum Algorithms

Improving Data Encoding for Enhanced AI Performance in Compl...

引用

Pervasive Computational Technologies (ICPCT), International Conference on

作者： Gurpreet Singh Walia Sathiya Priya S KV Karthikeya D. Suresh P Sudheer V. Syambabu Lead Enterprise Security and Networking Architect NetApp Inc. Durham NC Department of ECE Panimalar Engineering College Chennai AT&T Sattva Knowledge City Hyderabad Department of ECE St. Joseph's Institute of Technology Chennai Department of Computer Science and Engineering (AI&ML) CVR College of Engineering Department of Electronics and Communication Engineering MLR Institute of Technology Hyderabad

ISBN: (数字)9798331508685

ISBN: (纸本)9798331519476

The purpose of this study is to investigate the potential for quantum feature space mapping to be utilized in the enhancement of data encoding approaches for artificial intelligence (AI) systems that are capable of managing complicated datasets. Traditional artificial intelligence models frequently face challenges when confronted with the high-dimensionality and non-linearity of such datasets. This can hinder their performance in areas such as pattern recognition, optimization, and predictive modeling. Quantum computing, which is able to make use of quantum superposition and entanglement, provides a method that is revolutionary in nature by means of quantum feature space mapping. By encoding data into quantum states, this technology enables the construction of feature spaces that are tenfold bigger than those that would be possible in classical conditions. This makes it much simpler to differentiate between intricate patterns that would otherwise be indistinguishable. The purpose of this research is to investigate the application of quantum algorithms, such as Quantum Support Vector Machines (QSVM) and Variational Quantum Classifiers (VQC), with the intention of enhancing the capacity of artificial intelligence to learn from complex and high-dimensional data. We demonstrate that quantum feature space mapping leads to more efficient and accurate data classification, regression, and clustering tasks by comparing the performance of quantum-enhanced artificial intelligence models to that of their classical counterparts on difficult datasets. Additionally, the research addresses important difficulties, such as the constraints of the quantum hardware that is now available and the requirement for quantum circuits that are scalable. Quantum computing has the potential to improve the performance of artificial intelligence in the management of complicated, high-dimensional data, which may ultimately pave the way for advances in domains such as genetics, finance, and cryptogra

关键词： Support vector machines Quantum computing Quantum algorithm Quantum entanglement Computational modeling Space mapping Quantum state Encoding Hardware Quantum circuit

来源：评论

学校读者我要写书评

暂无评论

Aerial Reliable Collaborative Communications for Terrestrial Mobile Users via Evolutionary Multi-Objective Deep Reinforcement Learning

arXiv

引用

arXiv 2025年

作者： Sun, Geng Xiao, Jian Li, Jiahui Wang, Jiacheng Kang, Jiawen Niyato, Dusit Mao, Shiwen College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China affiliated with the College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore School of Computer Science and Engineering Nanyang Technological University Singapore639798 Singapore School of Automation Guangdong University of Technology Guangzhou510641 China Department of Electrical and Computer Engineering Auburn University AuburnAL36849-5201 United States

Unmanned aerial vehicles (UAVs) have emerged as the potential aerial base stations (BSs) to improve terrestrial communications. However, the limited onboard energy and antenna power of a UAV restrict its communication range and transmission capability. To address these limitations, this work employs collaborative beamforming through a UAV-enabled virtual antenna array to improve transmission performance from the UAV to terrestrial mobile users, under interference from non-associated BSs and dynamic channel conditions. Specifically, we introduce a memory-based random walk model to more accurately depict the mobility patterns of terrestrial mobile users. Following this, we formulate a multi-objective optimization problem (MOP) focused on maximizing the transmission rate while minimizing the flight energy consumption of the UAV swarm. Given the NP-hard nature of the formulated MOP and the highly dynamic environment, we transform this problem into a multi-objective Markov decision process and propose an improved evolutionary multi-objective reinforcement learning algorithm. Specifically, this algorithm introduces an evolutionary learning approach to obtain the approximate Pareto set for the formulated MOP. Moreover, the algorithm incorporates a long short-term memory network and hyper-sphere-based task selection method to discern the movement patterns of terrestrial mobile users and improve the diversity of the obtained Pareto set. Simulation results demonstrate that the proposed method effectively generates a diverse range of non-dominated policies and outperforms existing methods. Additional simulations demonstrate the scalability and robustness of the proposed CB-based method under different system parameters and various unexpected circumstances. © 2025, CC0.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

Joint Optimization of UAV-Carried IRS for Urban Low Altitude mmWave Communications with Deep Reinforcement Learning

arXiv

引用

arXiv 2025年

作者： Xie, Wenwen Sun, Geng Liu, Bei Li, Jiahui Wang, Jiacheng Du, Hongyang Niyato, Dusit Kim, Dong In The College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Jilin University Changchun130012 China The College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore The College of Computing and Data Science Nanyang Technological University Singapore The Department of Electrical and Electronic Engineering The University of Hong Kong 999077 Hong Kong The Department of Electrical and Computer Engineering Sungkyunkwan University Suwon16419 Korea Republic of

Emerging technologies in sixth generation (6G) of wireless communications, such as terahertz communication and ultra-massive multiple-input multiple-output, present promising prospects. Despite the high data rate potential of millimeter wave communications, millimeter wave (mmWave) communications in urban low altitude economy (LAE) environments are constrained by challenges such as signal attenuation and multipath interference. Specially, in urban environments, mmWave communication experiences significant attenuation due to buildings, owing to its short wavelength, which necessitates developing innovative approaches to improve the robustness of such communications in LAE networking. In this paper, we explore the use of an unmanned aerial vehicle (UAV)-carried intelligent reflecting surface (IRS) to support low altitude mmWave communication. Specifically, we consider a typical urban low altitude communication scenario where a UAV-carried IRS establishes a line-of-sight (LoS) channel between the mobile users and a source user (SU) despite the presence of obstacles. Subsequently, we formulate an optimization problem aimed at maximizing the transmission rates and minimizing the energy consumption of the UAV by jointly optimizing phase shifts of the IRS and UAV trajectory. Given the non-convex nature of the problem and its high dynamics, we propose a deep reinforcement learning-based approach incorporating neural episodic control, long short-term memory, and an IRS phase shift control method to enhance the stability and accelerate the convergence. Simulation results show that the proposed algorithm effectively resolves the problem and surpasses other benchmark algorithms in various performances. Copyright © 2025, The Authors. All rights reserved.

关键词： Deep reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：