检索结果-内蒙古大学图书馆

Learning Generalizable Agents via Saliency-Guided Features Decorrelation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Sili Sun, Yanchao Hu, Jifeng Guo, Siyuan Chen, Hechang Chang, Yi Sun, Lichao Yang, Bo Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education China School of Artificial Intelligence Jilin University China Department of Computer Science University of Maryland College Park United States Lehigh University BethlehemPA United States

In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as background noise, and task-relevant features, such as robot configurations, that are related to the optimal decisions. To achieve generalization in both situations, agents are required to accurately understand the impact of changed features on the decisions, i.e., establishing the true associations between changed features and decisions in the policy model. However, due to the inherent correlations among features in the state space, the associations between features and decisions become entangled, making it difficult for the policy to distinguish them. To this end, we propose Saliency-Guided Features Decorrelation (SGFD) to eliminate these correlations through sample reweighting. Concretely, SGFD consists of two core techniques: Random Fourier Functions (RFF) and the saliency map. RFF is utilized to estimate the complex non-linear correlations in high-dimensional images, while the saliency map is designed to identify the changed features. Under the guidance of the saliency map, SGFD employs sample reweighting to minimize the estimated correlations related to changed features, thereby achieving decorrelation in visual RL tasks. Our experimental results demonstrate that SGFD can generalize well on a wide range of test environments and significantly outperforms state-of-the-art methods in handling both task-irrelevant variations and task-relevant variations. Copyright © 2023, The Authors. All rights reserved.

关键词： Reinforcement learning

A Survey on Performance Optimization of High-Level Synthesis Tools

学校读者我要写书评

暂无评论

Journal of Computer Science & Technology 2020年第3期35卷 697-720页

作者： Lan Huang Da-Lin Li Kang-Ping Wang Teng Gao Adriano Tavares College of Computer Science and Technology Jilin UniversityChangchun 130012China Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun 130012China Zhuhai Laboratory of Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education Zhuhai College of Jilin University Zhuhai 519041China Algorithm Center University of MinhoGuimaraes 4800058Portugal

Field-programmable gate arrays(FPGAs)have recently evolved as a valuable component of the heterogeneous *** register transfer level(RTL)design flows demand the designers to be experienced in hardware,resulting in a possible failure of ***-level synthesis(HLS)permits designers to work at a higher level of abstraction through synthesizing high-level language programs to RTL *** provides a promising approach to solve these ***,the performance of HLS tools still has *** example,designers remain exposed to various aspects of hardware design,development cycles are still time consuming,and the quality of results(QoR)of HLS tools is far behind that of RTL *** this paper,we survey the literature published since 2014 focusing on the performance optimization of HLS *** with previous work,we extend the scope of the performance of HLS tools,and present a set of three-level evaluation criteria,covering from ease of use of the HLS tools to promotion on specific metrics of *** also propose performance evaluation equations for describing the relation between the performance optimization and the *** find that it needs more efforts on the ease of use for efficient HLS *** suggest that it is better to draw an analogy between the HLS development process and the embedded system design process,and to provide more elastic HLS methodology which integrates FPGAs virtual machines.

关键词： evaluation criterion field-programmable gate array(FPGA) high-level synthesis(HLS) performance optimization quality of results(QoR)

Elucidating Spatial Complex Structures from Mass Spectrometry Imaging with Deep Multimodal Model 1

学校读者我要写书评

暂无评论

Elucidating Spatial Complex Structures from Mass Spectrometr...

1st IEEE International Conference on Medical Artificial Intelligence, MedAI 2023

作者： Cui, Jiangnan Xia, Junjie Li, Xuan Wang, Yan Qiu, Fufang Xu, Yaochen Xu, Keren Zuo, Chunman School of Computer Science and Technology Institute of Artificial Intelligence Donghua University Shanghai China College of Computer Science and Technology Jilin University Changchun China Huashan Hospital Department of Neurosurgery Shanghai China Shanghai Institute of Biochemistry and Cell Biology Center for Excellence in Molecular Cell Science Chinese Academy of Sciences Cas Key Laboratory of Systems Biology Shanghai China Institute of Artificial Intelligence Donghua University Shanghai China Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering Ministry of Education Changchun China

ISBN: (纸本)9798350358780

Spatial mass spectrometry imaging (SMSI) technology has enabled the characterization of biomolecule patterns within the tissue microenvironment, yet its analyses suffer from substantial noise. The lack of effective methods for exploiting multi-view features (e.g., spatial location) has hindered their elucidation ability for tissue heterogeneity. Here, we propose MSG, a multimodal modal that integrates histology, spatial location, and MSI data, in deciphering tissue structure by graph neural network. Specifically, MSG learns low-dimensional representations by aggregating histomorphological features from neighboring tiles via graph attention autoencoder. MSG outperforms other methods in identifying spatial domains and denoising data. The subsequent domain-guided differential expression analysis of the denoised data enables the identification of ions with significantly enriched patterns within the recognized domains. MSG exhibits its versatility in handling SMSI data from various platforms. © 2023 IEEE.

关键词： Data integration

CMRM: Collaborative Multi-agent Reinforcement Learning for Multi-objective Traffic Signal Control

学校读者我要写书评

暂无评论

IEEE Transactions on Consumer Electronics 2025年

作者： Nie, Lei Qi, Dandan Liu, Bingyi Li, Peng Bao, Haizhou He, Heng Wuhan University of Science and Technology School of Computer Science and Technology Wuhan430065 China Wuhan University of Science and Technology Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System Wuhan430065 China Wuhan University of Technology School of Computer Science and Artificial Intelligence Wuhan430070 China Jilin University Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Changchun130012 China

Efficient traffic signal control is a cost-effective way to ease urban traffic congestion. Multi-agent reinforcement learning (MARL) has become a widely adopted method for optimizing traffic signal control (TSC). However, existing MARL-based methods often focus on a single optimization objective, lacking a comprehensive consideration of traffic efficiency, environmental pollution, and traffic safety. Simultaneously, these methods often fail to effectively capture the dynamic and complex interactions among agents in multi-intersection scenarios, which negatively impacts traffic efficiency. In this article, we propose a collaborative MARL-based method for multi-objective TSC, called CMRM. First, we introduce a multi-objective reward mechanism that integrates traffic efficiency, environmental impact, and safety to guide agents toward more comprehensive optimization. Second, we design a cooperation enhancement module (CEM) based on the graph attention mechanism to dynamically capture neighboring agents’ state information. This mitigates the partial observability problem in independent proximal policy optimization (IPPO) and enhances the model’s ability to capture dynamic and complex interactions among agents. Finally, we assess the performance of the proposed CMRM method using SUMO on two real traffic networks. Experimental results demonstrate that our method significantly improves traffic efficiency while reducing environmental pollution and enhancing traffic safety, compared to the best performing baseline, our method reduces CO2 emission by approximately 17.53% and 9.57%, and lowers vehicle collision risks by 44.39% and 42.85% in two different traffic networks. © 1975-2011 IEEE.

关键词： Traffic congestion

Optimizing Human Pose Estimation Through Focused Human and Joint Regions

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Jiao, Yingying Wang, Zhigang Liu, Zhenguang Fan, Shaojing Wu, Sifan Wu, Zheqi Xu, Zhuoyue College of Computer Science and Technology Jilin University China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University China College of Computer Science and Technology Zhejiang Gongshang University China The State Key Laboratory of Blockchain and Data Security Zhejiang University China Institute of Blockchain and Data Security China School of Computing National University of Singapore Singapore

Human pose estimation has given rise to a broad spectrum of novel and compelling applications, including action recognition, sports analysis, as well as surveillance. However, accurate video pose estimation remains an open challenge. One aspect that has been overlooked so far is that existing methods learn motion clues from all pixels rather than focusing on the target human body, making them easily misled and disrupted by unimportant information such as background changes or movements of other people. Additionally, while the current Transformer-based pose estimation methods has demonstrated impressive performance with global modeling, they struggle with local context perception and precise positional identification. In this paper, we try to tackle these challenges from three aspects: (1) We propose a bilayer Human-keypoint Mask module that performs coarse-to-fine visual token refinement, which gradually zooms in on the target human body and keypoints while masking out unimportant figure regions. (2) We further introduce a novel deformable cross attention mechanism and a bidirectional separation strategy to adaptively aggregate spatial and temporal motion clues from constrained surrounding contexts. (3) We mathematically formulate the deformable cross attention, constraining that the model focuses solely on the regions centered at the target person body. Empirically, our method achieves state-of-the-art performance on three large-scale benchmark datasets. A remarkable highlight is that our method achieves an 84.8 mean Average Precision (mAP) on the challenging wrist joint, which significantly outperforms the 81.5 mAP achieved by the current state-of-the-art method on the PoseTrack2017 dataset. Copyright © 2025, The Authors. All rights reserved.

关键词： Benchmarking

UAV-assisted Joint Mobile Edge Computing and Data Collection via Matching-enabled Deep Reinforcement Learning

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Boxiong Kang, Hui Li, Jiahui Sun, Geng Sun, Zemin Wang, Jiacheng Niyato, Dusit College of Computer Science and Technology Jilin University Changchun130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Jilin University Changchun130012 China College of Computing and Data Science Nanyang Technological University 639798 Singapore College of Computing and Data Science Nanyang Technological University Singapore

Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) and data collection (DC) have been popular research issues. Different from existing works that consider MEC and DC scenarios separately, this paper investigates a multi-UAV-assisted joint MEC-DC system. Specifically, we formulate a joint optimization problem to minimize the MEC latency and maximize the collected data volume. This problem can be classified as a non-convex mixed integer programming problem that exhibits long-term optimization and dynamics. Thus, we propose a deep reinforcement learning-based approach that jointly optimizes the UAV movement, user transmit power, and user association in real time to solve the problem efficiently. Specifically, we reformulate the optimization problem into an action space-reduced Markov decision process (MDP) and optimize the user association by using a two-phase matching-based association (TMA) strategy. Subsequently, we propose a soft actor-critic (SAC)-based approach that integrates the proposed TMA strategy (SAC-TMA) to solve the formulated joint optimization problem collaboratively. Simulation results demonstrate that the proposed SAC-TMA is able to coordinate the two subsystems and can effectively reduce the system latency and improve the data collection volume compared with other benchmark algorithms. Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

Shortcut Learning in In-Context Learning: A Survey

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Song, Rui Li, Yingji Shi, Lida Giunchiglia, Fausto Xu, Hao College of Computer Science and Technology Jilin University Changchun China Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education Jilin University China Department of Information Engineering and Computer Science University of Trento Italy

Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks, which hinders their generalization and robustness. With the rapid development of Large Language Models (LLMs) in recent years, an increasing number of studies have shown the impact of shortcut learning on LLMs. This paper provides a novel perspective to review relevant research on shortcut learning in In-Context Learning (ICL). It conducts a detailed exploration of the types of shortcuts in ICL tasks, their causes, available benchmarks, and strategies for mitigating shortcuts. Based on the corresponding observations, we summarize the unresolved issues in existing research and attempts to outline the future research landscape of shortcut learning. © 2024, CC BY.

关键词： Contrastive Learning

COVID-19 knowledge Graph for Drug and Vaccine Development

学校读者我要写书评

暂无评论

COVID-19 Knowledge Graph for Drug and Vaccine Development

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Lan Huang Hongrui Guan Yanchun Liang Renchu Guan Xiaoyue Feng The Key Laboratory for Symbolic Computation and Knowledge Engineering of the Ministry of Education College of Computer Science and Technology Jilin University Changchun China Zhuhai Sub Laboratory Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education Zhuhai College of Science and Technology Zhuhai China

ISBN: (纸本)9781665429825

The worldwide spread of COVID-19 has made a severe impact on human health and life. It has shown rapid propagation, long in vitro survival, and a long incubation period. More seriously, COVID-19 is more susceptible to variation, as it is an RNA virus. Mutations of COVID-19 have been reported in multiple countries worldwide, which makes drug and vaccine development a significant challenge. To search for potential drugs and vaccines and reveal the atlas of COVID-19 evolution, we extract information from massive unstructured data and construct a COVID-19 knowledge graph using the COVID-19 data. Based on machine learning approaches, we infer and predict novel coronavirus pneumonia-related diseases, drug action targets, etc. to speculate on new and more effective treatment methods. In addition, to study transcriptome of SARS-CoV-2, new ideas can be provided to biomedical experts with flexible responses to viral variation. An in-depth analysis of the COVID-19 pathomechanism at the pharmaceutical, genetic, and protein levels provides effective means and tools for novel coronavirus pneumonia vaccines, drug development, and therapeutic program design.

关键词： COVID-19 Drugs Proteins Protein engineering Pulmonary diseases RNA Machine learning

A Lightweight Api Recommendation Method for App Development Based on Multi-Objective Evolutionary Algorithm

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Li, Xun Liu, Lei Liu, Yuzhou Liu, Huaxiao College of Computer Science and Technology Jilin University Jilin130012 China Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education Changchun Jilin University Jilin130012 China

Context: API is important in daily programming activities during app development, but finding appropriate APIs is time-consuming for developers. To simplify this process, many researchers pay attention to overcoming the task-API knowledge gap using semantic information mined from the large-scale dataset for API recommendation. However, only semantic information is not enough since API descriptions and developer's query may not share similar words, meanwhile, large-scale data mining brings huge time cost and causes knowledge fixed problem (i.e. data cannot be timely updated). This limits the efficiency of existing API commendation methods. Objective: In this work, we aim at proposing a lightweight API recommendation method for app development based on the data in app store. Method: We model API recommendation as a multi-objective optimization problem by considering both structural and semantic information of API, and use the genetic algorithm to gain optimal solutions for overcoming limitations of the small-scale dataset. Specially, we collect APK files of related apps and API descriptions to establish a lightweight dataset, and extract the structural and semantic information of API from them with graph embedding and NLP techniques respectively. Then, we get the recommended APIs satisfying structural and semantic objectives according to the developers’ target functionality with a genetic algorithm. Finally, we give the interpretation of our recommendation information to help developers understand the results easily. Results and Conclusion: We conduct a series of experiments based on apps in Google Play and Q&As in Stack Overflow. The results show that Precision@N of our recommendation can be up to 0.89, MAP@N is up to 0.50, and MRR reaches 0.69, and our method achieves such good performance only utilizing less than 1/19 of the project number of our compared machine learning method. Besides, we conduct a survey and most of the participants confirm the understandabilit

关键词： Multiobjective optimization