检索结果-内蒙古大学图书馆

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Wang, Renzhi Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

ISBN: (纸本)9798891761643

Large language models (LLMs) require continual knowledge updates to stay abreast of the ever-changing world facts, prompting the formulation of lifelong model editing task. While recent years have witnessed the development of various techniques for single and batch editing, these methods either fail to apply or perform sub-optimally when faced with lifelong editing. In this paper, we introduce LEMoE, an advanced Mixture of Experts (MoE) adaptor for lifelong model editing. We first analyze the factors influencing the effectiveness of conventional MoE adaptor in lifelong editing, including catastrophic forgetting, inconsistent routing and order sensitivity. Based on these insights, we propose a tailored module insertion method to achieve lifelong editing, incorporating a novel KV anchor routing to enhance routing consistency between training and inference stage, along with a concise yet effective clustering-based editing order planning. Experimental results demonstrate the effectiveness of our method in lifelong editing, surpassing previous model editing techniques while maintaining outstanding performance in batch editing task. Our code can be found at: https://***/rzhwang/LEMoE. © 2024 Association for Computational Linguistics.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

GBCI: Adaptive Frequency Band Learning for Gender Recognition in Brain-Computer Interfaces 1st

GBCI: Adaptive Frequency Band Learning for Gender Recogniti...

引用

1st CAAI International Conference on Artificial intelligence, CICAI 2021

作者： Wang, Pengpai Zhou, Yueying Li, Zhongnian Zhang, Daoqiang College of Computer Science and Technology MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing University of Aeronautics and Astronautics Nanjing211106 China

ISBN: (纸本)9783030930455

In recent years, with the rapid development of brain-computer interface (BCI) technology, various applications based on BCI have generated significant interest. A motivating application of BCI is predicting human gender by electroencephalogram (EEG) analysis. However, most of the recent researches only identify the gender of EEG in the resting state. In real-life practice, it is difficult for the subjects to be at a full resting state when it mixes with motor imagery (MI). Therefore, we acquired two kinds of EEG activities data including 9 subjects (5 males and 4 females) with two state (i.e., resting state and MI) based on Chinese sign language. In this paper, to recognize gender form two state, an improved adaptive variational mode decomposition with long short term memory (AVMD-LSTM) network is developed to construct a hybrid state learning framework. Besides, the sample entropy (SE) is employed to select the channel of EEG data as the input of AVMD-LSTM. The recognition accuracy of gender classification was 89.21 %. Comparing with the task of complete resting state, the model is validated with more robustness. Furthermore, the proposed algorithm has many applications, including biometrics, healthcare, and online entertainment advertising. © 2021, Springer Nature Switzerland AG.

关键词： Variational mode decomposition

来源：评论

学校读者我要写书评

暂无评论

Decoding the Echoes of Vision from fMRI: Memory Disentangling for Past Semantic Information

Decoding the Echoes of Vision from fMRI: Memory Disentanglin...

引用

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Xia, Runze Yin, Congchi Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

ISBN: (纸本)9798891761643

The human visual system is capable of processing continuous streams of visual information, but how the brain encodes and retrieves recent visual memories during continuous visual processing remains unexplored. This study investigates the capacity of working memory to retain past information under continuous visual stimuli. And then we propose a new task Memory Disentangling, which aims to extract and decode past information from fMRI signals. To address the issue of interference from past memory information, we design a disentangled contrastive learning method inspired by the phenomenon of proactive interference. This method separates the information between adjacent fMRI signals into current and past components and decodes them into image descriptions. Experimental results demonstrate that this method effectively disentangles the information within fMRI signals. This research could advance brain-computer interfaces and mitigate the problem of low temporal resolution in fMRI. © 2024 Association for Computational Linguistics.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

DouGNN: An End-to-End Deep Learning Framework for Predicting Individual Behaviors from fMRI Data 2

DouGNN: An End-to-End Deep Learning Framework for Predicting...

引用

2nd International Conference on Image Processing, Computer Vision and machine Learning, ICICML 2023

作者： Cao, Qumei Wen, Xuyun MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing University of Aeronautics and Astronautics College of Computer Science and Technology Jiangsu Nanjing China

ISBN: (纸本)9798350331417

Predicting individual behavior from functional connectivity (FC) using machine learning is a critical research topic in neuroscience. While various models have been proposed, they mainly focus on designing behavior prediction methods, overlooking the influence of upstream FC network construction approach on downstream tasks. In this paper, leveraging graph neural networks (GNNs), we introduce an end-to-end deep learning framework named DouGNN, aimed at learning individual behavior from fMRI data. Through joint training of two GNNs, DouGNN innovatively integrates individualized cortical parcellation (for FC network construction) and individual behavior prediction into a unified optimization model. By integrating individualized cortical parcellation, the model gains the ability to dynamically modify the subject's cortical parcellation and the downstream tasks. This enhancement enables the subsequently constructed FC networks to better represent individual-specific features and task-related characteristics, thereby significantly improving the performance of individual behavior prediction. Moreover, the generated individual-specific, task-aware cortical parcellations from this process can also help us in understanding the relationship between FC and behaviors. We conducted three representative behavior prediction experiments on the publicly available HCP dataset. The results demonstrate that DouGNN outperforms existing methods in all behavior prediction tasks, achieving superior performance and generating more functionally homogeneous individualized cortical parcellations. © 2023 IEEE.

关键词： Behavior prediction functional magnetic resonance imaging graph neural network individualized cortical parcellation

来源：评论

学校读者我要写书评

暂无评论

A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks 22

A Systematic Evaluation of Large Language Models for Natural...

引用

22nd Chinese National Conference on Computational Linguistics, CCL 2023

作者： Ni, Xuanfan Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Jiangsu Nanjing210016 China

ISBN: (纸本)9781713889892

Recent efforts have evaluated large language models (LLMs) in areas such as commonsense reasoning, mathematical reasoning, and code generation. However, to the best of our knowledge, no work has specifically investigated the performance of LLMs in natural language generation (NLG) tasks, a pivotal criterion for determining model excellence. Thus, this paper conducts a comprehensive evaluation of well-known and high-performing LLMs, namely ChatGPT, ChatGLM, T5-based models, LLaMA-based models, and Pythia-based models, in the context of NLG tasks. We select English and Chinese datasets encompassing Dialogue Generation and Text Summarization. Moreover, we propose a common evaluation setting that incorporates input templates and post-processing strategies. Our study reports both automatic results, accompanied by a detailed analysis. © 2023 China National Conference on Computational Linguistics.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

Faster Adaptive Decentralized Learning Algorithms 41

Faster Adaptive Decentralized Learning Algorithms

引用

41st International Conference on machine Learning, ICML 2024

作者： Huang, Feihu Zhao, Jianyu College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

Decentralized learning recently has received increasing attention in machine learning due to its advantages in implementation simplicity and system robustness, data privacy. Meanwhile, the adaptive gradient methods show superior performances in many machine learning tasks such as training neural networks. Although some works focus on studying decentralized optimization algorithms with adaptive learning rates, these adaptive decentralized algorithms still suffer from high sample complexity. To fill these gaps, we propose a class of faster adaptive decentralized algorithms (i.e., AdaMDOS and AdaMDOF) for distributed nonconvex stochastic and finite-sum optimization, respectively. Moreover, we provide a solid convergence analysis framework for our methods. In particular, we prove that our AdaMDOS obtains a near-optimal sample complexity of Õ(ϵ-3) for finding an ϵ-stationary solution of nonconvex stochastic optimization. Meanwhile, our AdaMDOF obtains a near-optimal sample complexity of O(√nϵ-2) for finding an ϵ-stationary solution of for nonconvex finite-sum optimization, where n denotes the sample size. To the best of our knowledge, our AdaMDOF algorithm is the first adaptive decentralized algorithm for nonconvex finite-sum optimization. Some experimental results demonstrate efficiency of our algorithms. Copyright 2024 by the author(s)

关键词： Optimization algorithms

来源：评论

学校读者我要写书评

暂无评论

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization 41

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimizat...

引用

41st International Conference on machine Learning, ICML 2024

作者： Huang, Feihu College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

Bilevel optimization is widely applied in many machine learning tasks such as hyper-parameter learning, meta learning and reinforcement learning. Although many algorithms recently have been developed to solve the bilevel optimization problems, they generally rely on the (strongly) convex lower-level problems. More recently, some methods have been proposed to solve the nonconvex-PL bilevel optimization problems, where their upper-level problems are possibly nonconvex, and their lower-level problems are also possibly nonconvex while satisfying Polyak-Lojasiewicz (PL) condition. However, these methods still have a high convergence complexity or a high computation complexity such as requiring compute expensive Hessian/Jacobian matrices and its inverses. In the paper, thus, we propose an efficient Hessian/Jacobian-free method (i.e., HJFBiO) with the optimal convergence complexity to solve the nonconvex-PL bilevel problems. Theoretically, under some mild conditions, we prove that our HJFBiO method obtains an optimal convergence rate of O(1/T), where T denotes the number of iterations, and has an optimal gradient complexity of O(ϵ-1) in finding an ϵ-stationary solution. We conduct some numerical experiments on the bilevel PL game and hyper-representation learning task to demonstrate efficiency of our proposed method. Copyright 2024 by the author(s)

关键词： Optimization algorithms

来源：评论

学校读者我要写书评

暂无评论

AE-TPGG:a novel autoencoder-based approach for single-cell RNA-seq data imputation and dimensionality reduction

引用

Frontiers of Computer Science 2023年第3期17卷 217-234页

作者： Shuchang ZHAO Li ZHANG Xuejun LIU MIIT Key Laboratory of Pattern Analysis and Machine Intelligence College of Computer Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjing 211106China Collaborative Innovation Center of Novel Software Technology and Industrialization Nanjing 210023China College of Computer Science and Technology Nanjing Forestry UniversityNanjing 210037China

Single-cell RNA sequencing(scRNA-seq)technology has become an effective tool for high-throughout transcriptomic study,which circumvents the averaging artifacts corresponding to bulk RNA-seq technology,yielding new perspectives on the cellular diversity of potential superficially homogeneous *** various sequencing techniques have decreased the amplification bias and improved capture efficiency caused by the low amount of starting material,the technical noise and biological variation are inevitably introduced into experimental process,resulting in high dropout events,which greatly hinder the downstream *** the bimodal expression pattern and the right-skewed characteristic existed in normalized scRNA-seq data,we propose a customized autoencoder based on a twopart-generalized-gamma distribution(AE-TPGG)for scRNAseq data analysis,which takes mixed discrete-continuous random variables of scRNA-seq data into account using a twopart model and utilizes the generalized gamma(GG)distribution,for fitting the positive and right-skewed continuous *** adopted autoencoder enables AE-TPGG to captures the inherent relationship between *** addition to the ability of achieving low-dimensional representation,the AETPGG model also provides a denoised imputation according to statistical characteristic of gene *** on real datasets demonstrate that our proposed model is competitive to current imputation methods and ameliorates a diverse set of typical scRNA-seq data analyses.

关键词： scRNA-seq autoencoder TPGG data imputation dimensionality reduction

来源：评论

学校读者我要写书评

暂无评论

A generative deep learning framework for airfoil flow field prediction with sparse data

引用

Chinese Journal of Aeronautics 2022年第1期35卷 470-484页

作者： Haizhou WU Xuejun LIU Wei AN Hongqiang LYU MIIT Key Laboratory of Pattern Analysis and Machine Intelligence College of Computer Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjing 211106China Key Laboratory of Aerodynamic Noise Control Mianyang 621000China State Key Laboratory of Aerodynamics Mianyang 621000China Collaborative Innovation Center of Novel Software Technology and Industrialization Nanjing 210023China College of Aerospace Engineering Nanjing University of Aeronautics and AstronauticsNanjing 211106China

Deep learning has been probed for the airfoil performance prediction in recent *** with the expensive CFD simulations and wind tunnel experiments,deep learning models can be leveraged to somewhat mitigate such expenses with proper ***,effective training of the data-driven models in deep learning severely hinges on the data in diversity and *** this paper,we present a novel data augmented Generative Adversarial Network(GAN),daGAN,for rapid and accurate flow filed prediction,allowing the adaption to the task with sparse *** presented approach consists of two modules,pre-training module and fine-tuning *** pre-training module utilizes a conditional GAN(cGAN)to preliminarily estimate the distribution of the training *** the fine-tuning module,we propose a novel adversarial architecture with two generators one of which fulfils a promising data augmentation operation,so that the complement data is adequately incorporated to boost the generalization of the *** use numerical simulation data to verify the generalization of daGAN on airfoils and flow conditions with sparse training *** results show that daGAN is a promising tool for rapid and accurate evaluation of detailed flow field without the requirement for big training data.

关键词： CFD Flow field Generative adversarial networks(GANs) Sparse data Supercritical airfoil

来源：评论

学校读者我要写书评

暂无评论

Shape-based image retrieval applied to trademark images

引用

International Journal of Image and Graphics 2002年第3期2卷 375-393页

作者： El Badawy, Ossama Kamel, Mohamed Pattern Analysis and Machine Intelligence Laboratory Department of Systems Design Engineering University of Waterloo 200 University Avenue West WaterlooONN2L 3G1 Canada

We propose a new shape-based, query-by-example, image database retrieval method that is able to match a query image to one of the images in the database, based on a whole or partial match. The proposed method has two key components: the architecture of the retrieval and the features used. Both play a role in the overall retrieval efficacy. The proposed architecture is based on the analysis of connected components and holes in the query and database images. The features we propose to use are geometric in nature, and are invariant to translation, rotation and scale. Each of the suggested three features is not new per se, but combining them to produce a compact and efficient feature vector is. We use hand-sketched, rotated and scaled query images to test the proposed method using a database of 500 logo images. We compare the performance of the suggested features with the performance of the moment invariants (a set of commonly-used shape features). The suggested features match the moment invariants in rotated and scaled queries and consistently surpass them in hand-sketched queries. Moreover, results clearly show that the proposed architecture significantly increases the performance of the two feature sets. © 2002 World Scientific Publishing Company.

关键词： Database systems

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：