检索结果-内蒙古大学图书馆

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Xia, Runze Yin, Congchi Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

ISBN: (纸本)9798891761643

The human visual system is capable of processing continuous streams of visual information, but how the brain encodes and retrieves recent visual memories during continuous visual processing remains unexplored. This study investigates the capacity of working memory to retain past information under continuous visual stimuli. And then we propose a new task Memory Disentangling, which aims to extract and decode past information from fMRI signals. To address the issue of interference from past memory information, we design a disentangled contrastive learning method inspired by the phenomenon of proactive interference. This method separates the information between adjacent fMRI signals into current and past components and decodes them into image descriptions. Experimental results demonstrate that this method effectively disentangles the information within fMRI signals. This research could advance brain-computer interfaces and mitigate the problem of low temporal resolution in fMRI. © 2024 Association for Computational Linguistics.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

GBCI: Adaptive Frequency Band Learning for Gender Recognition in Brain-Computer Interfaces 1st

GBCI: Adaptive Frequency Band Learning for Gender Recogniti...

引用

1st CAAI International Conference on Artificial intelligence, CICAI 2021

作者： Wang, Pengpai Zhou, Yueying Li, Zhongnian Zhang, Daoqiang College of Computer Science and Technology MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing University of Aeronautics and Astronautics Nanjing211106 China

ISBN: (纸本)9783030930455

In recent years, with the rapid development of brain-computer interface (BCI) technology, various applications based on BCI have generated significant interest. A motivating application of BCI is predicting human gender by electroencephalogram (EEG) analysis. However, most of the recent researches only identify the gender of EEG in the resting state. In real-life practice, it is difficult for the subjects to be at a full resting state when it mixes with motor imagery (MI). Therefore, we acquired two kinds of EEG activities data including 9 subjects (5 males and 4 females) with two state (i.e., resting state and MI) based on Chinese sign language. In this paper, to recognize gender form two state, an improved adaptive variational mode decomposition with long short term memory (AVMD-LSTM) network is developed to construct a hybrid state learning framework. Besides, the sample entropy (SE) is employed to select the channel of EEG data as the input of AVMD-LSTM. The recognition accuracy of gender classification was 89.21 %. Comparing with the task of complete resting state, the model is validated with more robustness. Furthermore, the proposed algorithm has many applications, including biometrics, healthcare, and online entertainment advertising. © 2021, Springer Nature Switzerland AG.

关键词： Variational mode decomposition

来源：评论

学校读者我要写书评

暂无评论

uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers 29

uChecker: Masked Pretrained Language Models as Unsupervised ...

引用

29th International Conference on Computational Linguistics, COLING 2022

作者： Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics Astronautics MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Jiangsu Nanjing China

The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of the training dataset is usually very small (e.g., SIGHAN151 only contains 2339 samples for training), therefore supervised-learning based models usually suffer the data sparsity limitation and over-fitting issue, especially in the era of big language models. In this paper, we are dedicated to investigating the unsupervised paradigm to address the CSC problem and we propose a framework named uChecker to conduct unsupervised spelling error detection and correction. Masked pretrained language models such as BERT are introduced as the backbone model considering their powerful language diagnosis capability. Benefiting from the various and flexible MASKing operations, we propose a Confusionset-guided masking strategy to fine-train the masked language model to further improve the performance of unsupervised detection and correction. Experimental results on standard datasets demonstrate the effectiveness of our proposed model uChecker in terms of character-level and sentence-level Accuracy, Precision, Recall, and F1-Measure on tasks of spelling error detection and correction respectively. © 2022 Proceedings - International Conference on Computational Linguistics, COLING. All rights reserved.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

DouGNN: An End-to-End Deep Learning Framework for Predicting Individual Behaviors from fMRI Data 2

DouGNN: An End-to-End Deep Learning Framework for Predicting...

引用

2nd International Conference on Image Processing, Computer Vision and machine Learning, ICICML 2023

作者： Cao, Qumei Wen, Xuyun MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing University of Aeronautics and Astronautics College of Computer Science and Technology Jiangsu Nanjing China

ISBN: (纸本)9798350331417

Predicting individual behavior from functional connectivity (FC) using machine learning is a critical research topic in neuroscience. While various models have been proposed, they mainly focus on designing behavior prediction methods, overlooking the influence of upstream FC network construction approach on downstream tasks. In this paper, leveraging graph neural networks (GNNs), we introduce an end-to-end deep learning framework named DouGNN, aimed at learning individual behavior from fMRI data. Through joint training of two GNNs, DouGNN innovatively integrates individualized cortical parcellation (for FC network construction) and individual behavior prediction into a unified optimization model. By integrating individualized cortical parcellation, the model gains the ability to dynamically modify the subject's cortical parcellation and the downstream tasks. This enhancement enables the subsequently constructed FC networks to better represent individual-specific features and task-related characteristics, thereby significantly improving the performance of individual behavior prediction. Moreover, the generated individual-specific, task-aware cortical parcellations from this process can also help us in understanding the relationship between FC and behaviors. We conducted three representative behavior prediction experiments on the publicly available HCP dataset. The results demonstrate that DouGNN outperforms existing methods in all behavior prediction tasks, achieving superior performance and generating more functionally homogeneous individualized cortical parcellations. © 2023 IEEE.

关键词： Behavior prediction functional magnetic resonance imaging graph neural network individualized cortical parcellation

来源：评论

学校读者我要写书评

暂无评论

LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models

LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Mode...

引用

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Wang, Renzhi Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

ISBN: (纸本)9798891761643

Large language models (LLMs) require continual knowledge updates to stay abreast of the ever-changing world facts, prompting the formulation of lifelong model editing task. While recent years have witnessed the development of various techniques for single and batch editing, these methods either fail to apply or perform sub-optimally when faced with lifelong editing. In this paper, we introduce LEMoE, an advanced Mixture of Experts (MoE) adaptor for lifelong model editing. We first analyze the factors influencing the effectiveness of conventional MoE adaptor in lifelong editing, including catastrophic forgetting, inconsistent routing and order sensitivity. Based on these insights, we propose a tailored module insertion method to achieve lifelong editing, incorporating a novel KV anchor routing to enhance routing consistency between training and inference stage, along with a concise yet effective clustering-based editing order planning. Experimental results demonstrate the effectiveness of our method in lifelong editing, surpassing previous model editing techniques while maintaining outstanding performance in batch editing task. Our code can be found at: https://***/rzhwang/LEMoE. © 2024 Association for Computational Linguistics.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks 22

A Systematic Evaluation of Large Language Models for Natural...

引用

22nd Chinese National Conference on Computational Linguistics, CCL 2023

作者： Ni, Xuanfan Li, Piji College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Jiangsu Nanjing210016 China

ISBN: (纸本)9781713889892

Recent efforts have evaluated large language models (LLMs) in areas such as commonsense reasoning, mathematical reasoning, and code generation. However, to the best of our knowledge, no work has specifically investigated the performance of LLMs in natural language generation (NLG) tasks, a pivotal criterion for determining model excellence. Thus, this paper conducts a comprehensive evaluation of well-known and high-performing LLMs, namely ChatGPT, ChatGLM, T5-based models, LLaMA-based models, and Pythia-based models, in the context of NLG tasks. We select English and Chinese datasets encompassing Dialogue Generation and Text Summarization. Moreover, we propose a common evaluation setting that incorporates input templates and post-processing strategies. Our study reports both automatic results, accompanied by a detailed analysis. © 2023 China National Conference on Computational Linguistics.

关键词： Computational linguistics

来源：评论

学校读者我要写书评

暂无评论

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization 41

Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimizat...

引用

41st International Conference on machine Learning, ICML 2024

作者： Huang, Feihu College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

Bilevel optimization is widely applied in many machine learning tasks such as hyper-parameter learning, meta learning and reinforcement learning. Although many algorithms recently have been developed to solve the bilevel optimization problems, they generally rely on the (strongly) convex lower-level problems. More recently, some methods have been proposed to solve the nonconvex-PL bilevel optimization problems, where their upper-level problems are possibly nonconvex, and their lower-level problems are also possibly nonconvex while satisfying Polyak-Lojasiewicz (PL) condition. However, these methods still have a high convergence complexity or a high computation complexity such as requiring compute expensive Hessian/Jacobian matrices and its inverses. In the paper, thus, we propose an efficient Hessian/Jacobian-free method (i.e., HJFBiO) with the optimal convergence complexity to solve the nonconvex-PL bilevel problems. Theoretically, under some mild conditions, we prove that our HJFBiO method obtains an optimal convergence rate of O(1/T), where T denotes the number of iterations, and has an optimal gradient complexity of O(ϵ-1) in finding an ϵ-stationary solution. We conduct some numerical experiments on the bilevel PL game and hyper-representation learning task to demonstrate efficiency of our proposed method. Copyright 2024 by the author(s)

关键词： Optimization algorithms

来源：评论

学校读者我要写书评

暂无评论

Faster Adaptive Decentralized Learning Algorithms 41

Faster Adaptive Decentralized Learning Algorithms

引用

41st International Conference on machine Learning, ICML 2024

作者： Huang, Feihu Zhao, Jianyu College of Computer Science and Technology Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China

Decentralized learning recently has received increasing attention in machine learning due to its advantages in implementation simplicity and system robustness, data privacy. Meanwhile, the adaptive gradient methods show superior performances in many machine learning tasks such as training neural networks. Although some works focus on studying decentralized optimization algorithms with adaptive learning rates, these adaptive decentralized algorithms still suffer from high sample complexity. To fill these gaps, we propose a class of faster adaptive decentralized algorithms (i.e., AdaMDOS and AdaMDOF) for distributed nonconvex stochastic and finite-sum optimization, respectively. Moreover, we provide a solid convergence analysis framework for our methods. In particular, we prove that our AdaMDOS obtains a near-optimal sample complexity of Õ(ϵ-3) for finding an ϵ-stationary solution of nonconvex stochastic optimization. Meanwhile, our AdaMDOF obtains a near-optimal sample complexity of O(√nϵ-2) for finding an ϵ-stationary solution of for nonconvex finite-sum optimization, where n denotes the sample size. To the best of our knowledge, our AdaMDOF algorithm is the first adaptive decentralized algorithm for nonconvex finite-sum optimization. Some experimental results demonstrate efficiency of our algorithms. Copyright 2024 by the author(s)

关键词： Optimization algorithms

来源：评论

学校读者我要写书评

暂无评论

AE-TPGG:a novel autoencoder-based approach for single-cell RNA-seq data imputation and dimensionality reduction

引用

Frontiers of Computer Science 2023年第3期17卷 217-234页

作者： Shuchang ZHAO Li ZHANG Xuejun LIU MIIT Key Laboratory of Pattern Analysis and Machine Intelligence College of Computer Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjing 211106China Collaborative Innovation Center of Novel Software Technology and Industrialization Nanjing 210023China College of Computer Science and Technology Nanjing Forestry UniversityNanjing 210037China

Single-cell RNA sequencing(scRNA-seq)technology has become an effective tool for high-throughout transcriptomic study,which circumvents the averaging artifacts corresponding to bulk RNA-seq technology,yielding new perspectives on the cellular diversity of potential superficially homogeneous *** various sequencing techniques have decreased the amplification bias and improved capture efficiency caused by the low amount of starting material,the technical noise and biological variation are inevitably introduced into experimental process,resulting in high dropout events,which greatly hinder the downstream *** the bimodal expression pattern and the right-skewed characteristic existed in normalized scRNA-seq data,we propose a customized autoencoder based on a twopart-generalized-gamma distribution(AE-TPGG)for scRNAseq data analysis,which takes mixed discrete-continuous random variables of scRNA-seq data into account using a twopart model and utilizes the generalized gamma(GG)distribution,for fitting the positive and right-skewed continuous *** adopted autoencoder enables AE-TPGG to captures the inherent relationship between *** addition to the ability of achieving low-dimensional representation,the AETPGG model also provides a denoised imputation according to statistical characteristic of gene *** on real datasets demonstrate that our proposed model is competitive to current imputation methods and ameliorates a diverse set of typical scRNA-seq data analyses.

关键词： scRNA-seq autoencoder TPGG data imputation dimensionality reduction

来源：评论

学校读者我要写书评

暂无评论

HELPD: Mitigating Hallucination of LVLMs by Hierarchical Feedback Learning with Vision-enhanced Penalty Decoding

HELPD: Mitigating Hallucination of LVLMs by Hierarchical Fee...

引用

2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024

作者： Yuan, Fan Qin, Chi Xu, Xiaogang Li, Piji College of Artificial Intelligence Nanjing University of Aeronautics and Astronautics Nanjing China MIIT Key Laboratory of Pattern Analysis and Machine Intelligence Nanjing China The Chinese University of Hong Kong Hong Kong

ISBN: (纸本)9798891761643

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the images. Many existing work detects hallucination by directly judging whether an object exists in an image, overlooking the association between the object and semantics. To address this issue, we propose Hierarchical Feedback Learning with Vision-enhanced Penalty Decoding (HELPD). This framework incorporates hallucination feedback at both object and sentence semantic levels. Remarkably, even with a marginal degree of training, this approach can alleviate over 15% of hallucination. Simultaneously, HELPD penalizes the output logits according to the image attention window to avoid being overly affected by generated text. HELPD can be seamlessly integrated with any LVLMs. Our experiments demonstrate that the proposed framework yields favorable results across multiple hallucination benchmarks. It effectively mitigates hallucination for different LVLMs and concurrently improves their text generation quality. © 2024 Association for Computational Linguistics.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：