检索结果-内蒙古大学图书馆

SEED-VII: A Multimodal Dataset of Six Basic Emotions with Continuous Labels for Emotion Recognition

IEEE Transactions on Affective Computing 2024年第02期16卷 969-985页

作者： Jiang, Wei-Bang Liu, Xuan-Hao Zheng, Wei-Long Lu, Bao-Liang Shanghai Jiao Tong University Center for Brain-Like Computing and Machine Intelligence Department of Computer Science and Engineering Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Brain Science and Technology Research Center Shanghai200240 China

Recognizing emotions from physiological signals is a topic that has garnered widespread interest, and research continues to develop novel techniques for perceiving emotions. However, the emergence of deep learning has highlighted the need for comprehensive and high-quality emotional datasets that enable the accurate decoding of human emotions. To systematically explore human emotions, we develop a multimodal dataset consisting of six basic (happiness, sadness, fear, disgust, surprise, and anger) emotions and the neutral emotion, named SEED-VII. This multimodal dataset includes electroencephalography (EEG) and eye movement signals. The seven emotions in SEED-VII are elicited by 80 different videos and fully investigated with continuous labels that indicate the intensity levels of the corresponding emotions. Additionally, we propose a novel Multimodal Adaptive Emotion Transformer (MAET), that can flexibly process both unimodal and multimodal inputs. Adversarial training is utilized in the MAET to mitigate subject discrepancies, which enhances domain generalization. Our extensive experiments, encompassing both subject-dependent and cross-subject conditions, demonstrate the superior performance of the MAET in terms of handling various inputs. Continuous labels are used to filter the data with high emotional intensity, and this strategy is proven to be effective for attaining improved emotion recognition performance. Furthermore, complementary properties between the EEG signals and eye movements and stable neural patterns of the seven emotions are observed. © 2010-2012 IEEE.

关键词： Eye movements

来源：评论

学校读者我要写书评

暂无评论

Elevating Robust ASR By Decoupling Multi-Channel Speaker Separation and Speech Recognition

Elevating Robust ASR By Decoupling Multi-Channel Speaker Sep...

引用

2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

作者： Yang, Yufeng Taherian, Hassan Kalkhorani, Vahid Ahmadi Wang, DeLiang Department of Computer Science and Engineering The Ohio State University United States Center for Cognitive and Brain Sciences The Ohio State University United States

ISBN: (纸本)9798350368741

Despite the tremendous success of automatic speech recognition (ASR) with the introduction of deep learning, its performance is still unsatisfactory in many real-world multi-talker scenarios. Speaker separation excels in separating individual talkers but, as a frontend, it introduces processing artifacts that degrade the ASR backend trained on clean speech. As a result, mainstream robust ASR systems train on noisy speech to avoid processing artifacts. In this work, we propose to decouple the training of the multi-channel speaker separation frontend and the ASR backend, with the latter trained only on clean speech. On SMS-WSJ, the proposed approach achieves a word error rate (WER) of 5.74%, outperforming the previous best by 14.3%. Furthermore, on recorded LibriCSS, we achieve the speaker-attributed WER of 3.86%, outperforming the previous best system trained on the same data by 24.8%. These state-of-the-art results suggest that decoupling speech separation and recognition is a potentially effective approach to robust ASR. © 2025 IEEE.

关键词： LibriCSS multi-channel robust ASR SMS-WSJ speaker separation

来源：评论

学校读者我要写书评

暂无评论

Multi-objective Feature Attribution Explanation for Explainable Machine Learning

引用

ACM Transactions on Evolutionary Learning and Optimization 2024年第1期4卷 1-32页

作者： Wang, Ziming Huang, Changwu Li, Yun Yao, Xin Research Institute of Trustworthy Autonomous Systems Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation Departmentof Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China The Advanced Cognitive Technology Lab Huawei Technologies Co. Ltd Shanghai201206 China School of Computer Science University of Birmingham BirminghamB15 2TT United Kingdom

The feature attribution-based explanation (FAE) methods, which indicate how much each input feature contributes to the model's output for a given data point, are one of the most popular categories of explainable machine learning techniques. Although various metrics have been proposed to evaluate the explanation quality, no single metric could capture different aspects of the explanations. Different conclusions might be drawn using different metrics. Moreover, during the processes of generating explanations, existing FAE methods either do not consider any evaluation metric or only consider the faithfulness of the explanation, failing to consider multiple metrics simultaneously. To address this issue, we formulate the problem of creating FAE explainable models as a multi-objective learning problem that considers multiple explanation quality metrics simultaneously. We first reveal conflicts between various explanation quality metrics, including faithfulness, sensitivity, and complexity. Then, we define the considered multi-objective explanation problem and propose a multi-objective feature attribution explanation (MOFAE) framework to address this newly defined problem. Subsequently, we instantiate the framework by simultaneously considering the explanation's faithfulness, sensitivity, and complexity. Experimental results comparing with six state-of-The-Art FAE methods on eight datasets demonstrate that our method can optimize multiple conflicting metrics simultaneously and can provide explanations with higher faithfulness, lower sensitivity, and lower complexity than the compared methods. Moreover, the results have shown that our method has better diversity, i.e., it provides various explanations that achieve different tradeoffs between multiple conflicting explanation quality metrics. Therefore, it can provide tailored explanations to different stakeholders based on their specific requirements. © 2024 Copyright held by the owner/author(s). Publication rights licensed

关键词： Machine learning

来源：评论

学校读者我要写书评

暂无评论

Multi-Resolution Location-Based Training for Multi-Channel Continuous Speech Separation 48

Multi-Resolution Location-Based Training for Multi-Channel C...

引用

48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Taherian, Hassan Wang, DeLiang The Ohio State University Department of Computer Science and Engineering United States The Ohio State University Center for Cognitive and Brain Sciences United States

ISBN: (纸本)9781728163277

The performance of automatic speech recognition (ASR) systems severely degrades when multi-talker speech overlap occurs. In meeting environments, speech separation is typically performed to improve the robustness of ASR systems. Recently, location-based training (LBT) was proposed as a new training criterion for multi-channel talker-independent speaker separation. Assuming fixed array geometry, LBT outperforms widely-used permutation-invariant training in fully overlapped utterances and matched reverberant conditions. This paper extends LBT to conversational multi-channel speaker separation. We introduce multi-resolution LBT to estimate the complex spectrograms from low to high time and frequency resolutions. With multi-resolution LBT, convolutional kernels are assigned consistently based on speaker locations in physical space. Evaluation results show that multi-resolution LBT consistently outperforms other competitive methods on the recorded LibriCSS corpus. © 2023 IEEE.

关键词： Source separation

来源：评论

学校读者我要写书评

暂无评论

Cross-Domain Diffusion Based Speech Enhancement for Very Noisy Speech 48

Cross-Domain Diffusion Based Speech Enhancement for Very Noi...

引用

48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Wang, Heming Wang, Deliang The Ohio State University Department of Computer Science and Engineering United States The Ohio State University Center for Cognitive and Brain Sciences United States

ISBN: (纸本)9781728163277

Deep learning based speech enhancement has achieved remarkable success, but challenges remain in low signal-to-noise ratio (SNR) nonstationary noise scenarios. In this study, we propose to incorporate diffusion-based learning into an enhancement model and improve robustness in extremely noisy conditions. Specifically, a frequency-domain diffusion-based generative module is employed, and it accepts the enhanced signal obtained from a time-domain supervised enhancement module as an auxiliary input to learn to recover clean speech spectrograms. Experimental results on the TIMIT dataset demonstrate the advantage of this approach and show better enhancement performance over other strong baselines in both -5 and -10 dB SNR noisy conditions. © 2023 IEEE.

关键词： Speech enhancement

来源：评论

学校读者我要写书评

暂无评论

Emotion Recognition from Eye Movements Using Multi-way Autoregressive Model

Emotion Recognition from Eye Movements Using Multi-way Autor...

引用

2024 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2024

作者： Ma, Tian-Fang Liu, Xuan-Hao Zheng, Wei-Long Lu, Bao-Liang Shanghai Jiao Tong University Center for Brain-Like Computing and Machine Intelligence Department of Computer Science and Engineering Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai China

ISBN: (纸本)9798350386226

The application of physiological signals in emotion recognition is a popular research topic in human-computer interactions. Eye movement, as an important physiological signal, plays an essential role in medicine, psychology, cognitive science, and other scientific research fields. Previous studies have successfully identified human emotions by combining various eye-related measurements, selecting features, and utilizing machine learning techniques. However, the exploration of eye movement signals in emotion recognition remains insufficient. In this study, we utilize eye tracking heatmap and eye movement trajectory data for emotion recognition for the first time. Based on the two types of eye movement data, we develop a multi-way autoregressive model capable of processing multi-view eye movement data. Compared to traditional deep learning baseline models, our model better adapts to the structure of eye movement data and significantly improves the classification performance. Furthermore, we integrate heatmap and trajectory data with commonly used eye-related measurement features, which further enhance the performance of emotion recognition beyond previous methods. © 2024 IEEE.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

brain-inspired artificial intelligence research: A review

引用

science China(Technological sciences) 2024年第8期67卷 2282-2296页

作者： WANG GuoYin BAO HuaNan LIU Qun ZHOU TianGang WU Si HUANG TieJun YU ZhaoFei LU CeWu GONG YiHong ZHANG ZhaoXiang HE Sheng Chongqing Key Laboratory of Computational Intelligence Chongqing University of Posts and TelecommunicationsChongqing 400065China Key Laboratory of Cyberspace Big Data Intelligent Security Chongqing University of Posts and TelecommunicationsChongqing 400065China College of Computer and Information Science Chongqing Normal UniversityChongqing 401331China State Key Laboratory of Brain and Cognitive Science Institute of BiophysicsChinese Academy of SciencesBeijing 100101China School of Psychological and Cognitive Sciences Peking UniversityBeijing 100871China State Key Laboratory of Multimedia Information Processing School of Computer SciencePeking UniversityBeijing 100871China Department of Computer Science School of ElectronicsInformation and Electrical EngineeringShanghai Jiao Tong UniversityShanghai 200240China Faculty of Electronic and Information Engineering Xi’an Jiaotong UniversityXi’an 710049China The Center for Research on Intelligent Perception and Computing Institute of AutomationChinese Academy of SciencesBeijing 100190China Institute of Biophysics Chinese Academy of SciencesBeijing 100101China

Artificial intelligence(AI) systems surpass certain human intelligence abilities in a statistical sense as a whole, but are not yet the true realization of these human intelligence abilities and behaviors. There are differences, and even contradictions, between the cognition and behavior of AI systems and humans. With the goal of achieving general AI, this study contains a review of the role of cognitive science in inspiring the development of the three mainstream academic branches of AI based on the three-layer framework proposed by David Marr, and the limitations of the current development of AI are explored and analyzed. The differences and inconsistencies between the cognition mechanisms of the human brain and the computation mechanisms of AI systems are analyzed. They are found to be the cause of the differences and contradictions between the cognition and behavior of AI systems and humans. Additionally, eight important research directions and their scientific issues that need to focus on braininspired AI research are proposed: highly imitated bionic information processing, a large-scale deep learning model that balances structure and function, multi-granularity joint problem solving bidirectionally driven by data and knowledge, AI models that simulate specific brain structures, a collaborative processing mechanism with the physical separation of perceptual processing and interpretive analysis, embodied intelligence that integrates the brain cognitive mechanism and AI computation mechanisms,intelligence simulation from individual intelligence to group intelligence(social intelligence), and AI-assisted brain cognitive intelligence.

关键词： artificial intelligence cognitive science brain science intelligence science large language model

来源：评论

学校读者我要写书评

暂无评论

Fault-tolerant neural networks from biological error correction codes

引用

Physical Review E 2024年第5期110卷 054303页

作者： Alexander Zlokapa Andrew K. Tan John M. Martyn Ila R. Fiete Max Tegmark Isaac L. Chuang Center for Theoretical Physics Department of Physics McGovern Institute for Brain Research Department of Brain and Cognitive Sciences Department of Electrical Engineering and Computer Science

It has been an open question in deep learning if fault-tolerant computation is possible: can arbitrarily reliable computation be achieved using only unreliable neurons? In the grid cells of the mammalian cortex, analog error correction codes have been observed to protect states against neural spiking noise, but their role in information processing is unclear. Here, we use these biological error correction codes to develop a universal fault-tolerant neural network that achieves reliable computation if the faultiness of each neuron lies below a sharp threshold; remarkably, we find that noisy biological neurons fall below this threshold. The discovery of a phase transition from faulty to fault-tolerant neural computation suggests a mechanism for reliable computation in the cortex and opens a path towards understanding noisy analog systems relevant to artificial intelligence and neuromorphic computing.

关键词： Biological neural networks Artificial neural networks

来源：评论

学校读者我要写书评

暂无评论

Exploring Children’s Strategies in Response to Robot’s Advice During a Group Task with iCub and Nao 16th

Exploring Children’s Strategies in Response to Robot’s A...

引用

16th International Conference on Social Robotics, ICSR + AI 2024

作者： Pusceddu, Giulia Sangineto, Mariapia Cocchella, Francesca Bogliolo, Michela Belgiovine, Giulia Lastrico, Linda Casadio, Maura Rea, Francesco Gena, Cristina Sciutti, Alessandra Robotics Brain and Cognitive Science Department Italian Institute of Technology Genoa Italy Department of Informatics Bioengineering Robotics and Systems Engineering University of Genoa Genoa Italy Department of Computer Science University of Turin Turin Italy Cognitive Architecture for Collaborative Technologies Unit Italian Institute of Technology Genoa Italy Scuola di Robotica Genoa Italy

ISBN: (纸本)9789819635184

This study investigates children’s trust in two humanoid robots, Nao and iCub, through a cooperative game designed to elicit spontaneous behaviors and group dynamics. We investigate whether participants change their choices after hearing advice from a robot, considering rounds where the advice is correct or incorrect, with the robot apologizing for its mistakes. Results reveal that, in most cases, participants prefer not to change their moves after the robot’s advice. Additionally, after the robots made mistakes, participants are less likely to actively follow their advice and more likely to reject it. No significant differences in strategies among the iCub and Nao samples are evidenced. Furthermore, we examine the influence of group dynamics, identifying "Proactive Players" who consistently initiated moves. A significant association between the strategies of this player and their teammates is found, suggesting potential influence. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Adversarial machine learning

来源：评论

学校读者我要写书评

暂无评论

DOMAIN RANDOMIZATION VIA ENTROPY MAXIMIZATION 12

DOMAIN RANDOMIZATION VIA ENTROPY MAXIMIZATION

引用

12th International Conference on Learning Representations, ICLR 2024

作者： Tiboni, Gabriele Klink, Pascal Peters, Jan Tommasi, Tatiana D'Eramo, Carlo Chalvatzaki, Georgia Department of Control and Computer Engineering Politecnico di Torino Italy Department of Computer Science Technische Universität Darmstadt Germany Center for Artificial Intelligence and Data Science University of Würzburg Germany Darmstadt Germany Centre for Cognitive Science TU Darmstadt Germany Germany Center for Mind Brain and Behavior Uni. Marburg and JLU Giessen Germany

Varying dynamics parameters in simulation is a popular Domain Randomization (DR) approach for overcoming the reality gap in Reinforcement Learning (RL). Nevertheless, DR heavily hinges on the choice of the sampling distribution of the dynamics parameters, since high variability is crucial to regularize the agent's behavior but notoriously leads to overly conservative policies when randomizing excessively. In this paper, we propose a novel approach to address sim-to-real transfer, which automatically shapes dynamics distributions during training in simulation without requiring real-world data. We introduce DOmain RAndomization via Entropy MaximizatiON (DORAEMON), a constrained optimization problem that directly maximizes the entropy of the training distribution while retaining generalization capabilities. In achieving this, DORAEMON gradually increases the diversity of sampled dynamics parameters as long as the probability of success of the current policy is sufficiently high. We empirically validate the consistent benefits of DORAEMON in obtaining highly adaptive and generalizable policies, i.e. solving the task at hand across the widest range of dynamics parameters, as opposed to representative baselines from the DR literature. Notably, we also demonstrate the Sim2Real applicability of DORAEMON through its successful zero-shot transfer in a robotic manipulation setup under unknown real-world parameters. © 2024 12th International Conference on Learning Representations, ICLR 2024. All rights reserved.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：