检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Kalkhorani, Vahid Ahmadi Yu, Cheng Kumar, Anurag Tan, Ke Xu, Buye Wang, DeLiang Department of Computer Science and Engineering Ohio State University ColumbusOH43210 United States Meta Reality Labs RedmondWA20004 United States Department of Computer Science and Engineering The Center for Cognitive and Brain Sciences Ohio State University ColumbusOH43210 United States

Adding visual cues to audio-based speech separation can improve separation performance. This paper introduces AVCrossNet, an audiovisual (AV) system for speech enhancement, target speaker extraction, and multi-talker speaker separation. AV-CrossNet is extended from the CrossNet architecture, which is a recently proposed network that performs complex spectral mapping for speech separation by leveraging global attention and positional encoding. To effectively utilize visual cues, the proposed system incorporates pre-extracted visual embeddings and employs a visual encoder comprising temporal convolutional layers. Audio and visual features are fused in an early fusion layer before feeding to AV-CrossNet blocks. We evaluate AVCrossNet on multiple datasets, including LRS, VoxCeleb, and COG-MHEAR challenge. Evaluation results demonstrate that AV-CrossNet advances the state-of-the-art performance in all audiovisual tasks, even on untrained and mismatched datasets. © 2024, CC BY.

关键词： Extraction

来源：评论

学校读者我要写书评

暂无评论

MULTI-RESOLUTION LOCATION-BASED TRAINING FOR MULTI-CHANNEL CONTINUOUS SPEECH SEPARATION

arXiv

引用

arXiv 2023年

作者： Taherian, Hassan Wang, DeLiang Department of Computer Science and Engineering The Ohio State University United States Center for Cognitive and Brain Sciences The Ohio State University United States

The performance of automatic speech recognition (ASR) systems severely degrades when multi-talker speech overlap occurs. In meeting environments, speech separation is typically performed to improve the robustness of ASR systems. Recently, location-based training (LBT) was proposed as a new training criterion for multi-channel talker-independent speaker separation. Assuming fixed array geometry, LBT outperforms widely-used permutation-invariant training in fully overlapped utterances and matched reverberant conditions. This paper extends LBT to conversational multi-channel speaker separation. We introduce multi-resolution LBT to estimate the complex spectrograms from low to high time and frequency resolutions. With multi-resolution LBT, convolutional kernels are assigned consistently based on speaker locations in physical space. Evaluation results show that multi-resolution LBT consistently outperforms other competitive methods on the recorded LibriCSS corpus. Copyright © 2023, The Authors. All rights reserved.

关键词： Location

来源：评论

学校读者我要写书评

暂无评论

Multi-channel Conversational Speaker Separation via Neural Diarization

arXiv

引用

arXiv 2023年

作者： Taherian, Hassan Wang, DeLiang Department of Computer Science and Engineering The Ohio State University ColumbusOH43210-1277 United States Department of Computer Science and Engineering the Center for Cognitive and Brain Sciences The Ohio State University ColumbusOH43210-1277 United States

When dealing with overlapped speech, the performance of automatic speech recognition (ASR) systems substantially degrades as they are designed for single-talker speech. To enhance ASR performance in conversational or meeting environments, continuous speaker separation (CSS) is commonly employed. However, CSS requires a short separation window to avoid many speakers inside the window and sequential grouping of discontinuous speech segments. To address these limitations, we introduce a new multi-channel framework called "speaker separation via neural diarization" (SSND) for meeting environments. Our approach utilizes an end-to-end diarization system to identify the speech activity of each individual speaker. By leveraging estimated speaker boundaries, we generate a sequence of embeddings, which in turn facilitate the assignment of speakers to the outputs of a multi-talker separation model. SSND addresses the permutation ambiguity issue of talker-independent speaker separation during the diarization phase through location-based training, rather than during the separation process. This unique approach allows multiple non-overlapped speakers to be assigned to the same output stream, making it possible to efficiently process long segments—a task impossible with CSS. Additionally, SSND is naturally suitable for speaker-attributed ASR. We evaluate our proposed diarization and separation methods on the open LibriCSS dataset, advancing state-of-the-art diarization and ASR results by a large margin. Copyright © 2023, The Authors. All rights reserved.

关键词： Speech recognition

来源：评论

学校读者我要写书评

暂无评论

Emotion Recognition from Eye Movements Using Multi-way Autoregressive Model

Emotion Recognition from Eye Movements Using Multi-way Autor...

引用

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Tian-Fang Ma Xuan-Hao Liu Wei-Long Zheng Bao-Liang Lu Center for Brain-Like Computing and Machine Intelligence Department of Computer Science and Engineering Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798350386226

ISBN: (纸本)9798350386233

The application of physiological signals in emotion recognition is a popular research topic in human-computer interactions. Eye movement, as an important physiological signal, plays an essential role in medicine, psychology, cognitive science, and other scientific research fields. Previous studies have successfully identified human emotions by combining various eye-related measurements, selecting features, and utilizing machine learning techniques. However, the exploration of eye movement signals in emotion recognition remains insufficient. In this study, we utilize eye tracking heatmap and eye movement trajectory data for emotion recognition for the first time. Based on the two types of eye movement data, we develop a multi-way autoregressive model capable of processing multi-view eye movement data. Compared to traditional deep learning baseline models, our model better adapts to the structure of eye movement data and significantly improves the classification performance. Furthermore, we integrate heatmap and trajectory data with commonly used eye-related measurement features, which further enhance the performance of emotion recognition beyond previous methods.

关键词： Heating systems Emotion recognition Adaptation models Accuracy Psychology Gaze tracking Biomedical measurement Data models Physiology Trajectory

来源：评论

学校读者我要写书评

暂无评论

The applied principles of EEG analysis methods in neuroscience and clinical neurology

引用

Military Medical Research 2024年第6期11卷 907-941页

作者： Hao Zhang Qing-Qi Zhou He Chen Xiao-Qing Hu Wei-Guang Li Yang Bai Jun-Xia Han Yao Wang Zhen-Hu Liang Dan Chen Feng-Yu Cong Jia-Qing Yan Xiao-Li Li School of Systems Science Beijing Normal UniversityBeijing 100875China College of Electrical and Control Engineering North China University of TechnologyBeijing 100041China School of Automation Science and Engineering South China University of TechnologyGuangzhou 510641China Department of Psychology the State Key Laboratory of Brain and Cognitive Sciencesthe University of Hong KongHong Kong SAR 999077China HKU-Shenzhen Institute of Research and Innovation Shenzhen 518057GuangdongChina Department of Health Technology and Informatics the Hong Kong Polytechnic UniversityHong Kong SAR 999077China Department of Rehabilitation Medicine the First Afliated Hospital of Nanchang UniversityNanchang 330006China Rehabilitation Medicine Clinical Research Center of Jiangxi Province Nanchang 330006China Beijing Key Laboratory of Learning and Cognition School of PsychologyCapital Normal UniversityBeijing 100048China School of Communication Science Beijing Language and Culture UniversityBeijing 100083China Institute of Electrical Engineering Yanshan UniversityQinhuangdao 066004HebeiChina School of Computer Science Wuhan UniversityWuhan 430072China School of Biomedical Engineering Faculty of Electronic Information and Electrical EngineeringDalian University of TechnologyDalian 116081LiaoningChina Guangdong Artifcial Intelligence and Digital Economy Laboratory(Guangzhou) Guangzhou 510335China.

Electroencephalography(EEG)is a non-invasive measurement method for brain *** to its safety,high resolution,and hypersensitivity to dynamic changes in brain neural signals,EEG has aroused much interest in scientific research and medical *** article reviews the types of EEG signals,multiple EEG signal analysis methods,and the application of relevant methods in the neuroscience feld and for diagnosing neurological ***,3 types of EEG signals,including time-invariant EEG,accurate event-related EEG,and random event-related EEG,are ***,5 main directions for the methods of EEG analysis,including power spectrum analysis,time-frequency analysis,connectivity analysis,source localization methods,and machine learning methods,are described in the main section,along with diferent sub-methods and effect evaluations for solving the same ***,the application scenarios of different EEG analysis methods are emphasized,and the advantages and disadvantages of similar methods are *** article is expected to assist researchers in selecting suitable EEG analysis methods based on their research objectives,provide references for subsequent research,and summarize current issues and prospects for the future.

关键词： Electroencephalogram analysis methods Applied principles Neuroscience Diagnosis Neurological diseases

来源：评论

学校读者我要写书评

暂无评论

EEG-based Driver Drowsiness Classification via Calibration-Free Framework with Domain Generalization

EEG-based Driver Drowsiness Classification via Calibration-F...

引用

2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022

作者： Kim, Dong-Young Han, Dong-Kyun Jeong, Ji-Hoon Lee, Seong-Whan Korea University Dept. Artificial Intelligence Seoul Korea Republic of Korea University Dept. Brain and Cognitive Engineering Seoul Korea Republic of Chungbuk National University School of Computer Science Cheongju Korea Republic of

ISBN: (数字)9781665452588

ISBN: (纸本)9781665452588

Drowsy driving causes severe road traffic accidents and significantly threatens road driving. Recently, electroencephalogram (EEG)-based drowsiness state classification has gained attention in the field of brain-computer interface (BCI). Because of the inter-and intra-subject variability of EEG signals, EEG-based drowsiness state classification is still challenging in developing an estimator applicable to unseen subjects. Generally, calibration sessions are required to tune the model with subject-specific data. In this paper, we propose an EEG-based driver drowsiness state (i.e., alert and drowsy) classification framework that improves the generalization performance to unseen subjects. Style features of multi-domain instances are mixed to generate unseen domains, and the distance of labels within classes is minimized to learn robust representations. Experiments were conducted on EEG data acquired from a drowsy driving experiment in a simulated-driving environment. Our proposed framework achieved an accuracy of 77.26%, an F1-score of 0.6266, and a recall of 0.6813 across eleven subjects in leave-one-subject-out cross-validation. The experimental results showed an improvement in the generalization performance for novel target subjects in driver drowsiness state classification and demonstrated the potential for calibration-free BCI. © 2022 IEEE.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

Right Frontal Gamma Transcranial Alternating Current Stimulation Modulates Optimism Biases

引用

Neuroscience Bulletin 2025年第1期41卷 172-176页

作者： Ziqing Yao Jinwen Wei Gan Huang Linling Li Zhen Liang Li Zhang Haiyan Wu Tifei Yuan Zhiguo Zhang Xiaoqing Hu Department of Psychology The State Key Laboratory of Brain and Cognitive SciencesThe University of Hong KongHong KongSARChina School of Biomedical Engineering Medical SchoolShenzhen UniversityShenzhen518060China Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging Shenzhen UniversityShenzhen518060China Centre for Cognitive and Brain Sciences and Department of Psychology University of MacaoMacao SARChina Shanghai Key Laboratory of Psychotic Disorders Brain Health InstituteNational Center for Mental DisordersShanghai Mental Health CenterShanghai Jiaotong University School of MedicineShanghai210109China School of Computer Science and Technology Harbin Institute of TechnologyShenzhen518055China Peng Cheng Laboratory Shenzhen518055China HKU-Shenzhen Institute of Research and Innovation Shenzhen518063China

Dear Editor,People are often optimistic when forecasting the future,such that they believe they are less likely to encounter adverse life *** phenomenon,known as optimism bias,emerges due to preferential encoding and consolidation of desirable over undesirable information[1,2],engaging frontal brain regions such as the anterior cingulate cortex and inferior frontal gyrus[1].An optimism bias is instrumental in supporting mental health:reduction or absence of optimism biases is associated with mood disorders such as depression,characterized by pessimistic thinking about the future[3].This relationship highlights the potential value of interventions that could enhance optimism bias[4].

关键词： ism such likely

来源：评论

学校读者我要写书评

暂无评论

Learning to Escape: Multi-mode Policy Learning for the Traveling Salesmen Problem

Learning to Escape: Multi-mode Policy Learning for the Trave...

引用

IEEE Workshop on Evolving and Adaptive Intelligent Systems (EAIS)

作者： Myoung Hoon Ha Seunggeun Chi Sang Wan Lee Center for Neuroscience-inspired AI KAIST Daejeon Korea School of Electrical & Computer Engineering Purdue University West Lafayette USA Department of Brain Cognitive Science KAIST Daejeon Korea

ISBN: (数字)9798350366235

ISBN: (纸本)9798350366242

The traveling salesmen problem (TSP)-one of the most fundamental NP-hard problems in combinatorial optimization-has received considerable attention owing to its direct applicability to real-world routing. Recent studies on TSP have adopted a deep policy network to learn a stochastic acceptance rule. Despite its success in some cases, the structural and functional complexity of the deep policy networks makes it hard to explore the problem space while performing a local search at the same time. We found in our empirical analyses that searching processes are often stuck in the local region, leading to severe performance degradation. To tackle this issue, we propose a novel method for multi-mode policy learning. In the proposed method, a conventional exploration-exploitation scheme is reformulated as the problem of learning to escape from a local search area to induce exploration. We present a multi-mode Markov decision process, followed by policy and value design for local search and escaping modes. Experimental results show that the performance of the proposed method is superior to that of various baseline models, suggesting that the learned escaping policy allows the model to initiate a new local search in promising regions efficiently.

关键词： Degradation NP-hard problem Markov decision processes Stochastic processes Search problems Routing Space exploration

来源：评论

学校读者我要写书评

暂无评论

M(otion)-mode Based Prediction of Ejection Fraction using Echocardiograms

arXiv

引用

arXiv 2023年

作者： Ozkan, Ece Sutter, Thomas M. Hu, Yurong Balzer, Sebastian Vogt, Julia E. Department of Brain and Cognitive Sciences MIT United States Department of Computer Science ETH Zurich Switzerland Department of Information Technology and Electrical Engineering ETH Zurich Switzerland Department of Biosystems Science and Engineering ETH Zurich Switzerland

Early detection of cardiac dysfunction through routine screening is vital for diagnosing cardiovascular diseases. An important metric of cardiac function is the left ventricular ejection fraction (EF), where lower EF is associated with cardiomyopathy. Echocardiography is a popular diagnostic tool in cardiology, with ultrasound being a low-cost, real-time, and non-ionizing technology. However, human assessment of echocardiograms for calculating EF is time-consuming and expertise-demanding, raising the need for an automated approach. In this work, we propose using the M(otion)-mode of echocardiograms for estimating the EF and classifying cardiomyopathy. We generate multiple artificial M-mode images from a single echocardiogram and combine them using off-the-shelf model architectures. Additionally, we extend contrastive learning (CL) to cardiac imaging to learn meaningful representations from exploiting structures in unlabeled data allowing the model to achieve high accuracy, even with limited annotations. Our experiments show that the supervised setting converges with only ten modes and is comparable to the baseline method while bypassing its cumbersome training process and being computationally much more efficient. Furthermore, CL using M-mode images is helpful for limited data scenarios, such as having labels for only 200 patients, which is common in medical applications. © 2023, CC BY.

关键词： Echocardiography

来源：评论

学校读者我要写书评

暂无评论

Intrinsic dimension estimation using Wasserstein distance

引用

The Journal of Machine Learning Research 2022年第1期23卷 14124-14160页

作者： Adam Block Zeyu Jia Yury Polyanskiy Alexander Rakhlin Department of Mathematics Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology Department of Brain & Cognitive Sciences Statistics and Data Science Center Massachusetts Institute of Technology

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension of a given population distribution from a finite sample. We introduce a new estimator of the intrinsic dimension and provide finite sample, non-asymptotic guarantees. We then apply our techniques to get new sample complexity bounds for Generative Adversarial Networks (GANs) depending only on the intrinsic dimension of the data.

关键词： manifold hypothesis dimension estimation manifold learning intrinsic dimension Hölder GANs

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：