检索结果-内蒙古大学图书馆

1st IEEE International Symposium on Consumer Technology, ISCT 2024

作者： Rinartha, Komang Ku, Lun-Wei Social Networks and Human Centered Computing Program Taiwan International Graduate Program Institute of Information Science 128 Academia Road Sec. 2. Nangang Taipei115 Taiwan Institute of Information Science Academia Sinica Taipei Taiwan

ISBN: (纸本)9798350365191

Speech emotion recognition (SER) is a Machine Learning (ML) topic that is now receiving a lot of research attention. This can be attributed to its growing capacity, improvements in algorithms, and utilization in practical situations. Furthermore, speech contains not just auditory information but also lexical information. Both speech-based emotion recognition and text-based emotion recognition, called bimodal emotion recognition, can be highly beneficial for human interaction. Take an example, maintaining the communication between elder parents who are left behind after their children leave for education, employment, and family dynamics who can be greatly affected, both physically and emotionally, by feelings of loneliness and social isolation. Bimodal emotion recognition employs both text-based and audio-based methods to identify emotions. Each algorithm was trained separately and then combined using a late fusion technique. RoBERTa text-based emotion recognition can be combined with CNN audio-based emotion recognition by using late fusion to create a bimodal emotion recognition that can obtain more than 50% of accuracy by combining text and audio in a similar proportion or relying on text more than audio. By adjusting the proportion of text or audio emotion recognition, we can get better result of recognition and it can be customized by the user's preference. We elaborate on creating bimodal emotion recognition, conversational interface, a framework for emotion monitoring system, and give the example of a combined algorithm to perform emotion recognition. © 2024 IEEE.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Facial Landmark Generation in Violin Performance using 3DCNN Network with Self Attention Model 48

Audio-Driven Facial Landmark Generation in Violin Performanc...

引用

48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Lin, Ting-Wei Liu, Chao-Lin Su, Li Taiwan International Graduate Program Social Networks and Human-Centered Computing Taiwan Academia Sinica Institute of Information Science Taipei Taiwan National Chengchi University Department of Computer Science Taipei Taiwan

ISBN: (纸本)9781728163277

In a music scenario, both auditory and visual elements are essential to achieve an outstanding performance. Recent research has focused on the generation of body movements or fingering from audio in music performance. The audio-driven face generation technique in music performance is still deficient. In this paper, we compile a violin soundtrack and facial expression dataset (VSFE) for modeling facial expressions in violin performance. To our knowledge, this is the first dataset mapping the relationship between violin performance audio and musicians' facial expressions. We then propose a 3DCNN network with self-attention and residual blocks for audio-driven facial expression generation. In the experiments, we compare our methods with three baselines on talking face generation. The codes and dataset are available on the Github (https://***/kevinlin91/icassp-music2face). © 2023 IEEE.

关键词： Music

来源：评论

学校读者我要写书评

暂无评论

Text and Speech Adjustable Bimodal Emotion Recognition in Conversational Interface

Text and Speech Adjustable Bimodal Emotion Recognition in Co...

引用

IEEE International Symposium on Consumer Electronics (ISCE)

作者： Komang Rinartha Lun-Wei Ku Social Networks and Human Centered Computing Program Taiwan International Graduate Program Institute of Information Science Nangang Taipei Taiwan Institute of Information Science Academia Sinica Taipei Taiwan

ISBN: (数字)9798350365191

ISBN: (纸本)9798350365207

关键词： Emotion recognition Accuracy Machine learning algorithms Text recognition Computational modeling Heuristic algorithms Speech recognition Machine learning Real-time systems Monitoring

来源：评论

学校读者我要写书评

暂无评论

On Efficient Processing of Queries for Live Multi-Streaming Soiree Organization

引用

IEEE Transactions on Services computing 2023年第4期16卷 2812-2826页

作者： Kankeu Fotsing, C.P. Shen, Chih-Ya Huang, Liang-Hao Chen, Yi-Shin Lee, Wang-Chien Yang, De-Nian International Graduate Program Academia Sinica Social Networks and Human-Centered Computing Program Taipei115 Taiwan National Tsing Hua University Institute of Information Systems and Applications Hsinchu300 Taiwan National Tsing Hua University Department of Computer Science Hsinchu300 Taiwan Academia Sinica Institute of Information Science Taipei115 Taiwan Pennsylvania State University Department of Computer Science and Engineering State CollegePA16801 United States

Real-time social interactions and multi-streaming are two critical features of live streaming services. In this paper, we formulate a new fundamental service query, social-aware Diverse and Preferred Organization Query (SDSQ), that jointly selects a set of diverse and preferred live streaming channels and a group of socially tight viewers for organization of a live multi-streaming soiree. We prove that SDSQ is NP-hard and inapproximable within any factor, and design SDSSel, a 2-approximation algorithm with a guaranteed error bound. Moreover, we study SDSQ-T, a special case of SDSQ, where the social graph is a threshold graph, and propose TDSSel, a 2-approximation algorithm without any error to SDSQ-T. We propose two pruning strategies, PCP and CDP to boost SDSSel and TDSSel. We further propose a more challenging but practical service query, Generalized social-aware Maximum Preferred and Diverse Query (GSPQ), a generalization of SDSQ. We design GPDSel, a 4-approximation algorithm for GSPQ with a guaranteed error bound. We propose a strategy to improve the approximation ratios of the proposed algorithms. A user study on Twitch validates SDSQ, and the large-scale experiments on real datasets demonstrate the superiority of the proposed algorithms over several baselines for live-streaming services. © 2008-2012 IEEE.

关键词： Approximation algorithms

来源：评论

学校读者我要写书评

暂无评论

Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning 30th

Adversarially Robust Deepfake Detection via Adversarial Fea...

引用

30th International Conference on MultiMedia Modeling, MMM 2024

作者： Khan, Sarwar Chen, Jun-Cheng Liao, Wen-Hung Chen, Chu-Song Research Center for Information Technology Innovation Academia Sinica Taipei Taiwan Social Networks Human-Centered Computing TIGP Academia Sinica Taipei Taiwan Computer Science National Chengchi University Taipei Taiwan Computer Science and Information Engineering National Taiwan University Taipei Taiwan

ISBN: (纸本)9783031533105

Deepfake technology has raised concerns about the authenticity of digital content, necessitating the development of effective detection methods. However, the widespread availability of deepfakes has given rise to a new challenge in the form of adversarial attacks. Adversaries can manipulate deepfake videos with small, imperceptible perturbations that can deceive the detection models into producing incorrect outputs. To tackle this critical issue, we introduce Adversarial Feature Similarity Learning (AFSL), which integrates three fundamental deep feature learning paradigms. By optimizing the similarity between samples and weight vectors, our approach aims to distinguish between real and fake instances. Additionally, we aim to maximize the similarity between both adversarially perturbed examples and unperturbed examples, regardless of their real or fake nature. Moreover, we introduce a regularization technique that maximizes the dissimilarity between real and fake samples, ensuring a clear separation between these two categories. With extensive experiments on popular deepfake datasets, including FaceForensics++, FaceShifter, and DeeperForensics, the proposed method outperforms other standard adversarial training-based defense methods significantly. This further demonstrates the effectiveness of our approach to protecting deepfake detectors from adversarial attacks. © 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

TERMS: textual emotion recognition in multidimensional space

引用

Applied Intelligence 2023年第3期53卷 2673-2693页

作者： Ghafoor, Yusra Jinping, Shi Calderon, Fernando H. Huang, Yen-Hao Chen, Kuan-Ta Chen, Yi-Shin Social Networks and Human-Centered Computing Taiwan International Graduate Program Institute of Information Science Academia Sinica. Institute of Information Systems and Applications National Tsing Hua University Hsinchu City Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu City Taiwan Institute of Information Science Academia Sinica Taipei Taiwan Department of Computer Science National Tsing Hua University Hsinchu City Taiwan

Microblogs generate a vast amount of data in which users express their emotions regarding almost all aspects of everyday life. Capturing affective content from these context-dependent and subjective texts is a challenging task. We propose an intelligent probabilistic model for textual emotion recognition in multidimensional space (TERMS) that captures the subjective emotional boundaries and contextual information embedded in a text for robust emotion recognition. It is implausible with discrete label assignment;therefore, the model employs a soft assignment by mapping varying emotional perceptions in a multidimensional space and generates them as distributions via the Gaussian mixture model (GMM). To strengthen emotion distributions, TERMS integrates a probabilistic emotion classifier that captures the contextual and linguistic information from texts. The integration of these aspects, the context-aware emotion classifier and the learned GMM parameters provide a complete coverage for accurate emotion recognition. The large-scale experimentation shows that compared to baseline and state-of-the-art models, TERMS achieved better performance in terms of distinguishability, prediction, and classification performance. In addition, TERMS provide insights on emotion classes, the annotation patterns, and the models application in different scenarios. © 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Boosting Patch Correctness Checking via Combining Code-Edit Embeddings as Additional What-To-Change Information 22

Boosting Patch Correctness Checking via Combining Code-Edit ...

引用

22nd IEEE/WIC International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)

作者： Plengvittaya, Chontipan Tang, Zee Hen Yeh, Mi-Yen Shen, Chih-Ya Taiwan Int Grad Program Social Networks & Human Centered Comp Taipei Taiwan Natl Taiwan Univ & Acad Sinica Data Sci Degree Program Taipei Taiwan Acad Sinica Inst Informat Sci Taipei Taiwan Natl Tsing Hua Univ Inst Informat Syst & Applicat Taipei Taiwan

ISBN: (纸本)9798350309188

Patch Correctness Checking is the task of detecting automated-program-repair-generated patches that can pass the test suite but are still buggy. In this study, we investigated a new feature to improve the classification performance for automated patch correctness checking. Our approach involved leveraging code-change information at a finer granular level by embedding the code edits and combining them with existing code-change vectors. Through extensive experiments, the results revealed gains up to 3.4% and 3.2% on the F1-score and AUC.

关键词： Patch Correctness Checking Code Edits Code Changes Feature Combination

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Facial Landmark Generation in Violin Performance using 3DCNN Network with Self Attention Model

Audio-Driven Facial Landmark Generation in Violin Performanc...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Ting-Wei Lin Chao-Lin Liu Li Su Social Networks and Human-Centered Computing Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei Taiwan Department of Computer Science National Chengchi University Taipei Taiwan

In a music scenario, both auditory and visual elements are essential to achieve an outstanding performance. Recent research has focused on the generation of body movements or fingering from audio in music performance. The audio-driven face generation technique in music performance is still deficient. In this paper, we compile a violin soundtrack and facial expression dataset (VSFE) for modeling facial expressions in violin performance. To our knowledge, this is the first dataset mapping the relationship between violin performance audio and musicians’ facial expressions. We then propose a 3DCNN network with self-attention and residual blocks for audio-driven facial expression generation. In the experiments, we compare our methods with three baselines on talking face generation. The codes and dataset are available on the Github (https://***/kevinlin91/icassp_music2face).

关键词： Visualization Codes Avatars Signal processing Acoustics Multiple signal classification Speech processing

来源：评论

学校读者我要写书评

暂无评论

Adversarially Robust Deepfake Detection via Adversarial Feature Similarity Learning

arXiv

引用

arXiv 2024年

作者： Khan, Sarwar Chen, Jun-Cheng Liao, Wen-Hung Chen, Chu-Song Research Center for Information Technology Innovation Academia Sinica Taiwan Social Networks Human-Centered Computing TIGP Academia Sinica Taiwan National Chengchi University Taiwan National Taiwan University Taiwan

Deepfake technology has raised concerns about the authenticity of digital content, necessitating the development of effective detection methods. However, the widespread availability of deepfakes has given rise to a new challenge in the form of adversarial attacks. Adversaries can manipulate deepfake videos with small, imperceptible perturbations that can deceive the detection models into producing incorrect outputs. To tackle this critical issue, we introduce Adversarial Feature Similarity Learning (AFSL), which integrates three fundamental deep feature learning paradigms. By optimizing the similarity between samples and weight vectors, our approach aims to distinguish between real and fake instances. Additionally, we aim to maximize the similarity between both adversarially perturbed examples and unperturbed examples, regardless of their real or fake nature. Moreover, we introduce a regularization technique that maximizes the dissimilarity between real and fake samples, ensuring a clear separation between these two categories. With extensive experiments on popular deepfake datasets, including FaceForensics++, FaceShifter, and DeeperForensics, the proposed method outperforms other standard adversarial training-based defense methods significantly. This further demonstrates the effectiveness of our approach to protecting deepfake detectors from adversarial attacks. Copyright © 2024, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Learning Adaptation and Generalization from human-Inspired Meta-Reinforcement Learning Using Bayesian Knowledge and Analysis 6

Learning Adaptation and Generalization from Human-Inspired M...

引用

6th IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2023

作者： Ho, Joshua Wang, Chien-Min King, Chung-Ta You, Yi-Hsin Feng, Chi-Wei Chen, Yen-Min Kuo, Bo-Yi Institute of Information Science Academia Sinica Taipei11529 Taiwan Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan Department of Computer Science National Tsing Hua University Hsinchu30013 Taiwan Department of Computer Science National Taiwan University Taipei10631 Taiwan Center of Intelligent Healthcare National Taiwan University Hospital Taipei10022 Taiwan

ISBN: (纸本)9798350331288

Over the last decades, there has been growing interest in research in multiple and interdisciplinary fields of human-AI computing. In particular, approaches integrating the intersecting design with reinforcement learning (RL) have received more attention. However, the current research on RL may need to consider its enhancement from a humaninspired approach further. In the present work, we focus on enabling a meta-reinforcement learning (meta-RL) agent to achieve adaptation and generalization according to modeling Markov decision processes using Bayesian knowledge and analysis. By introducing a novel framework called human-inspired meta-RL (HMRL), we incorporate the agent performing resilient actions to leverage the dynamic dense reward based on the knowledge and prediction of a Bayesian analysis. The proposed framework can make the agent learn generalization and prevent the agent from failing catastrophically. The experimental results show that our approach helps the agent reduce computational costs with learning adaptation. Finally, we conclude and anticipate that integrating human-inspired meta-RL can enable learning more formulations relating to robustness and scalability, leading to promising directions and more complex AI goals in the future. © 2023 IEEE.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：