检索结果-内蒙古大学图书馆

1st IEEE international Symposium on Consumer Technology, ISCT 2024

作者： Rinartha, Komang Ku, Lun-Wei Social Networks and Human Centered Computing Program Taiwan International Graduate Program Institute of Information Science 128 Academia Road Sec. 2. Nangang Taipei115 Taiwan Institute of Information Science Academia Sinica Taipei Taiwan

ISBN: (纸本)9798350365191

Speech emotion recognition (SER) is a Machine Learning (ML) topic that is now receiving a lot of research attention. This can be attributed to its growing capacity, improvements in algorithms, and utilization in practical situations. Furthermore, speech contains not just auditory information but also lexical information. Both speech-based emotion recognition and text-based emotion recognition, called bimodal emotion recognition, can be highly beneficial for human interaction. Take an example, maintaining the communication between elder parents who are left behind after their children leave for education, employment, and family dynamics who can be greatly affected, both physically and emotionally, by feelings of loneliness and social isolation. Bimodal emotion recognition employs both text-based and audio-based methods to identify emotions. Each algorithm was trained separately and then combined using a late fusion technique. RoBERTa text-based emotion recognition can be combined with CNN audio-based emotion recognition by using late fusion to create a bimodal emotion recognition that can obtain more than 50% of accuracy by combining text and audio in a similar proportion or relying on text more than audio. By adjusting the proportion of text or audio emotion recognition, we can get better result of recognition and it can be customized by the user's preference. We elaborate on creating bimodal emotion recognition, conversational interface, a framework for emotion monitoring system, and give the example of a combined algorithm to perform emotion recognition. © 2024 IEEE.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Facial Landmark Generation in Violin Performance using 3DCNN network with Self Attention Model 48

Audio-Driven Facial Landmark Generation in Violin Performanc...

引用

48th IEEE international Conference on Acoustics, Speech and Signal Processing, ICASSP 2023

作者： Lin, Ting-Wei Liu, Chao-Lin Su, Li Taiwan International Graduate Program Social Networks and Human-Centered Computing Taiwan Academia Sinica Institute of Information Science Taipei Taiwan National Chengchi University Department of Computer Science Taipei Taiwan

ISBN: (纸本)9781728163277

In a music scenario, both auditory and visual elements are essential to achieve an outstanding performance. Recent research has focused on the generation of body movements or fingering from audio in music performance. The audio-driven face generation technique in music performance is still deficient. In this paper, we compile a violin soundtrack and facial expression dataset (VSFE) for modeling facial expressions in violin performance. To our knowledge, this is the first dataset mapping the relationship between violin performance audio and musicians' facial expressions. We then propose a 3DCNN network with self-attention and residual blocks for audio-driven facial expression generation. In the experiments, we compare our methods with three baselines on talking face generation. The codes and dataset are available on the Github (https://***/kevinlin91/icassp-music2face). © 2023 IEEE.

关键词： Music

来源：评论

学校读者我要写书评

暂无评论

On Efficient Processing of Queries for Live Multi-Streaming Soiree Organization

引用

IEEE Transactions on Services computing 2023年第4期16卷 2812-2826页

作者： Kankeu Fotsing, C.P. Shen, Chih-Ya Huang, Liang-Hao Chen, Yi-Shin Lee, Wang-Chien Yang, De-Nian International Graduate Program Academia Sinica Social Networks and Human-Centered Computing Program Taipei115 Taiwan National Tsing Hua University Institute of Information Systems and Applications Hsinchu300 Taiwan National Tsing Hua University Department of Computer Science Hsinchu300 Taiwan Academia Sinica Institute of Information Science Taipei115 Taiwan Pennsylvania State University Department of Computer Science and Engineering State CollegePA16801 United States

Real-time social interactions and multi-streaming are two critical features of live streaming services. In this paper, we formulate a new fundamental service query, social-aware Diverse and Preferred Organization Query (SDSQ), that jointly selects a set of diverse and preferred live streaming channels and a group of socially tight viewers for organization of a live multi-streaming soiree. We prove that SDSQ is NP-hard and inapproximable within any factor, and design SDSSel, a 2-approximation algorithm with a guaranteed error bound. Moreover, we study SDSQ-T, a special case of SDSQ, where the social graph is a threshold graph, and propose TDSSel, a 2-approximation algorithm without any error to SDSQ-T. We propose two pruning strategies, PCP and CDP to boost SDSSel and TDSSel. We further propose a more challenging but practical service query, Generalized social-aware Maximum Preferred and Diverse Query (GSPQ), a generalization of SDSQ. We design GPDSel, a 4-approximation algorithm for GSPQ with a guaranteed error bound. We propose a strategy to improve the approximation ratios of the proposed algorithms. A user study on Twitch validates SDSQ, and the large-scale experiments on real datasets demonstrate the superiority of the proposed algorithms over several baselines for live-streaming services. © 2008-2012 IEEE.

关键词： Approximation algorithms

来源：评论

学校读者我要写书评

暂无评论

TERMS: textual emotion recognition in multidimensional space

引用

Applied Intelligence 2023年第3期53卷 2673-2693页

作者： Ghafoor, Yusra Jinping, Shi Calderon, Fernando H. Huang, Yen-Hao Chen, Kuan-Ta Chen, Yi-Shin Social Networks and Human-Centered Computing Taiwan International Graduate Program Institute of Information Science Academia Sinica. Institute of Information Systems and Applications National Tsing Hua University Hsinchu City Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu City Taiwan Institute of Information Science Academia Sinica Taipei Taiwan Department of Computer Science National Tsing Hua University Hsinchu City Taiwan

Microblogs generate a vast amount of data in which users express their emotions regarding almost all aspects of everyday life. Capturing affective content from these context-dependent and subjective texts is a challenging task. We propose an intelligent probabilistic model for textual emotion recognition in multidimensional space (TERMS) that captures the subjective emotional boundaries and contextual information embedded in a text for robust emotion recognition. It is implausible with discrete label assignment;therefore, the model employs a soft assignment by mapping varying emotional perceptions in a multidimensional space and generates them as distributions via the Gaussian mixture model (GMM). To strengthen emotion distributions, TERMS integrates a probabilistic emotion classifier that captures the contextual and linguistic information from texts. The integration of these aspects, the context-aware emotion classifier and the learned GMM parameters provide a complete coverage for accurate emotion recognition. The large-scale experimentation shows that compared to baseline and state-of-the-art models, TERMS achieved better performance in terms of distinguishability, prediction, and classification performance. In addition, TERMS provide insights on emotion classes, the annotation patterns, and the models application in different scenarios. © 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Text and Speech Adjustable Bimodal Emotion Recognition in Conversational Interface

Text and Speech Adjustable Bimodal Emotion Recognition in Co...

引用

IEEE international Symposium on Consumer Electronics (ISCE)

作者： Komang Rinartha Lun-Wei Ku Social Networks and Human Centered Computing Program Taiwan International Graduate Program Institute of Information Science Nangang Taipei Taiwan Institute of Information Science Academia Sinica Taipei Taiwan

ISBN: (数字)9798350365191

ISBN: (纸本)9798350365207

关键词： Emotion recognition Accuracy Machine learning algorithms Text recognition Computational modeling Heuristic algorithms Speech recognition Machine learning Real-time systems Monitoring

来源：评论

学校读者我要写书评

暂无评论

Learning Adaptation and Generalization from human-Inspired Meta-Reinforcement Learning Using Bayesian Knowledge and Analysis 6

Learning Adaptation and Generalization from Human-Inspired M...

引用

6th IEEE international Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2023

作者： Ho, Joshua Wang, Chien-Min King, Chung-Ta You, Yi-Hsin Feng, Chi-Wei Chen, Yen-Min Kuo, Bo-Yi Institute of Information Science Academia Sinica Taipei11529 Taiwan Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan Department of Computer Science National Tsing Hua University Hsinchu30013 Taiwan Department of Computer Science National Taiwan University Taipei10631 Taiwan Center of Intelligent Healthcare National Taiwan University Hospital Taipei10022 Taiwan

ISBN: (纸本)9798350331288

Over the last decades, there has been growing interest in research in multiple and interdisciplinary fields of human-AI computing. In particular, approaches integrating the intersecting design with reinforcement learning (RL) have received more attention. However, the current research on RL may need to consider its enhancement from a humaninspired approach further. In the present work, we focus on enabling a meta-reinforcement learning (meta-RL) agent to achieve adaptation and generalization according to modeling Markov decision processes using Bayesian knowledge and analysis. By introducing a novel framework called human-inspired meta-RL (HMRL), we incorporate the agent performing resilient actions to leverage the dynamic dense reward based on the knowledge and prediction of a Bayesian analysis. The proposed framework can make the agent learn generalization and prevent the agent from failing catastrophically. The experimental results show that our approach helps the agent reduce computational costs with learning adaptation. Finally, we conclude and anticipate that integrating human-inspired meta-RL can enable learning more formulations relating to robustness and scalability, leading to promising directions and more complex AI goals in the future. © 2023 IEEE.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

Audio-Driven Facial Landmark Generation in Violin Performance using 3DCNN network with Self Attention Model

Audio-Driven Facial Landmark Generation in Violin Performanc...

引用

international Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Ting-Wei Lin Chao-Lin Liu Li Su Social Networks and Human-Centered Computing Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei Taiwan Department of Computer Science National Chengchi University Taipei Taiwan

In a music scenario, both auditory and visual elements are essential to achieve an outstanding performance. Recent research has focused on the generation of body movements or fingering from audio in music performance. The audio-driven face generation technique in music performance is still deficient. In this paper, we compile a violin soundtrack and facial expression dataset (VSFE) for modeling facial expressions in violin performance. To our knowledge, this is the first dataset mapping the relationship between violin performance audio and musicians’ facial expressions. We then propose a 3DCNN network with self-attention and residual blocks for audio-driven facial expression generation. In the experiments, we compare our methods with three baselines on talking face generation. The codes and dataset are available on the Github (https://***/kevinlin91/icassp_music2face).

关键词： Visualization Codes Avatars Signal processing Acoustics Multiple signal classification Speech processing

来源：评论

学校读者我要写书评

暂无评论

Influence of land-sea breeze on PM _2.5 prediction in central and southern taiwan using composite neural network

引用

Scientific Reports 2023年第1期13卷 1-9页

作者： Kibirige, George William Huang, Chiao Cheng Liu, Chao Lin Chen, Meng Chang Institute of Information Science Academia Sinica New Taipei Taiwan Social Networks and Human Centered Computing Program Taiwan International Graduate Program New Taipei Taiwan National Chengchi University New Taipei Taiwan

PM2.5 prediction plays an important role for governments in establishing policies to control the emission of excessive atmospheric pollutants to protect the health of citizens. However, traditional machine learning me...

PM_2.5 prediction plays an important role for governments in establishing policies to control the emission of excessive atmospheric pollutants to protect the health of citizens. However, traditional machine learning methods that use data collected from ground-level monitoring stations have reached their limit with poor model generalization and insufficient data. We propose a composite neural network trained with aerosol optical depth (AOD) and weather data collected from satellites, as well as interpolated ocean wind features. We investigate the model outputs of different components of the composite neural network, concluding that the proposed composite neural network architecture yields significant improvements in overall performance compared to each component and the ensemble model benchmarks. The monthly analysis also demonstrates the superiority of the proposed architecture for stations where land-sea breezes frequently occur in the southern and central taiwan in the months when land-sea breeze dominates the accumulation of PM_2.5. © 2023, The Author(s).

关键词：

来源：评论

学校读者我要写书评

暂无评论

Boosting Patch Correctness Checking via Combining Code-Edit Embeddings as Additional What-to-Change Information

Boosting Patch Correctness Checking via Combining Code-Edit ...

引用

IEEE WIC ACM international Conference on Web Intelligence (WI)

作者： Chontipan Plengvittaya Zee Hen Tang Mi-Yen Yeh Chih-Ya Shen Social Networks and Human Centered Computing Taiwan International Graduate Program Taiwan Institute of Information Science Academia Sinica Taiwan Institute of Information Systems and Applications National Tsing Hua University Taiwan Data Science Degree Program National Taiwan University and Academia Sinica Taiwan

Patch Correctness Checking is the task of detecting automated-program-repair-generated patches that can pass the test suite but are still buggy. In this study, we investigated a new feature to improve the classification performance for automated patch correctness checking. Our approach involved leveraging code-change information at a finer granular level by embedding the code edits and combining them with existing code-change vectors. Through extensive experiments, the results revealed gains up to 3.4% and 3.2% on the Fl-score and AUC.

关键词：

来源：评论

学校读者我要写书评

暂无评论

TEAM: Task-Clustering and Enhanced Adaptability for Meta-Reinforcement Learning on Robotics Through Multi-Task Diffusion and Optimization

TEAM: Task-Clustering and Enhanced Adaptability for Meta-Rei...

引用

IEEE international Conference on Robotic computing (IRC)

作者： Joshua Ho Chien-Min Wang Chung-Ta King Chi-Wei Feng Shih-Yun Sunkuan Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu Taiwan Department of Computer Science National Tsing Hua University Hsinchu Taiwan Department of Electrical Engineering National Taiwan University Taipei Taiwan

ISBN: (数字)9798331521554

ISBN: (纸本)9798331521561

The ability of robots to imitate human learning strategies-rapidly adapting to new tasks without large datasets-has garnered significant attention in meta-learning. Meta-reinforcement learning seeks to enhance robotic agent flexibility across diverse tasks and contexts, offering promise where single-task learning often fails. Despite advancements like multi-task diffusion models and task-weighted optimization mechanisms, effectively training tasks with varying complexities simultaneously remains a major challenge. This paper introduces a novel meta-reinforcement learning method that addresses this issue by clustering the training tasks of robotic arms based on semantic and trajectory similarities, while leveraging adaptive learning rates and task-specific weights proposed by the multitask optimization techniques. Our approach, TEAM, emphasizes performance-driven semantic clustering, optimizing based on robotic task similarity, complexity, and convergence objectives. We also integrate fast adaptive and multi-task optimization of the diffusion model to enhance computational efficiency and adaptability. More specifically, we introduce a cluster-specific optimization technique, using specialized parameters for each group to allow more refined task handling. The experimental validation demonstrates the effectiveness of this scalable method in improving performance, adaptability, and efficiency in real-world, heterogeneous robotic tasks, further advancing robotic computing in meta-reinforcement learning.

关键词： Training Metalearning program processors Semantics Multitasking Diffusion models Complexity theory Trajectory Robots Optimization

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：