检索结果-内蒙古大学图书馆

Data Collection and Real-Time Facial Emotion Recognition in iOS Apps with CNN-Based Models

学校读者我要写书评

暂无评论

Data Collection and Real-Time Facial Emotion Recognition in ...

AI IoT Congress (AIIoT), World

作者： Damian Valles Lois Adrianne R. Umali Thomas Paveglio Josiah N. Brinson Mohammed Hyder Gavin E. Jackson Dylan Hall John W. Farrell Yumeng Li Semih Aslan Maria D. Resendiz Ting Liu Ingram School of Engineering Texas State University San Marcos TX USA Department of Communication Disorders Texas State University Round Rock TX USA Department of Physics Wake Forest University Winston-Salem NC USA Department of Mathematics and Computer Science Rhodes College Memphis TN USA Department of Computer Science Texas State University San Marcos TX USA Department of Health and Human Performance Texas State University San Marcos TX USA

This study analyzes and compares deep learning models, including Naïve-CNN, VGG16, EfficientNetV2, and MobileNetV2, for facial emotion recognition using the FER2013, and collected Zoom datasets are presented. The paper discusses the data collection of human subjects over Zoom to gather quality samples for the seven emotions targeted with the classifiers. Preprocessing steps are considered to enhance histogram information, brightness contrast, and augmentation of both datasets. The performance of these models was evaluated based on their accuracy, precision, recall, and F1-score. An iOS app was developed to test the trained models in real-time with YouTube videos. The Naïve-CNN and VGG16 models demonstrated the highest performance, while the EfficientNetV2 and MobileNetV2 models showed potential for further improvement during training and testing. The iOS app implementation showed the expected weak results of the trained models but observed capacities that the model provided for actual utilization on mobile devices. The work provides valuable insights into the challenges faced by deep learning CNN-based models for facial emotion recognition and suggests directions for future research.

关键词：

Efficient Training of Neural Transducer for Speech Recognition

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhou, Wei Michel, Wilfried Schlüter, Ralf Ney, Hermann Human Language Technology and Pattern Recognition Computer Science Department RWTH Aachen University Aachen52074 Germany AppTek GmbH Aachen52062 Germany

As one of the most popular sequence-to-sequence modeling approaches for speech recognition, the RNN-Transducer has achieved evolving performance with more and more sophisticated neural network models of growing size and increasing training epochs. While strong computation resources seem to be the prerequisite of training superior models, we try to overcome it by carefully designing a more efficient training pipeline. In this work, we propose an efficient 3-stage progressive training pipeline to build highly-performing neural transducer models from scratch with very limited computation resources in a reasonable short time period. The effectiveness of each stage is experimentally verified on both Librispeech and Switchboard corpora. The proposed pipeline is able to train transducer models approaching state-of-the-art performance with a single GPU in just 2-3 weeks. Our best conformer transducer achieves 4.1% WER on Librispeech test-other with only 35 epochs of training. Copyright © 2022, The Authors. All rights reserved.

关键词： Speech recognition

LATTICE-FREE SEQUENCE DISCRIMINATIVE TRAINING FOR PHONEME-BASED NEURAL TRANSDUCERS

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yang, Zijian Zhou, Wei Schlüter, Ralf Ney, Hermann Human Language Technology and Pattern Recognition Computer Science Department RWTH Aachen University Aachen52074 Germany AppTek GmbH Aachen52062 Germany

Recently, RNN-Transducers have achieved remarkable results on various automatic speech recognition tasks. However, lattice-free sequence discriminative training methods, which obtain superior performance in hybrid models, are rarely investigated in RNN-Transducers. In this work, we propose three lattice-free training objectives, namely lattice-free maximum mutual information, lattice-free segment-level minimum Bayes risk, and lattice-free minimum Bayes risk, which are used for the final posterior output of the phoneme-based neural transducer with a limited context dependency. Compared to criteria using N-best lists, lattice-free methods eliminate the decoding step for hypotheses generation during training, which leads to more efficient training. Experimental results show that lattice-free methods gain up to 6.5% relative improvement in word error rate compared to a sequence-level cross-entropy trained model. Compared to the N-best-list based minimum Bayes risk objectives, lattice-free methods gain 40% - 70% relative training time speedup with a small degradation in performance. Copyright © 2022, The Authors. All rights reserved.

关键词： Transducers

Algorithmic Mirror: Designing an Interactive Tool to Promote Self-Reflection for YouTube Recommendations

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Kondo, Yui Dunnell, Kevin Xiao, Qing Zhao, Jun Rocher, Luc Oxford Internet Institute University of Oxford United Kingdom MIT Media Lab Massachusetts Institute of Technology United States Human-Computer Interaction Institute Carnegie Mellon University United States Department of Computer Science University of Oxford United Kingdom

Big Data analytics and Artificial Intelligence systems derive non-intuitive and often unverifiable inferences about individuals’ behaviors, preferences, and private lives. Drawing on diverse, feature-rich datasets of unpredictable value, these systems erode the intuitive connection between our actions and how we are perceived, diminishing control over our digital identities. While Explainable Artificial Intelligence scholars have attempted to explain the inner workings of algorithms, their visualizations frequently overwhelm end-users with complexity. This research introduces ‘hypothetical inference’—a novel approach that uses language models to simulate how algorithms might interpret users’ digital footprints and infer personal characteristics without requiring access to proprietary platform algorithms. Through empirical studies with fourteen adult participants, we identified three key design opportunities to foster critical algorithmic literacy: (1) reassembling scattered digital footprints into a unified map, (2) simulating algorithmic inference through LLM-generated interpretations, and (3) incorporating temporal dimensions to visualize evolving patterns. This research lays the groundwork for tools that can help users recognize the influence of data on platforms and develop greater autonomy in increasingly algorithm-mediated digital environments. Copyright © 2025, The Authors. All rights reserved.

关键词： Video analysis

Towards expert gaze modeling and recognition of a user’s attention in realtime

学校读者我要写书评

暂无评论

Procedia computer science 2020年 176卷 2020-2029页

作者： Nora Castner Lea Geßler David Geisler Fabian Hüttig Enkelejda Kasneci Human-Computer Interaction University of Tübingen Germany Institute of Computer Science University of Tübingen Germany Department of Prosthodontics University Hospital Tübingen Germany

One of the appealing areas of expertise research is devoted to measuring the effectiveness of training programs for novices. With recent progress in eye tracking, gaze-based interaction systems recognize a user’s attention and can direct it accordingly. Moreover, dynamic visualization of an expert gaze model facilitates novice training by guiding the gaze to relevant areas. In addition, the system should be aware of realtime attention to remove an overlay that could occlude relevant information. We use an implementation of subtle gaze direction (SGD) and the simplified scanpath of a dentist to train naive participants in finding anomalies in dental radiographs. We were able to effectively direct user gaze to relevant image features without occluding the area when attention was recognized. Additionally, participants reported that the intervention was helpful for image inspection. The results of the model intervention show minimal improvements in anomaly detection, which is expected of naive subjects. We advocate that the system has the potential to be highly effective for advanced students and trainees with a certain foundation of conceptual knowledge.

关键词： Eye Tracking Gaze-based interaction Attention Guiding Expertise Learning

MONOTONIC SEGMENTAL ATTENTION FOR AUTOMATIC SPEECH RECOGNITION

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zeyer, Albert Schmitt, Robin Zhou, Wei Schlüter, Ralf Ney, Hermann Human Language Technology and Pattern Recognition Computer Science Department RWTH Aachen University Aachen52062 Germany AppTek GmbH Aachen52062 Germany

We introduce a novel segmental-attention model for automatic speech recognition. We restrict the decoder attention to segments to avoid quadratic runtime of global attention, better generalize to long sequences, and eventually enable streaming. We directly compare global-attention and different segmental-attention modeling variants. We develop and compare two separate time-synchronous decoders, one specifically taking the segmental nature into account, yielding further improvements. Using time-synchronous decoding for segmental models is novel and a step towards streaming applications. Our experiments show the importance of a length model to predict the segment boundaries. The final best segmental-attention model using segmental decoding performs better than global-attention, in contrast to other monotonic attention approaches in the literature. Further, we observe that the segmental model generalizes much better to long sequences of up to several minutes. © 2022, CC BY-SA.

关键词： Decoding

Improving the Training Recipe for a Robust Conformer-based Hybrid Model

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zeineldeen, Mohammad Xu, Jingjing Lüscher, Christoph Schlüter, Ralf Ney, Hermann Human Language Technology and Pattern Recognition Computer Science Department RWTH Aachen University Aachen52074 Germany AppTek GmbH Aachen52062 Germany

Speaker adaptation is important to build robust automatic speech recognition (ASR) systems. In this work, we investigate various methods for speaker adaptive training (SAT) based on feature-space approaches for a conformer-based acoustic model (AM) on the Switchboard 300h dataset. We propose a method, called Weighted-Simple-Add, which adds weighted speaker information vectors to the input of the multi-head self-attention module of the conformer AM. Using this method for SAT, we achieve 3.5% and 4.5% relative improvement in terms of WER on the CallHome part of Hub5'00 and Hub5'01 respectively. Moreover, we build on top of our previous work where we proposed a novel and competitive training recipe for a conformer-based hybrid AM. We extend and improve this recipe where we achieve 11% relative improvement in terms of word-error-rate (WER) on Switchboard 300h Hub5'00 dataset. We also make this recipe efficient by reducing the total number of parameters by 34% relative. Copyright © 2022, The Authors. All rights reserved.

关键词： Speech recognition

Language Model Pre-training on True Negatives

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhang, Zhuosheng Zhao, Hai Utiyama, Masao Sumita, Eiichiro Department of Computer Science and Engineering Shanghai Jiao Tong University China Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai Jiao Tong University Shanghai China Kyoto Japan

Discriminative pre-trained language models (PLMs) learn to predict original texts from intentionally corrupted ones. Taking the former text as positive and the latter as negative samples, the PLM can be trained effectively for contextualized representation. However, the training of such a type of PLMs highly relies on the quality of the automatically constructed samples. Existing PLMs simply treat all corrupted texts as equal negative without any examination, which actually lets the resulting model inevitably suffer from the false negative issue where training is carried out on pseudo-negative data and leads to less efficiency and less robustness in the resulting PLMs. In this work, on the basis of defining the false negative issue in discriminative PLMs that has been ignored for a long time, we design enhanced pre-training methods to counteract false negative predictions and encourage pre-training language models on true negatives by correcting the harmful gradient updates subject to false negative predictions. Experimental results on GLUE and SQuAD benchmarks show that our counter-false-negative pre-training methods indeed bring about better performance together with stronger robustness. Copyright © 2022, The Authors. All rights reserved.

关键词： Forecasting

Reducing Uncertainty and Offering Comfort: Designing Technology for Coping with Interpersonal Racism 21

学校读者我要写书评

暂无评论

Reducing Uncertainty and Offering Comfort: Designing Technol...

Proceedings of the 2021 CHI Conference on human Factors in Computing Systems

作者： Alexandra To Hillary Carey Geoff Kaufman Jessica Hammer Art + Design and Khoury College of Computer Science Northeastern University United States School of Design Carnegie Mellon University United States Human-Computer Interaction Institute Carnegie Mellon University United States

ISBN: (纸本)9781450380966

Ranging from subtle to overt, unintentional to systemic, navigating racism is additional everyday work for many people. Yet the needs of people who experience racism have been overlooked as a fertile ground for better technology. Through a series of workshops we call Foundational Fiction, we engaged BIPOC (Black, Indigenous, People of Color) in participatory design to identify qualities of technology that can support people coping before, during, and after a racist interaction. Participants developed storyboards for digital tools that offer advice, predict consequences, identify racist remarks and intervene, educate both targets and perpetrators about interpersonal and systemic racism, and more. In the paper we present our workshop method utilizing interactive fiction, participants’ design concepts, prevalent themes (reducing uncertainty and offering comfort), and we provide critical analysis of the complexity of technology in these contexts. This work identifies specific opportunities for exploring anti-racist social tools.

关键词： interactive fiction design workshops microaggressions participatory design racism uncertainty