检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Shahzad, Sahibzada Adil Hashmi, Ammarah Peng, Yan-Tsung Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan The Department of Computer Science National Chengchi University Taipei11605 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Multimodal manipulations (also known as audiovisual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial. The damage to either modality (i.e., visual or audio) can only be discovered through multi-modal models that can exploit both pieces of information simultaneously. Previous methods mainly adopt uni-modal video forensics and use supervised pre-training for forgery detection. This study proposes a new method based on a multi-modal self-supervised-learning (SSL) feature extractor to exploit inconsistency between audio and visual modalities for multi-modal video forgery detection. We use the transformer-based SSL pre-trained Audio-Visual HuBERT (AV-HuBERT) model as a visual and acoustic feature extractor and a multi-scale temporal convolutional neural network to capture the temporal correlation between the audio and visual modalities. Since AV-HuBERT only extracts visual features from the lip region, we also adopt another transformer-based video model to exploit facial features and capture spatial and temporal artifacts caused during the deepfake generation process. Experimental results show that our model outperforms all existing models and achieves new state-of-the-art performance on the FakeAVCeleb and DeepfakeTIMIT datasets. © 2023, CC BY.

关键词： Audio acoustics

来源：评论

学校读者我要写书评

暂无评论

Learning Pairwise Preferences from Movie Ratings 7

Learning Pairwise Preferences from Movie Ratings

引用

7th International Conference on ICT for Smart Society, ICISS 2020

作者： Qomariyah, Nunung Nurul Fajar, Ahmad Nurul Bina Nusantara University Faculty of Computing and Media Computer Science Department Jakarta11480 Indonesia Bina Nusantara University BINUS Graduate Program-Master of Information Systems Management Information Systems Management Department Jakarta11480 Indonesia

ISBN: (纸本)9781665404228

Preference Elicitation is now considered a crucial stage in recommender system. That is the stage where we collect and query preferences of the users as part of interactive decision support system. Preference elicitation can be performed using many ways, such as asking the user explicitly to give ratings or feedbacks for some products, or implicitly observing their behaviour. Once this preference has been collected by the system, it can then be used to generate item recommendation. Using explicit feedback itself, such as rating only, has several drawbacks. Using ratings is very subjective. Two users with similar taste might give different rating to the same item. A user also may not be consistent in giving number to express their liking. In other case, a user may like an item more than the other items, but feels difficult to give lower rating on the other item, because it means that the particular item is just as bad as the one he/she does not like. By showing two different items as a pair, it will be easier for the users to pick which one is the best. In this paper, we show the result of our experiment in predicting user pairwise preferences by using their movie ratings data. We evaluated five different machine learning algorithms to predict the data in pairwise preference format. The result shows that K-Nearest Neighbour and Random Forest outperformed the other algorithms. © 2020 IEEE.

关键词： Recommender systems

来源：评论

学校读者我要写书评

暂无评论

An Analysis Method for Metric-Level Switching in Beat Tracking

arXiv

引用

arXiv 2022年

作者： Chiu, Ching-Yu Müller, Meinard Davies, Matthew E.P. Su, Alvin Wen-Yu Yang, Yi-Hsuan Graduate Program of Multimedia Systems and Intelligent Computing National Cheng Kung University Academia Sinica Taiwan International Audio Laboratories Erlangen Germany Department of Informatics Engineering Centre for Informatics and Systems The University of Coimbra University of Coimbra Portugal Department of CSIE National Cheng Kung University Taiwan Taiwan AI Labs Taiwan

For expressive music, the tempo may change over time, posing challenges to tracking the beats by an automatic model. The model may first tap to the correct tempo, but then may fail to adapt to a tempo change, or switch between several incorrect but perceptually plausible ones (e.g., half- or double-tempo). Existing evaluation metrics for beat tracking do not reflect such behaviors, as they typically assume a fixed relationship between the reference beats and estimated beats. In this paper, we propose a new performance analysis method, called annotation coverage ratio (ACR), that accounts for a variety of possible metric-level switching behaviors of beat trackers. The idea is to derive sequences of modified reference beats of all metrical levels for every two consecutive reference beats, and compare every sequence of modified reference beats to the subsequences of estimated beats. We show via experiments on three datasets of different genres the usefulness of ACR when being utilized alongside existing metrics, and discuss the new insights that can be gained. © 2022, CC BY.

关键词： Taps

来源：评论

学校读者我要写书评

暂无评论

Opportunities and Challenges from Using Animal Videos in Reinforcement Learning for Navigation

arXiv

引用

arXiv 2022年

作者： Giammarino, Vittorio Queeney, James Carstensen, Lucas C. Hasselmo, Michael E. Paschalidis, Ioannis Ch. Division of Systems Engineering Boston University BostonMA02215 United States Center for Systems Neuroscience Department of Psychological and Brain Sciences Graduate Program for Neuroscience Boston University BostonMA02215 United States College of Engineering Hariri Institute for Computing & Computational Science & Engineering Boston University BostonMA02215 United States

We investigate the use of animal videos (observations) to improve Reinforcement Learning (RL) efficiency and performance in navigation tasks with sparse rewards. Motivated by theoretical considerations, we make use of weighted policy optimization for off-policy RL and describe the main challenges when learning from animal videos. We propose solutions and test our ideas on a series of 2D navigation tasks. We show how our methods can leverage animal videos to improve performance over RL algorithms that do not leverage such observations. © 2022, CC BY.

关键词： Reinforcement learning

来源：评论

学校读者我要写书评

暂无评论

FluxProg 2.0 - Teaching Introductory programming Using Flowcharts with Real and Simulated Robots for The Brazilian Robotics Olympiad (OBR)

FluxProg 2.0 - Teaching Introductory Programming Using Flowc...

引用

IEEE Latin American Robotics Symposium, LARS

作者： João Alberto Fabro Matheus Biscaya Gutierrez Fernando Henrique Ratusznei Caetano DAINF - Academic Department of Informatica PPGCA - Graduate Program on Applied Computing LASER-Laboratory for Advanced Robotics and Embedded Systems UTFPR - Federal University of Technology - Paraná Curitiba PR - Brazil Information Systems academic - UTFPR - Federal University of Technology - Paraná Curitiba PR - Brazil Computer Engineering academic - UTFPR - Federal University of Technology - Paraná Curitiba PR - Brazil

ISBN: (数字)9781665462808

ISBN: (纸本)9781665462815

In this paper, an approach to aid in introductory programming courses is presented, focused on students that had never had any contact with computer programming. The approach, that was introduced in a previous paper [3], presents programming concepts using icons and “flowcharts”, and a 3D robotics simulator (CoppeliaSim), that has free educational use. This time, a real version of the simulated robot, built using Arduino and cheap, easily obtainable electronic components, is also presented. The programs to control the robot are developed by graphically constructing flowcharts on the visual editor, and then following the execution of programs using the simulated (or real) robot, step by step. This graphic program editor is named “FluxProg”, and its 2nd version is now available online, with new features comprising variables, arithmetic and logic expressions, thus providing a complete programming environment.

关键词： Flowcharts Visualization Three-dimensional displays Conferences Education Electronic components Robots

来源：评论

学校读者我要写书评

暂无评论

Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights

arXiv

引用

arXiv 2024年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei11529 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu300044 Taiwan The Department of Computer Science National Chengchi University Taipei11529 Taiwan The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. Despite extensive research on unimodal deepfake detection, identifying complex deepfakes through joint analysis of audio and visual streams remains relatively unexplored. To fill this gap, this survey first provides an overview of audiovisual deepfake generation techniques, applications, and their consequences, and then provides a comprehensive review of state-of-the-art methods that combine audio and visual modalities to enhance detection accuracy, summarizing and critically analyzing their strengths and limitations. Furthermore, we discuss existing open source datasets for a deeper understanding, which can contribute to the research community and provide necessary information to beginners who want to analyze deep learning-based audiovisual methods for video forensics. By bridging the gap between unimodal and multimodal approaches, this paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity. © 2024, CC BY.

关键词： Audiovisual

来源：评论

学校读者我要写书评

暂无评论

Unmasking Illusions: Understanding Human Perception of Audiovisual Deepfakes

arXiv

引用

arXiv 2024年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei11529 Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu300044 Taiwan Department of Computer Science National Chengchi University Taipei11529 Taiwan Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan Institute of Information Science Academia Sinica Taipei11529 Taiwan

The emergence of contemporary deepfakes has attracted significant attention in machine learning research, as artificial intelligence (AI) generated synthetic media increases the incidence of misinterpretation and is difficult to distinguish from genuine content. Currently, machine learning techniques have been extensively studied for automatically detecting deepfakes. However, human perception has been less explored. Malicious deepfakes could ultimately cause public and social problems. Can we humans correctly perceive the authenticity of the content of the videos we watch? The answer is obviously uncertain;therefore, this paper aims to evaluate the human ability to discern deepfake videos through a subjective study. We present our findings by comparing human observers to five state-of-the-art deepfake detection models. To this end, we used gamification concepts to provide 110 participants (55 native English speakers and 55 non-native English speakers) with a web-based platform where they could access a series of 40 videos (20 real and 20 fake) to determine their authenticity. Each participant performed the experiment twice with the same 40 videos in different random orders. The videos are manually selected from the FakeAVCeleb dataset. We found that all AI models performed significantly better than humans when evaluated on the same 40 videos. The study also reveals that while deception is not impossible, humans tend to overestimate their detection capabilities. Our experimental results may help benchmark human versus machine performance, advance forensics analysis, and enable adaptive countermeasures. © 2024, CC BY.

关键词： Audiovisual

来源：评论

学校读者我要写书评

暂无评论

Acoustic and Textual Data Augmentation for Code-Switching Speech Recognition in Under-Resourced Language

Acoustic and Textual Data Augmentation for Code-Switching Sp...

引用

Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)

作者： I-Ting Hsieh Chung-Hsien Wu Chun-Huang Wang Graduate Program of Multimedia Systems and Intelligent Computing National Cheng Kung University Tainan Taiwan

ISBN: (数字)9789881476883

ISBN: (纸本)9781728181301

Under-resourced and code-switching speech recognition have recently received research interest, resulting in several robust acoustic and language modeling approaches. As Taiwanese and Mandarin have been popularly and widely used in Taiwan, this paper aims to address the under-resourced and codeswitching issues. First, phone sharing between Taiwanese and Mandarin is employed for acoustic data augmentation to construct the acoustic models of Taiwanese speech recognizer. Regarding the lack of Taiwanese text corpus, this paper translates Mandarin corpus into Taiwanese corpus based on word-to-word translation. Moreover, additional translation rules for codeswitching text are manually designed. The augmented text corpus is then used for training the code-switching language models. In the experimental results, the word error rate for code-switching speech recognition was 26.02%, which was better than that trained by the pure Taiwanese corpus.

关键词： Speech recognition Training Acoustics Switches Mathematical model Speech coding Hidden Markov models

来源：评论

学校读者我要写书评

暂无评论

A Domain Specific Language to Provide Middleware for Interoperability among SaaS and DaaS/DBaaS through a Metamodel Approach 23

A Domain Specific Language to Provide Middleware for Interop...

引用

23rd International Conference on Enterprise Information systems, ICEIS 2021

作者： Mane, Babacar Magalhaes, Ana Patricia Quinteiro, Gustavo Maciel, Rita Suzana Pitangueira Claro, Daniela Barreiro Federal University of Bahia – DCC – IME Av. Adhemar de Barros Ondina 40170-110 Bahia Salvador Brazil Department of Exact Sciences and Earth State University of Bahia 2555 Silveira Martins st. Bahia Cabula Brazil Post Graduate Program in Computing and Systems Salvador University 251 Dr. Jose Peroba st. Bahia Brazil

ISBN: (纸本)9789897585098

Cloud computing (CC) is a paradigm that manages a pool of virtualized resources at infrastructure, platform, and software levels to deliver them as services over the Internet. Cloud Platforms are heterogeneous, and therefore cloud users may face interoperability and integration issues regarding consumption, provisioning, management, and supervision resources among distinct clouds. Due to the lack of standards in such a heterogeneous environment, an organization may face a lock-in situation. A middleware can minimize the effort to overcome lock-in problems. The MIDAS middleware ensures semantic interoperability between Software as a Service (SaaS) and Data as a Service (DaaS), and at the same times provides data integration between DaaS. Currently, MIDAS runtime implementations rely on Cloud Foundry, Amazon Web Services, OpenShift and, Heroku providers. To avoid ambiguity in MIDAS development and deployment an unambiguous definition of MIDAS architectural concepts must be provided. Thus, our work presents a Domain-Specific Modeling Language (DSML) comprising a metamodel of MIDAS semantic architecture and a Unified Modeling Language (UML) profile. To evaluate the DSML expressiveness, we instantiate several middleware models, and the findings demonstrate that our modeling language has an acceptable level of concepts to specify the middleware. Copyright © 2021 by SCITEPRESS – Science and Technology Publications, Lda. All rights reserved.

关键词： Web services

来源：评论

学校读者我要写书评

暂无评论

AVTENet: Audio-Visual Transformer-based Ensemble Network Exploiting Multiple Experts for Video Deepfake Detection

arXiv

引用

arXiv 2023年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan The Department of Computer Science National Chengchi University Taipei11605 Taiwan The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Forged content shared widely on social media platforms is a major social problem that requires increased regulation and poses new challenges to the research community. The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous work on detecting AI-generated fake videos only utilizes visual modality or audio modality. While there are some methods in the literature that exploit audio and visual modalities to detect forged videos, they have not been comprehensively evaluated on multi-modal datasets of deepfake videos involving acoustic and visual manipulations. Moreover, these existing methods are mostly based on CNN and suffer from low detection accuracy. Inspired by the recent success of Transformer in various fields, to address the challenges posed by deepfake technology, in this paper, we propose an Audio-Visual Transformer-based Ensemble Network (AVTENet) framework that considers both acoustic manipulation and visual manipulation to achieve effective video forgery detection. Specifically, the proposed model integrates several purely transformer-based variants that capture video, audio, and audio-visual salient cues to reach a consensus in prediction. For evaluation, we use the recently released benchmark multi-modal audio-video FakeAVCeleb dataset. For a detailed analysis, we evaluate AVTENet, its variants, and several existing methods on multiple test sets of the FakeAVCeleb dataset. Experimental results show that our best model outperforms all existing methods and achieves state-of-the-art performance on Testset-I and Testset-II of the FakeAVCeleb dataset. © 2023, CC BY.

关键词： Statistical tests

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：