检索结果-内蒙古大学图书馆

Local Periodicity-Based Beat Tracking for Expressive Classical Piano Music

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Chiu, Ching-Yu Müller, Meinard Davies, Matthew E.P. Su, Alvin Wen-Yu Yang, Yi-Hsuan The Graduate Program of Multimedia Systems and Intelligent Computing National Cheng Kung University Academia Sinica Taiwan The International Audio Laboratories Erlangen Germany The Department of Informatics Engineering Centre for Informatics and Systems of the University of Coimbra University of Coimbra Portugal The Department of Computer Science and Information Engineering National Cheng Kung University Taiwan Yating Music Team Taiwan AI Labs Taiwan Research Center for IT Innovation Academia Sinica Taiwan

To model the periodicity of beats, state-of-the-art beat tracking systems use "post-processing trackers" (PPTs) that rely on several empirically determined global assumptions for tempo transition, which work well for music with a steady tempo. For expressive classical music, however, these assumptions can be too rigid. With two large datasets of Western classical piano music, namely the Aligned Scores and Performances (ASAP) dataset and a dataset of Chopin's Mazurkas (Maz-5), we report on experiments showing the failure of existing PPTs to cope with local tempo changes, thus calling for new methods. In this paper, we propose a new local periodicity-based PPT, called predominant local pulse-based dynamic programming (PLPDP) tracking, that allows for more flexible tempo transitions. Specifically, the new PPT incorporates a method called "predominant local pulses" (PLP) in combination with a dynamic programming (DP) component to jointly consider the locally detected periodicity and beat activation strength at each time instant. Accordingly, PLPDP accounts for the local periodicity, rather than relying on a global tempo assumption. Compared to existing PPTs, PLPDP particularly enhances the recall values at the cost of a lower precision, resulting in an overall improvement of F1-score for beat tracking in ASAP (from 0.473 to 0.493) and Maz-5 (from 0.595 to 0.838). © 2023, CC BY.

关键词： Dynamic programming

AV-Lip-Sync+: Leveraging AV-HuBERT to Exploit Multimodal Inconsistency for Video Deepfake Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Shahzad, Sahibzada Adil Hashmi, Ammarah Peng, Yan-Tsung Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan The Department of Computer Science National Chengchi University Taipei11605 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Multimodal manipulations (also known as audiovisual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial. The damage to either modality (i.e., visual or audio) can only be discovered through multi-modal models that can exploit both pieces of information simultaneously. Previous methods mainly adopt uni-modal video forensics and use supervised pre-training for forgery detection. This study proposes a new method based on a multi-modal self-supervised-learning (SSL) feature extractor to exploit inconsistency between audio and visual modalities for multi-modal video forgery detection. We use the transformer-based SSL pre-trained Audio-Visual HuBERT (AV-HuBERT) model as a visual and acoustic feature extractor and a multi-scale temporal convolutional neural network to capture the temporal correlation between the audio and visual modalities. Since AV-HuBERT only extracts visual features from the lip region, we also adopt another transformer-based video model to exploit facial features and capture spatial and temporal artifacts caused during the deepfake generation process. Experimental results show that our model outperforms all existing models and achieves new state-of-the-art performance on the FakeAVCeleb and DeepfakeTIMIT datasets. © 2023, CC BY.

关键词： Audio acoustics

Regularization of Extreme Learning Machines with information of spatial relations of the projected data

学校读者我要写书评

暂无评论

Regularization of Extreme Learning Machines with information...

International Conference on Control, Decision and Information Technologies (CoDIT)

作者： Lourenço R. G. Araújo Luiz C. B. Torres Leonardo J. Silvestre Carla Takahashi Antônio P. Braga Graduate Program in Electrical Engineering Universidade Federal de Minas Gerais Belo Horizonte MG Brazil Department of Computing and Systems Federal University of Ouro Preto Jo??o Monlevade Brazil Department of Computing and Electronics Federal University of Esp??rito Santo S??o Mateus ES Brazil Loggi Tecnologia Alameda Santos S??o Paulo SP Brazil Department of Electronics Engineering Federal University of Minas Gerais Belo Horizonte MG Brazil

The following work presents a new approach to automatic selection of Tikhonov's regularization parameter, responsible for controlling the weight value of an ELM neural network. A strategy based on measurements obtained from data projection (Fisher-Score) is introduced. Seven datasets are tested and results are compared to those obtained when the regularization parameter is selected through cross-validation. The strategy shows satisfactory classification performance (in terms of p-value), while presenting significant training time reduction.

关键词： Neurons Training Cybernetics Minimization Testing Biological neural networks Aerospace electronics

Preprocessing Techniques for Enhancing Vision-Based Detection System for Tire Sidewall Extraction

学校读者我要写书评

暂无评论

Preprocessing Techniques for Enhancing Vision-Based Detectio...

International Seminar on Research of Information Technology and Intelligent systems (ISRITI)

作者： Jia Hao Loo Veronica Lestari Jauw Chin Seong Lim Khairul-Rijal Sarmin Nunung Nurul Qomariyah Ahmad Nurul Fajar Department of Mechanical Materials and Manufacturing Engineering University of Nottingham Malaysia Malaysia Continental Tyre Technology Centre Malaysia Petaling Jaya Malaysia Computer Science Department School of Computing and Creative Arts Bina Nusantara University Jakarta Indonesia Information System Management Department BINUS Graduate Program-Master Information Systems Bina Nusantara University Jakarta Indonesia

ISBN: (数字)9798331519643

ISBN: (纸本)9798331519650

This study aims to develop a system for extracting crucial information from tire sidewalls using Optical Character Recognition (OCR). Initially, images of tire were captured manually by smartphone cameras, including Redmi 9T, iPhone 11, and Galaxy S23 Ultra. The captured images are then transferred to a computer for storage. Subsequently, these images were cropped according to the boundaries identified by Hough Circle Transform (HCT). The cropped images were then further pre-processed. During the pre-processing phase, geometrical transformation and image sharpening techniques are applied to enhance the clarity and readability of the text images. The text is then extracted using Google Vision, with the extracted text categorized by size, DOT, brand and pattern. The results indicated that the effectiveness of image pre-processing was constrained by the accuracy of circle detection, which reached a maximum rate of 87.1%. This causes parts of the text to be cut out inaccurately, leading to a suboptimal extraction accuracy of 55.65%. It is also observed that the Redmi 9T camera produced inconsistent results compared to other devices. Specifically, the iPhone 11 and Samsung Galaxy S23 Ultra demonstrated superior extraction accuracies of 69.71% and 66.37%, respectively, whereas the Redmi 9T achieved a lower extraction accuracy of 37.76%.

关键词： Accuracy Optical character recognition Text categorization Lighting Transforms US Department of Transportation Cameras Tires Internet Data mining

Fusion of Mixture of Experts and Generative Artificial Intelligence in Mobile Edge Metaverse

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Liu, Guangyuan Du, Hongyang Niyato, Dusit Kang, Jiawen Xiong, Zehui Jamalipour, Abbas Mao, Shiwen Kim, Dong In The College of Computing and Data Science The Energy Research Institute @ NTU Interdisciplinary Graduate Program Nanyang Technological University Singapore The College of Computing and Data Science Nanyang Technological University Singapore The School of Automation Guangdong University of Technology China The Pillar of Information Systems Technology and Design Singapore University of Technology and Design Singapore The Department of Electrical and Computer Engineering Auburn University Auburn United States The School of Electrical and Computer Engineering University of Sydney Australia The Department of Electrical and Computer Engineering Sungkyunkwan University Korea Republic of

In the digital transformation era, Metaverse offers a fusion of virtual reality (VR), augmented reality (AR), and web technologies to create immersive digital experiences. However, the evolution of the Metaverse is slowed down by the challenges of content creation, scalability, and dynamic user interaction. Our study investigates an integration of Mixture of Experts (MoE) models with Generative Artificial Intelligence (GAI) for mobile edge computing to revolutionize content creation and interaction in the Metaverse. Specifically, we harness an MoE model's ability to efficiently manage complex data and complex tasks by dynamically selecting the most relevant experts running various sub-models to enhance the capabilities of GAI. We then present a novel framework that improves video content generation quality and consistency, and demonstrate its application through case studies. Our findings underscore the efficacy of MoE and GAI integration to redefine virtual experiences by offering a scalable, efficient pathway to harvest the Metaverse's full potential. © 2024, CC BY.

关键词： Augmented reality

Recent advances in wearable electrochemical biosensors towards technological and material aspects

学校读者我要写书评

暂无评论

Biosensors and Bioelectronics: X 2024年 19卷

作者： Hosseinzadeh Fakhr, Mahan Lopez Carrasco, Ivan Belyaev, Dmitry Kang, Jihun Shin, YeHyeon Yeo, Jong-Souk Koh, Won-Gun Ham, Jeongwoo Michaelis, Alexander Opitz, Joerg Beshchasna, Natalia Fraunhofer Institute for Ceramic Technologies and Systems IKTS Maria-Reiche-Straße 2 Dresden01109 Germany Faculty of Mechanical Science and Engineering Dresden University of Technology Dresden Germany School of Integrated Technology College of Computing Yonsei University Seoul Korea Republic of BK21 Graduate Program in Intelligent Semiconductor Technology Yonsei University Seoul Korea Republic of Department of Chemical and Biomolecular Engineering Yonsei University Seoul Korea Republic of

The next generation of wearable biosensors comes with the latest advancements in biosensor technology. Soft and stretchable electrode materials like hydrogels with the similar functionalities of human tissue including stretchability, self-healability, and responsiveness to different stimuli have emerged as the most versatile materials in wearable electronics. The incorporation of conductive nanofillers is found to enhance the sensitivity of the electrochemical biosensors significantly. Microfluidic technology has reduced the volume of samples and reagents required for the analysis, allowing continuous biomedical monitoring from a drop of biofluid. In this paper, the most advanced progress in electrochemical wearable platforms that can noninvasively and continuously monitor the biochemical markers in body fluids for the diagnosis and health management is reviewed. Innovation in microelectronics, modification, fabrication technologies, and detection methods are the main focus of the discussion. In particular, hydrogel-based sensors and microfluidic systems as the latest technology trends in wearable detection are discussed in detail. Integration of miniaturized electrochemical wearable biosensors with wireless technology as a great promise for real-time healthcare monitoring and point-of-care (POC) diagnostics is also summarized. Finally, we outline the most advanced wearable biosensors with optimized material and design as well as key challenges that need to be addressed to improve sensing performance (accuracy, sensitivity, selectivity, stability), portability (miniaturized size and light weight), and flexibility of the wearable biosensors. © 2024 The Authors

关键词： Body fluids

Facebook reaction-based emotion classifier as cue for sarcasm detection

学校读者我要写书评

暂无评论

arXiv 2018年

作者： Kuo, Po Chen Calderon Alvarado, Fernando H. Chen, Yi-Shin Department of Computer Science National Tsing Hua University GuangFu Rd. Sec.2 No. 101 Hsinchu30013 Taiwan Social Networks and Human Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica 128 Academia Road Sec. 2. Nangang Taipei115 Taiwan Institute of Information Systems and Applications National Tsing Hua University GuangFu Rd. Sec.2 No. 101 Hsinchu30013 Taiwan

Online social media users react to content in them based on context. Emotions or mood play a significant part of these reactions, which has filled these platforms with opinionated content. Different approaches and applications to make better use of this data are continuously being developed. However, due to the nature of the data, the variety of platforms, and dynamic online user behavior, there are still many issues to be dealt with. It remains a challenge to properly obtain a reliable emotional status from a user prior to posting a comment. This work introduces a methodology that explores semi-supervised multilingual emotion detection based on the overlap of Facebook reactions and textual data. With the resulting emotion detection system we evaluate the possibility of using emotions and user behavior features for the task of sarcasm detection. More than 1 million English and Chinese comments from over 62,000 public Facebook pages posts have been collected and processed, conducted experiments show acceptable performance metrics. Copyright © 2018, The Authors. All rights reserved.

关键词： Sentiment analysis

Robot Hand Interaction Using Plastic Deformation Control with Inner Position Loop

学校读者我要写书评

暂无评论

Robot Hand Interaction Using Plastic Deformation Control wit...

IEEE/ASME (AIM) International Conference on Advanced Intelligent Mechatronics

作者： Kenichi Murakami Koki Ishimoto Taku Senoo Masatoshi Ishikawa Data Science Research Division Information Technology Center The University of Tokyo 7-3-1 Hongo Bunkyo-ku Tokyo Japan Department of Information Physics and Computing The University of Tokyo 7-3-1 Hongo Bunkyo-ku Tokyo Japan Electrical Systems and Control Engineering Program Graduate School of Advanced Science and Engineering Hiroshima University 1-4-1 Kagamiyama Higashi-Hiroshima City Hiroshima Japan

ISBN: (数字)9781728167947

ISBN: (纸本)9781728167954

In this study, the inner position loop addition for plastic deformation control of the error robustness of the model and actual parameters is proposed. The inner position loop is a type of position feedback control based on the estimation of model parameters and dynamics of robots. This position control system with proportional and derivative gains modifies the trajectory of the end effector close to the desired trajectory. The robustness of the proposed control scheme is evaluated by comparing it with plastic deformation control without an inner position loop in both simulation and actual environments. Finally, the stable reaction with the proposed control is demonstrated for the case where a human pushes the robot finger.

关键词： Strain Plastics Force Deformable models Robots Friction Trajectory

AVTENet: Audio-Visual Transformer-based Ensemble Network Exploiting Multiple Experts for Video Deepfake Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan The Department of Computer Science National Chengchi University Taipei11605 Taiwan The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Forged content shared widely on social media platforms is a major social problem that requires increased regulation and poses new challenges to the research community. The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous work on detecting AI-generated fake videos only utilizes visual modality or audio modality. While there are some methods in the literature that exploit audio and visual modalities to detect forged videos, they have not been comprehensively evaluated on multi-modal datasets of deepfake videos involving acoustic and visual manipulations. Moreover, these existing methods are mostly based on CNN and suffer from low detection accuracy. Inspired by the recent success of Transformer in various fields, to address the challenges posed by deepfake technology, in this paper, we propose an Audio-Visual Transformer-based Ensemble Network (AVTENet) framework that considers both acoustic manipulation and visual manipulation to achieve effective video forgery detection. Specifically, the proposed model integrates several purely transformer-based variants that capture video, audio, and audio-visual salient cues to reach a consensus in prediction. For evaluation, we use the recently released benchmark multi-modal audio-video FakeAVCeleb dataset. For a detailed analysis, we evaluate AVTENet, its variants, and several existing methods on multiple test sets of the FakeAVCeleb dataset. Experimental results show that our best model outperforms all existing methods and achieves state-of-the-art performance on Testset-I and Testset-II of the FakeAVCeleb dataset. © 2023, CC BY.

关键词： Statistical tests