检索结果-内蒙古大学图书馆

Influence of land-sea breeze on PM _2.5 prediction in central and southern Taiwan using composite neural network

Scientific Reports 2023年第1期13卷 1-9页

作者： Kibirige, George William Huang, Chiao Cheng Liu, Chao Lin Chen, Meng Chang Institute of Information Science Academia Sinica New Taipei Taiwan Social Networks and Human Centered Computing Program Taiwan International Graduate Program New Taipei Taiwan National Chengchi University New Taipei Taiwan

PM2.5 prediction plays an important role for governments in establishing policies to control the emission of excessive atmospheric pollutants to protect the health of citizens. However, traditional machine learning me...

PM_2.5 prediction plays an important role for governments in establishing policies to control the emission of excessive atmospheric pollutants to protect the health of citizens. However, traditional machine learning methods that use data collected from ground-level monitoring stations have reached their limit with poor model generalization and insufficient data. We propose a composite neural network trained with aerosol optical depth (AOD) and weather data collected from satellites, as well as interpolated ocean wind features. We investigate the model outputs of different components of the composite neural network, concluding that the proposed composite neural network architecture yields significant improvements in overall performance compared to each component and the ensemble model benchmarks. The monthly analysis also demonstrates the superiority of the proposed architecture for stations where land-sea breezes frequently occur in the southern and central Taiwan in the months when land-sea breeze dominates the accumulation of PM_2.5. © 2023, The Author(s).

关键词：

来源：评论

学校读者我要写书评

暂无评论

Boosting Patch Correctness Checking via Combining Code-Edit Embeddings as Additional What-to-Change Information

Boosting Patch Correctness Checking via Combining Code-Edit ...

引用

IEEE WIC ACM International Conference on Web Intelligence (WI)

作者： Chontipan Plengvittaya Zee Hen Tang Mi-Yen Yeh Chih-Ya Shen Social Networks and Human Centered Computing Taiwan International Graduate Program Taiwan Institute of Information Science Academia Sinica Taiwan Institute of Information Systems and Applications National Tsing Hua University Taiwan Data Science Degree Program National Taiwan University and Academia Sinica Taiwan

Patch Correctness Checking is the task of detecting automated-program-repair-generated patches that can pass the test suite but are still buggy. In this study, we investigated a new feature to improve the classification performance for automated patch correctness checking. Our approach involved leveraging code-change information at a finer granular level by embedding the code edits and combining them with existing code-change vectors. Through extensive experiments, the results revealed gains up to 3.4% and 3.2% on the Fl-score and AUC.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Lip Sync Matters: A Novel Multimodal Forgery Detector

Lip Sync Matters: A Novel Multimodal Forgery Detector

引用

14th Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA ASC)

作者： Shahzad, Sahibzada Adil Hashmi, Ammarah Khan, Sarwar Peng, Yan-Tsung Tsao, Yu Wang, Hsin-Min Acad Sinica Inst Informat Sci Social Networks & Human Centered Comp Program Taiwan Int Grad Program New Taipei Taiwan Natl Chengchi Univ Dept Comp Sci Taipei Taiwan Natl Tsing Hua Univ Inst Informat Syst & Applicat Taipei Taiwan Acad Sinica Res Ctr Informat Technol Innovat Taipei Taiwan

ISBN: (数字)9786165904773

ISBN: (纸本)9786165904773

Deepfake technology has advanced a lot, but it is a double-sided sword for the community. One can use it for beneficial purposes, such as restoring vintage content in old movies, or for nefarious purposes, such as creating fake footage to manipulate the public and distribute non-consensual pornography. A lot of work has been done to combat its improper use by detecting fake footage with good performance thanks to the availability of numerous public datasets and unimodal deep learning-based models. However, these methods are insufficient to detect multimodal manipulations, such as both visual and acoustic. This work proposes a novel lip-reading-based multimodal Deepfake detection method called "Lip Sync Matters." It targets high-level semantic features to exploit the mismatch between the lip sequence extracted from the video and the synthetic lip sequence generated from the audio by the Wav2lip model to detect forged videos. Experimental results show that the proposed method outperforms several existing unimodal, ensemble, and multimodal methods on the publicly available multimodal FakeAVCeleb dataset.

关键词： Deepfakes Visualization Lips Semantics Detectors Feature extraction Motion pictures

来源：评论

学校读者我要写书评

暂无评论

TEAM: Task-Clustering and Enhanced Adaptability for Meta-Reinforcement Learning on Robotics Through Multi-Task Diffusion and Optimization

TEAM: Task-Clustering and Enhanced Adaptability for Meta-Rei...

引用

IEEE International Conference on Robotic computing (IRC)

作者： Joshua Ho Chien-Min Wang Chung-Ta King Chi-Wei Feng Shih-Yun Sunkuan Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu Taiwan Department of Computer Science National Tsing Hua University Hsinchu Taiwan Department of Electrical Engineering National Taiwan University Taipei Taiwan

ISBN: (数字)9798331521554

ISBN: (纸本)9798331521561

The ability of robots to imitate human learning strategies-rapidly adapting to new tasks without large datasets-has garnered significant attention in meta-learning. Meta-reinforcement learning seeks to enhance robotic agent flexibility across diverse tasks and contexts, offering promise where single-task learning often fails. Despite advancements like multi-task diffusion models and task-weighted optimization mechanisms, effectively training tasks with varying complexities simultaneously remains a major challenge. This paper introduces a novel meta-reinforcement learning method that addresses this issue by clustering the training tasks of robotic arms based on semantic and trajectory similarities, while leveraging adaptive learning rates and task-specific weights proposed by the multitask optimization techniques. Our approach, TEAM, emphasizes performance-driven semantic clustering, optimizing based on robotic task similarity, complexity, and convergence objectives. We also integrate fast adaptive and multi-task optimization of the diffusion model to enhance computational efficiency and adaptability. More specifically, we introduce a cluster-specific optimization technique, using specialized parameters for each group to allow more refined task handling. The experimental validation demonstrates the effectiveness of this scalable method in improving performance, adaptability, and efficiency in real-world, heterogeneous robotic tasks, further advancing robotic computing in meta-reinforcement learning.

关键词： Training Metalearning program processors Semantics Multitasking Diffusion models Complexity theory Trajectory Robots Optimization

来源：评论

学校读者我要写书评

暂无评论

AVTENet: A human-Cognition-Inspired Audio-Visual Transformer-Based Ensemble Network for Video Deepfake Detection

引用

IEEE Transactions on Cognitive and Developmental Systems 2025年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min Taiwan International Graduate Program Academia Sinica Social Networks and Human-Centered Computing Program Taipei11529 Taiwan National Tsing Hua University Institute of Information Systems and Applications Hsinchu30013 Taiwan National Chengchi University Department of Computer Science Taipei11605 Taiwan National Tsing Hua University Department of Electrical Engineering Institute of Communications Engineering Hsinchu300044 Taiwan Academia Sinica Research Center for Information Technology Innovation Taipei11529 Taiwan

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or audio modality. While some methods exploit audio and visual modalities to detect forged videos, they have not been comprehensively evaluated on multimodal datasets of deepfake videos involving acoustic and visual manipulations, and are mostly based on convolutional neural networks with low detection accuracy. Considering that human cognition instinctively integrates multisensory information including audio and visual cues to perceive and interpret content and the success of transformer in various fields, this study introduces the audio-visual transformer-based ensemble network (AVTENet). This innovative framework tackles the complexities of deepfake technology by integrating both acoustic and visual manipulations to enhance the accuracy of video forgery detection. Specifically, the proposed model integrates several purely transformer-based variants that capture video, audio, and audio-visual salient cues to reach a consensus in prediction. For evaluation, we use the recently released benchmark multimodal audio-video FakeAVCeleb dataset. For a detailed analysis, we evaluate AVTENet, its variants, and several existing methods on multiple test sets of the FakeAVCeleb dataset. Experimental results show that the proposed model outperforms all existing methods and achieves state-of-the-art performance on Testset-I and Testset-II of the FakeAVCeleb dataset. We also compare AVTENet against humans in detecting video forgery. The results show that AVTENet significantly outperforms humans. © 2016 IEEE.

关键词： audio-visual AVTENet Deepfake detection

来源：评论

学校读者我要写书评

暂无评论

Unsupervised Multi-document Summarization for News Corpus with Key Synonyms and Contextual Embeddings 33

Unsupervised Multi-document Summarization for News Corpus wi...

引用

33rd Conference on Computational Linguistics and Speech Processing, ROCLING 2021

作者： Huang, Yen-Hao Pornvattanavichai, Ratana Alvarado, Fernando Henrique Calderon Chen, Yi-Shin Institute of Information Systems and Applications National Tsing Hua University Hsinchu Taiwan Department of Computer Science National Tsing Hua University Hsinchu Taiwan Social Networks and Human-Centered Computing Program Institute of Information Sciences Academia Sinica Taipei Taiwan

ISBN: (纸本)9789869576949

Information overload has been one of the challenges regarding information on the Internet. It is no longer a matter of information access, instead, the focus has shifted towards the quality of the retrieved data. Particularly in the news domain, multiple outlets report on the same news events but may differ in details. This work considers that different news outlets are more likely to differ in their writing styles and the choice of words, and proposes a method to extract sentences based on their key information by focusing on the shared synonyms in each sentence. Our method also attempts to reduce redundancy through hierarchical clustering and arrange selected sentences on the proposed orderBERT. The results show that the proposed unsupervised framework successfully improves the coverage and coherence, while also reducing the redundancy for a generated summary. Moreover, due to the process through which the dataset is obtained, a data refinement method is proposed to alleviate the problem of undesirable texts, which result from the process of automatic scraping. © 2021 ROCLING 2021 - Proceedings of the 33rd Conference on Computational Linguistics and Speech Processing. All rights reserved.

关键词： Redundancy

来源：评论

学校读者我要写书评

暂无评论

How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and human Perception

arXiv

引用

arXiv 2024年

作者： Shahzad, Sahibzada Adil Hashmi, Ammarah Peng, Yan-Tsung Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei Taiwan The Department of Computer Science National Chengchi University Taipei Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei Taiwan The Institute of Information Science Academia Sinica Taiwan

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learning-based forgery detection methods. Audiovisual forensic models, while more capable than unimodal models, require large training datasets and are computationally expensive for training and inference. Furthermore, these models lack interpretability and often do not generalize well to unseen manipulations. In this study, we examine the detection capabilities of a large language model (LLM) (i.e., ChatGPT) to identify and account for any possible visual and auditory artifacts and manipulations in audiovisual deepfake content. Extensive experiments are conducted on videos from a benchmark multimodal deepfake dataset to evaluate the detection performance of ChatGPT and compare it with the detection capabilities of state-of-the-art multimodal forensic models and humans. Experimental results demonstrate the importance of domain knowledge and prompt engineering for video forgery detection tasks using LLMs. Unlike approaches based on end-to-end learning, ChatGPT can account for spatial and spatiotemporal artifacts and inconsistencies that may exist within or across modalities. Additionally, we discuss the limitations of ChatGPT for multimedia forensic tasks. © 2024, CC BY.

关键词： Audiovisual

来源：评论

学校读者我要写书评

暂无评论

Zema Dataset: A Comprehensive Study of Yaredawi Zema with a Focus on Horologium Chants

arXiv

引用

arXiv 2024年

作者： Muluneh, Mequanent Argaw Peng, Yan-Tsung Degife, Worku Abebe Tadesse, Nigussie Abate Demeku, Aknachew Mebreku Su, Li Institute of Information Science Academia Sinica Taipei Taiwan Department of Information System University of Gondar Gondar Ethiopia Department of Computer Science National Chengchi University Taipei Taiwan Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Taiwan Department of Information Management National Taiwan University of Science and Technology Taipei Taiwan Department of Material Science and Engineering National Taiwan University of Science and Technology Taipei Taiwan

Computational music research plays a critical role in advancing music production, distribution, and understanding across various musical styles in the world. Despite the immense cultural and religious significance, the Ethiopian Orthodox Tewahedo Church (EOTC) chants are relatively underrepresented in computational music research. This paper contributes to this field by introducing a new dataset specifically tailored for the analysis of EOTC chants, also known as Yaredawi Zema. This work provides a comprehensive overview of a 10-hour dataset, 369 instances, creation, and curation process, including rigorous quality assurance measures. Our dataset has a detailed word-level temporal boundary and reading tone annotation along with the corresponding chanting mode label of audios. Moreover, we have also identified the chanting options associated with multiple chanting notations in the manuscript by annotating them accordingly. Our goal in making this dataset available to the public1 is to encourage more research and study of EOTC chants, including lyrics transcription, lyric-to-audio alignment, and music generation tasks. Such research work will advance knowledge and efforts to preserve this distinctive liturgical music, a priceless cultural artifact for the Ethiopian people. © 2024, CC BY.

关键词： Music

来源：评论

学校读者我要写书评

暂无评论

Towards Adversarial Robustness for Multi-Mode Data through Metric Learning

引用

Sensors 2023年第13期23卷 6173页

作者： Khan, Sarwar Chen, Jun-Cheng Liao, Wen-Hung Chen, Chu-Song Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan Social Networks Human-Centered Computing Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan Department of Computer Science National Chengchi University Taipei11605 Taiwan Department of Computer Science and Information Engineering National Taiwan University Taipei106319 Taiwan

Adversarial attacks have become one of the most serious security issues in widely used deep neural networks. Even though real-world datasets usually have large intra-variations or multiple modes, most adversarial defense methods, such as adversarial training, which is currently one of the most effective defense methods, mainly focus on the single-mode setting and thus fail to capture the full data representation to defend against adversarial attacks. To confront this challenge, we propose a novel multi-prototype metric learning regularization for adversarial training which can effectively enhance the defense capability of adversarial training by preventing the latent representation of the adversarial example changing a lot from its clean one. With extensive experiments on CIFAR10, CIFAR100, MNIST, and Tiny ImageNet, the evaluation results show the proposed method improves the performance of different state-of-the-art adversarial training methods without additional computational cost. Furthermore, besides Tiny ImageNet, in the multi-prototype CIFAR10 and CIFAR100 where we reorganize the whole datasets of CIFAR10 and CIFAR100 into two and ten classes, respectively, the proposed method outperforms the state-of-the-art approach by 2.22% and 1.65%, respectively. Furthermore, the proposed multi-prototype method also outperforms its single-prototype version and other commonly used deep metric learning approaches as regularization for adversarial training and thus further demonstrates its effectiveness. © 2023 by the authors.

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Multimodal Forgery Detection Using Ensemble Learning

Multimodal Forgery Detection Using Ensemble Learning

引用

14th Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA ASC)

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Ahmad, Wasim Lin, Chia Wen Tsao, Yu Wang, Hsin-Min Acad Sinica Inst Informat Sci Social Networks & Human Centered Comp Program Taiwan Int Grad Program New Taipei Taiwan Natl Tsing Hua Univ Inst Informat Syst & Applicat Hsinchu Taiwan Natl Tsing Hua Univ Dept Elect Engn Hsinchu Taiwan Natl Chengchi Univ Dept Comp Sci Taipei Taiwan Acad Sinica Res Ctr Informat Technol Innovat New Taipei Taiwan

ISBN: (数字)9786165904773

ISBN: (纸本)9786165904773

The recent rapid revolution in Artificial Intelligence (AI) technology has enabled the creation of hyper-realistic deepfakes, and detecting deepfake videos (also known as AI-synthesized videos) has become a critical task. The existing systems generally do not fully consider the unified processing of audio and video data, so there is still room for further improvement. In this paper, we focus on the multimodal forgery detection task and propose a deep forgery detection method based on audiovisual ensemble learning. The proposed method consists of four parts, namely a Video Network, an Audio Network, an Audiovisual Network, and a Voting Module. Given a video, the proposed multimodal and ensemble learning system can identify whether it is fake or real. Experimental results on a recently released multimodal FakeAVCeleb dataset show that the proposed method achieves 89% accuracy, significantly outperforming existing models.

关键词： Deepfakes Visualization Information processing Transformers Forgery Ensemble learning Task analysis

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：