检索结果-内蒙古大学图书馆

arXiv 2023年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Academia Sinica Taipei11529 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu30013 Taiwan The Department of Computer Science National Chengchi University Taipei11605 Taiwan The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Forged content shared widely on social media platforms is a major social problem that requires increased regulation and poses new challenges to the research community. The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous work on detecting AI-generated fake videos only utilizes visual modality or audio modality. While there are some methods in the literature that exploit audio and visual modalities to detect forged videos, they have not been comprehensively evaluated on multi-modal datasets of deepfake videos involving acoustic and visual manipulations. Moreover, these existing methods are mostly based on CNN and suffer from low detection accuracy. Inspired by the recent success of Transformer in various fields, to address the challenges posed by deepfake technology, in this paper, we propose an Audio-Visual Transformer-based Ensemble Network (AVTENet) framework that considers both acoustic manipulation and visual manipulation to achieve effective video forgery detection. Specifically, the proposed model integrates several purely transformer-based variants that capture video, audio, and audio-visual salient cues to reach a consensus in prediction. For evaluation, we use the recently released benchmark multi-modal audio-video FakeAVCeleb dataset. For a detailed analysis, we evaluate AVTENet, its variants, and several existing methods on multiple test sets of the FakeAVCeleb dataset. Experimental results show that our best model outperforms all existing methods and achieves state-of-the-art performance on Testset-I and Testset-II of the FakeAVCeleb dataset. © 2023, CC BY.

关键词： Statistical tests

来源：评论

学校读者我要写书评

暂无评论

SAMENESS ENTICES, BUT NOVELTY ENCHANTS IN FANFICTION ONLINE

arXiv

引用

arXiv 2019年

作者： Jing, Elise DeDeo, Simon Wright, Devin Robert Ahn, Yong-Yeol Center for Complex Networks and Systems Research Luddy School of Informatics Computing and Engineering Indiana University Bloomington United States Social and Decision Sciences Dietrich College Carnegie Mellon University United States Sirius XM United States Cognitive Science Program Indiana University Bloomington United States Indiana University Network Science Institute Indiana University Bloomington United States

Cultural evolution is driven by how we choose what to consume and share with others. A common belief is that the cultural artifacts that succeed are ones that balance novelty and conventionality. This balance theory suggests that people prefer works that are familiar, but not so familiar as to be boring;novel, but not so novel as to violate the expectations of their genre. We test this idea using a large dataset of fanfiction. We apply a multiple regression model and a generalized additive model to examine how the recognition a work receives varies with its novelty, estimated through a Latent Dirichlet Allocation topic model, in the context of existing works. We find the opposite pattern of what the balance theory predicts—overall success decline almost monotonically with novelty and exhibits a U-shaped, instead of an inverse U-shaped, curve. This puzzle is resolved by teasing out two competing forces: sameness attracts the mass whereas novelty provides enjoyment. Taken together, even though the balance theory holds in terms of expressed enjoyment, the overall success can show the opposite pattern due to the dominant role of sameness to attract the audience. Under these two "forces", cultural evolution may have to work against inertia—the appetite for consuming the familiar—and may resemble a punctuated equilibrium, marked by occasional leaps. Copyright © 2019, The Authors. All rights reserved.

关键词： Large dataset

来源：评论

学校读者我要写书评

暂无评论

Modular boundaries in recurrent neural networks

arXiv

引用

arXiv 2023年

作者： Tanner, Jacob C. Mansour, Sina L. Coletta, Ludovico Gozzi, Alessandro Betzel, Richard F. Cognitive Science Program 2 School of Informatics Computing and Engineering Indiana University BloomingtonIN47405 United States National University of Singapore Singapore Fondazione Bruno Kessler Trento Italy Functional Neuroimaging Lab Istituto Italiano di Tecnologia Center for Neuroscience and Cognitive Systems Rovereto Italy Department of Psychological and Brain Sciences Indiana University BloomingtonIN47405 United States

Recent theoretical and experimental work in neuroscience has focused on the representational and dynamical character of neural manifolds –subspaces in neural activity space wherein many neurons coactivate. Importantly, neural populations studied under this "neural manifold hypothesis" are continuous and not cleanly divided into separate neural populations. This perspective clashes with the "modular hypothesis" of brain organization, wherein neural elements maintain an "all- or-nothing" affiliation with modules. In line with this modular hypothesis, recent research on recurrent neural networks suggests that multi-task networks become modular across training, such that different modules specialize for task-general dynamical motifs [1, 2]. If the modular hypothesis is true, then it would be important to use a dimensionality reduction technique that captures modular structure. Here, we investigate the features of such a method. We leverage RNNs as a model system to study the character of modular neural populations, using a community detection method from network science known as modularity maximization to partition neurons into distinct modules. These partitions allow us to ask the following question: do these modular boundaries matter to the system? We find evidence that they do. First, we find that these boundaries neatly divide the representational content and role of neurons. Next, we find that these boundaries can be directly inferred from features of the weight matrix in feed-forward neural networks, and are related to clustering of the Jacobian matrix in recurrent neural networks. We also find that the weights of input neurons to recurrent neurons partially inform their modular structure, an observation that we corroborated using structural and functional imaging data from mice and humans. Finally, we find that the dynamics of these RNNs reflected the boundaries between modules. Collectively, our results suggest that neural populations in RNNs sometimes form modu

关键词： Recurrent neural networks

来源：评论

学校读者我要写书评

暂无评论

Speaker-Specific Articulatory Feature Extraction Based on Knowledge Distillation for Speaker Recognition

引用

APSIPA Transactions on Signal and Information Processing 2023年第2期12卷

作者： Qian-Bei Hong Hsin-Min Wang Chung-Hsien Wu Graduate Program of Multimedia Systems and Intelligent Computing National Cheng Kung University and Academia Sinica Taiwan Graduate Program of Multimedia Systems and Intelligent Computing National Cheng Kung University and Academia Sinica and Department of Computer Science and Information Engineering National Cheng Kung University Taiwan

This paper proposes a novel speaker-specific articulatory feature (AF) extraction model based on knowledge distillation (KD) for speaker recognition. First, an AF extractor is trained as a teacher model for extracting the AF profiles of the input speaker dataset. Next, a KD-based speaker embedding extraction method is proposed to distill the speaker-specific information from the AF profiles in the teacher model to a student model based on multi-task learning, in which the lower layers not only capture the speaker characteristics from acoustic features, but also learn the speaker-specific features from the AF profiles for robust speaker representation. Finally, speaker embeddings are extracted from the high-level layer, and the obtained speaker embeddings are further used to train a probabilistic linear discriminant analysis (PLDA) model for speaker recognition. In the experiments, speaker embedding models were trained using the VoxCeleb2 dataset and the AF extractor was trained based on the LibriSpeech dataset, and the performance was evaluated using the VoxCeleb1 dataset. The experiments showed that the proposed KD-based models outperformed the baseline models without KD. Furthermore, feature concatenation of multimodal results can further improve the performance.

关键词： Speaker recognition articulatory feature knowledge distillation

来源：评论

学校读者我要写书评

暂无评论

Scientific models management in computational grids

Scientific models management in computational grids

引用

17th International Conference Scientific and Statistical Database Management, SSDBM 2005

作者： De Brito, Halisson Matos Strauch, Julia De Souza, Jano Moreira Osthoff, Carla COPPE/UFRJ Systems Engineering and Computer Science Program Federal University of Rio de Janeiro PO Box 68511 ZIP Code: 21945-970 Rio de Janeiro RJ Brazil ENCE /IBGE National School of Statistical Sciences 106 S. 401 ZIP Code: 20231-050 R. André Cavalcanti Rio de Janeiro RJ Brazil LNCC National Laboratory for Scientific Computing Av. Getulio 333 Quitandinha Vargas Petrópolis RJ Brazil IM/UFRJ Institute of Mathematics Federal University of Rio de Janeiro PO Box 68511 ZIP Code: 21945-970 Rio de Janeiro RJ Brazil

This paper presents MODENA, an architecture for scientific models management using Computational Grid platform. This architecture is comprised of two systems: ModManager and ModRunner. ModManager deals with knowledge management about scientific models, acting as a scientific models library allowing for cataloguing, searching, reutilization and generation of new models. To achieve this, a metamodel is proposed to classify models, in order to support the organization, searching and retrieving of models. ModRunner manages the execution of models in a Grid environment allowing for model composition to generate a scientific Grid Workflow to be executed by distributed services offered by Grid Services. An initial prototype of ModManager is presented.

关键词： Knowledge management

来源：评论

学校读者我要写书评

暂无评论

Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights

arXiv

引用

arXiv 2024年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min The Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei11529 Taiwan The Institute of Information Systems and Applications National Tsing Hua University Hsinchu300044 Taiwan The Department of Computer Science National Chengchi University Taipei11529 Taiwan The Department of Electrical Engineering The Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan The Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan The Institute of Information Science Academia Sinica Taipei11529 Taiwan

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. Despite extensive research on unimodal deepfake detection, identifying complex deepfakes through joint analysis of audio and visual streams remains relatively unexplored. To fill this gap, this survey first provides an overview of audiovisual deepfake generation techniques, applications, and their consequences, and then provides a comprehensive review of state-of-the-art methods that combine audio and visual modalities to enhance detection accuracy, summarizing and critically analyzing their strengths and limitations. Furthermore, we discuss existing open source datasets for a deeper understanding, which can contribute to the research community and provide necessary information to beginners who want to analyze deep learning-based audiovisual methods for video forensics. By bridging the gap between unimodal and multimodal approaches, this paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity. © 2024, CC BY.

关键词： Audiovisual

来源：评论

学校读者我要写书评

暂无评论

Unmasking Illusions: Understanding Human Perception of Audiovisual Deepfakes

arXiv

引用

arXiv 2024年

作者： Hashmi, Ammarah Shahzad, Sahibzada Adil Lin, Chia-Wen Tsao, Yu Wang, Hsin-Min Social Networks and Human-Centered Computing Program Taiwan International Graduate Program Institute of Information Science Academia Sinica Taipei11529 Taiwan Institute of Information Systems and Applications National Tsing Hua University Hsinchu300044 Taiwan Department of Computer Science National Chengchi University Taipei11529 Taiwan Department of Electrical Engineering Institute of Communications Engineering National Tsing Hua University Hsinchu300044 Taiwan Research Center for Information Technology Innovation Academia Sinica Taipei11529 Taiwan Institute of Information Science Academia Sinica Taipei11529 Taiwan

The emergence of contemporary deepfakes has attracted significant attention in machine learning research, as artificial intelligence (AI) generated synthetic media increases the incidence of misinterpretation and is difficult to distinguish from genuine content. Currently, machine learning techniques have been extensively studied for automatically detecting deepfakes. However, human perception has been less explored. Malicious deepfakes could ultimately cause public and social problems. Can we humans correctly perceive the authenticity of the content of the videos we watch? The answer is obviously uncertain;therefore, this paper aims to evaluate the human ability to discern deepfake videos through a subjective study. We present our findings by comparing human observers to five state-of-the-art deepfake detection models. To this end, we used gamification concepts to provide 110 participants (55 native English speakers and 55 non-native English speakers) with a web-based platform where they could access a series of 40 videos (20 real and 20 fake) to determine their authenticity. Each participant performed the experiment twice with the same 40 videos in different random orders. The videos are manually selected from the FakeAVCeleb dataset. We found that all AI models performed significantly better than humans when evaluated on the same 40 videos. The study also reveals that while deception is not impossible, humans tend to overestimate their detection capabilities. Our experimental results may help benchmark human versus machine performance, advance forensics analysis, and enable adaptive countermeasures. © 2024, CC BY.

关键词： Audiovisual

来源：评论

学校读者我要写书评

暂无评论

Double-SP Method to Enhance Privacy and Security of Smart City Applications

Double-SP Method to Enhance Privacy and Security of Smart Ci...

引用

International Conference on computing for Sustainable Global Development (INDIACom)

作者： Nour Mahmoud Bahbouh Abdulelah Alhussain Hassan Hakami Yaser Mohammed Aljohani Adnan Ahmed Abi Sen Ahmad Alkhodre Aeshah Alsughayyir Department of Information and Communication Sciences Granada University Granada Spain Saudi Electronic University Al-Madinah Saudi Arabia YasRef Program Yanbu Saudi Arabia Computing and Information Technology Islamic University Al-Madinah Saudi Arabia Faculty of Computer and Information Systems Islamic University Al-Madinah Saudi Arabia College of Computer Science and Engineering Taibah University Al-Madinah Saudi Arabia

Smart cities promise a lot of well-being to their users in all areas of life through millions of applications and services. Smart services rely heavily on collecting data and the preferences of users. But on the dark side, the users' information is posed to threat and penetration during transmission or stored far in the clouds. Depending on encryption only is not sufficient if the attacker has strong resources or if the attacker is the service provider (SP) itself. In addition, changing data before sending is not a practical solution in many systems because of the adverse impact on the quality of a main service. This research presented a new idea to address the issue of protection. The proposed method enhanced the privacy and security of users' data without affecting the accuracy of service. The core of the suggested solution relies on a knowledge base of services that are managed by experts. Also, the solution depends on fog nodes to measure the level of security and privacy of users' queries without delay. Moreover, the fog nodes manage contact with SPs. Finally, the proposed method divided the SP into two, one for user queries and the other for user data. The simulation and analytical discussion on a practical case in smart cities demonstrated the superiority of the proposed approach over previous methods in the level of protection by maintaining the quality of services, and the resistance to attacks.

关键词： Resistance Privacy Data privacy Machine learning algorithms Smart cities Knowledge based systems Quality of service

来源：评论

学校读者我要写书评

暂无评论

Self-Awareness for Autonomous systems

引用

PROCEEDINGS OF THE IEEE 2020年第7期108卷 971-975页

作者： Dutt, Nikil Regazzoni, Carlo S. Rinner, Bernhard Yao, Xin Nikil Dutt (Fellow IEEE) received the Ph.D. degree from the University of Illinois at Urbana–Champaign Champaign IL USA in 1989.""He is currently a Distinguished Professor of computer science (CS) cognitive sciences and electrical engineering and computer sciences (EECS) with the University of California at Irvine Irvine CA USA. He is a coauthor of seven books. His research interests include embedded systems electronic design automation (EDA) computer architecture distributed systems healthcare Internet of Things (IoT) and brain-inspired architectures and computing.""Dr. Dutt is a Fellow of ACM. He was a recipient of the IFIP Silver Core Award. He has received numerous best paper awards. He serves as the Steering Committee Chair of the IEEE/ACM Embedded Systems Week (ESWEEK). He is also on the steering organizing and program committees of several premier EDA and embedded system design conferences and workshops. He has served on the Editorial Boards for the IEEE Transactions on Very Large Scale Integration (VLSI) Systems and the ACM Transactions on Embedded Computing Systems and also previously served as the Editor-in-Chief (EiC) for the ACM Transactions on Design Automation of Electronic Systems. He served on the Advisory Boards of the IEEE Embedded Systems Letters the ACM Special Interest Group on Embedded Systems the ACM Special Interest Group on Design Automationt and the ACM Transactions on Embedded Computing Systems. Carlo S. Regazzoni (Senior Member IEEE) received the M.S. and Ph.D. degrees in electronic and telecommunications engineering from the University of Genoa Genoa Italy in 1987 and 1992 respectively.""He is currently a Full Professor of cognitive telecommunications systems with the Department of Electrical Electronics and Telecommunication Engineering and Naval Architecture (DITEN) University of Genoa and a Co-Ordinator of the Joint Doctorate on Interactive and Cognitive Environments (JDICE) international Ph.D. course started initially as EU Erasmus Mundus Project and

Autonomous systems are able to make decisions and potentially take actions without direct human intervention, which requires some knowledge about the system and its environment as well as goal-oriented reasoning. In computer systems, one can derive such behavior from the concept of a rational agent with autonomy (“control over its own actions”), reactivity (“react to events from the environment”), proactivity (“act on its own initiative”), and sociality (“interact with other agents”) as fundamental properties \n[1]\n. Autonomous systems will undoubtedly pervade into our everyday lives, and we will find them in a variety of domains and applications including robotics, transportation, health care, communications, and entertainment to name a few. \nThe articles in this month’s special issue cover concepts and fundamentals, architectures and techniques, and applications and case studies in the exciting area of self-awareness in autonomous systems.

关键词： Special issues and sections Autonomous systems Self-aware Robot sensing systems Computational modeling

来源：评论

学校读者我要写书评

暂无评论

Fair Patient Model: Mitigating Bias in the Patient Representation Learned from the Electronic Health Records

arXiv

引用

arXiv 2023年

作者： Sivarajkumar, Sonish Huang, Yufei Wang, Yanshan Intelligent Systems Program School of Computing and Information University of Pittsburgh PittsburghPA United States Department of Electrical and Computer Engineering University of Pittsburgh PittsburghPA United States Department of Health Information Management University of Pittsburgh PittsburghPA United States Department of Biomedical Informatics University of Pittsburgh PittsburghPA United States Clinical and Translational Science Institute University of Pittsburgh PittsburghPA United States

Objective: To pre-train fair and unbiased patient representations from Electronic Health Records (EHRs) using a novel weighted loss function that reduces bias and improves fairness in deep representation learning models. Methods: We defined a new loss function, called weighted loss function, in the deep representation learning model to balance the importance of different groups of patients and features. We applied the proposed model, called Fair Patient Model (FPM), to a sample of 34,739 patients from the MIMIC-III dataset and learned patient representations for four clinical outcome prediction tasks. Results: FPM outperformed the baseline models in terms of three fairness metrics: demographic parity, equality of opportunity difference, and equalized odds ratio. FPM also achieved comparable predictive performance with the baselines, with an average accuracy of 0.7912. Feature analysis revealed that FPM captured more information from clinical features than the baselines. Conclusion: FPM is a novel method to pre-train fair and unbiased patient representations from EHR data using a weighted loss function. The learned representations can be used for various downstream tasks in healthcare and can be extended to other domains where bias and fairness are important. Copyright © 2023, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：