检索结果-内蒙古大学图书馆

Lip-Audio Modality Fusion for Deep Forgery Video Detection

computers, Materials & Continua 2025年第2期82卷 3499-3515页

作者： Yong Liu Zhiyu Wang Shouling Ji Daofu Gong Lanxin Cheng Ruosi Cheng College of Cyberspace Security Information Engineering UniversityZhengzhou450001China Research Institute of Intelligent Networks Zhejiang LabHangzhou311121China College of Computer Science and Technology Zhejiang UniversityHangzhou310027China Henan Key Laboratory of Cyberspace Situation Awareness Zhengzhou450001China Key Laboratory of Cyberspace Security Ministry of EducationZhengzhou450001China

In response to the problem of traditional methods ignoring audio modality tampering, this study aims to explore an effective deep forgery video detection technique that improves detection precision and reliability by fusing lip images and audio signals. The main method used is lip-audio matching detection technology based on the Siamese neural network, combined with MFCC (Mel Frequency Cepstrum Coefficient) feature extraction of band-pass filters, an improved dual-branch Siamese network structure, and a two-stream network structure design. Firstly, the video stream is preprocessed to extract lip images, and the audio stream is preprocessed to extract MFCC features. Then, these features are processed separately through the two branches of the Siamese network. Finally, the model is trained and optimized through fully connected layers and loss functions. The experimental results show that the testing accuracy of the model in this study on the LRW (Lip Reading in the Wild) dataset reaches 92.3%;the recall rate is 94.3%;the F1 score is 93.3%, significantly better than the results of CNN (Convolutional Neural networks) and LSTM (Long Short-Term Memory) models. In the validation of multi-resolution image streams, the highest accuracy of dual-resolution image streams reaches 94%. Band-pass filters can effectively improve the signal-to-noise ratio of deep forgery video detection when processing different types of audio signals. The real-time processing performance of the model is also excellent, and it achieves an average score of up to 5 in user research. These data demonstrate that the method proposed in this study can effectively fuse visual and audio information in deep forgery video detection, accurately identify inconsistencies between video and audio, and thus verify the effectiveness of lip-audio modality fusion technology in improving detection performance.

关键词： Deep forgery video detection lip-audio modality fusion mel frequency cepstrum coefficient siamese neural network band-pass filter

来源：评论

学校读者我要写书评

暂无评论

Fusion of Time-Frequency Features in Contrastive Learning for Shipboard Wind Speed Correction

引用

Journal of Ocean University of China 2025年第2期24卷 377-386页

作者： SONG Jian HUANG Meng LI Xiang ZHANG Zhenqiang WANG Chunxiao ZHAO Zhigang Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center(National Supercomputer Center in Jinan)Qilu University of Technology(Shandong Academy of Sciences)Jinan 250000China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer ScienceJinan 250000China

Accurate wind speed measurements on maritime vessels are crucial for weather forecasting,sea state prediction,and safe ***,vessel motion and challenging environmental conditions often affect measurement *** address this issue,this study proposes an innovative framework for correcting and predicting shipborne wind *** integrating a main network with a momentum updating network,the proposed framework effectively extracts features from the time and frequency domains,thereby allowing for precise adjustments and predictions of shipborne wind speed *** using real sensor data collected at the Qingdao Oceanographic Institute demonstrates that the proposed method outperforms existing approaches in single-and multi-step predictions compared to existing methods,achieving higher accuracy in wind speed *** proposed innovative approach offers a promising direction for future validation in more realistic maritime onboard scenarios.

关键词： time series prediction wind speed correction comparative learning shipborne sensor

来源：评论

学校读者我要写书评

暂无评论

Multiple Edge Data Integrity Verification with Multi-Vendors and Multi-Servers in Mobile Edge Computing

引用

IEEE Transactions on Mobile Computing 2025年第6期24卷 4668-4683页

作者： Islam, Md Rashedul Xiang, Yong Uddin, Md Palash Zhao, Yao Kua, Jonathan Gao, Longxiang The School of Information Technology Deakin University GeelongVIC3220 Australia The Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology Shandong Academy of Sciences Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

Ensuring Edge Data Integrity (EDI) is imperative in providing reliable and low-latency services in mobile edge computing. Existing EDI schemes typically address single-vendor (App Vendor, AV) single-server (Edge Server, ES), single-vendor multi-server, and multi-vendor multi-server scenarios, which consider a single data replica cached by an ES from the AVs. However, the most practical scenario of Multi-Vendors and Multi-Servers with Multiple Data (MVMS-MD) cached by an ES from different AVs remains unexplored. Current solutions struggle when applied to this scenario due to increased computation and communication costs in the verification process across all ESs using the classical challenge-response per-data multi-round strategy. To tackle this issue, we propose a Multiple EDI-Verification (MEDI-V) approach in this paper. In particular, our MEDI-V utilizes an adaptive Merkle Hash Tree (ad-MHT) to efficiently generate a tree of multiple data replicas within each AV. Next, the dynamic mechanism computes minimal verification information using ad-MHT to create a challenge for individual ESs to produce EDI proofs. The ES then leverages its ad-MHT and the ES’s proof to send the reconstructed ad-MHT root to the AV for verification. Theoretical insights into MEDI-V’s correctness, efficiency, security, and comprehensive evaluations demonstrate its superiority in addressing MEDI issues in the MVMS-MD scenario. © 2002-2012 IEEE.

关键词： Data integrity

来源：评论

学校读者我要写书评

暂无评论

MUNE: A Multi-Level User-News Embedding Model for Personalised News Recommendations 24

MUNE: A Multi-Level User-News Embedding Model for Personalis...

引用

8th International Conference on computer Science and Artificial Intelligence, CSAI 2024

作者： Long, Haixiang Luo, Xudong School of Computer Science and Engineering Guangxi Key Lab of Multi-Source Information Mining & Security Key Lab of Education Blockchain and Intelligent Technology of Ministry of Education Guangxi Normal University Guangxi Guilin China

ISBN: (纸本)9798400718182

Personalised news recommendation systems are critical for delivering relevant content, but effectively capturing and modelling users’ diverse and evolving interests is challenging. In this paper, we introduce a Multi-level User-News Embedding (MUNE) model for personalised news recommendations. MUNE uses pre-trained BERT embeddings to generate contextual representations, enabling dynamic, multi-level interaction modelling between users and candidate news. It incorporates a Dynamic Multi-Level Interaction Attention (DMIA) module for capturing complex interactions and a Dynamic Similarity Unit (DSU) for enhancing feature fusion using cosine similarity and non-linear transformations. Evaluated on large-scale datasets (MIND and EB-NeRD), MUNE significantly outperforms state-of-the-art baselines in key metrics, with ablation studies validating the importance of DMIA and DSU in improving user interest modelling and recommendation quality. MUNE’s integration of multi-level features makes it highly effective in capturing user behaviours and understanding news content. © 2024 Copyright held by the owner/author(s).

关键词： Linear transformations

来源：评论

学校读者我要写书评

暂无评论

Cascaded Sliding-Window-Based Relativistic GAN Fusion for Perceptual and Consistent Video Super-Resolution 6th

Cascaded Sliding-Window-Based Relativistic GAN Fusion for P...

引用

6th IFIP TC 12 International Conference on Intelligence Science, ICIS 2024

作者： Li, Dingyi PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education and Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing210094 China

ISBN: (纸本)9783031712524

Perceptual video super-resolution aims at converting low-resolution videos to visually appealing high-resolution ones. It may lead to temporal inconsistency due to the drastically changing outputs. In this paper, we propose cascaded sliding-window-based relativistic GAN (Generative Adversarial Network) fusion for perceptual and consistent video super-resolution (PC-VSR). Firstly, cascaded sliding-window-based relativistic GAN is designed to extract more useful information. It enlarges the temporal receptive field of sliding-window-based model in each step. It is able to enhance perceptual quality and compensate temporal consistency progressively and sufficiently. The trained separate refinement generator networks are fused into a final refinement generator. The final refinement generator can be calculated recursively at the testing stage. With our generator fusion, the parameter number is reduced and good quality is maintained. Extensive experimental results demonstrate that our approach outperforms state-of-the-art super-resolution methods in terms of perceptual quality. Our method also achieves good temporal consistency and per-pixel accuracy, compared with other perceptual approaches. © IFIP International Federation for information Processing 2025.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Modeling High-Order Relationships Between Human and Video for Emotion Recognition in Video Learning 31st

Modeling High-Order Relationships Between Human and Video f...

引用

31st International Conference on Multimedia Modeling, MMM 2025

作者： Ai, Hanxu Tao, Xiaomei Li, Xingbing Gan, Yanling Key Lab of Education Blockchain and Intelligent Technology Ministry of Education Guangxi Normal University Guilin541004 China Guangxi Key Lab of Multi-Source Information Mining and Security Guangxi Normal University Guilin541004 China School of Computer Science and Engineering Guangxi Normal University Guilin541004 China

ISBN: (纸本)9789819620630

In video learning, accurately identifying learners’ emotional state is fundamental for enhancing the learner experience and improving teaching effectiveness. Most existing methods focus on analyzing learners’ physiological signals, neglecting the impact of instructional videos on learners, especially the hidden high-order relationships between video stimuli and physiological signals. This paper introduces a Multimodal Multi-Hpergraph emotion recognition framework, MMH, leveraging the strengths of hypergraphs in modeling high-order relationships. MMH captures high-order relationships between different modalities within instructional videos and between videos and learners, aiming to identify learners’ emotional states during video learning. During the hypergraph construction process, we employ two strategies to construct the hypergraph: (1) using multiple k-value feature KNN construction methods, and (2) construction methods based on vertex attributes. In the hypergraph learning process, we introduce a vertex attention mechanism to update vertex features during the hypergraph learning process, further improving the emotion recognition performance of MMH. Our method achieves state-of-the-art cross-subject emotion recognition performance on the VLMED dataset. Experimental results on two public benchmark datasets, MAHNOB-HCI and DEAP, further verify the effectiveness of our method in emotion recognition tasks. Our source code will be made publicly availab.e upon acceptance of the paper. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Across-Platform Detection of Malicious Cryptocurrency Accounts via Interaction Feature Learning

引用

IEEE Transactions on information Forensics and security 2025年 20卷 4783-4798页

作者： Che, Zheng Shen, Meng Tan, Zhehui Du, Hanbiao Wang, Wei Chen, Ting Zhao, Qinglin Xie, Yong Zhu, Liehuang Beijing Institute of Technology School of Computer Science Beijing100081 China Beijing Institute of Technology School of Cyberspace Science and Technology Beijing100081 China Xi’an Jiaotong University Ministry of Education Key Lab for Intelligent Networks and Network Security Xi’an710049 China University of Electronic Science and Technology of China School of Computer Science and Engineering Chengdu611731 China Macau University of Science and Technology School of Computer Science and Engineering Macau China School of Computer and Information Science Qinghai institute of Technology China Xining810016 China

With the rapid evolution of Web3.0, cryptocurrency has become a cornerstone of decentralized finance. While these digital assets enable efficient and borderless financial transactions, their pseudonymous nature has also attracted malicious activities such as money laundering, fraud, and other financial crimes. Effective detection of malicious accounts is crucial to maintaining the security and integrity of the Web 3.0 ecosystem. Existing malicious account detection methods rely on large amounts of lab.led data and suffer from low generalization. lab.l-efficient and generalizable malicious account detection remains a challenging task. In this paper, we propose ShadowEyes, a framework for detecting malicious accounts by leveraging interaction feature learning with only a small lab.led dataset. Specifically, We first propose a generalized account representation named TxGraph, which captures the universal interaction features of Ethereum and Bitcoin. Then we carefully design an account representation augmentation method tailored to simulate the evolution of malicious accounts to generate positive pairs. We conduct extensive experiments using public datasets to evaluate the performance of ShadowEyes. The results demonstrate that it outperforms state-of-the-art (SOTA) methods in four typical scenarios. Specifically, in the scenario of acrossplatform malicious account detection, ShadowEyes maintains an F1 score of around 90%, which is 10% higher than the SOTA method. In the zero-shot learning scenario, it can achieve an F1 score of 79.56% for detecting gambling accounts, surpassing the SOTA method by 10.44%. © 2005-2012 IEEE.

关键词： Zero-shot learning

来源：评论

学校读者我要写书评

暂无评论

Using Multi-Feature Weak Consensus Model to Discover Essential Proteins

IEEE Transactions on Computational Biology and Bioinformatic...

引用

IEEE Transactions on Computational Biology and Bioinformatics 2025年第1期22卷 322-332页

作者： Zhipeng Hu Gaoshi Li Xinlong Luo Jiafei Liu Jingli Wu Wei Peng Xiaoshu Zhu Key Lab of Education Blockchain and Intelligent Technology Ministry of Education The Guangxi Key Lab of Multi-source Information Mining & Security The College of Computer Science and Engineering Guangxi Normal University Guilin China Faculty of Information Engineering and Automation Kunming University of Science and Technology Kunming China School of Computer and Information Security & School of Software Engineering Guilin University of Electronic Science and Technology Guilin China

Essential proteins play an essential role in cell survival and replication. Currently, more and more computational methods are developed to identify essential proteins, which overcome the time-consuming, costly and inefficient shortcomings with biological experimental methods. In order to improve the recognition rate, some new methods by fusing multiple features are developed, but they seldom consider the connection among features. After analyzing a large number of methods based on multi-feature fusion, a phenomenon among features is found, called weak consensus, then a weak consensus model to fuse these features is proposed in this paper. After analyzing the relationship between a protein and its neighbors in protein-protein interaction networks, a new centrality, namely neighborhood aggregation centrality(NAC) is developed in this paper. Then, a Max-Min strategy is used to integrate NAC with Pearson correlation coefficient and Jaccard similarity coefficient based on gene expression data to obtain local importance score. In addition, orthologous feature score is used to measure proteins conservation. Finally, by using the weak consensus model to fuse orthologous feature score with local importance score, a new method WOL is proposed in this paper. Then experiments are performed on *** data. The results show that compared with WDC, PeC, ION, JDC, NCCO and E_POC, WOL has a higher recognition rate.

关键词： Proteins Computational biology Bioinformatics Feature extraction Biological system modeling Fuses Computational modeling Shape Reliability Minimax techniques

来源：评论

学校读者我要写书评

暂无评论

Disentangled Noisy Correspondence Learning

引用

IEEE Transactions on Image Processing 2025年 34卷 2602-2615页

作者： Dang, Zhuohang Luo, Minnan Wang, Jihong Jia, Chengyou Han, Haochen Wan, Herun Dai, Guang Chang, Xiaojun Wang, Jingdong Xi’an Jiaotong University School of Computer Science and Technology Ministry of Education Key Laboratory of Intelligent Networks and Network Security Shaanxi Province Key Laboratory of Big Data Knowledge Engineering Shaanxi Xi’an710049 China SGIT AI Laboratory Xi’an710048 China State Grid Corporation of China State Grid Shaanxi Electric Power Company Ltd. Xi’an710048 China University of Science and Technology of China School of Information Science and Technology Hefei230026 China Abu Dhabi United Arab Emirates Baidu Inc. Beijing100085 China

Cross-modal retrieval is crucial in understanding latent correspondences across modalities. However, existing methods implicitly assume well-matched training data, which is impractical as real-world data inevitably involves imperfect alignments, i.e., noisy correspondences. Although some works explore similarity-based strategies to address such noise, they suffer from sub-optimal similarity predictions influenced by modality-exclusive information (MEI), e.g., background noise in images and abstract definitions in texts. This issue arises as MEI is not shared across modalities, thus aligning it in training can markedly mislead similarity predictions. Moreover, although intuitive, directly applying previous cross-modal disentanglement methods suffers from limited noise tolerance and disentanglement efficacy. Inspired by the robustness of information bottlenecks against noise, we introduce DisNCL, a novel information-theoretic framework for feature Disentanglement in Noisy Correspondence Learning, to adaptively balance the extraction of modality-invariant information (MII) and MEI with certifiable optimal cross-modal disentanglement efficacy. DisNCL then enhances similarity predictions in modality-invariant subspace, thereby greatly boosting similarity-based alleviation strategy for noisy correspondences. Furthermore, DisNCL introduces soft matching targets to model noisy many-to-many relationships inherent in multi-modal inputs for noise-robust and accurate cross-modal alignment. Extensive experiments confirm DisNCL’s efficacy by 2% average recall improvement. Mutual information estimation and visualization results show that DisNCL learns meaningful MII/MEI subspaces, validating our theoretical analyses. © 1992-2012 IEEE.

关键词： information theory

来源：评论

学校读者我要写书评

暂无评论

Learning Inverse Laplacian Pyramid for Progressive Depth Completion

arXiv

引用

arXiv 2025年

作者： Wang, Kun Yan, Zhiqiang Fan, Junkai Li, Jun Yang, Jian PCA Lab Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education Jiangsu Key Lab of Image and Video Understanding for Social Security School of Computer Science and Engineering Nanjing University of Science and Technology Nanjing China

Depth completion endeavors to reconstruct a dense depth map from sparse depth measurements, leveraging the information provided by a corresponding color image. Existing approaches mostly hinge on single-scale propagation strategies that iteratively ameliorate initial coarse depth estimates through pixel-level message passing. Despite their commendable outcomes, these techniques are frequently hampered by computational inefficiencies and a limited grasp of scene context. To circumvent these challenges, we introduce LP-Net, an innovative framework that implements a multi-scale, progressive prediction paradigm based on Laplacian Pyramid decomposition. Diverging from propagation-based approaches, LP-Net initiates with a rudimentary, low-resolution depth prediction to encapsulate the global scene context, subsequently refining this through successive upsampling and the reinstatement of high-frequency details at incremental scales. We have developed two novel modules to bolster this strategy: 1) the Multi-path Feature Pyramid module, which segregates feature maps into discrete pathways, employing multi-scale transformations to amalgamate comprehensive spatial information, and 2) the Selective Depth Filtering module, which dynamically learns to apply both smoothness and sharpness filters to judiciously mitigate noise while accentuating intricate details. By integrating these advancements, LP-Net not only secures state-of-the-art (SOTA) performance across both outdoor and indoor benchmarks such as KITTI, NYUv2, and TOFDC, but also demonstrates superior computational efficiency. At the time of submission, LP-Net ranks 1st among all peer-reviewed methods on the official KITTI leaderboard. The source code will be made publicly accessible upon paper acceptance. © 2025, CC BY-NC-SA.

关键词： Laplace transforms

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：