检索结果-内蒙古大学图书馆

Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yaning Li, Qiufu Yu, Zitong Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Guangdong Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Guangdong Shenzhen518060 China School of Computing and Information Technology Great Bay University Guangdong Dongguan523000 China

Face forgery detection (FFD) is devoted to detecting the authenticity of face images. Although current CNN-based works achieve outstanding performance in FFD, they are susceptible to capturing local forgery patterns generated by various manipulation methods. Though transformer-based detectors exhibit improvements in modeling global dependencies, they are not good at exploring local forgery artifacts. Hybrid transformer-based networks are designed to capture local and global manipulated traces, but they tend to suffer from the attention collapse issue as the transformer block goes deeper. Besides, soft labels are rarely available. In this paper, we propose a distilled transformer network (DTN) to capture both rich local and global forgery traces and learn general and common representations for different forgery faces. Specifically, we design a mixture of expert (MoE) module to mine various robust forgery embeddings. Moreover, a locally-enhanced vision transformer (LEVT) module is proposed to learn locally-enhanced global representations. We design a lightweight multi-attention scaling (MAS) module to avoid attention collapse, which can be plugged and played in any transformer-based models with only a slight increase in computational costs. In addition, we propose a deepfake self-distillation (DSD) scheme to provide the model with abundant soft label information. Extensive experiments show that the proposed method surpasses the state of the arts on five deepfake datasets. Copyright © 2024, The Authors. All rights reserved.

关键词： Face recognition

Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Xiaoqing Nie, Qiushi Xiao, Zunjie Zhao, Jilu Wu, Xiao Guo, Pengxin Li, Runzhi Liu, Jin Wei, Yanjie Pan, Yi Center for High Performance Computing Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Shenzhen518055 China Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China Department of Statistics and Actuarial Science The University of Hong Kong 999077 Hong Kong Cooperative Innovation Center of Internet Healthcare Zhengzhou University Zhengzhou450001 China Hunan Provincial Key Lab on Bioinformatics School of Computer Science and Engineering Central South University Changsha410083 China Xinjiang Engineering Research Center of Big Data and Intelligent Software School of software Xinjiang University Wulumuqi830046 China Faculty of Computer Science and Control Engineering Shenzhen University of Advanced Technology Shenzhen China

Spatial pooling (SP) and cross-channel pooling (CCP) operators have been applied to aggregate spatial features and pixel-wise features from feature maps in deep neural networks (DNNs), respectively. Their main goal is to reduce computation and memory overhead without visibly weakening the performance of DNNs. However, SP often faces the problem of losing the subtle feature representations, while CCP has a high possibility of ignoring salient feature representations, which may lead to both miscalibration of confidence issues and suboptimal medical classification results. To address these problems, we propose a novel dual-view framework, the first to systematically investigate the relative roles of SP and CCP by analyzing the difference between spatial features and pixel-wise features. Based on this framework, we propose a new pooling method, termed dual-view pyramid pooling (DVPP), to aggregate multi-scale dual-view features. DVPP aims to boost both medical image classification and confidence calibration performance by fully leveraging the merits of SP and CCP operators from a dual-axis perspective. Additionally, we discuss how to fulfill DVPP with five parameter-free implementations. Extensive experiments on six 2D/3D medical image classification tasks show that our DVPP surpasses state-of-the-art pooling methods in terms of medical image classification results and confidence calibration across different DNNs. © 2024, CC BY.

关键词： Deep neural networks

MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yaning Wang, Tianyi Yu, Zitong Gao, Zan Shen, Linlin Chen, Shengyong Jinan250353 China Nanyang Technological University 50 Nanyang Ave Block N 4 639798 Singapore School of Computing and Information Technology Great Bay University Dongguan523000 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen518060 China Jinan250014 China The Key Laboratory of Computer Vision and System Ministry of Education Tianjin University of Technology Tianjin300384 China Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China

The rapid development of photo-realistic face generation methods has raised significant concerns in society and academia, highlighting the urgent need for robust and generalizable face forgery detection (FFD) techniques. Although existing approaches mainly capture face forgery patterns using image modality, other modalities like fine-grained noises and texts are not fully explored, which limits the generalization capability of the model. In addition, most FFD methods tend to identify facial images generated by GAN, but struggle to detect unseen diffusion-synthesized ones. To address the limitations, we aim to leverage the cutting-edge foundation model, contrastive language-image pre-training (CLIP), to achieve generalizable diffusion face forgery detection (DFFD). In this paper, we propose a novel multi-modal fine-grained CLIP (MFCLIP) model, which mines comprehensive and fine-grained forgery traces across image-noise modalities via language-guided face forgery representation learning, to facilitate the advancement of DFFD. Specifically, we devise a fine-grained language encoder (FLE) that extracts fine global language features from hierarchical text prompts. We design a multi-modal vision encoder (MVE) to capture global image forgery embeddings as well as fine-grained noise forgery patterns extracted from the richest patch, and integrate them to mine general visual forgery traces. Moreover, we build an innovative plug-and-play sample pair attention (SPA) method to emphasize relevant negative pairs and suppress irrelevant ones, allowing cross-modality sample pairs to conduct more flexible alignment. Extensive experiments and visualizations show that our model outperforms the state of the arts on different settings like cross-generator, cross-forgery, and cross-dataset evaluations. Copyright © 2024, The Authors. All rights reserved.

关键词： Alignment

How to respond to emerging threats of cyberspace security via social engineering? A novel paradigm to solve cyberspace security issues

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

作者： Lin, Hao Wang, Chun-Dong Gao, Hao-Yu School of Computer Science and Engineering Tianjin University of Technology Tianjin China Tianjin Key Laboratory of Intelligence Computing Novel Software Technology Ministry of Education Tianjin China Engineering Research Center of Learning-Based Intelligent System Ministry of Education Tianjin China College of Data Science and Application Inner Mongolia University of Technology Hohhot China

Cybersecurity researchers always ignore the "people" behind the issues when dealing with cyberspace security issues. The human and technological aspects of cyberspace security must be simultaneously addressed to enable a secure cyber environment. Social engineering is a discipline whose research object is people, and the combination of social engineering and cyberspace security can provide new solution ideas for lots of cyberspace security issues. This paper attempts to answer the question —— "How to solve cyberspace security issues via social engineering?" We briefly review existing frameworks for social engineering attacks and propose a novel, recursive, and iterative framework for social engineering attacks in cyberspace. The existing research achievements of combination of social engineering and cyberspace security were reviewed in the order of cyber personality, hacker psychology, human flesh search, and social engineering defense. To answer this question, we summarized four "guidelines" for using social engineering. Finally, we look ahead, give our thoughts, and discuss answers of the question and future research. It is aimed at getting more researchers of cyberspace security and social science to pay attention to this field. © 2022, CC BY.

关键词： Cybersecurity

Model-enhanced Vector Index

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Hailin Wang, Yujing Chen, Qi Chang, Ruiheng Zhang, Ting Miao, Ziming Hou, Yingyan Ding, Yang Miao, Xupeng Wang, Haonan Pang, Bochen Zhan, Yuefeng Sun, Hao Deng, Weiwei Zhang, Qi Yang, Fan Xie, Xing Yang, Mao Cui, Bin School of Computer Science Key Lab of High Confidence Software Technologies Peking University China Microsoft United States Aerospace Information Research Institute Key Laboratory of Target Cognition and Application Technology Chinese Academy of Sciences China Institute of Information Engineering Chinese Academy of Sciences China Carnegie Mellon University United States National University of Singapore Singapore National Engineering Laboratory for Big Data Analysis and Applications Peking University China

Embedding-based retrieval methods construct vector indices to search for document representations that are most similar to the query representations. They are widely used in document retrieval due to low latency and decent recall performance. Recent research indicates that deep retrieval solutions offer better model quality, but are hindered by unacceptable serving latency and the inability to support document updates. In this paper, we aim to enhance the vector index with endto- end deep generative models, leveraging the differentiable advantages of deep retrieval models while maintaining desirable serving efficiency. We propose Modelenhanced Vector Index (MEVI), a differentiable model-enhanced index empowered by a twin-tower representation model. MEVI leverages a Residual Quantization (RQ) codebook to bridge the sequence-to-sequence deep retrieval and embeddingbased models. To substantially reduce the inference time, instead of decoding the unique document ids in long sequential steps, we first generate some semantic virtual cluster ids of candidate documents in a small number of steps, and then leverage the well-adapted embedding vectors to further perform a fine-grained search for the relevant documents in the candidate virtual clusters. We empirically show that our model achieves better performance on the commonly used academic benchmarks MSMARCO Passage and Natural Questions, with comparable serving latency to dense retrieval solutions. Copyright © 2023, The Authors. All rights reserved.

关键词： Embeddings

Study on an Adaptive Clamping Device for Passive Safety Delivery of Vascular Intervention robot

学校读者我要写书评

暂无评论

Study on an Adaptive Clamping Device for Passive Safety Deli...

IEEE International Conference on Mechatronics and Automation

作者： Sheng Cao Shuxiang Guo Jian Guo Jian Wang Chunying Li Huiyin Xu Bin Wang Mingchao Ding Aerospace Center Hospital & the Key Laboratory of Convergence Medical Engineering System and Healthcare Technology School of Life Science & Ministry of Industry and Information Technology Beijing Institute of Technology Beijing China Shenzhen Institute of Advanced Biomedical Robot Company Limited Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China National Engineering Laboratory of Computer Technology for Big Data Systems Shenzhen University Shenzhen China

ISBN: (数字)9798350388077

ISBN: (纸本)9798350388084

In practical clinical applications, vascular intervention surgical robots have developed sophisticated human-machine interaction systems, enabling assistance to physicians in performing remote surgeries and providing intelligent visual feedback. However, regarding surgical safety, current research predominantly focuses on force feedback and robot control logic, with clamping mechanisms targeting the locking of catheters and guide wires. Excessive clamping force may lead to surface damage to intervention instruments, while insufficient force delivery may result from slippery surfaces. Therefore, addressing these issues, this study proposed a passive, compliant safety strategy for an adaptive clamping device based on a vascular intervention surgical robot platform. This device can accommodate different diameter catheters and maintain a constant delivery force during the intervention process. Finally, through experimentation, the effectiveness, safety, and stability of the device were demonstrated.

关键词： Visualization Medical robotics Force Wires robot control Surgery Safety

Weighted Linear Multiple Kernel Learning for Saliency Detection 2nd

学校读者我要写书评

暂无评论

Weighted Linear Multiple Kernel Learning for Saliency Detect...

2nd EAI International Conference on robotic Sensor Networks, ROSENET 2018

作者： Zhou, Quan Wu, Jinwen Fan, Yawen Zhang, Suofei Wu, Xiaofu Zheng, Baoyu Jin, Xin Lu, Huimin Latecki, Longin Jan National Engineering Research Center of Communications and Networking Nanjing University of Posts and Telecommunications Nanjing China State Key Laboratory for Novel Software Technology Nanjing University Nanjing China College of Information Engineering China University of Geosciences Wuhan China School of Internet of Things Nanjing University of Posts and Telecommunications Nanjing China National Engineering Research Center of Communications and Networking Nanjing University of Posts and Telecommunications Nanjing China Department of Cyber Security Beijing Electronic Science and Technology Institute Beijing China CETC Big Data Research Institute Co. Ltd. Guizhou Guiyang China Department of Mechanical and Control Engineering Kyushu Institute of Technology Kitakyushu Japan Department of Computer and Information Sciences Temple University PhiladelphiaPA United States

ISBN: (纸本)9783030177621

This paper presents a novel saliency detection method based on weighted linear multiple kernel learning (WLMKL), which is able to adaptively combine different contrast measurements in a supervised manner. Three commonly used bottom-up visual saliency operations are first introduced, including corner-surround contrast (CSC), center-surround contrast (CESC), and global contrast (GC). Then these contrast measures are fed into our WLMKL framework to produce the final saliency map. We show that the assigned weights for each contrast feature maps are always normalized in our WLMKL formulation. In addition, the proposed approach benefits from the advantages of the contribution of each individual contrast operation, and thus produces more robust and accurate saliency maps. The extensive experimental results show the effectiveness of the proposed model, and demonstrate the combination is superior to individual subcomponent. © 2020, Springer Science and Business Media Deutschland GmbH. All rights reserved.

关键词： Center-surround contrast Corner-surround contrast Global contrast Multiple kernel learning Saliency detection

Deep User Modeling for Content-based Event Recommendation in Event-based Social Networks

学校读者我要写书评

暂无评论

Deep User Modeling for Content-based Event Recommendation in...

IEEE Annual Joint Conference: INFOCOM, IEEE Computer and Communications Societies

作者： Zhibo Wang Yongquan Zhang Honglong Chen Zhetao Li Feng Xia Jiangsu Key Lab. of Big Data Security & Intelligent Processing NJUPT P. R. China School of Cyber Science and Engineering Wuhan University P. R. China College of Information and Control Engineering China University of Petroleum P. R. China College of Information Engineering Xiangtan University P. R. China School of Software Dalian University of Technology P. R. China

ISBN: (纸本)9781538641293

Event-based social networks (EBSNs) are the newly emerging social platforms for users to publish events online and attract others to attend events offline. The content information of events plays an important role in event recommendation. However, the content-based approaches in existing event recommender systems cannot fully represent the preference of each user on events since most of them focus on exploiting the content information from events' perspective, and the bag-of-words model, commonly used by them, can only capture word frequency but ignore word orders and sentence structure. In this paper, we shift the focus from events' perspective to users' perspective, and propose a Deep User Modeling framework for Event Recommendation (DUMER) to characterize the preference of users by exploiting the contextual information of events that users have attended. Specifically, we utilize convolutional neural network (CNN) with word embedding to deeply capture the contextual information of a user's interested events and build up a user latent model for each user. We then incorporate the user latent model into probabilistic matrix factorization (PMF) model to enhance the recommendation accuracy. We conduct experiments on the real-world dataset crawled from a typical EBSN, ***, and the experimental results show that DUMER outperforms the compared benchmarks.

关键词： Recommender systems Machine learning Social network services Feature extraction Context modeling Conferences Probabilistic logic

Mandari: Multi-Modal Temporal Knowledge Graph-aware Sub-graph Embedding for Next-POI Recommendation

学校读者我要写书评

暂无评论

Mandari: Multi-Modal Temporal Knowledge Graph-aware Sub-grap...

IEEE International Conference on Multimedia and Expo (ICME)

作者： Xiaoqian Liu Xiuyun Li Yuan Cao Fan Zhang Xiongnan Jin Jinpeng Chen School of Computer Science (National Pilot Software Engineering School) Beijing University of Posts and Telecommunications Beijing China Key Laboratory of Trustworthy Distributed Computing and Service (BUPT) Ministry of Education Beijing China The Technology Innovation Center of Cultural Tourism Big Data of Hebei Province Chengde China Hebei Normal University for Nationalities Chengde China Knowledge Discovery and Data Mining Research Center Zhejiang Lab Hangzhou China

Next-POI recommendation aims to explore from user check-in sequence to predict the next possible location to be visited. Existing methods are often difficult to model the implicit association of multi-modal data with user choices. Moreover, traditional methods struggle to fully explore the variation of user preferences at variable time intervals. To tackle these limitations, we propose a Multi-Modal Temporal Knowledge Graph-aware Sub-graph Embedding approach (Mandari). We first construct a novel Multi-Modal Temporal Knowledge Graph. Based on the proposed knowledge graph, we integrate multi-modal information and leverage the graph attention network to calculate sub-graph prediction probability. Next, we implement a temporal knowledge mining method to model the segmentation and periodicity of user check-in and obtain temporal prediction probability. Finally, we fuse temporal prediction probability with the previous sub-graph prediction probability to obtain the final result. Extensive experiments demonstrate that our approach outperforms existing state-of-the-art methods.

关键词：