检索结果-内蒙古大学图书馆

Detection of Deepfake videos using long distance attention

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Lu, Wei Liu, Lingyi Luo, Junwei Zhao, Xianfeng Zhou, Yicong Huang, Jiwu School of Computer Science and Engineering Guangdong Province Key Laboratory of Information Security Technology Ministry of Education Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-sen University Guangzhou510006 China State Key Laboratory of Information Security Institute of Information Engineering Chinese Academy of Sciences Beijing100195 China School of Cyber Security University of Chinese Academy of Sciences Beijing100195 China Department of Computer and Information Science University of Macau 999078 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Key Laboratory of Media Security Shenzhen University Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518055 China

With the rapid progress of deepfake techniques in recent years, facial video forgery can generate highly deceptive video contents and bring severe security threats. And detection of such forgery videos is much more urgent and challenging. Most existing detection methods treat the problem as a vanilla binary classification problem. In this paper, the problem is treated as a special fine-grained classification problem since the differences between fake and real faces are very subtle. It is observed that most existing face forgery methods left some common artifacts in the spatial domain and time domain, including generative defects in the spatial domain and inter-frame inconsistencies in the time domain. And a spatial-temporal model is proposed which has two components for capturing spatial and temporal forgery traces in global perspective respectively. The two components are designed using a novel long distance attention mechanism. The one component of the spatial domain is used to capture artifacts in a single frame, and the other component of the time domain is used to capture artifacts in consecutive frames. They generate attention maps in the form of patches. The attention method has a broader vision which contributes to better assembling global information and extracting local statistic information. Finally, the attention maps are used to guide the network to focus on pivotal parts of the face, just like other fine-grained classification methods. The experimental results on different public datasets demonstrate that the proposed method achieves the state-of-the-art performance, and the proposed long distance attention method can effectively capture pivotal parts for face forgery. Copyright © 2021, The Authors. All rights reserved.

关键词： Time domain analysis

Synthesis Lectures on Computer Vision

学校读者我要写书评

暂无评论

Preface

Synthesis Lectures on computer vision 2023年 Part F825卷 v-vi页

作者： Wan, Jun Escalera, Sergio Li, Stan Z. Guo, Guodong Escalante, Hugo Jair State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing China Department of Mathematics and Informatics University of Barcelona and Computer Vision Center Barcelona Spain AI Lab Westlake University Hangzhou China Department of Computer Science and Electrical Engineering West Virginia University Morgantown China Department of Computer Science Instituto Nacional de Astrofísica Optica y Electrónica Puebla Mexico

Learning Context-Based Non-local Entropy Modeling for Image Compression

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Timofte, Radu Zhang, David Zuo, Wangmeng Zhang, Kai Li, Mu School of Science and Engineering Chinese University of Hong Kong ShenzhenGuangdong518172 China Computer Vision Laboratory ETH Zurich Zurich Switzerland School of Computer Science and Technology Harbin Institute of Technology Harbin150001 China Shenzhen Research Institute of Big Data Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen China

The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in the performance. However, existing deep learning based entropy modeling methods generally assume the latent codes are statistically independent or depend on some side information or local context, which fails to take the global similarity within the context into account and thus hinder the accurate entropy estimation. To address this issue, we propose a non-local operation for context modeling by employing the global similarity within the context. Specifically, we first introduce the proxy similarity functions and spatial masks to handle the missing reference problem in context modeling. Then, we combine the local and the global context via a non-local attention block and employ it in masked convolutional networks for entropy modeling. The entropy model is further adopted as the rate loss in a joint rate-distortion optimization to guide the training of the analysis transform and the synthesis transform network in transforming coding framework. Considering that the width of the transforms is essential in training low distortion models, we finally produce an U-Net block in the transforms to increase the width with manageable memory consumption and time complexity. Experiments on Kodak and Tecnick datasets demonstrate the superiority of the proposed context-based non-local attention block in entropy modeling and the U-Net block in low distortion compression against the existing image compression standards and recent deep image compression models. Copyright © 2020, The Authors. All rights reserved.

关键词： Image compression

Regularization with multilevel non-stationary tight framelets for image restoration

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Li, Yan-Ran Chan, Raymond H.F. Shen, Lixin Zhuang, Xiaosheng College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Key Laboratory of Media Security Shenzhen University Shenzhen518060 China SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society China Department of Mathematics City University of Hong Kong Tat Chee Avenue Kowloon Tong Hong Kong Department of Mathematics Syracuse University SyracuseNY13244 United States

Variational regularization models are one of the popular and efficient approaches for image restoration. The regularization functional in the model carries prior knowledge about the image to be restored. The prior knowledge, in particular for natural images, are the first-order (i.e. variance in luminance) and second-order (i.e. contrast and texture) information. In this paper, we propose a model for image restoration, using a multilevel non-stationary tight framelet system that can capture the image's first-order and second-order information. We develop an algorithm to solve the proposed model and the numerical experiments show that the model is effective and efficient as compared to other higher-order models. Copyright © 2021, The Authors. All rights reserved.

关键词： Image reconstruction

Using micro- and macro-level network metrics unveils top communicative gene modules in psoriasis

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Naderi, Reyhaneh Mollaei, Homa Saadati Elofsson, Arne Ashtiani, Saman Hosseini Department of Artificial Intelligence and Robotics Faculty of Computer Engineering Iran University of Science and Technology Tehran Iran Department of Advanced Sciences and Technology Islamic Azad University Medical Branch Tehran Iran Department of Biochemistry and Biophysics and Science for Life Laboratory Stockholm University Stockholm106 91 Sweden

Background: Psoriasis is a multifactorial chronic inflammatory disorder of the skin with significant morbidity, characterized by hyper proliferation of the epidermis. Even though psoriasis etiology is not fully understood, it is believed to be multifactorial with numerous key components. Methods: In order to cast light on the complex molecular interactions in psoriasis vulgaris at both protein-protein interactions and transcriptomics levels, we analyzed a set of microarray gene expression analysis consisting of 170 paired lesional and non-lesional samples. Afterwards, a network analysis was conducted on protein-protein interaction network of differentially expressed genes based on micro- and macro-level network metrics at a systemic level standpoint. Results: We found 17 top communicative genes, all of which experimentally proven to be pivotal in psoriasis were identified in two modules, namely, cell cycle and immune system. Intra- and inter-gene interaction subnetworks from the top communicative genes might provide further insight into the corresponding characteristic mechanisms. Conclusions: Potential gene combinations for therapeutic/diagnostics purposes were identified. Moreover, our proposed pipeline could be of interest to a broader range of biological network analysis *** Codes 92C42 Copyright © 2020, The Authors. All rights reserved.

关键词： Dermatology

Soft yet Effective Robots via Holistic Co-Design

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Stölzle, Maximilian Pagliarani, Niccolò Stella, Francesco Hughes, Josie Laschi, Cecilia Rus, Daniela Cianchetti, Matteo Santina, Cosimo Della Zardini, Gioele Laboratory for Information & Decision Systems Massachusetts Institute of Technology CambridgeMA02139 United States Cognitive Robotics Delft University of Technology Mekelweg 2 CD Delft2628 Netherlands The BioRobotics Institute Scuola Superiore Sant’Anna Pisa56025 Italy Embodied AI AG Lausanne1015 Switzerland CREATE Lab EPFL Lausanne1015 Switzerland Advanced Robotics Centre Department of Mechanical Engineering National University of Singapore 117575 Singapore Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology CambridgeMA02139 United States

Soft robots promise inherent safety via their material compliance for seamless interactions with humans or delicate environments. Yet, their development is challenging because it requires integrating materials, geometry, actuation, and autonomy into complex mechatronic systems. Despite progress, the field struggles to balance task-specific performance with broader factors like durability and manufacturability—a difficulty that we find is compounded by traditional sequential design processes with their lack of feedback loops. In this perspective, we review emerging co-design approaches that simultaneously optimize the body and brain, enabling the discovery of unconventional designs highly tailored to the given tasks. We then identify three key shortcomings that limit the broader adoption of such co-design methods within the soft robotics domain. First, many rely on simulation-based evaluations focusing on a single metric, while real-world designs must satisfy diverse criteria. Second, current methods emphasize computational modeling without ensuring feasible realization, risking sim-to-real performance gaps. Third, high computational demands limit the exploration of the complete design space. Finally, we propose a holistic co-design framework that addresses these challenges by incorporating a broader range of design values, integrating real-world prototyping to refine evaluations, and boosting efficiency through surrogate metrics and model-based control strategies. This holistic framework, by simultaneously optimizing functionality, durability, and manufacturability, has the potential to enhance reliability and foster broader acceptance of soft robotics, transforming human-robot interactions. © 2025, CC BY.

关键词： Intellectual property core

REFUGE2 CHALLENGE: A TREASURE TROVE FOR MULTI-DIMENSION ANALYSIS AND EVALUATION IN GLAUCOMA SCREENING

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Fang, Huihui Li, Fei Wu, Junde Fu, Huazhu Sun, Xu Son, Jaemin Yu, Shuang Zhang, Menglu Yuan, Chenglang Bian, Cheng Lei, Baiying Zhao, Benjian Xu, Xinxing Li, Shaohua Fumero, Francisco Sigut, José Almubarak, Haidar Bazi, Yakoub Guo, Yuanhao Zhou, Yating Baid, Ujjwal Innani, Shubham Guo, Tianjiao Yang, Jie Orlando, José Ignacio Bogunović, Hrvoje Zhang, Xiulan Xu, Yanwu The REFUGE2 Challenge Australia State Key Laboratory of Ophthalmology Zhongshan Ophthalmic Center Sun Yat-Sen University Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science Guangzhou China Intelligent Healthcare Unit Baidu Inc. Beijing China The Institute of High Performance Computing Agency for Science Technology and Research Singapore Yatiris Group PLADEMA Institute CONICET UNICEN Tandil Argentina Christian Doppler Lab for Artificial Intelligence in Retina Department of Ophthalmology and Optometry Medical University of Vienna Vienna Austria VUNO Inc Seoul Korea Republic of Tencent HealthCare Tencent Shenzhen China Computer Vision Institute College of Computer Science and Software Engineering of Shenzhen University Shenzhen China School of Biomedical Engineering Health Science Center Shenzhen University China Xiaohe Healthcare ByteDance Guangdong Guangzhou510000 China School of Biomedical Engineering Shenzhen University China College of Computer Science & Software Engineering Shenzhen University China Department of Computer Science and Systems Engineering Universidad de La Laguna Spain Saudi Electronic University Saudi Arabia King Saud University Saudi Arabia Institute of Automation Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China SGGS Institute of Engineering and Technology India Institute of Medical Robotics Shanghai Jiao Tong University China Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China

With the rapid development of artificial intelligence (AI) in medical image processing, deep learning in color fundus photography (CFP) analysis is also evolving. Although there are some open-source, labeled datasets of CFPs in the ophthalmology community, large-scale datasets for screening only have labels of disease categories, and datasets with annotations of fundus structures are usually small in size. In addition, labeling standards are not uniform across datasets, and there is no clear information on the acquisition device. Here we release a multi-annotation, multi-quality, and multi-device color fundus image dataset for glaucoma analysis on an original challenge-Retinal Fundus Glaucoma Challenge 2nd Edition (REFUGE2). The REFUGE2 dataset contains 2000 color fundus images with annotations of glaucoma classification, optic disc/cup segmentation, as well as fovea localization. Meanwhile, the REFUGE2 challenge sets three sub-tasks of automatic glaucoma diagnosis and fundus structure analysis and provides an online evaluation framework. Based on the characteristics of multi-device and multi-quality data, some methods with strong generalizations are provided in the challenge to make the predictions more robust. This shows that REFUGE2 brings attention to the characteristics of real-world multi-domain data, bridging the gap between scientific research and clinical application. © 2022, CC BY-NC-ND.

关键词： Color

Continuity scaling: A rigorous framework for detecting and quantifying causality accurately

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Ying, Xiong Leng, Si-Yang Ma, Huan-Fei Nie, Qing Lai, Ying-Cheng Lin, Wei School of Mathematical Sciences SCMS SCAM Fudan University Shanghai200433 China Research Institute for Intelligent Complex Systems CCSB LCNBI Fudan University Shanghai200433 China State Key Laboratory of Medical Neurobiology MOE Frontiers Center for Brain Science Institutes of Brain Science Fudan University Shanghai200032 China Institute of AI and Robotics Academy for Engineering and Technology Fudan University Shanghai200433 China School of Mathematical Sciences Soochow University Suzhou215006 China Department of Mathematics Department of Developmental and Cell Biology NSF-Simons Center for Multiscale Cell Fate Research University of California IrvineCA92697-3875 United States School of Electrical Computer and Energy Engineering Arizona State University TempeAZ85287-5706 United States Shanghai Artificial Intelligence Laboratory Shanghai200232 China

Data based detection and quantification of causation in complex, nonlinear dynamical systems is of paramount importance to science, engineering and beyond. Inspired by the widely used methodology in recent years, the cross-map-based techniques, we develop a general framework to advance towards a comprehensive understanding of dynamical causal mechanisms, which is consistent with the natural interpretation of causality. In particular, instead of measuring the smoothness of the cross map as conventionally implemented, we define causation through measuring the scaling law for the continuity of the investigated dynamical system directly. The uncovered scaling law enables accurate, reliable, and efficient detection of causation and assessment of its strength in general complex dynamical systems, outperforming those existing representative methods. The continuity scaling based framework is rigorously established and demonstrated using datasets from model complex systems and the real world. Copyright © 2022, The Authors. All rights reserved.

关键词： Dynamical systems

Binary Channel Fuzzy Self-Adjusted Neural Network for Solving Time-Changing QP Problems

学校读者我要写书评

暂无评论

IEEE transactions on neural networks and learning systems 2025年 PP卷 PP页

作者： Yamei Luo Qingyi Ren Zihao Zheng Siyuan Chen Xin Ma Yu Liu Xiaoli Li Junzhi Yu Zhijun Zhang The Chinese University of Hong Kong Department of Mechanical and Automation Engineering Shatin Hong Kong South China University of Technology School of Automation Science and Engineering Guangzhou510640 China Southern University of Science and Technology Institute for Robotics Shenzhen518055 China Peking University College of Engineering Beijing100871 China South China University of Technology Key Library of Autonomous Systems and Network Control Ministry of Education School of Automation Science and Engineering Guangzhou510640 China Institute for Super Robotics Huangpu Guangzhou510555 China Nanchang University Jiangxi Thousand Talents Plan Nanchang330031 China Jishou University College of Computer Science and Engineering Jishou416000 China Guangdong Artificial Intelligence and Digital Economy Laboratory Pazhou Laboratory Guangzhou510335 China Shaanxi University of Technology Shaanxi Provincial Key Laboratory of Industrial Automation School of Mechanical Engineering Hanzhong 723001 China Changsha Normal University School of Information Science and Engineering Changsha410100 China Guangdong University of Petrochemical Technology School of Automation Science and Engineering Institute of Artificial Intelligence and Automation Maoming525000 China

A novel binary channel fuzzy self-adjusted neural network (BCF-SANN) is proposed and researched for solving time-changing quadratic programming (QP) problems in this article. Unlike the fixed parameters of the typical zeroing neural network, the main parameters of the proposed BCF-SANN are time-changing, and its errors are adaptively quickly convergent. The biggest advantage of the novel neural network is that it combines a fuzzy self-adjusted controller, which takes the errors and derivatives of errors as fuzzy inputs and neural networks, further improving the convergence and robustness of the neural networks. To design the novel neural network, a time-changing QP problem is first established; then, using Lagrange's law, the time-changing QP problem is transformed into a time-changing matrix equation; and finally, based on the time-changing parameter neural dynamics method, a novel BCF-SANN is proposed. The detailed design process is given in this article, and the convergence and robustness of the proposed BCF-SANN are proved by theoretical analysis. Through comparative experiments, it is demonstrated that the proposed BCF-SANN has a faster convergence rate and stronger robustness than the traditional zeroing neural network and 1-D fuzzy recurrent neural network (RNN).

关键词： Recurrent neural networks