The security threat of backdoor attacks is a central concern for deep neural networks (DNNs). Recently, without poisoned data, unlearning models with clean data and then learning a pruning mask have contributed to bac...
ISBN:
(纸本)9798331314385
The security threat of backdoor attacks is a central concern for deep neural networks (DNNs). Recently, without poisoned data, unlearning models with clean data and then learning a pruning mask have contributed to backdoor defense. Additionally, vanilla fine-tuning with those clean data can help recover the lost clean accuracy. However, the behavior of clean unlearning is still under-explored, and vanilla fine-tuning unintentionally induces back the backdoor effect. In this work, we first investigate model unlearning from the perspective of weight changes and gradient norms, and find two interesting observations in the backdoored model: 1) the weight changes between poison and clean unlearning are positively correlated, making it possible for us to identify the backdoored-related neurons without using poisoned data; 2) the neurons of the backdoored model are more active (i.e., larger gradient norm) than those in the clean model, suggesting the need to suppress the gradient norm during fine-tuning. Then, we propose an effective two-stage defense method. In the first stage, an efficient Neuron Weight Change (NWC)-based Backdoor Reinitialization is proposed based on observation 1). In the second stage, based on observation 2), we design an Activeness-Aware Fine-Tuning to replace the vanilla fine-tuning. Extensive experiments, involving eight backdoor attacks on three benchmark datasets, demonstrate the superior performance of our proposed method compared to recent state-of-the-art backdoor defense approaches. The code is available at https://***/linweiii/***.
We carry out an in-depth analysis of the capability of the upcoming space-based gravitational wave mission eLISA in addressing the Hubble tension, with a primary focus on observations at intermediate redshifts (3 0) a...
详细信息
Assuming a slow-roll inflationary model where conformal invariance of the Maxwell action is broken via a non-minimal kinetic coupling term, we investigate the non-Gaussian three-point cross-correlation function betwee...
详细信息
Traditional image processing methods employing partial differential equations (PDEs) offer a multitude of meaningful regularizers, along with valuable theoretical foundations for a wide range of image-related tasks. T...
详细信息
Large-Eddy Simulation (LES) numerical experiments of neutrally-stratified turbulent flow over an urban-type surface and passive scalar transport by this flow are performed. A simple parameterization of the turbulent l...
详细信息
In this article, stability analysis and chaos control of three species food chain model have been studied in the fractional order case. The fractional order three-species food chain model with fear term is the extensi...
详细信息
We study the prospects of Gaussian processes (GP), a machine learning (ML) algorithm, as a tool to reconstruct the Hubble parameter H(z) with two upcoming gravitational wave missions, namely the evolved Laser Interfer...
详细信息
Artificial Intelligence (AI) is a disrupting technology, which has been changing our world. Photonics is a well-established technology, encompassing the generation, emission, transmission, modulation, signal processin...
详细信息
ISBN:
(数字)9798350361803
ISBN:
(纸本)9798350361810
Artificial Intelligence (AI) is a disrupting technology, which has been changing our world. Photonics is a well-established technology, encompassing the generation, emission, transmission, modulation, signal processing, switching, amplification, and detection of light. The aim of this work is two-fold. From one side we aim to explore how AI methods can be used in Photonics applications, understanding the ubiquity of such models thanks to a journey through some authors' Machine Learning applications, going from images in Radiomics up to time series analysis. We will show strengths and weaknesses of AI in Photonics, along with new possible perspectives. In addition, we will explore the integration of Photonics and AI, which is a burgeoning field that leverages the strengths of both technologies to overcome limitations inherent in traditional electronic-based computing systems. Actually, AI models, especially those utilizing Artificial Neural Networks, require substantial computational power and speed, which can be enhanced through photonic technologies. This synergy between AI and Photonics not only can accelerate computational processes but also opens new avenues for implementing advanced Machine Learning models in real-time applications, showcasing a significant paradigm shift in the field of computing.
We introduce an intelligent mesh smoothing method for the mesh quality improvement of unstructured 3D hexahedral meshes with fixed boundaries. We apply a supervised learning framework based on the deep neural networks...
详细信息
Accurately representing surface weather at the sub-kilometer scale is crucial for optimal decision-making in a wide range of applications. This motivates the use of statistical techniques to provide accurate and calib...
详细信息
暂无评论