Deep learning image classifiers are known to be vulnerable to small adversarial perturbations of input images. In this paper, we derive the locally optimal generalized likelihood ratio test based detector for detectin...
详细信息
ISBN:
(纸本)9781728176055
Deep learning image classifiers are known to be vulnerable to small adversarial perturbations of input images. In this paper, we derive the locally optimal generalized likelihood ratio test based detector for detecting stochastic targeted universal adversarial perturbations to a classifier's input. We employ a two-stage process to learn the detector's parameters, which involves unsupervised maximum likelihood estimation followed by supervised training and demonstrates better performance of the detector compared to other detection methods on several popular image classification datasets.
The imaging equipment working in the atmosphere will not only be limited by the performance of the imaging system, but also be affected by turbulence. In the fields of astronomical observation, ground-based remote sen...
详细信息
In recent years, score-based generative models (SGM) have achieved state-of-the-art (SOTA) performance in noisy image restoration [1], [2]. But at present, most of these methods are performed in the position space, an...
In recent years, score-based generative models (SGM) have achieved state-of-the-art (SOTA) performance in noisy image restoration [1], [2]. But at present, most of these methods are performed in the position space, and there is a lack in modeling of the velocity and acceleration of the image on the restoration path. In this paper, we propose a new image restoration method called conditional acceleration score approximation (CASA), which introduces velocity and acceleration variables on top of the data position along the recovery path. Guided by the degraded image, CASA can effectively and dynamically control the direction and speed of motion along the diffusion path in the reverse-time stochastic differential equation. Therefore, the key to this process is how to inject the degraded image as a guidance into the third-order reverse-time process in this position-velocity-acceleration space, especially in the evolution direction of the diffusion path. We propose a strategy for approximating the conditional acceleration score by decomposing the true posterior CAS into a priori CAS and an observed acceleration score for the measurement at the current moment. Experiments on 3 different datasets and 7 kinds of restoration tasks show that CASA is better than other methods and achieves a new SOTA.
Although adversarial training is the most reliable method to train robust deep neural networks so far, adversarially trained networks still show large gap between their accuracies on clean images and those on adversar...
详细信息
ISBN:
(纸本)9781665441155
Although adversarial training is the most reliable method to train robust deep neural networks so far, adversarially trained networks still show large gap between their accuracies on clean images and those on adversarial images. In conventional classification problem, one can gain higher accuracy by ensembling multiple networks. However, in adversarial training, there are obstacles to adopt such ensemble method. First, as inner maximization is expensive, training multiple networks adversarially becomes overburden. Moreover, the naive ensemble faces dilemma on choosing target model to generate adversarial examples with. Training adversarial examples of the members causes covariate shift, while training those of ensemble diminishes the benefit of ensembling. With these insights, we adopt stochastic weight average methods and improve it by considering overfitting nature of adversarial training. Our method take the benefit of ensemble while avoiding the described problems. Experiments on CIFAR10 and CIFAR100 shows our method improves the robustness effectively.
Single-photon Lidar is a promising 3D imaging technique, but it is challenging to deploy in real-world applications due to high noise levels and the presence of multiple surfaces per pixel. Existing statistical method...
详细信息
ISBN:
(数字)9789464593617
ISBN:
(纸本)9798331519773
Single-photon Lidar is a promising 3D imaging technique, but it is challenging to deploy in real-world applications due to high noise levels and the presence of multiple surfaces per pixel. Existing statisticalmethods are interpretable, but limited by the assumed model. Data-driven approaches show excellent performance, but with limited interpretability, preventing their use in critical applications. In this paper, we propose an interpretable deep learning architecture with graph attention networks for the reconstruction of dual peaks per pixel in single photon Lidar. Instead of the conventional image-based representation, we represent the solution as point clouds, allowing reconstruction of more than one surface per pixel. The proposed architecture is based on a statistical Bayesian algorithm, whose iterative steps are converted into neural network layers. This approach combines the advantages of both statistical and learning-based frameworks, providing good estimates with improved network interpretability. Experimental results demonstrate the effectiveness of the proposed method.
The enhancement of historical document images is critical for improving the quality and legibility of scanned or captured document images. Convolutional-based techniques previously generated competitive results for do...
详细信息
In recent years, the classification accuracy of CNN (convolutional neural network) steganalyzers has rapidly improved. However, as general CNN classifiers will misclassify adversarial samples, CNN steganalyzers can ha...
详细信息
ISBN:
(纸本)9781665405409
In recent years, the classification accuracy of CNN (convolutional neural network) steganalyzers has rapidly improved. However, as general CNN classifiers will misclassify adversarial samples, CNN steganalyzers can hardly detect adversarial steganography, which combines adversarial samples and steganography. Adversarial training and preprocessing are two effective methods to defend against adversarial samples. But literature shows adversarial training is ineffective for adversarial steganography. Steganographic modifications will also be destroyed by preprocessing, which aims to wipe out adversarial perturbations. In this paper, we propose a novel sampling based defense method for steganalysis. Specifically, by sampling image patches, CNN steganalyzers can bypass the sparse adversarial perturbations and extract effective features. Additionally, by calculating statistical vectors and regrouping deep features, the impact on the classification accuracy of common samples is effectively compressed. The experiments show that the proposed method can significantly improve the robustness against adversarial steganography without adversarial training.
The modern coherent-optical methods based on the processing of the detected multiple-scattered by randomly inhomogeneous media signals. The statistical analysis of the stochastic intensity distributions caused by the ...
详细信息
Variational methods are extremely popular in the analysis of network data. statistical guarantees obtained for these methods typically provide asymptotic normality for the problem of estimation of global model paramet...
详细信息
ISBN:
(纸本)9781713845393
Variational methods are extremely popular in the analysis of network data. statistical guarantees obtained for these methods typically provide asymptotic normality for the problem of estimation of global model parameters under the stochastic block model. In the present work, we consider the case of networks with missing links that is important in application and show that the variational approximation to the maximum likelihood estimator converges at the minimax rate. This provides the first minimax optimal and tractable estimator for the problem of parameter estimation for the stochastic block model with missing links. We complement our results with numerical studies of simulated and real networks, which confirm the advantages of this estimator over current methods.
Deep learning-based models have achieved impressive performance on public segmentation benchmarks, yet generalizing to unseen environments remains challenging. Test-time training (TTT) addresses this by adapting sourc...
详细信息
ISBN:
(数字)9798350368741
ISBN:
(纸本)9798350368758
Deep learning-based models have achieved impressive performance on public segmentation benchmarks, yet generalizing to unseen environments remains challenging. Test-time training (TTT) addresses this by adapting source-pretrained models during evaluation. While existing TTT methods have shown promise in image classification, they often exhibit instability with small test batches and class imbalance—challenges that intensify in semantic segmentation tasks. To tackle this issue, we present Output Contrastive Loss (OCL) to improve the stability of contrastive loss when applied to TTT for segmentation. OCL applies contrastive loss directly to the output space, avoiding the need for extra regularization, and employs a high temperature to prevent model collapse. To further stabilize the TTT process, we integrate BN statistics Modulation and stochastic Restoration techniques. Extensive experiments across diverse datasets, settings, architectures, and pretrained methods demonstrate consistent performance improvements, achieving a 7.5 mIoU gain on the GTA→CS benchmark and showing effectiveness even with domain adaptation pretraining. Code is available at https://***/dazhangyul23/OCL.
暂无评论