The biometric identification method of fingerprint recognition is quite popular because of its uniqueness and durability. The KNN-S 1FT algorithm is used in this research work to present a novel method for extracting ...
详细信息
This paper delves into the challenging issues in uncertain multi-objective optimization, where uncertainty permeates nonsmooth nonconvex objective and constraint functions. In this context, we investigate highly robus...
详细信息
Graph-based methods, pivotal for label inference over interconnected objects in many real-world applications, often encounter generalization challenges, if the graph used for model training differs significantly from ...
Graph-based methods, pivotal for label inference over interconnected objects in many real-world applications, often encounter generalization challenges, if the graph used for model training differs significantly from the graph used for testing. This work delves into Graph Domain Adaptation (GDA) to address the unique complexities of distribution shifts over graph data, where interconnected data points experience shifts in features, labels, and in particular, connecting patterns. We propose a novel, theoretically principled method, Pairwise Alignment (Pair-Align) to counter graph structure shift by mitigating conditional structure shift (CSS) and label shift (LS). Pair-Align uses edge weights to recalibrate the influence among neighboring nodes to handle CSS and adjusts the classification loss with label weights to handle LS. Our method demonstrates superior performance in real-world applications, including node classification with region shift in social networks, and the pileup mitigation task in particle colliding experiments. For the first application, we also curate the largest dataset by far for GDA studies. Our method shows strong performance in synthetic and other existing benchmark datasets.
Concurrent B+trees have been widely used in many systems. With the scale of data requests increasing exponentially, the systems are facing tremendous performance pressure. GPU has shown its potential to accelerate con...
详细信息
Unsupervised Domain Adaptive Object Detection (DAOD) task can relax the domain shift problem between source and target domains, which requires to train models on labeled source and unlabeled target domains jointly. Ho...
详细信息
ISBN:
(数字)9798350390155
ISBN:
(纸本)9798350390162
Unsupervised Domain Adaptive Object Detection (DAOD) task can relax the domain shift problem between source and target domains, which requires to train models on labeled source and unlabeled target domains jointly. However, due to limitations of data privacy protection, the source domain data is usually inaccessible, which poses significant challenges for the DAOD task. Hence, Source-Free Object Detection (SFOD) task has been developed that aims to fine-tune a pre-trained source model with only unlabeled target domain data. Most of the existing SFOD methods are based on pseudo labeling using the student-teacher framework, where the teacher model is the Exponential Moving Average (EMA) of the student models in different time steps. However, these methods always exist a knowledge bias problem due to class imbalance, and therefore, a fixed EMA update rate is no longer suitable for different classes. For high-quality classes, a fast EMA rate can accelerate knowledge updating and promote model convergence, while for low-quality classes, a fast EMA rate can accelerate the accumulation of knowledge bias and lead to the collapse of such categories. To solve this problem, we propose a novel SFOD method called Slow-Fast Adaptation which develops two different teacher models, a slow teacher, and a fast teacher model, to jointly guide the student training. The slow and fast teacher models can provide richer supervision information and complement each other. The experiments on four benchmark datasets show that our method achieves state-of-the-art results and even outperforms DAOD methods in some cases, which demonstrate the effectiveness of our method on the SFOD task.
Today various water-pump operating systems are available in the market, which allows the user/farmer to operate his water-pump from a distant location using mobile app or on a phone call to the system which is integra...
详细信息
As machine learning models in critical fields increasingly grapple with multimodal data, they face the dual challenges of handling a wide array of modalities, often incomplete due to missing elements, and the temporal...
详细信息
In this paper, the existence and nonexistence of solutions for a class of fractional differential equations are studied by using an interesting fixed point theorem on order intervals and the well-known Schauder's ...
详细信息
Spiking Neural Networks (SNNs) offer several advantages over traditional Artificial Neural Networks (ANNs), especially in terms of biologically inspired event-driven mechanisms and energy efficiency. This paper aims t...
详细信息
ISBN:
(数字)9798350357509
ISBN:
(纸本)9798350357516
Spiking Neural Networks (SNNs) offer several advantages over traditional Artificial Neural Networks (ANNs), especially in terms of biologically inspired event-driven mechanisms and energy efficiency. This paper aims to demonstrate parameter efficiency of Convolutional Spiking Neural Networks (CSNNs) by training extremely small CSNNs and comparing those with conventional Convolutional Neural Networks (CNNs) of same parameter count and depth, as well as against state-of-the-art SNN implementations. Through experiments conducted on multiple small-scale CSNN models, we observed that CSNNs are able to achieve exceptional parameter efficiency and performance with the help of a fast sigmoid surrogate gradient descent, proving an astonishing balance between accuracy and compactness. The findings fulfill the promise that CSNNs hold as a feasible solution for resource-constrained and low-power applications at the same time, as it demonstrates the biological plausibility of learning in such complex machine learning tasks.
Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use gr...
详细信息
ISBN:
(数字)9798350368741
ISBN:
(纸本)9798350368758
Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting from GNNs’ message-passing framework. However, the potential of GNNs in more general data representations, especially in the image domain, remains underexplored. Leveraging the manifold hypothesis, which posits that high-dimensional data lies in a low-dimensional manifold, we explore GNNs’ potential in this context. We construct an image manifold using variational autoencoders, then sample the manifold to generate graphs where each node is an image. This approach reduces data dimensionality while preserving geometric information. We then train a GNN to predict node labels corresponding to the image labels in the classification task, and leverage convergence of GNNs to manifold neural networks to analyze GNN generalization. Experiments on MNIST and CIFAR10 datasets demonstrate that GNNs generalize effectively to unseen graphs, achieving competitive accuracy in classification tasks.
暂无评论