In this paper,to deal with the heterogeneity in federated learning(FL)systems,a knowledge distillation(KD)driven training framework for FL is proposed,where each user can select its neural network model on demand and ...
详细信息
In this paper,to deal with the heterogeneity in federated learning(FL)systems,a knowledge distillation(KD)driven training framework for FL is proposed,where each user can select its neural network model on demand and distill knowledge from a big teacher model using its own private *** overcome the challenge of train the big teacher model in resource limited user devices,the digital twin(DT)is exploit in the way that the teacher model can be trained at DT located in the server with enough computing ***,during model distillation,each user can update the parameters of its model at either the physical entity or the digital *** joint problem of model selection and training offloading and resource allocation for users is formulated as a mixed integer programming(MIP)*** solve the problem,Q-learning and optimization are jointly used,where Q-learning selects models for users and determines whether to train locally or on the server,and optimization is used to allocate resources for users based on the output of *** results show the proposed DT-assisted KD framework and joint optimization method can significantly improve the average accuracy of users while reducing the total delay.
In the field of automated language processing, distinguishing between Moroccan Arabic (Darija) in multilingual contexts is a major challenge. This study addresses this challenge by exploiting feature selection techniq...
详细信息
An agricultural greenhouse is a temperature-controlled habitat that has the benefit of maintaining a crop-specific climate or producing them independently of the seasons and protects against insects, illnesses, and in...
详细信息
Ultrahigh field magnetic resonance imaging (UHF MRI) has become an indispensable tool for human brain imaging, offering excellent diagnostic accuracy while avoiding the risks associated with invasive modalities. When ...
详细信息
A hidden Markov model(HMM)comprises a state with Markovian dynamics that can only be observed via noisy *** paper considers three problems connected to HMMs,namely,inverse filtering,belief estimation from actions,and ...
详细信息
A hidden Markov model(HMM)comprises a state with Markovian dynamics that can only be observed via noisy *** paper considers three problems connected to HMMs,namely,inverse filtering,belief estimation from actions,and privacy enforcement in such a ***,the authors discuss how HMM parameters and sensor measurements can be reconstructed from posterior distributions of an HMM ***,the authors consider a rational decision-maker that forms a private belief(posterior distribution)on the state of the world by filtering private *** authors show how to estimate such posterior distributions from observed optimal actions taken by the *** the setting of adversarial systems,the authors finally show how the decision-maker can protect its private belief by confusing the adversary using slightly sub-optimal *** range from financial portfolio investments to life science decision systems.
In this work, we propose a small-size and low-cost phase shifter based on defective microstrip structure (DMS) technique, with a modified reconfigurable unit cell (MRDMS) for WLAN applications at 5.2 GHz. The phase sh...
详细信息
Unlearnable examples (UEs) seek to maximize testing error by making subtle modifications to training examples that are correctly labeled. Defenses against these poisoning attacks can be categorized based on whether sp...
详细信息
Unlearnable examples (UEs) seek to maximize testing error by making subtle modifications to training examples that are correctly labeled. Defenses against these poisoning attacks can be categorized based on whether specific interventions are adopted during training. The first approach is training-time defense, such as adversarial training, which can mitigate poisoning effects but is computationally intensive. The other approach is pre-training purification, e.g., image short squeezing, which consists of several simple compressions but often encounters challenges in dealing with various UEs. Our work provides a novel disentanglement mechanism to build an efficient pre-training purification method. Firstly, we uncover rate-constrained variational autoencoders (VAEs), demonstrating a clear tendency to suppress the perturbations in UEs. We subsequently conduct a theoretical analysis for this phenomenon. Building upon these insights, we introduce a disentangle variational autoencoder (D-VAE), capable of disentangling the perturbations with learnable class-wise embeddings. Based on this network, a two-stage purification approach is naturally developed. The first stage focuses on roughly eliminating perturbations, while the second stage produces refined, poison-free results, ensuring effectiveness and robustness across various scenarios. Extensive experiments demonstrate the remarkable performance of our method across CIFAR-10, CIFAR-100, and a 100-class ImageNet-subset. Code is available at https://***/yuyi-sd/D-VAE. Copyright 2024 by the author(s)
We offer new methods for characterizing general closed and convex quantum resource theories, including dynamic ones, based on entropic concepts and operational tasks. We propose a resource-theoretic generalization of ...
详细信息
Although smart grid technologies bring valuable economic, social, and environmental benefits, testing the combination of heterogeneous and co-existing cyber-physical grid structure with legacy technologies presents ma...
详细信息
Integrated sensing and communication (ISAC) has become a promising technique to alleviate the spectrum congestion via sharing the same spectrum for communication and sensing. Nevertheless, many ISAC schemes encounter ...
详细信息
暂无评论