Recent efforts have been made to integrate self-supervised learning (SSL) with the framework of federated learning (FL). One unique challenge of federated self-supervised learning (FedSSL) is that the global objective...
详细信息
Recent efforts have been made to integrate self-supervised learning (SSL) with the framework of federated learning (FL). One unique challenge of federated self-supervised learning (FedSSL) is that the global objective of FedSSL usually does not equal the weighted sum of local SSL objectives. Consequently, conventional approaches, such as federated averaging (FedAvg), fail to precisely minimize the FedSSL global objective, often resulting in suboptimal performance, especially when data is non-i.i.d.. To fill this gap, we propose a provable FedSSL algorithm, named FedSC, based on the spectral contrastive objective. In FedSC, clients share correlation matrices of data representations in addition to model weights periodically, which enables inter-client contrast of data samples in addition to intra-client contrast and contraction, resulting in improved quality of data representations. Differential privacy (DP) protection is deployed to control the additional privacy leakage on local datasets when correlation matrices are shared. We also provide theoretical analysis on the convergence and extra privacy leakage. The experimental results validate the effectiveness of our proposed algorithm. Copyright 2024 by the author(s)
A huge number of text documents are divided into a limited number of groups using the unsupervised learning technique known as text clustering. While the clusters contain different text documents, each cluster contain...
详细信息
The Visual Storytelling Task (VST) extends beyond describing a single image, such as image captioning, to sequential image descriptions in the form of a coherent story. However, such descriptions present challenges in...
详细信息
The study of leaf diseases, as well as their detection and diagnosis, has been the subject of an increasing amount of research and attention as intelligent agricultural systems have become increasingly common and wide...
详细信息
Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories. In this work, we consider a multi-task setting, in which each agent h...
There are a plethora of new Android portable apps available now. As a result, making sure the apps you install on your mobile device are safe is a daunting undertaking for the average user. This study provides a popul...
详细信息
This paper describes spatially aware Artificial Intelligence, GeoAI, tailored for small organizations such as NGOs in resource constrained contexts where access to large datasets, expensive compute infrastructure and ...
详细信息
Pedestrian-related accidents account for an estimated 20-25% of the approximately 1.19 million road fatalities occurring annually, highlighting the urgent need for enhanced detection systems in surveillance and smart ...
详细信息
Diabetes is one of the most common diseases in Jordan. It is the main reason of death among Jordanian adult citizens. Worldwide, 48% of all deaths are due to Diabetes occurred before the age of 70 years. Hence, this r...
详细信息
In this study, an efficient system to improve the oxygen supply in hospitals and other healthcare institutions is proposed. It uses Internet of things (IoT) devices and cloud based data transmission and processing sys...
详细信息
暂无评论