The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of n local cost functions by using local information exchange is *** problem is an important component of many machin...
详细信息
The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of n local cost functions by using local information exchange is *** problem is an important component of many machine learning techniques with data parallelism,such as deep learning and federated *** propose a distributed primal-dual stochastic gradient descent(SGD)algorithm,suitable for arbitrarily connected communication networks and any smooth(possibly nonconvex)cost *** show that the proposed algorithm achieves the linear speedup convergence rate O(1/(√nT))for general nonconvex cost functions and the linear speedup convergence rate O(1/(nT)) when the global cost function satisfies the Polyak-Lojasiewicz(P-L)condition,where T is the total number of *** also show that the output of the proposed algorithm with constant parameters linearly converges to a neighborhood of a global *** demonstrate through numerical experiments the efficiency of our algorithm in comparison with the baseline centralized SGD and recently proposed distributed SGD algorithms.
Changes in coal seam hardness cause fluctuations in the feed resistance at the drill bit during the drilling process, leading to unstable feeding speed. This paper proposes a robust dynamic output feedback controller ...
详细信息
We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challe...
详细信息
ISBN:
(数字)9798350316339
ISBN:
(纸本)9798350316346
We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise and local updates with streaming non-iid data, we develop a perturbed iterate analysis to control the impact of the DP noise on the utility. Moreover, we demonstrate how the drift errors from local updates can be effectively managed under a quasi-strong convexity condition. Subject to an $(\epsilon, \delta)$ DP budget, we establish a dynamic regret bound over the entire time horizon, quantifying the impact of key parameters and the intensity of changes in dynamic environments. Numerical experiments confirm the efficacy of the proposed algorithm.
Pneumonia is one of the top causes of death in Romania and early detection of this disease improves the recovery chances and shortens the length of hospitalization. In this work, we develop a solution for automatic pn...
Pneumonia is one of the top causes of death in Romania and early detection of this disease improves the recovery chances and shortens the length of hospitalization. In this work, we develop a solution for automatic pneumonia detection based on convolutional neural networks. Four network models are investigated. They are trained on 4.163 images from a public dataset and tested on 530 images. The best results are obtained by one of the proposed models conducting to a sensitivity of 98.72%, an accuracy of 89.81%, and ROC 93.46%. Thus, this research proposes a lightweight screening tool that can help triaging the patients with pneumonia.
The growing demand for energy-saving lamps highlights critical limitations in traditional LED secondary optics, which reduce energy efficiency and complicate heat dissipation - a key factor in LED lamp longevity. This...
详细信息
This paper introduces a new variational Gaussian filtering approach for estimating the state of a nonlinear dynamic system. We first assume that the predictive distribution of the state is Gaussian and derive an itera...
详细信息
The results of the development of the new fast-speed method of classification images using a structural approach are *** method is based on the system of hierarchical features,based on the bitwise data distribution fo...
详细信息
The results of the development of the new fast-speed method of classification images using a structural approach are *** method is based on the system of hierarchical features,based on the bitwise data distribution for the set of descriptors of image *** article also proposes the use of the spatial data processing apparatus,which simplifies and accelerates the classification *** have shown that the time of calculation of the relevance for two descriptions according to their distributions is about 1000 times less than for the traditional voting procedure,for which the sets of descriptors are *** introduction of the system of hierarchical features allows to further reduce the calculation time by 2–3 times while ensuring high efficiency of *** noise immunity of the method to additive noise has been experimentally *** to the results of the research,the marginal degree of the hierarchy of features for reliable classification with the standard deviation of noise less than 30 is the 8-bit *** costs increase proportionally with decreasing bit *** method can be used for application tasks where object identification time is critical.
This paper proposes a novel approach to improving speech recognition performance by combining spectrogram images with extracted formant frequency data within a dual input neural network framework. While spectrograms a...
详细信息
Iris segmentation and localization in unconstrained environments are challenging due to long distances, illumination variations, limited user cooperation, and moving subjects. Some existing methods in the literature h...
详细信息
暂无评论