In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are K clients whose individually ch...
详细信息
ISBN:
(纸本)9781713871088
In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are K clients whose individually chosen models are aggregated by a central server. The bounds depend on the compressibility of each client's algorithm while keeping other clients' algorithms un-compressed, and leveraging the fact that small changes in each local model change the aggregated model by a factor of only 1/K. Adopting a recently proposed approach by Sefidgaran et al., and extending it suitably to the distributed setting, enables smaller rate-distortion terms which are shown to translate into tighter generalization bounds. The bounds are then applied to the distributed support vector machines (SVM), suggesting that the generalization error of the distributed setting decays faster than that of the centralized one with a factor of O(root log(K)/K). This finding is validated also experimentally. A similar conclusion is obtained for a multiple-round federated learning setup where each client uses stochastic gradient Langevin dynamics (SGLD).
With the progress of smart grid, power systems are faced with more and more complex data challenges, including large-scale data, multi-sample types and low resource integration. This research takes power big data as t...
详细信息
3D human pose estimation is widely applied in various fields, including action recognition, sports analysis, and human-computer interaction. 3D human pose estimation has achieved significant progress with the introduc...
详细信息
3D human pose estimation is widely applied in various fields, including action recognition, sports analysis, and human-computer interaction. 3D human pose estimation has achieved significant progress with the introduction of convolutional neuralnetwork (CNN). Recently,several researches have proposed the use of multiview approaches to avoid occlusions in single-view approaches. However, as the number of cameras increases, a 3D pose estimation system relying on a CNN may lack in computational resources. In addition, when a single host system uses multiple cameras, the data transition speed becomes inadequate owing to bandwidth limitations. To address this problem, we propose a distributed real-time 3D pose estimation framework based on asynchronous multiple cameras. The proposed frameworkcomprises a central server and multiple edge devices. Each multiple-edge device estimates a 2D human pose from its view and sends it to the central server. Subsequently, the central server synchronizes the received 2D human pose data based on the timestamps. Finally, the central server reconstructs a 3D human pose using geometrical triangulation. We demonstrate that the proposed framework increases the percentage of detected joints and successfully estimates 3D human poses in real-time.
作者:
Raghavendra, R.Niranjanamurthy, M.Department of MCA
BMS Institute of Technology and Management (Affiliated to Visvesvaraya Technological University) Jnana Sangama Avalahalli Karnataka Belgavi Bangalore 560064 India Department of AI and ML
BMS Institute of Technology and Management (Affiliated to Visvesvaraya Technological University) Jnana Sangama Avalahalli Karnataka Belgavi Bangalore 560064 India
Social media is a strong Internet platform that allows people to voice their thoughts about numerous events happening in real time at multiple locations. People comment and express their thoughts on any social media p...
详细信息
Due to its advantages of non-contact measurement and high sensitivity, light-induced thermoelastic spectroscopy (LITES) is one of the most promising methods for corrosive gas detection. In this manuscript, a highly se...
详细信息
Due to its advantages of non-contact measurement and high sensitivity, light-induced thermoelastic spectroscopy (LITES) is one of the most promising methods for corrosive gas detection. In this manuscript, a highly sensitive hydrogen fluoride (HF) sensor based on LITES technique is reported for the first time. With simple structure and strong robustness, a shallow neuralnetwork (SNN) fitting algorithm is introduced into the field of spectroscopy data processing to achieve denoising. This algorithm provides an end-to-end approach that takes in the raw input data without any pre-processing and extracts features automatically. A continuous wave (CW) distributed feedback diode (DFB) laser with an emission wavelength of 1.27 mu m was used as the excitation source. A Herriott multi-pass cell (MPC) with an optical length of 10.1 m was selected to enhance the laser absorption. A quartz tuning fork (QTF) with resonance frequency of 32,767.52 Hz was adopted as the thermoelastic detector. An Allan variance analysis was performed to demonstrate the system stability. When the integration time was 110 s, the minimum detection limit (MDL) was found to be 71 ppb. After the SNN fitting algorithm was used, the signal-to-noise ratio (SNR) of the HF-LITES sensor was improved by a factor of 2.0, which verified the effectiveness of this fitting algorithm for spectroscopy data processing.
Satellite image classification for land cover involves determining high-resolution imagery to recognize and classify various types of land covers. This process assists in monitoring forest health, managing resources, ...
详细信息
Due to its fantastic performance in the quality of the images created, Generator Adversarial networks have recently become a viable option for image reconstruction. The main problem with employing GAN is how expensive...
详细信息
Due to its fantastic performance in the quality of the images created, Generator Adversarial networks have recently become a viable option for image reconstruction. The main problem with employing GAN is how expensive the computations are. Researchers have developed techniques for distributing GANs across multiple nodes. However, these techniques typically do not scale because they frequently separate the components (Discriminator and Generator), leading to high communication overhead or encountering distribution-related problems unique to GAN training. In this study, the training procedure for the GAN is parallelized and carried out over many Graphical processing Units (GPUs). TensorFlow's built-in logic and a custom loop were tweaked for more control over the resources allotted to each GPU worker. In this study, GPU image processing improvements and multi-GPU learning are used. The GAN model is accelerated using distributed TensorFlow with synchronous data-parallel training on a single system and several GPUs. Acceleration was accomplished using the Genesis Cloud Platform and the NVIDIA CIRCLED LATIN CAPITAL LETTER R GeForceTM GTX 108 GPU accelerator. The speed-up of 1.322 for two GPUs, 1.688 for three GPUs, and 1.7792 for four GPUs using multi-GPU acceleration. The parameter server model's data initialization and image production bottlenecks are removed, but the results' speed-up is not linear. Increasing the number of GPUs and removing the connectivity constraint will accelerate things even more. The bottlenecks are detected using new network lines and resources, and solutions are suggested. Recomputation and quantization are the two techniques to reduce the amount of GPU acceleration in memory. Deployment and versioning are essential for successfully operating multi-node GAN models in MLflow. Properly deploying and versioning these models can improve scalability, reproducibility, and collaboration across teams working on the same model. MLflow provides built-in
neuralnetworks, as powerful models for solving many genuine problems, are suffering from the issue of being too computationally intensive due to the excessive size of the models themselves and the large datasets used...
详细信息
For online learning, Graph neuralnetworks(GNNs) often require real graph data for parameter fine-tuning, but obtaining the graph data is challenging. Currently, GNNs are trained based on existing graph data. When lea...
详细信息
Globally, Colorectal Cancer (CRC) is the one most significant cancer types as well as it grows in a region of colon of large intestine. An early CRC detection is supportive to handle the impression of accumulating can...
详细信息
暂无评论