Mobile edge computing has emerged as a new paradigm to enhance computing capabilities by offloading complicated tasks to nearby cloud server. To conserve energy as well as maintain quality of service, algorithms with ...
详细信息
The rapid growth of data traffic in the last decade is expected to continue in the next generation (5G) system. In order to service the high demand of data rates in 5G, complex communication architectures are needed s...
详细信息
Nonnegative Matrix Factorization (NMF) is an effective tool for clustering nonnegative data, either for computing a flat partitioning of a dataset or for determining a hierarchy of similarity. In this paper, we propos...
详细信息
ISBN:
(纸本)9781665422925
Nonnegative Matrix Factorization (NMF) is an effective tool for clustering nonnegative data, either for computing a flat partitioning of a dataset or for determining a hierarchy of similarity. In this paper, we propose a parallel algorithm for hierarchical clustering that uses a divide-and-conquer approach based on rank-two NMF to split a data set into two cohesive parts. Not only does this approach uncover more structure in the data than a flat NMF clustering, but also rank-two NMF can be computed more quickly than for general ranks, providing comparable overall time to solution. Our data distribution and parallelization strategies are designed to maintain computational load balance throughout the data-dependent hierarchy of computation while limiting interprocess communication, allowing the algorithm to scale to large dense and sparse data sets. We demonstrate the scalability of our parallel algorithm in terms of data size (up to 800 GB) and number of processors (up to 80 nodes of the Summit supercomputer), applying the hierarchical clustering approach to hyperspectral imaging and image classification data. Our algorithm for Rank-2 NMF scales perfectly on up to 1000s of cores and the entire hierarchical clustering method achieves 5.9x speedup scaling from 10 to 80 nodes on the 800 GB dataset.
Federated learning (FL) strives to enable collaborative training of deep models on the distributed clients of different data without centrally aggregating raw data and hence improving data privacy. Nevertheless, a cen...
详细信息
Federated learning (FL) strives to enable collaborative training of deep models on the distributed clients of different data without centrally aggregating raw data and hence improving data privacy. Nevertheless, a central challenge in training classification models in the federated system is learning with non-IID data. Most of the existing work is dedicated to eliminating the heterogeneous influence of non-IID data in a federated system. However, in many real-world FL applications, the co-occurrence of data heterogeneity and long-tailed distribution is unavoidable. The universal class distribution is long-tailed, causing them to become easily biased towards head classes, which severely harms the global model performance. In this work, we also discovered an intriguing fact that the classifier logit vector (i.e., pre-softmax output) introduces a heterogeneity drift during the learning process of local training and global optimization, which harms the convergence as well as model performance. Therefore, motivated by the above finding, we propose a novel logit calibration FL method to solve the joint problem of non-IID and long-tailed data in federated learning, called Federated Learning with Logit Calibration (FedLC). First, we presented a method to mitigate the local update drift by calculating the Wasserstein distance among adjacent client logits and then aggregating similar clients to regulate local training. Second, based on the model ensemble, a new distillation method with logit calibration and class weighting was proposed by exploiting the diversity of local models trained on heterogeneous data, which effectively alleviates the global drift problem under long-tailed distribution. Finally, we evaluated FedLC using a highly non-IID and long-tailed experimental setting, comprehensive experiments on several benchmark datasets demonstrated that FedLC achieved superior performance compared with state-of-the-art FL methods, which fully illustrated the effectiveness of
In the last few years, we have seen a significant increase both in the number and capabilities of mobile devices, as well as in the number of applications that need more and more computing and storage resources. Curre...
详细信息
ISBN:
(纸本)9783030576752;9783030576745
In the last few years, we have seen a significant increase both in the number and capabilities of mobile devices, as well as in the number of applications that need more and more computing and storage resources. Currently, in order to deal with this growing need for resources, applications make use of cloud services. This raises some problems, namely high latency, considerable use of energy and bandwidth, and the unavailability of connectivity infrastructures. Given this context, for some applications it makes sense to do part, or all, of the computations locally on the mobile devices themselves. In this paper we present OREGANO, a framework for distributedcomputing on mobile devices, capable of processing batches or streams of data generated on mobile device networks, without requiring centralized services. Contrary to current state-of-the-art, where computations and data are sent to worker mobile devices, OREGANO performs computations where the data is located, significantly reducing the amount of exchanged data.
Serverless is a new online services paradigm of cloud computing for running extremely resilient and short-lived applications. Reducing the cost of running services is a critical goal of Serverless computing. However, ...
详细信息
Serverless is a new online services paradigm of cloud computing for running extremely resilient and short-lived applications. Reducing the cost of running services is a critical goal of Serverless computing. However, most of the current state-of-the-art works optimize the Serverless performance via mitigating the cold-start overheads, the system-level resource overheads of typical real-world Serverless workloads is not fully explored. In this paper, we study the Serverless performance and overheads from the perspective of system-level resource analysis. We firstly present a Kmeans-based method to categorize Microsoft Azure workloads into four typical workloads and then introduce a Bayesian-based approach to fit these workloads into four time-series models respectively for online workload predicting. To investigate the system-level resource overheads, we replay the Azure workloads with the time series models in a Kubernetes cluster with 20 servers and profile application performance and system-level metrics. We highlight two observations via workload modeling and introduce three system-level implementations by analyzing the data profiled from the experiment cluster. In particular, we find that the task-balancing schedule could not guarantee fair resource usage among nodes, which leads to 3-4X resource utilization bias and interference among function instances.
In edge computing it is pivotal to automatically manage the resources to increase efficiency with limited resources. Deep reinforcement learning, which aims to maximize the long term cumulative reward, has recently be...
详细信息
In edge computing it is pivotal to automatically manage the resources to increase efficiency with limited resources. Deep reinforcement learning, which aims to maximize the long term cumulative reward, has recently been adopted in such scenarios. However, training the policy in real-world edge computing environment is challenging since arbitrary exploration in real world could drastically impair user utilities. In this paper, we propose a novel imitation learning approach to construct a virtual environment, in which the policy can be trained freely without additional costs. Under the virtual environment, we use a multi-agent reinforcement learning to manage the edge resources. Our method adopts a decentralized, sequential approach to deal with the uncertainties in the environment. Specifically, we decompose the target reward function into separated global part and local parts, where the global part is shared by all agents for cooperation, and the local parts are owned by each individual edge to accelerate the model learning. Extensive experimental results demonstrate that the constructed environment is very close to the real environment. In addition, the proposed multi agent reinforcement learning algorithm can converge very fast in the training phase and outperforms other state-of-art methods significantly in a variety of scenarios.
The rapid development of information and communication technology has made great advancements to grid structure, but at the same time it has also brought new security and privacy challenges to smart grid. Metering dat...
详细信息
The rapid development of information and communication technology has made great advancements to grid structure, but at the same time it has also brought new security and privacy challenges to smart grid. Metering data transmitted in insecure public networks are vulnerable to eavesdropping and tampering by other organizations or users. Also, smart meters exposed to the outside could be physically attacked. Many privacy-preserving authentication schemes in smart grid have been proposed in recent years. However, most of them cannot protect smart meters from physical attacks. In this paper, a new lightweight privacy-preserving authenticated data collection scheme (PAC) based on Physically Unclonable Functions (PUFs) is proposed. With the uniqueness property of PUFs, the proposed scheme can not only resist physical attacks, but also support key sharing and identity authentication. Security analysis shows that the proposed scheme can guarantee the privacy of users and resist traditional attacks such as man-in-the-middle attacks, replay attacks, impersonation attacks and physical attacks. Experimental performance indicates that the proposed scheme has high efficiency and low interaction.
Microgrids are a novel concept for modern power distribution networks that integrate renewable power sources and increase power control capabilities. This system's essential problem is controlling the frequency in...
详细信息
ISBN:
(纸本)9781665463645
Microgrids are a novel concept for modern power distribution networks that integrate renewable power sources and increase power control capabilities. This system's essential problem is controlling the frequency in island mode. Using the synchronous generator (SG) control approach, the microgrid frequency is more stable due to the inertial features of the SG. In this regard, this paper presents a control algorithm for voltage source converters (VSC)-based distributed generators (DGs), which emulates the principal behavior of synchronous machines and can support inertia to the grid and reduce frequency gradients considering the parallel operation of the SG. The controller is designed based on droop control theory, and a supervisory center controller is implemented to maintain system frequency close to a nominal value of the whole microgrid. The simulation results demonstrate that the system frequency is stabilized even in different and sudden load changes in the island mode where the microgrid is fed by multiple VSC units and a SG. The Simulink model of the system is designed using MATLAB Simulink Software.
Uninterruptible Power Supply (UPS) can provide a stable, continuous and uninterrupted power supply and it has higher requirements for the power supply quality of UPS. In order to improve the reliability and engineerin...
详细信息
ISBN:
(纸本)9783030311292;9783030311285
Uninterruptible Power Supply (UPS) can provide a stable, continuous and uninterrupted power supply and it has higher requirements for the power supply quality of UPS. In order to improve the reliability and engineering feasibility of uninterruptible power supply (UPS) redundant parallel operation system, a phase locking control method is proposed. This method adjusts the AC output by measuring the system frequency dynamics in real time to realize the seamless switching of the bypass input. There is no discontinuous process in this process, so as to provide stable, continuous and uninterrupted power.
暂无评论