We propose distributed algorithms for high-dimensional sparse optimization. In many applications, the parameter is sparse but high-dimensional. This is pathological for existing distributed algorithms as the latter re...
详细信息
ISBN:
(纸本)9781479999897
We propose distributed algorithms for high-dimensional sparse optimization. In many applications, the parameter is sparse but high-dimensional. This is pathological for existing distributed algorithms as the latter require an information exchange stage involving transmission of the full parameter, which may not be sparse during the intermediate steps of optimization. The novelty of this work is to develop communication efficient algorithms using the stochastic Frank-Wolfe (sFW) algorithm, where the gradient computation is inexact but controllable. For star network topology, we propose an algorithm with low communication cost and establishes its convergence. The proposed algorithm is then extended to perform decentralized optimization on general network topology. Numerical experiments are conducted to verify our findings.
Cooperation in distributed settings often involves activities that must be performed at least once by the participating processors. When processor failures or delays occur, it becomes unavoidable that some tasks are d...
详细信息
Cooperation in distributed settings often involves activities that must be performed at least once by the participating processors. When processor failures or delays occur, it becomes unavoidable that some tasks are done redundantly. To make efficient use of the available processors, several distributed algorithms schedule the activities of the processors in terms of permutations of tasks that need to be performed at least once. This paper presents the first explicit practical deterministic construction of sets of permutations with certain combinatorial properties that immediately make practical several deterministic distributed algorithms. These algorithms solve a variety of problems, for example, cooperation in shared-memory and message-passing settings, and the gossip problem. Prior to this work, the most efficient algorithms for some of these problems were primarily of theoretical interest - they relied on permutations that are known to exist, but very expensive to construct, with the cost of construction being at least exponential in the size of the permutations. In this paper, the explicitly constructed permutations are ultimately used directly to produce practical instances of several classes of efficient deterministic algorithms. Most importantly, for all of these algorithms, the schedule construction cost is reduced from exponential to polynomial, at the expense of slight detuning, at most polylogarithmic, of the efficiency of these algorithms
This paper presents two communication-efficient distributed algorithms for solving linear algebraic equations of the form Ax = b, which has at least one solution, among a network of m> 1 agents. Each agent knows on...
详细信息
ISBN:
(数字)9781728174471
ISBN:
(纸本)9781728174488
This paper presents two communication-efficient distributed algorithms for solving linear algebraic equations of the form Ax = b, which has at least one solution, among a network of m> 1 agents. Each agent knows only a subset of the rows of the partitioned matrix [A b] and recursively updates its estimate of a solution by utilizing information received only from its neighbors. Neighbor relations are characterized by a fixed directed graph. The first algorithm aims to reduce communication costs at each iteration, in which each agent broadcasts the entries of its estimate in a cyclic manner, instead of broadcasting the entire vector of its estimate. It is shown that for any strongly connected neighbor graph, the algorithm causes all agents' estimates to converge to the same solution to Ax = b exponentially fast. The second algorithm reduces the vector size of each agent's estimate by exploiting the sparsity of the matrix A. It is shown that the algorithm causes each agent's estimate to converge to a specific part of the same solution to Ax = b corresponding to its own interest exponentially fast for a certain class of directed graphs.
This paper studies iterative distributed algorithms for real-time available transfer capability (ATC) assessment in energy management systems of multiarea power systems. Since ATC calculations can be modeled as a spec...
详细信息
ISBN:
(纸本)9781538622131;9781538622124
This paper studies iterative distributed algorithms for real-time available transfer capability (ATC) assessment in energy management systems of multiarea power systems. Since ATC calculations can be modeled as a special nonlinear optimal power-flow problem, iterative decomposition-coordination approaches based on constrained augmented Lagrangian methods can be applied. One special distributed scheme, called the auxiliary problem principle method, will be studied for distributed ATC assessment in this paper. A computation framework of this distributed algorithm is investigated. System partition with nonoverlapping and boundary sub-systems will also be studied. Simulations of several IEEE test systems will be conducted to validate the feasibility and the correctness of this distributed ATC. In addition, the real-time monitoring and reaction mechanism of this distributed algorithm will also be demonstrated by numerical experiments.
A large class of problems in multiagent systems can be solved by distributed constraint optimization (DCOP). Several algorithms have been created to solve these problems, however, no extensive evaluation of current DC...
详细信息
ISBN:
(纸本)9781595938541
A large class of problems in multiagent systems can be solved by distributed constraint optimization (DCOP). Several algorithms have been created to solve these problems, however, no extensive evaluation of current DCOP algorithms on live networks exists in the literature. This paper uses DCOPolis--a framework for comparing and deploying DCOP software in heterogeneous environments--to contribute an analysis of two state-of-the-art DCOP algorithms solving a number of different problem types. Then, we use this empirical validation to evaluate the use of both cycle-based runtime and concurrent constraint checks.
Shows the power of sampling techniques in designing efficient distributed algorithms. In particular, we show that, by using sampling techniques, selection can be done on some networks in such a way that the message co...
详细信息
Shows the power of sampling techniques in designing efficient distributed algorithms. In particular, we show that, by using sampling techniques, selection can be done on some networks in such a way that the message complexity is independent of the cardinality of the set (file), provided the file size is polynomial in the network size. For example, given a file F of size n and an integer k (1/spl les/k/spl les/n), on a p-processor de Bruijn network our deterministic selection algorithm can find the kth smallest key from F using O(p log/sup 3/p) messages and with a communication delay of O(log/sup 3/p), and our randomized selection algorithm can finish the same task using only O(p) messages and a communication delay of O(log p) with high probability, provided the file size is polynomial in network size. Our randomized selection outperforms the existing approaches in terms of both message complexity and communication delay. The property that the number of messages needed and the communication delay are independent of the size of the file makes our distributed selection schemes extremely attractive in such domains as very large database systems. Making use of our selection algorithms to select pivot element(s), we also develop a near-optimal quicksort-based sorting scheme and a nearly-optimal enumeration sorting scheme for sorting large distributed files on the hypercube and de Bruijn networks. Our algorithms are fully distributed without any a priori central control.
Parallel and distributed algorithms constitute an advanced topic in theoretical and practical computer science that has gained much interest recently. It is generally known that studying and teaching the fundamentals ...
详细信息
ISBN:
(纸本)9781424443970;9781424443987
Parallel and distributed algorithms constitute an advanced topic in theoretical and practical computer science that has gained much interest recently. It is generally known that studying and teaching the fundamentals of parallel algorithm's concepts present a constant challenge to both learners and educators. Due to the additional abstract concepts applied in the implementation of parallel algorithms, designing visualisations of parallel algorithms is far more arduous than visualising sequential algorithms (single process). At the same time, the pedagogical gain of parallel algorithm visualisations is much higher than that of sequential ones. In this paper we introduce a new approach to minimising the effort needed to create effective visual simulations of parallel and distributed algorithms.
In a static wireless ad hoc network, given a distinguished source node, and a subset of nodes called multicast group members, the minimum-energy multicast problem is to assign appropriate power levels to nodes in the ...
详细信息
In a static wireless ad hoc network, given a distinguished source node, and a subset of nodes called multicast group members, the minimum-energy multicast problem is to assign appropriate power levels to nodes in the network so that all group members are reachable from the source, and the total power usage is as small as possible. Computing effective power assignments and the multicast trees in a distributed manner is a major challenge. We devise two distributed algorithms for this problem. The central idea is called incremental power with potential power saving (IP3S). One algorithm, called DMIP3S (distributed multicast IP3S), is for small multicast groups and the other one, called P-DIP3S (pruning version of distributed IP3S), is for larger groups. Extensive simulations show that our distributed algorithms work even better than most known centralized ones. As far as we know, these are the first distributed algorithms for this problem.
A parallel algorithm is required to satisfy mutual exclusion in order to execute all processes properly. To execute Mutual exclusion, there must be required to satisfy these two conditions: synchronization and concurr...
详细信息
A parallel algorithm is required to satisfy mutual exclusion in order to execute all processes properly. To execute Mutual exclusion, there must be required to satisfy these two conditions: synchronization and concurrent execution of all processes. Though failure of process inside the critical region may occur and that makes all other processes to wait until that process exit or stop using that critical region. This may lead to infinite time of wait for other process. This problem might be solved by time based mutual exclusion. In this paper we will present one solution for such failure. We create a new data structure of every critical region which is shared by other processes in the parallel and distributed environment. We introduce timestamp based data structure which tries to recover from such process failure. This timestamp based data structure has certain attributes based on that attributed we will recover from the failure of that process.
One of the main methods for achieving fault tolerance in distributed systems is recovery of the state of failed components. Though generic recovery methods like checkpointing and message logging exist, in many cases t...
详细信息
One of the main methods for achieving fault tolerance in distributed systems is recovery of the state of failed components. Though generic recovery methods like checkpointing and message logging exist, in many cases the recovery has to be application specific. In this paper we propose a general model for a node state reconstruction after crash failures. In our model the reconstruction operation is defined only by the requirements it fulfills, without referring to the specific application dependent way it is performed. The model provides a framework for formal treatment of algorithm-specific and system-specific recovery procedures. It is used to specify node state reconstruction procedures for several widely used distributed algorithms and systems, as well as to prove their correctness.
暂无评论