Our aim is to present for nonlinear problems asynchronous multisplitting algorithms including both the basic situation of O'Leary and White and the discrete analogue of Schwarz's alternating method and its mul...
详细信息
Our aim is to present for nonlinear problems asynchronous multisplitting algorithms including both the basic situation of O'Leary and White and the discrete analogue of Schwarz's alternating method and its multisubdomain extensions and moreover their two-stage counterparts. The analysis of these methods is based on El Tarazi's convergence theorem for asynchronous iterations and leads to a good level of asynchronism in each of the considered situations.
In this work we propose an asynchronous parallel evolutionary algorithm that is efficient for a specific type of gray-box optimization problems, in which the calculation of the fitness function may be split into a set...
详细信息
ISBN:
(数字)9781665467087
ISBN:
(纸本)9781665467087
In this work we propose an asynchronous parallel evolutionary algorithm that is efficient for a specific type of gray-box optimization problems, in which the calculation of the fitness function may be split into a set of several independent calculations. An example of such an optimization problem is the search for backdoors (hidden structures) in the Boolean satisfiability problem: subsets of variables that allow an efficient splitting of the problem into a set of independent subproblems. Our experiments show that the proposed asynchronous approach allows speeding up the algorithm considerably, while also efficiently utilizing computing cluster time.
asynchronous methods for solving systems of linear equations have been researched since Chazan and Miranker's pioneering 1969 paper. The underlying idea of asynchronous methods is to avoid processor idle time by a...
详细信息
ISBN:
(纸本)9780769552071
asynchronous methods for solving systems of linear equations have been researched since Chazan and Miranker's pioneering 1969 paper. The underlying idea of asynchronous methods is to avoid processor idle time by allowing the processors to continue to make progress even if not all progress made by other processors has been communicated to them. Historically, work on asynchronous methods for solving linear equations focused on proving convergence in the limit. Comparison of the asynchronous convergence rate with its synchronous counterpart and its scaling with the number of processors were seldom studied, and are still not well understood. Furthermore, the applicability of these methods was limited to restricted classes of matrices, such as diagonally dominant matrices. We propose a randomized shared-memory asynchronous method for general symmetric positive definite matrices. We rigorously analyze the convergence rate and prove that it is linear, and is close to that of the method's synchronous counterpart if the processor count is not excessive relative to the size and sparsity of the matrix. Our work presents a significant improvement in convergence analysis as well as in the applicability of asynchronous linear solvers, and suggests randomization as a key paradigm to serve as a foundation for asynchronous methods.
Motivated by the famous Vicsek's model, this paper addresses the problem of heading consensus for a multi-agent group by using asynchronous decentralized algorithms. Two algorithms, one for the leaderless case and...
详细信息
ISBN:
(纸本)9781424447947
Motivated by the famous Vicsek's model, this paper addresses the problem of heading consensus for a multi-agent group by using asynchronous decentralized algorithms. Two algorithms, one for the leaderless case and one for the leader based case are proposed. The appealing feature of both algorithms is that neither a global coordinate system nor a common clock is required. It is proved that these algorithms guarantee (almost) global consensus of the headings under some well known connectivity assumptions.
In this work we introduce an algorithm for distributed average consensus which is able to deal with asynchronous and unreliable communication systems. It is inspired by two algorithms for average consensus already pre...
详细信息
In this work we introduce an algorithm for distributed average consensus which is able to deal with asynchronous and unreliable communication systems. It is inspired by two algorithms for average consensus already present in the literature, one which deals with asynchronous but reliable communication and the other which deals with unreliable but synchronous communication. We show that the proposed algorithm is exponentially convergent under mild assumptions regarding the nodes update frequency and the link failures. The theoretical results are complemented with numerical simulations. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
In this work we introduce an algorithm for distributed average consensus which is able to deal with asynchronous and unreliable communication systems. It is inspired by two algorithms for average consensus already pre...
详细信息
We propose a novel parallel essentially cyclic asynchronous algorithm for the minimization of the sum of a smooth (nonconvex) function and a convex (nonsmooth) regularizer. The framework hinges on Successive Convex Ap...
详细信息
ISBN:
(纸本)9781509030095
We propose a novel parallel essentially cyclic asynchronous algorithm for the minimization of the sum of a smooth (nonconvex) function and a convex (nonsmooth) regularizer. The framework hinges on Successive Convex Approximation (SCA) techniques and on a new global model that describes many asynchronous environments in a more faithful and exhaustive way with respect to state-of-the-art models. A key feature of the model is the update of (block) variables according to the essential cyclic rule: an integer B exists such that, every B iterations, all (block) variables are updated at least once. The algorithm is theoretically guaranteed to achieve a sublinear convergence rate and near linear speedup with respect to the number of cores. Asymptotic convergence to stationary solutions is also proved. Numerical results show that our scheme compares favorably to existing asynchronous methods.
Consensus is a fundamental agreement problem that arises when a set of distributed processes has to decide on a common value among their respective proposals. An asynchronous consensus algorithm is capable of preservi...
详细信息
We present our asynchronous implementation of the LM-CMA-ES algorithm, which is a modern evolution strategy for solving complex large-scale continuous optimization problems. Our implementation brings the best results ...
详细信息
ISBN:
(纸本)9781509002870
We present our asynchronous implementation of the LM-CMA-ES algorithm, which is a modern evolution strategy for solving complex large-scale continuous optimization problems. Our implementation brings the best results when the number of cores is relatively high and the computational complexity of the fitness function is also high. The experiments with benchmark functions show that it is able to overcome its origin on the Sphere function, reaches certain thresholds faster on the Rosenbrock and Ellipsoid function, and surprisingly performs much better than the original version on the Rastrigin function.
We propose a novel algorithmic framework for the asynchronous and distributed optimization of multi-agent systems. We consider the constrained minimization of a nonconvex and nonsmooth partially separable sum-utility ...
详细信息
ISBN:
(纸本)9781538612514
We propose a novel algorithmic framework for the asynchronous and distributed optimization of multi-agent systems. We consider the constrained minimization of a nonconvex and nonsmooth partially separable sum-utility function, i.e., the cost function of each agent depends on the optimization variables of that agent and of its neighbors. This partitioned setting arises in several applications of practical interest. The proposed algorithmic framework is distributed and asynchronous: i) agents update their variables at arbitrary times, without any coordination with the others;and ii) agents may use outdated information from their neighbors. Convergence to stationary solutions is proved, and theoretical complexity results are provided, showing nearly ideal linear speedup with respect to the number of agents, when the delays are not too large.
暂无评论