We present a novel parallel gradient optimization algorithm designed for the optimization of molecular geometry - the parallel preconditioned LBFGS (PP-LBFGS) method. In each step, several additional gradient calculat...
详细信息
We present a novel parallel gradient optimization algorithm designed for the optimization of molecular geometry - the parallel preconditioned LBFGS (PP-LBFGS) method. In each step, several additional gradient calculations (performed in parallel with the calculation of the potential) are used to improve the most important elements of the Hessian. The sparsity of the connectivity matrix and the graph theory are used to estimate multiple Hessian elements from each additional gradient calculation. The simplest variant of the algorithm, which requires 4 gradient evaluations per cycle, converges 2x-4x faster than the LBFGS algorithm, depending on the size of the system. (C) 2013 Elsevier B. V. All rights reserved.
Camera robots are high-speed redundantly cable-driven parallel manipulators that realize the aerial panoramic photographing. When long-span cables and high maneuverability are involved, the effects of cable sags and i...
详细信息
Camera robots are high-speed redundantly cable-driven parallel manipulators that realize the aerial panoramic photographing. When long-span cables and high maneuverability are involved, the effects of cable sags and inertias on the dynamics must be carefully dealt with. This paper is devoted to the optimal cable tension distribution (OCTD for short) of the camera robots. Firstly, each fast varying-length cable is discretized into some nodes for computing the cable inertias. Secondly, the dynamic equation integrated with the cable inertias is set up regarding the large-span cables as catenaries. Thirdly, an iterative optimization algorithm is introduced for the cable tension distribution by using the dynamic equation and sag-to-span ratios as constraint conditions. Finally, numerical examples are presented to demonstrate the effects of cable sags and inertias on determining tensions. The results justify the convergence and effectiveness of the algorithm. In addition, the results show that it is necessary to take the cable sags and inertias into consideration for the large-span manipulators.
Research on mitigating land use conflicts is characterized by a variety of projects from the global to various sub-global scales. These projects are aiming at disentangling feedbacks within changing socio-environmenta...
详细信息
Research on mitigating land use conflicts is characterized by a variety of projects from the global to various sub-global scales. These projects are aiming at disentangling feedbacks within changing socio-environmental systems to identify strategies for sustainable resource use. Our review shows that any global analysis benefits from systematic synthesis of sub-global research from various scales, while sub-global investigations require embedding in global scenarios. There is an urgent need for improved methods to identify trade-offs at all scales as scenario analysis frequently results in a discrete set of options. We argue that the use of optimization algorithms including Pareto-frontiers combined with scenario analysis can provide efficient options for sustainable land use from global to subglobal scales.
In this paper we introduce two discrete-time, distributed optimization algorithms executed by a set of agents whose interactions are subject to a communication graph. The algorithms can be applied to optimization prob...
详细信息
ISBN:
(纸本)9781467357159
In this paper we introduce two discrete-time, distributed optimization algorithms executed by a set of agents whose interactions are subject to a communication graph. The algorithms can be applied to optimization problems where the cost function is expressed as a sum of functions, and where each function is associated to an agent. In addition, the agents can have equality constraints as well. The algorithms are not consensus-based and can be applied to non-convex optimization problems with equality constraints. We demonstrate that the first distributed algorithm results naturally from applying a first order method to solve the first order necessary conditions for a lifted optimization problem with equality constraints;the solution of our original problem is embedded in the solution of this lifted optimization problem. Using an augmented Lagrangian idea, we derive a second distributed algorithm that requires weaker conditions for local convergence compared to the first algorithm. For both algorithms we address the local convergence properties.
We design and analyze minimax-optimal algorithms for online linear optimization games where the player's choice is unconstrained. The player strives to minimize regret, the difference between his loss and the loss...
详细信息
ISBN:
(纸本)9781632660244
We design and analyze minimax-optimal algorithms for online linear optimization games where the player's choice is unconstrained. The player strives to minimize regret, the difference between his loss and the loss of a post-hoc benchmark strategy. While the standard benchmark is the loss of the best strategy chosen from a bounded comparator set, we consider a very broad range of benchmark functions. The problem is cast as a sequential multi-stage zero-sum game, and we give a thorough analysis of the minimax behavior of the game, providing characterizations for the value of the game, as well as both the player's and the adversary's optimal strategy. We show how these objects can be computed efficiently under certain circumstances, and by selecting an appropriate benchmark, we construct a novel hedging strategy for an unconstrained betting game.
MapReduce has recently emerged as a new paradigm for large-scale data analysis due to its high scalability, fine-grained fault tolerance and easy programming model. Since different jobs often share similar work (e.g.,...
详细信息
MapReduce has recently emerged as a new paradigm for large-scale data analysis due to its high scalability, fine-grained fault tolerance and easy programming model. Since different jobs often share similar work (e.g., several jobs scan the same input file or produce the same map output), there are many opportunities to optimize the performance for a batch of jobs. In this paper, we propose two new techniques for multi-job optimization in the MapReduce framework. The first is a generalized grouping technique (which generalizes the recently proposed MRShare technique) that merges multiple jobs into a single job thereby enabling the merged jobs to share both the scan of the input file as well as the communication of the common map output. The second is a materialization technique that enables multiple jobs to share both the scan of the input file as well as the communication of the common map output via partial materialization of the map output of some jobs (in the map and/or reduce phase). Our second contribution is the proposal of a new optimization algorithm that given an input batch of jobs, produces an optimal plan by a judicious partitioning of the jobs into groups and an optimal assignment of the processing technique to each group. Our experimental results on Hadoop demonstrate that our new approach significantly outperforms the state-of-the-art technique, MRShare, by up to 107%.
This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a gossip step which drives...
详细信息
ISBN:
(纸本)9781467360890
This paper investigates the problem of distributed stochastic approximation in multi-agent systems. The algorithm under study consists of two steps: a local stochastic approximation step and a gossip step which drives the network to a consensus. The gossip step uses row-stochastic matrices to weight network exchanges. We first prove the convergence of a distributed optimization algorithm, when the function to optimize may not be convex and the communication protocol is independent of the observations. In that case, we prove that the average estimate converges to a consensus;we also show that the set of limit points is not necessarily the set of the critical points of the function to optimize and is affected by the Perron eigenvector of the mean-matrix describing the communication protocol. Discussion about the success or failure of convergence to the minimizers of the function to optimize is also addressed. In a second part of the paper, we extend the convergence results to the more general context of distributed stochastic approximation.
We study the question of closeness testing for two discrete distributions. More precisely, given samples from two distributions p and q over an n-element set, we wish to distinguish whether p = q versus p is at least ...
详细信息
ISBN:
(纸本)9781611973389
We study the question of closeness testing for two discrete distributions. More precisely, given samples from two distributions p and q over an n-element set, we wish to distinguish whether p = q versus p is at least ε-far from q, in either l_1 or l_2 distance. Batu et al [BFR~+00, BFR~+13] gave the first sub-linear time algorithms for these problems, which matched the lower bounds of [Val11] up to a logarithmic factor in n, and a polynomial factor of ε. In this work, we present simple testers for both the l_1 and l_2 settings, with sample complexity that is information-theoretically optimal, to constant factors, both in the dependence on n, and the dependence on ε; for the l_1 testing problem we establish that the sample complexity is Θ(max{n~(2/3)/=ε~(4/3), n~(1/2)/ε~2}).
This paper describes the new release of RASR - the open source version of the well-proven speech recognition toolkit developed and used at RWTH Aachen University. The focus is put on the implementation of the NN modul...
详细信息
ISBN:
(纸本)9781479928941
This paper describes the new release of RASR - the open source version of the well-proven speech recognition toolkit developed and used at RWTH Aachen University. The focus is put on the implementation of the NN module for training neural network acoustic models. We describe code design, configuration, and features of the NN module. The key feature is a high flexibility regarding the network topology, choice of activation functions, training criteria, and optimization algorithm, as well as a built-in support for efficient GPU computing. The evaluation of run-time performance and recognition accuracy is performed exemplary with a deep neural network as acoustic model in a hybrid NN/HMM system. The results show that RASR achieves a state-of-the-art performance on a real-world large vocabulary task, while offering a complete pipeline for building and applying large scale speech recognition systems.
We consider a wireless control system where multiple power-constrained sensors transmit plant output measurements to a controller over a shared wireless medium. A centralized scheduler, situated at the controller, gra...
详细信息
ISBN:
(纸本)9781467360890
We consider a wireless control system where multiple power-constrained sensors transmit plant output measurements to a controller over a shared wireless medium. A centralized scheduler, situated at the controller, grants channel access to a single sensor on each time step. Given plant and controller dynamics, we design scheduling and transmit power policies that adapt opportunistically to the random wireless channel conditions experienced by the sensors. The objective is to obtain a stable system, by minimizing the expected decrease rate of a given Lyapunov function, while respecting the sensors' power constraints. We develop an online optimization algorithm based on the random channel sequence observed during execution which converges almost surely to the optimal protocol design.
暂无评论