In this paper, we prove a theorem of convergence to a point for descent minimization methods. When the objective function is differentiable, the convergence point is a stationary point. The theorem, however, is applic...
详细信息
In this paper, we prove a theorem of convergence to a point for descent minimization methods. When the objective function is differentiable, the convergence point is a stationary point. The theorem, however, is applicable also to nondifferentiable functions. This theorem is then applied to prove convergence of some nongradient algorithms.
Abstract: Let $f(x)$ be a general objective function and let $\bar f(x) = h + mf(Ax + d)$. An analytic estimation of the minimum of one would resemble an analytic estimation of the other in all nontrivial resp...
详细信息
Abstract: Let $f(x)$ be a general objective function and let $\bar f(x) = h + mf(Ax + d)$. An analytic estimation of the minimum of one would resemble an analytic estimation of the other in all nontrivial respects. However, the use of a minimization algorithm on either might or might not lead to apparently unrelated sequences of calculations. This paper is devoted to providing a general theory for the affine scale invariance of algorithms. Key elements in this theory are groups of transformations T whose elements relate $\bar f(x)$ and $f(x)$ given above. The statement that a specified algorithm is scale invariant with respect to a specified group T is defined. The scale invariance properties of several well-known algorithms are discussed.
Most minimization algorithms produce an irredundant sum of products by first generating all prime implicants of a switching function. In this note we show that such an approach can be a wasteful one for an already com...
详细信息
Most minimization algorithms produce an irredundant sum of products by first generating all prime implicants of a switching function. In this note we show that such an approach can be a wasteful one for an already complex problem. Specifically we show that there are functions for which the useful prime implicants form an extremely small fraction of all prime implicants, where we define a prime implicant to be useful if there is at least one irredundant sum of products which includes it.
Abstract: In this paper we suggest a single bench mark problem family for use in evaluating unconstrained minimization algorithms or routines. In essence, this problem consists of measuring, for each algorithm...
详细信息
Abstract: In this paper we suggest a single bench mark problem family for use in evaluating unconstrained minimization algorithms or routines. In essence, this problem consists of measuring, for each algorithm, the rate at which it descends an unlimited helical valley. The periodic nature of the problem allows us to exploit affine scale invariance properties of the algorithm. As a result, the capacity of the algorithm to minimize a wide range of helical valleys of various scales may be summarized by calculating a single valued function ${g_Q}({X_1})$. The measurement of this function is not difficult, and the result provides information of a simple, general character for use in decisions about choice of algorithm.
Reformulations of a generalization of a second-order cone complementarity problem (GSOCCP) as optimization problems are introduced, which preserve differentiability. Equivalence results are proved in the sense that th...
详细信息
Reformulations of a generalization of a second-order cone complementarity problem (GSOCCP) as optimization problems are introduced, which preserve differentiability. Equivalence results are proved in the sense that the global minimizers of the reformulations with zero objective value are solutions to the GSOCCP and vice versa. Since the optimization problems involved include only simple constraints, a whole range of minimization algorithms may be used to solve the equivalent problems. Taking into account that optimization algorithms usually seek stationary points, a theoretical result is established that ensures equivalence between stationary points of the reformulation and solutions to the GSOCCP. Numerical experiments are presented that illustrate the advantages and disadvantages of the reformulations.
A variational inequality problem (VIP) satisfying a constraint qualification can be reduced to a mixed complementarity problem (MCP). Monotonicity of the VIP implies that the MCP is also monotone. Introducing regulari...
详细信息
A variational inequality problem (VIP) satisfying a constraint qualification can be reduced to a mixed complementarity problem (MCP). Monotonicity of the VIP implies that the MCP is also monotone. Introducing regularizing perturbations, a sequence of strictly monotone mixed complementarity problems is generated. It is shown that, if the original problem is solvable, the sequence of computable inexact solutions of the strictly monotone MCP's is bounded and every accumulation point is a solution. Under an additional condition on the precision used for solving each subproblem, the sequence converges to the minimum norm solution of the MCP.
Mathematical programming problems with equilibrium constraints (MPEC) are nonlinear programming problems where the constraints have a form that is analogous to first-order optimality conditions of constrained optimiza...
详细信息
Mathematical programming problems with equilibrium constraints (MPEC) are nonlinear programming problems where the constraints have a form that is analogous to first-order optimality conditions of constrained optimization. We prove that, under reasonable sufficient conditions, stationary points of the sum of squares of the constraints are feasible points of the MPEC. In usual formulations of MPEC all the feasible points are nonregular in the sense that they do not satisfy the Mangasarian-Fromovitz constraint qualification of nonlinear programming. Therefore, all the feasible points satisfy the classical Fritz-John necessary optimality conditions. In principle, this can cause serious difficulties for nonlinear programming algorithms applied to MPEC. However, we show that most feasible points do not satisfy a recently introduced stronger optimality condition for nonlinear programming. This is the reason why, in general, nonlinear programming algorithms are successful when applied to MPEC.
Two-level logic is most often implemented as an inclusive-OR sum of product terms, e.g. with PLAs. Using exclusive-OR (EXOR) sums may simplify the representation and manipulation of Boolean functions and result in mor...
详细信息
Two-level logic is most often implemented as an inclusive-OR sum of product terms, e.g. with PLAs. Using exclusive-OR (EXOR) sums may simplify the representation and manipulation of Boolean functions and result in more easily testable implementations requiring fewer product terms. However, due to the lack of relevant algorithms and efficient implementation structures, it has not been possible to translate these theoretical advantages into practical benefits. In this paper solutions for the two main problems associated with the use of EXOR sums are presented. On the one hand we describe a new method to minimise functions using two-level EXOR sums of products, on the other hand we present an implementation structure called the XPLA to map the minimisation results to efficient circuit layouts. We show, for a set of benchmark examples, that the minimisation algorithm results in representations with considerably smaller product term counts than previous EXOR minimisation algorithms or sum-of-product minimisation algorithms. We also show, although the EXOR operator is more expensive to implement in today's technologies, that XPLA implementations can be considerably more compact than PLAs in some cases, and give increased testability.
The four-dimensional ensemble variational (4DEnVar) formulation is receiving increasing interest, especially in numerical weather prediction centres, which until now have mostly relied on the four-dimensional variatio...
详细信息
The four-dimensional ensemble variational (4DEnVar) formulation is receiving increasing interest, especially in numerical weather prediction centres, which until now have mostly relied on the four-dimensional variational (4D-Var) formalism. It may indeed combine some of the best features of variational and ensemble methods. In this article, it is shown that the 4DEnVar formulation is linked with the 4D state formulation of variational assimilation, and that the 4DEnVar is relatively easy to precondition, in addition of being parallelizable. Practical implementations of the 4DEnVar are also investigated and two new preconditioned algorithms are proposed. The hybrid formulation of 4DEnVar, combining static and ensemble background-error covariances, is discussed for the different possible algorithms. An application of the proposed implementations of 4DEnVar is shown with the Burgers model and compared to the use of 4D-Var.
In recent years, the theoretical convergence of iterative methods for solving nonlinear constrained optimization problems has been addressed using sequential optimality conditions, which are satisfied by minimizers in...
详细信息
In recent years, the theoretical convergence of iterative methods for solving nonlinear constrained optimization problems has been addressed using sequential optimality conditions, which are satisfied by minimizers independently of constraint qualifications (CQs). Even though there is a considerable literature devoted to sequential conditions for standard nonlinear optimization, the same is not true for mathematical programs with complementarity constraints (MPCCs). In this paper, we show that the established sequential optimality conditions are not suitable for the analysis of convergence of algorithms for MPCC. We then propose new sequential optimality conditions for usual stationarity concepts for MPCC, namely, weak, Clarke, and Mordukhovich stationarity. We call these conditions AW-, AC-, and AM-stationarity, respectively. The weakest MPCC-tailored CQs associated with them are also provided. We show that some of the existing methods for MPCC reach AC-stationary points, extending previous convergence results. In particular, the new results include the linear case, not previously covered.
暂无评论