This paper concerns the folded concave penalized sparse linear regression (FCPSLR), a class of popular sparse recovery methods. Although FCPSLR yields desirable recovery performance when solved globally, computing a g...
详细信息
This paper concerns the folded concave penalized sparse linear regression (FCPSLR), a class of popular sparse recovery methods. Although FCPSLR yields desirable recovery performance when solved globally, computing a global solution is NP-complete. Despite some existing statistical performance analyses on local minimizers or on specific FCPSLR-based learning algorithms, it still remains open questions whether local solutions that are known to admit fully polynomial-time approximation schemes (FPTAS) may already be sufficient to ensure the statistical performance, and whether that statistical performance can be non-contingent on the specific designs of computing procedures. To address the questions, this paper presents the following threefold results: (1) Any local solution (stationary point) is a sparse estimator, under some conditions on the parameters of the folded concave penalties. (2) Perhaps more importantly, any local solution satisfying a significant subspace second-order necessary condition (SONC), which is weaker than the second-order KKT condition, yields a bounded error in approximating the true parameter with high probability. In addition, if the minimal signal strength is sufficient, the SONC solution likely recovers the oracle solution. This result also explicates that the goal of improving the statistical performance is consistent with the optimization criteria of minimizing the suboptimality gap in solving the non-convex programming formulation of FCPSLR. (3) We apply (2) to the special case of FCPSLR with minimax concave penalty and show that under the restricted eigenvalue condition, any SONC solution with a better objective value than the Lasso solution entails the strong oracle property. In addition, such a solution generates a model error (ME) comparable to the optimal but exponential-time sparse estimator given a sufficient sample size, while the worst-case ME is comparable to the Lasso in general. Furthermore, to guarantee the SONC admits FPTA
This paper discusses a capacitated time minimization transportation problem in which transportation operation takes place in two stages. In the first stage, due to some constraints, only a specified flow F-1 is transp...
详细信息
This paper discusses a capacitated time minimization transportation problem in which transportation operation takes place in two stages. In the first stage, due to some constraints, only a specified flow F-1 is transported from available sources to various destinations and in the second stage, a flow F-2 is transported depending upon the total demand of the destinations. The current problem is motivated by a production system of a steel industry where semi-finished jobs, initially located at various bins in its warehouse, are transported to various manufacturing facilities by transporters for the final processing and finishing. Due to some additional constraints, it is not possible to transport the number of semi-finished jobs equal to the exact number of final products to be manufactured, in one go. Therefore the transportation operation has to take place in two stages. Further, a capacity is associated with each bin-machine link which makes the current problem, a capacitated, two stage time minimization transportation problem with restricted flow. The objective is to minimize the sum of the transportation times for Stage-I and Stage-II. A polynomial time iterative algorithm is proposed that within each iteration, solves a restricted version of a related standard capacitated time minimization transportation problem and generates a pair of Stage-I and Stage-II times with Stage-II time strictly less than the Stage-II time of the previous iteration, whereas Stage-I time may increase. Out of these generated pairs, a pair with the minimum sum of transportation times of Stage-I and Stage-II is selected that gives the global optimal solution. Numerical illustration is included in the support of the theory.
For many practical applications it is important to determine not only a numerical approximation of one but a representation of the whole set of globally optimal solutions of a non-convex optimization problem. Then one...
详细信息
For many practical applications it is important to determine not only a numerical approximation of one but a representation of the whole set of globally optimal solutions of a non-convex optimization problem. Then one element of this representation may be chosen based on additional information which cannot be formulated as a mathematical function or within a hierarchical problem formulation. We present such an application in the field of robotic design. This application problem can be modeled as a smooth box-constrained optimization problem. We extend the well-known alpha BB method such that it can be used to find an approximation of the set of globally optimal solutions with a predefined quality. We illustrate the properties and give a proof for the finiteness and correctness of our modified alpha BB method.
Transportation Problem is an important aspect which has been widely studied in Operations Research domain. A good and efficient transport is a key factor in mass production where the goods can reach the consumer from ...
详细信息
ISBN:
(纸本)9781467382533
Transportation Problem is an important aspect which has been widely studied in Operations Research domain. A good and efficient transport is a key factor in mass production where the goods can reach the consumer from the production site or factory which may be situated many miles away. It has been studied with the objective of minimizing cost and the time to simulate different real life problems. In this paper, we study a time minimizing transportation problem in which the exact total demand of the destinations cannot be satisfied in one go. Due to some reasons, only a particular amount less than the exact total demand, can be transported first and therefore, rest of the amount has to be transported later. It gives rise to a two stage time minimizing transportation problem in which the stage-I flow is restricted. The present study proposes an iterative algorithm which concentrates on minimizing the total time of transportation of both the stages. At each iteration, a pair of times of Stage-I and Stage-II is generated with Stage-II time strictly less than the Stage-II time of the previous iteration. The pair with the minimum sum of Stage-I and Stage-II times is considered as the optimal pair and the corresponding transportation schedule is considered as the optimal solution of the problem.
In this paper, we propose a new method to solve the robust adaptive beamforming problem for the general rank signal model with positive semi-definite constraint. On applying the worst-case performance optimization app...
详细信息
ISBN:
(纸本)9781479971657
In this paper, we propose a new method to solve the robust adaptive beamforming problem for the general rank signal model with positive semi-definite constraint. On applying the worst-case performance optimization approach, the considered robust adaptive beamforming problem generates a non-convex optimization problem. Here, we propose a two step closed form solution of the formulated problem, wherein a new single variable minimization problem is constructed. Result of this minimization is used to solve the robust adaptive beamforming problem. Simulation results verify the improvement in the performance by the proposed method over the current robust adaptive beamforming methods for general-rank signal model.
Transportation Problem is an important aspect which has been widely studied in Operations Research domain. A good and efficient transport is a key factor in mass production where the goods can reach the consumer from ...
详细信息
ISBN:
(纸本)9781467382540
Transportation Problem is an important aspect which has been widely studied in Operations Research domain. A good and efficient transport is a key factor in mass production where the goods can reach the consumer from the production site or factory which may be situated many miles away. It has been studied with the objective of minimizing cost and the time to simulate different real life problems. In this paper, we study a time minimizing transportation problem in which the exact total demand of the destinations cannot be satisfied in one go. Due to some reasons, only a particular amount less than the exact total demand, can be transported first and therefore, rest of the amount has to be transported later. It gives rise to a two stage time minimizing transportation problem in which the stage-I flow is restricted. The present study proposes an iterative algorithm which concentrates on minimizing the total time of transportation of both the stages. At each iteration, a pair of times of Stage-I and Stage-II is generated with Stage-II time strictly less than the Stage-II time of the previous iteration. The pair with the minimum sum of Stage-I and Stage-II times is considered as the optimal pair and the corresponding transportation schedule is considered as the optimal solution of the problem.
We consider the problem of minimizing a class of quasi-concave functions over a convex set. Quasi-concave functions are generalizations of concave functions and NP-hard to minimize in general. We present a simple full...
详细信息
We consider the problem of minimizing a class of quasi-concave functions over a convex set. Quasi-concave functions are generalizations of concave functions and NP-hard to minimize in general. We present a simple fully polynomial time approximation scheme (FPTAS) for minimizing a class of low-rank quasi-concave functions. Our algorithm solves a polynomial number of linear minimization problems and computes an extreme point near-optimal solution. Therefore, it applies directly to combinatorial 0-1 problems where the convex hull of feasible solutions is known. (C) 2013 Elsevier B.V. All rights reserved.
The robust adaptive beamforming (RAB) problem for general-rank signal model with an additional positive semi-definite constraint is considered. Using the principle of the worst-case performance optimization, such RAB ...
详细信息
The robust adaptive beamforming (RAB) problem for general-rank signal model with an additional positive semi-definite constraint is considered. Using the principle of the worst-case performance optimization, such RAB problem leads to a difference-of-convex functions (DC) optimization problem. The existing approaches for solving the resulted non-convex DC problem are based on approximations and find only suboptimal solutions. Here, we aim at finding the globally optimal solution for the non-convex DC problem and clarify the conditions under which the solution is guaranteed to be globally optimal. Particularly, we rewrite the problem as the minimization of a one-dimensional optimal value function (OVF). Then, the OVF is replaced with another equivalent one, for which the corresponding optimization problem is convex. The new one-dimensional OVF is minimized iteratively via polynomial time DC (POTDC) algorithm. We show that the POTDC converges to a point that satisfies Karush-Kuhn-Tucker (KKT) optimality conditions, and such point is the global optimum under certain conditions. Towards this conclusion, we prove that the proposed algorithm finds the globally optimal solution if the presumed norm of the mismatch matrix that corresponds to the desired signal covariance matrix is sufficiently small. The new RAB method shows superior performance compared to the other state-of-the-art general-rank RAB methods.
in this paper, a new algorithm for tracing the combined homotopy path of the non-convexnonlinear programming problem is proposed. The algorithm is based on the techniques of beta-cone neighborhood and a combined homo...
详细信息
in this paper, a new algorithm for tracing the combined homotopy path of the non-convexnonlinear programming problem is proposed. The algorithm is based on the techniques of beta-cone neighborhood and a combined homotopy interior point method. The residual control criteria, which ensures that the obtained iterative points are interior points, is given by the condition that ensures the beta-cone neighborhood to be included in the interior part of the feasible region. The global convergence and polynomial complexity are established under some hypotheses. (c) 2008 Elsevier B.V. All rights reserved.
Sum-rate maximization in two-way amplify-and-forward (AF) multiple-input multiple-output (MIMO) relaying belongs to the class of difference-of-convex functions (DC) programming problems. DC programming problems occur ...
详细信息
Sum-rate maximization in two-way amplify-and-forward (AF) multiple-input multiple-output (MIMO) relaying belongs to the class of difference-of-convex functions (DC) programming problems. DC programming problems occur also in other signal processing applications and are typically solved using different modifications of the branch-and-bound method which, however, does not have any polynomial time complexity guarantees. In this paper, we develop two efficient polynomial time algorithms for the sum-rate maximization in two-way AF MIMO relaying. The first algorithm guarantees to find at least a Karush-Kuhn-Tucker (KKT) solution. There is a strong evidence, however, that such a solution is actually globally optimal. The second algorithm that is based on the generalized eigenvectors shows the same performance as the first one with reduced computational complexity. The objective function of the problem is represented as a product of quadratic fractional ratios and parameterized so that its convex part (versus the concave part) contains only one (or two) optimization variables. One of the algorithms is called POlynomial Time DC (POTDC) and is based on semi-definite programming (SDP) relaxation, linearization, and an iterative Newton-type search over a single parameter. The other algorithm is called RAte-maximization via Generalized EigenvectorS (RAGES) and is based on the generalized eigenvectors method and an iterative search over two (or one, in its approximate version) optimization variables. We derive an upper-bound for the optimal value of the corresponding optimization problem and show by simulations that this upper-bound is achieved by both algorithms. It provides an evidence that the algorithms find a global optimum. The proposed methods are also superior to other state-of-the-art algorithms.
暂无评论