We address conditions for global convergence and worst-case complexity bounds of descent algorithms in nonconvex multi-objective optimization. Specifically, we define the concept of steepest-descent-related directions...
详细信息
We address conditions for global convergence and worst-case complexity bounds of descent algorithms in nonconvex multi-objective optimization. Specifically, we define the concept of steepest-descent-related directions. We consider iterative algorithms taking steps along such directions, selecting the stepsize according to a standard Armijo-type rule. We prove that methods fitting this framework automatically enjoy global convergence properties. Moreover, we show that a slightly stricter property, satisfied by most known algorithms, guarantees the same complexity bound of O(c-2) as the steepest descent method. (c) 2024 Elsevier B.V. All rights reserved.
Penalized regression is an attractive framework for variable selection problems. Often, variables possess a grouping structure, and the relevant selection problem is that of selecting groups, not individual variables....
详细信息
Penalized regression is an attractive framework for variable selection problems. Often, variables possess a grouping structure, and the relevant selection problem is that of selecting groups, not individual variables. The group lasso has been proposed as a way of extending the ideas of the lasso to the problem of group selection. Nonconvex penalties such as SCAD and MCP have been proposed and shown to have several advantages over the lasso;these penalties may also be extended to the group selection problem, giving rise to group SCAD and group MCP methods. Here, we describe algorithms for fitting these models stably and efficiently. In addition, we present simulation results and real data examples comparing and contrasting the statistical properties of these methods.
We propose and analyze a numerical algorithm for solving a class of optimal control problems for learning-informed semilinear partial differential equations (PDEs). Such PDEs contain constituents that are in principle...
详细信息
We propose and analyze a numerical algorithm for solving a class of optimal control problems for learning-informed semilinear partial differential equations (PDEs). Such PDEs contain constituents that are in principle unknown and are approximated by nonsmooth ReLU neural networks. We first show that direct smoothing of the ReLU network with the aim of using classical numerical solvers can have disadvantages, such as potentially introducing multiple solutions for the corresponding PDE. This motivates us to devise a numerical algorithm that treats directly the nonsmooth optimal control problem, by employing a descent algorithm inspired by a bundle-free method. Several numerical examples are provided and the efficiency of the algorithm is shown.
We consider the simultaneous optimization of the reliability and the cost of a ceramic component in a biobjective PDE constrained shape optimization problem. A probabilistic Weibull-type model is used to assess the pr...
详细信息
We consider the simultaneous optimization of the reliability and the cost of a ceramic component in a biobjective PDE constrained shape optimization problem. A probabilistic Weibull-type model is used to assess the probability of failure of the component under tensile load, while the cost is assumed to be proportional to the volume of the component. Two different gradient-based optimization methods are suggested and compared at 2D test cases. The numerical implementation is based on a first discretize then optimize strategy and benefits from efficient gradient computations using adjoint equations. The resulting approximations of the Pareto front nicely exhibit the trade-off between reliability and cost and give rise to innovative shapes that compromise between these conflicting objectives.
In this note, we show how to alleviate the catastrophic cancellations that occur when comparing function values in trust-region algorithms. The main original contribution is to successfully adapt the line search strat...
详细信息
In this note, we show how to alleviate the catastrophic cancellations that occur when comparing function values in trust-region algorithms. The main original contribution is to successfully adapt the line search strategy Hager and Zhang (2005) for use within trust-region-like algorithms. (C) 2017 Published by Elsevier B.V.
In this article, we focus on the design of code division multiple access filters (used in data transmission) composed of a particular optical fiber called sampled fiber Bragg grating (SFBG). More precisely, we conside...
详细信息
In this article, we focus on the design of code division multiple access filters (used in data transmission) composed of a particular optical fiber called sampled fiber Bragg grating (SFBG). More precisely, we consider an inverse problem that consists in determining the effective refractive index profile of an SFBG that produces a given reflected spectrum. In order to solve this problem, we use an original multi-layers semi-deterministic global optimization method based on the search of suitable initial conditions for a given optimization algorithm. The results obtained with our optimization algorithms are compared, in term of complexity and final design, with those given by an hybrid genetic algorithm (the method generally considered in the literature for designing SFBGs).
Image processing, in particular image enhancement techniques have been the focal point of considerable research activity in the last decade. With the aid of an existing image enhancement technique, adaptive unsharp ma...
详细信息
Image processing, in particular image enhancement techniques have been the focal point of considerable research activity in the last decade. With the aid of an existing image enhancement technique, adaptive unsharp masking (AUM), we propose a novel kernel to be used in AUM filtering in order to enhance discontinuities which occur on the edges of targets of interest in infrared (IR) images. The proposed method uses an adaptive filter approach where an objective function is minimized by using descent algorithms. The output IR image has better sharpness and contrast adjustment for the detection of targets in terms of objective quality metrics. Hence, the proposed method ensures that the edges of the targets in IR images are sharper and that the quality of contrast adjustment has its optimum level in terms of peak signal-to-noise ratios. (C) 2011 Elsevier B.V. All rights reserved.
We consider a class of derivative-free descent methods for solving the second-order cone complementarity problem (SOCCP). The algorithm is based on the Fischer-Burmeister (FB) unconstrained minimization reformulation ...
详细信息
We consider a class of derivative-free descent methods for solving the second-order cone complementarity problem (SOCCP). The algorithm is based on the Fischer-Burmeister (FB) unconstrained minimization reformulation of the SOCCP, and utilizes a convex combination of the negative partial gradients of the FB merit function FB as the search direction. We establish the global convergence results of the algorithm under monotonicity and the uniform Jordan P-property, and show that under strong monotonicity the merit function value sequence generated converges at a linear rate to zero. Particularly, the rate of convergence is dependent on the structure of second-order cones. Numerical comparisons are also made with the limited BFGS method used by Chen and Tseng (An unconstrained smooth minimization reformulation of the second-order cone complementarity problem, Math. Program. 104(2005), pp. 293-327), which confirm the theoretical results and the effectiveness of the algorithm.
In this paper, we describe the H-differentials of some well known NCP functions and their merit functions. We show how, under appropriate conditions on an H-differential of f, minimizing a merit function corresponding...
详细信息
In this paper, we describe the H-differentials of some well known NCP functions and their merit functions. We show how, under appropriate conditions on an H-differential of f, minimizing a merit function corresponding to f leads to a solution of the nonlinear complementarity problem. Our results give a unified treatment of such results for C(1)-functions, semismooth-functions, and locally Lipschitzian functions. Illustrations are given to show the usefulness of our results. We present also a result on the global convergence of a derivative-free descent algorithm for solving the nonlinear complementarity problem.
In this paper, we consider nonlinear control problems governed by some generalized transient bioheat transfer-type models with the nonlinear Robin boundary conditions. The control estimates the blood perfusion rate, t...
详细信息
In this paper, we consider nonlinear control problems governed by some generalized transient bioheat transfer-type models with the nonlinear Robin boundary conditions. The control estimates the blood perfusion rate, the heat transfer parameter, the distributed energy source terms, and the heat flux due to the evaporation, which affect the effects of thermal physical properties on the transient temperature of biological tissues. The result can be very beneficial for thermal diagnostics in medical practices, for example, for laser surgery, photo and thermotherapy for regional hyperthermia often used in treatment of cancer. First, the mathematical models are introduced and the existence, uniqueness, and regularity of a solution of the state equation are proved as well as the stability and maximum principle under extra assumptions. Afterwards, the optimal control problem is formulated in order to control the online temperature given by radiometric measurement. We prove that an optimal solution exists and obtain necessary optimality conditions. Some strategy for numerical realization based on the adjoint variables are provided.
暂无评论