The aim of this paper is to study the convergence of two proximalalgorithms via the notion of ( α , r )-relaxed cocoercivity without Lipschitzian continuity. We will show that this notion is enough to obtain ...
详细信息
The aim of this paper is to study the convergence of two proximalalgorithms via the notion of ( α , r )-relaxed cocoercivity without Lipschitzian continuity. We will show that this notion is enough to obtain some interesting convergence theorems without any Lipschitz-continuity assumption. The relaxed cocoercivity case is also investigated.
The problem of the minimization of least squares functionals with 1 penalties is considered in an infinite dimensional Hilbert space setting. Though there are several algorithms available in the finite dimensional set...
详细信息
The problem of the minimization of least squares functionals with 1 penalties is considered in an infinite dimensional Hilbert space setting. Though there are several algorithms available in the finite dimensional setting there are only a few of them that come with a proper convergence analysis in the infinite dimensional setting. In this work we provide an algorithm from a class that has not been considered for 1 minimization before, namely, a proximal-point method in combination with a projection step. We show that this idea gives a simple and easy-to-implement algorithm. We present experiments that indicate that the algorithm may perform better than other algorithms if we employ them without any special tricks. Hence, we may conclude that the projection proximal-point idea is a promising idea in the context of 1 minimization.
We study a general convex optimization problem, which covers various classic problems in different areas and particularly includes many optimal transport related problems arising in recent years. To solve this problem...
详细信息
We study a general convex optimization problem, which covers various classic problems in different areas and particularly includes many optimal transport related problems arising in recent years. To solve this problem, we revisit the classic Bregman proximal point algorithm (BPPA) and introduce a new inexact stopping condition for solving the subproblems, which can circumvent the underlying feasibility difficulty often appearing in existing inexact conditions when the problem has a complex feasible set. Our inexact condition also covers several existing inexact conditions as special cases and hence makes our inexact BPPA (iBPPA) more flexible to fit different scenarios in practice. As an application to the standard optimal transport (OT) problem, our iBPPA with the entropic proximal term can bypass some numerical instability issues that usually plague the popular Sinkhorn's algorithm in the OT community, since our iBPPA does not require the proximal param-eter to be very small for obtaining an accurate approximate solution. The iteration complexity of O(1/k) and the convergence of the sequence are also established for our iBPPA under some mild conditions. Moreover, inspired by Nesterov's acceleration technique, we develop an inertial variant of our iBPPA, denoted by V-iBPPA, and establish the iteration complexity of O(1/k\lambda), where \lambda\geq 1 is a quadrangle scaling exponent of the kernel function. In particular, when the proximal parameter is a constant and the kernel function is strongly convex with Lipschitz continuous gradient (hence \lambda = 2), our V-iBPPA achieves a faster rate of O(1/k(2)) just as existing accelerated inexact proximal point algorithms. Some preliminary numerical experiments for solving the standard OT problem are conducted to show the convergence behaviors of our iBPPA and V-iBPPA under different inexactness settings. The experiments also empirically verify the potential of our V-iBPPA for improving the convergence speed.
Compressive sensing(CS) is a new framework for simulations sensing and *** to reconstruct a sparse signal from limited measurements is the key problem in *** solving the reconstruction problem of a sparse signal, we p...
详细信息
Compressive sensing(CS) is a new framework for simulations sensing and *** to reconstruct a sparse signal from limited measurements is the key problem in *** solving the reconstruction problem of a sparse signal, we proposed a self-adaptive proximal point algorithm(PPA).This algorithm can handle the sparse signal reconstruction by solving a substituted problem—l *** last, the numerical results shows that the proposed method is more effective compared with the compressive sampling matching pursuit(CoSaMP).
In this paper, we prove the Δ-convergence of a modified proximal point algorithm for common fixed points in a CAT(0) space for different classes of generalized nonexpansive mappings including a total asymptotically n...
详细信息
作者:
Iiduka, HideakiMeiji Univ
Dept Comp Sci Tama Ku 1-1-1 Higashimita Kawasaki Kanagawa 2148571 Japan
The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be effic...
详细信息
The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is considered. The use of proximal point algorithms that use the proximity operators of the objective functions and incremental optimization techniques is proposed for solving the problem. With the focus on fixed point approximation techniques, two algorithms are devised for solving the problem. One blends an incremental subgradient method, which is a useful algorithm for nonsmooth convex optimization, with a Halpern-type fixed point iteration algorithm. The other is based on an incremental subgradient method and the Krasnosel'skiT-Mann fixed pointalgorithm. It is shown that any weak sequential cluster point of the sequence generated by the Halpern -type algorithm belongs to the solution set of the problem and that there exists a weak sequential cluster point of the sequence generated by the Krasnosel'skii-Mann-type algorithm, which also belongs to the solution set. Numerical comparisons of the two proposed algorithms with existing subgradient methods for concrete nonsmooth convex optimization show that the proposed algorithms achieve faster convergence. (C) 2016 Elsevier B.V. All rights reserved.
In this article, motivated by Rockafellar's proximal point algorithm in Hilbert spaces, we discuss various weak and strong convergence theorems for resolvents of accretive operators and maximal monotone operators ...
详细信息
In this article, motivated by Rockafellar's proximal point algorithm in Hilbert spaces, we discuss various weak and strong convergence theorems for resolvents of accretive operators and maximal monotone operators which are connected with the proximal point algorithm. We first deal with proximal point algorithms in Hilbert spaces. Then, we consider weak and strong convergence theorems for resolvents of accretive operators in Banach spaces which generalize the results in Hilbert spaces. Further, we deal with weak and strong convergence theorems for three types of resolvents of maximal monotone operators in Banach spaces which are related to proximal point algorithms. Finally, in Section 7, we apply some results obtained in Banach spaces to the problem of finding minimizers of convex functions in Banach spaces.
In this paper, we combine theS-iteration process introduced by Agarwal et al. (J. Nonlinear Convex Anal.,8(1), 61-792007) with the proximal point algorithm introduced by Rockafellar (SIAM J. Control Optim.,14, 877-898...
详细信息
In this paper, we combine theS-iteration process introduced by Agarwal et al. (J. Nonlinear Convex Anal.,8(1), 61-792007) with the proximal point algorithm introduced by Rockafellar (SIAM J. Control Optim.,14, 877-8981976) to propose a new modified proximal point algorithm based on theS-type iteration process for approximating a common element of the set of solutions of convex minimization problems and the set of fixed points of nearly asymptotically quasi-nonexpansive mappings in the framework of CAT(0) spaces and prove the o-convergence of the proposed algorithm for solving common minimization problem and common fixed point problem. Our result generalizes, extends and unifies the corresponding results of Dhompongsa and Panyanak (Comput. Math. Appl.,56, 2572-25792008), Khan and Abbas (Comput. Math. Appl.,61, 109-1162011), Abbas et al. (Math. Comput. Modelling,55, 1418-14272012) and many more.
This paper focuses on solving a class of multi-criteria optimization with the difference of convex objective functions. proximal point algorithms, extensively studied for scalar optimization, are extended to our setti...
详细信息
This paper focuses on solving a class of multi-criteria optimization with the difference of convex objective functions. proximal point algorithms, extensively studied for scalar optimization, are extended to our setting. We show that the proposed algorithms are well posed and globally convergent to a critical point. For an application, the new methods are used to a multi-criteria model arising in portfolio optimization. The numerical results show the efficiency of our methods.
In this paper, we propose a new proximal point algorithm for finding a common element of the set of fixed points of nonexpansive single-valued mappings, the set of fixed points of nonexpansive multivalued mappings, an...
详细信息
In this paper, we propose a new proximal point algorithm for finding a common element of the set of fixed points of nonexpansive single-valued mappings, the set of fixed points of nonexpansive multivalued mappings, and the set of minimizers of convex and lower semicontinuous functions. We obtain Delta-convergence and strong convergence of the proposed algorithm to a common element of the three sets in CAT(0) spaces. Furthermore, we apply our convergence results to obtain in a special space of CAT(0) spaces, so-called R-tree, under the gate condition. A numerical example to support our main results is also given.
暂无评论