In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC p...
详细信息
In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternatingminimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel-Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka-& Lstrok;ojasiewicz (K & Lstrok;) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the K & Lstrok;exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.
Excessive radiation exposure in computed tomography (CT) scans increases the chance of developing cancer and has become a major clinical concern. Recently, statistical iterative reconstruction (SIR) with l(0)-norm dic...
详细信息
Excessive radiation exposure in computed tomography (CT) scans increases the chance of developing cancer and has become a major clinical concern. Recently, statistical iterative reconstruction (SIR) with l(0)-norm dictionary learning regularization has been developed to reconstructCTimages from the lowdose and few-viewdataset in order to reduce radiation dose. Nonetheless, the sparse regularization term adopted in this approach is l(0)-norm, which cannot guarantee the global convergence of the proposed algorithm. To address this problem, in this study we introduced the l(1)norm dictionary learning penalty into SIR framework for low dose CT image reconstruction, and developed an alternating minimization algorithm to minimize the associated objective function, which transforms CT image reconstruction problem into a sparse coding subproblem and an image updating subproblem. During the image updating process, an efficient model function approach based on balancing principle is applied to choose the regularization parameters. The proposed alternating minimization algorithm was evaluated first using real projection data of a sheep lung CT perfusion and then using numerical simulation based on sheep lung CT image and chest image. Both visual assessment and quantitative comparison using terms of root mean square error (RMSE) and structural similarity (SSIM) index demonstrated that the new image reconstruction algorithm yielded similar performance with l(0)-norm dictionary learning penalty and outperformed the conventional filtered backprojection (FBP) and total variation (TV) minimizationalgorithms.
We propose a new algorithm, called line integral alternatingminimization (LIAM), for dual-energy X-ray CT image reconstruction. Instead of obtaining component images by minimizing the discrepancy between the data and...
详细信息
We propose a new algorithm, called line integral alternatingminimization (LIAM), for dual-energy X-ray CT image reconstruction. Instead of obtaining component images by minimizing the discrepancy between the data and the mean estimates, LIAM allows for a tunable discrepancy between the basis material projections and the basis sinograms. A parameter is introduced that controls the size of this discrepancy, and with this parameter the new algorithm can continuously go from a two-step approach to the joint estimation approach. LIAM alternates between iteratively updating the line integrals of the component images and reconstruction of the component images using an image iterative deblurring algorithm. An edge-preserving penalty function can be incorporated in the iterative deblurring step to decrease the roughness in component images. Images from both simulated and experimentally acquired sinograms from a clinical scanner were reconstructed by LIAM while varying the regularization parameters to identify good choices. The results from the dual-energy alternating minimization algorithm applied to the same data were used for comparison. Using a small fraction of the computation time of dual-energy alternatingminimization, LIAM achieves better accuracy of the component images in the presence of Poisson noise for simulated data reconstruction and achieves the same level of accuracy for real data reconstruction.
The privacy-protected algorithm (PPA) is pivotal in the realm of machine learning, especially for handling sensitive data types, such as medical and financial records. PPA enables two distinct operations: data publish...
详细信息
The privacy-protected algorithm (PPA) is pivotal in the realm of machine learning, especially for handling sensitive data types, such as medical and financial records. PPA enables two distinct operations: data publishing and data analysis, each capable of functioning independently. However, the field lacks a unified framework or an efficient algorithm to synergize these operations. This deficiency inspires our current research endeavor. In this paper, we introduce a novel dual-mode empirical risk minimization (D-ERM) model, specifically designed for integrated learning tasks. We also develop an alternatingminimization differential privacy protection algorithm (AMDPPA) for implementing the D-ERM model. Our theoretical analysis confirms the differential privacy and accuracy of AMDPPA. We validate the algorithm's efficacy through numerical experiments using real-world datasets, demonstrating its ability to effectively balance privacy with learning efficiency.
A new alternating minimization algorithm for image segmentation is proposed. Based on the similarities between Ambrosio-Tortorelli model and Perona-Malik model, a new explicit alternating minimization algorithm is dev...
详细信息
ISBN:
(纸本)9781510822030
A new alternating minimization algorithm for image segmentation is proposed. Based on the similarities between Ambrosio-Tortorelli model and Perona-Malik model, a new explicit alternating minimization algorithm is developed. The Euler-Lagrange equations of Ambrosio-Tortorelli model is modified to produce sharper edges. The effect of parameters is studied. Numerical results are presented to illustrate the effectiveness of the proposed model.
Building upon recent works on linesearch-free adaptive proximal gradient methods, this paper proposes AdaPG(q,r), a framework that unifies and extends existing results by providing larger stepsize policies and improve...
详细信息
Building upon recent works on linesearch-free adaptive proximal gradient methods, this paper proposes AdaPG(q,r), a framework that unifies and extends existing results by providing larger stepsize policies and improved lower bounds. Different choices of the parameters q and r are discussed and the efficacy of the resulting methods is demonstrated through numerical simulations. In an attempt to better understand the underlying theory, its convergence is established in a more general setting that allows for time-varying parameters. Finally, an adaptive alternating minimization algorithm is presented by exploring the dual setting. This algorithm not only incorporates additional adaptivity, but also expands its applicability beyond standard strongly convex settings.
Integrating heating and electricity networks offers extra flexibility to the energy system operation while improving energy utilization efficiency. This paper proposes a data-driven joint distributionally robust chanc...
详细信息
Integrating heating and electricity networks offers extra flexibility to the energy system operation while improving energy utilization efficiency. This paper proposes a data-driven joint distributionally robust chance-constrained (DRCC) operation model for multiple integrated electricity and heating systems (IEHSs). Flexible reserve resources in IEHS are exploited to mitigate the uncertainty of renewable energy. A distributed and parallel joint DRCC operation framework is developed to preserve the decision-making independence of multiple IEHSs, where the optimized CVaR approximation (OCA) approach is developed to transform the local joint DRCC model into a tractable model. An alternating minimization algorithm is presented to improve the tightness of OCA for joint chance constraints by iteratively tuning the OCA. Case studies on the IEEE 33-bus system with four IEHSs and the IEEE 141-bus system with eight IEHSs demonstrate the effectiveness of the proposed approach.
The regularized clustering (RC) framework based on the fusion penalty has attracted extensive attention in the last decade because it does not require the prior knowledge of the number of clusters. Although the ground...
详细信息
The regularized clustering (RC) framework based on the fusion penalty has attracted extensive attention in the last decade because it does not require the prior knowledge of the number of clusters. Although the ground truth connections and weights among samples are beneficial for clustering, the performance of RC could be distorted by the omnipresent spurious connections in real-world data sets. To effectively address the issue, this letter constructs an enhanced regularized clustering model by incorporating a spurious connection detection mechanism into the objective function of the RC framework. The proposed model can effectively reduce the damage caused by spurious connections through adaptively identifying the importance of each connection. Furthermore, an alternating minimization algorithm is developed with detailed convergence analysis. Experimental results validate its effectiveness against several state-of-the-art RC methods.
Image restoration is a core problem in computer vision and image processing. In this paper, we introduce a unified low-patch-rank minimization model, which possesses one nuclear norm regularization term promoting the ...
详细信息
Image restoration is a core problem in computer vision and image processing. In this paper, we introduce a unified low-patch-rank minimization model, which possesses one nuclear norm regularization term promoting the low-patch-rankness, and two sparse regulariza-tion terms including the classical total variation (TV) norm and a general sparse term un-der certain transform such as discrete cosine transform . By setting balancing parameters, our unified model reduces to the classical TV-regularized low-patch-rank minimization model and yields a new non-TV-regularized low-patch-rank prior image restoration model. Due to the multi-block structure of the model, we introduce a three-block alternating minimiza-tion algorithm to find approximate solutions of the proposed models. A series of compu-tational results on image inpainting and deblurring further show that our approaches are reliable to recover high-quality images from degraded ones. (c) 2022 Elsevier Inc. All rights reserved.
Matrix and tensor nuclear norms have been successfully used to promote the low-rankness of tensors in low-rank tensor completion. However, singular value decomposition (SVD), which is computationally expensive for lar...
详细信息
Matrix and tensor nuclear norms have been successfully used to promote the low-rankness of tensors in low-rank tensor completion. However, singular value decomposition (SVD), which is computationally expensive for large-scale matrices, frequently appears in solving those nuclear norm minimization models. Based on the tensor-tensor product (T-product), in this paper, we first establish the equivalence between the so-called transformed tubal nuclear norm for a third-order tensor and the minimum of the sum of two factor tensors' squared Frobenius norms under a general invertible linear transform. Gainfully, we introduce a mode-unfolding (often named as "spatio-temporal" in the internet traffic data recovery literature) regularized tensor completion model that is able to efficiently exploit the hidden structures of tensors. Then, we propose an implementable alternating minimization algorithm to solve the underlying optimization model. It is remarkable that our approach does not require any SVDs and all subproblems of our algorithm enjoy closed-form solutions. A series of numerical experiments on traffic data recovery, color images and videos inpainting demonstrate that our SVD-free approach takes less computing time to achieve satisfactory accuracy than some state-of-the-art tensor nuclear norm minimization approaches.
暂无评论