The relaxed optimal k-thresholding pursuit (ROTP) is a recent algorithm for linear inverse problems. This algorithm is based on the optimal k-thresholding technique which performs vector thresholding and error metric ...
详细信息
The relaxed optimal k-thresholding pursuit (ROTP) is a recent algorithm for linear inverse problems. This algorithm is based on the optimal k-thresholding technique which performs vector thresholding and error metric reduction simultaneously. Although ROTP can be used to solve small to medium-sized linear inverse problems, the computational cost of this algorithm is high when solving large-scale problems. By merging the optimal k-thresholding technique and iterative method with memory as well as optimization with sparse search directions, we propose the so-called dynamic thresholding algorithm with memory (DTAM), which iteratively and dynamically selects vector bases to construct the problem solution. At every step, the algorithm uses more than one or all iterates generated so far to construct a new search direction, and solves only the small-sized quadratic subproblems at every iteration. Thus the computational complexity of DTAM is remarkably lower than that of ROTP-type methods. It turns out that DTAM can locate the solution of linear inverse problems if the matrix involved satisfies the restricted isometry property. Experiments on synthetic data, audio signal reconstruction and image denoising demonstrate that the proposed algorithm performs comparably to several mainstream thresholding and greedy algorithms, and it works faster than the ROTP-type algorithms especially when the sparsity level of signal is relatively low.
In this work we study the increasing resolution of linearinverse scattering problems at a large fixed frequency. We consider the problem of recovering the density of a Herglotz wave function, and the linearized inver...
详细信息
In this work we study the increasing resolution of linearinverse scattering problems at a large fixed frequency. We consider the problem of recovering the density of a Herglotz wave function, and the linearized inverse scattering problem for a potential. It is shown that the number of features that can be stably recovered (stable region) becomes larger as the frequency increases, whereas one has strong instability for the rest of the features (unstable region). To show this rigorously, we prove that the singular values of the forward operator stay roughly constant in the stable region and decay exponentially in the unstable region. The arguments are based on structural properties of the problems and they involve the Courant min-max principle for singular values, quantitative AgmonH & ouml;rmander estimates, and a Schwartz kernel computation based on the coarea formula. (c) 2025 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http:// ***/licenses/by/4.0/).
The paper is devoted to the study of the solvability of linear inverse problems for a one-dimensional heat equation with an unknown right-hand side. The aim of the work is to obtain theorems of the existence and uniqu...
详细信息
The paper is devoted to the study of the solvability of linear inverse problems for a one-dimensional heat equation with an unknown right-hand side. The aim of the work is to obtain theorems of the existence and uniqueness of regular solutions (i.e., solutions having all weak derivatives in the sense of Sobolev occurring in the equation) The proofs will essentially use new results on the solvability of nonlocal problems with a generalized Samarskii-Ionkin boundary condition.
We investigate two ideas in this thesis. First, we analyze the results of adapting recovery algorithms from linear inverse problems to defend neural networks against adversarial attacks. Second, we analyze the results...
详细信息
We investigate two ideas in this thesis. First, we analyze the results of adapting recovery algorithms from linear inverse problems to defend neural networks against adversarial attacks. Second, we analyze the results of substituting sparsity priors with neural network priors in linear inverse problems. For the former, we are able to extend an existing compressive sensing framework to defend neural networks against ℓ0, ℓ2,and ℓ∞ norm attacks,and for the latter, we find that our method yields an improvement over reconstruction results of existing neural network based priors.
While a finite collection of data does not specify a unique solution to a linearinverse problem, it can allow bounds to be placed on certain nonlinear solution functionals. Using the Dirichlet problem for the unit di...
详细信息
While a finite collection of data does not specify a unique solution to a linearinverse problem, it can allow bounds to be placed on certain nonlinear solution functionals. Using the Dirichlet problem for the unit disc as an example, this note demonstrates the use of linear programming in constructing extremal solutions associated with a variety of such bounds.
In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with a general convex penalty term. When the data is gi...
详细信息
In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with a general convex penalty term. When the data is given exactly, we give a convergence analysis of our ADMM algorithm without assuming the existence of a Lagrange multiplier. In case the data contains noise, we show that our method is a regularization method as long as it is terminated by a suitable stopping rule. Various numerical simulations are performed to test the efficiency of the method.
An optimal m-vector descent iterative algorithm in a Krylov subspace is developed, of which the m weighting parameters are optimized from a properly defined objective function to accelerate the convergence rate in sol...
详细信息
An optimal m-vector descent iterative algorithm in a Krylov subspace is developed, of which the m weighting parameters are optimized from a properly defined objective function to accelerate the convergence rate in solving an ill-posed linear problem. The optimal multi-vector iterative algorithm (OMVIA) is convergent fast and accurate, which is verified by numerical tests of several linear inverse problems, including the backward heat conduction problem, the heat source identification problem, the inverse Cauchy problem, and the external force recovery problem. Because the OMVIA has a good filtering effect, the numerical results recovered are quite smooth with small error, even under a large noise up to 10%.
In the framework of abstract linear inverse problems in infinite-dimensional Hilbert space we discuss generic convergence behaviours of approximate solutions determined by means of general projection methods, namely o...
详细信息
In the framework of abstract linear inverse problems in infinite-dimensional Hilbert space we discuss generic convergence behaviours of approximate solutions determined by means of general projection methods, namely outside the standard assumptions of Petrov-Galerkin truncation schemes. This includes a discussion of the mechanisms why the error or the residual generically fail to vanish in norm, and the identification of practically plausible sufficient conditions for such indicators to be small in some weaker sense. The presentation is based on theoretical results together with a series of model examples and numerical tests.
In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimization methods in machine...
详细信息
In this work we consider stochastic gradient descent (SGD) for solving linear inverse problems in Banach spaces. SGD and its variants have been established as one of the most successful optimization methods in machine learning, imaging, and signal processing, to name a few. At each iteration SGD uses a single datum, or a small subset of data, resulting in highly scalable methods that are very attractive for large-scale inverseproblems. Nonetheless, the theoretical analysis of SGD-based approaches for inverseproblems has thus far been largely limited to Euclidean and Hilbert spaces. In this work we present a novel convergence analysis of SGD for linear inverse problems in general Banach spaces: we show the almost sure convergence of the iterates to the minimum norm solution and establish the regularizing property for suitable a priori stopping criteria. Numerical results are also presented to illustrate features of the approach.
A future cone in the Minkowski space, defined in terms of the square-norm of the residual vector for an ill-posed linear system to be solved, is used to derive an optimal tri-vector descent system of nonlinear ordinar...
详细信息
A future cone in the Minkowski space, defined in terms of the square-norm of the residual vector for an ill-posed linear system to be solved, is used to derive an optimal tri-vector descent system of nonlinear ordinary differential equations (ODEs). Then, a simple Euler scheme is used to generate an iterative algorithm from these ODEs, of which the two parameters appeared are optimized from a properly defined merit function to accelerate the convergence speed in solving the ill-posed linear systems. The optimal tri-vector iterative algorithm (OTVIA) is fast convergent and accurate, which is proven by numerical tests of inverseproblems, including the backward heat conduction problem, the Calderon inverse problem and the inverse Cauchy problems. By defining a suitable convergence rate, we assess the convergence speeds of OTVIA and the conjugate gradient method (CGM), which reveal that the performance of OTVIA is better than the CGM. Also by comparing the OTVIA with the generalized minimal residual method (GMRES), we observe that the OTVIA is better than the GMRES.
暂无评论