Spectral embedding and spectral clustering are common methods for non-linear dimensionality reduction and clustering of complex high dimensional datasets. In this paper we provide a diffusion based probabilistic analy...
详细信息
ISBN:
(纸本)9783540737490
Spectral embedding and spectral clustering are common methods for non-linear dimensionality reduction and clustering of complex high dimensional datasets. In this paper we provide a diffusion based probabilistic analysis of algorithms that use the normalized graph Laplacian. Given the pairwise adjacency matrix of all points in a dataset, we define a random walk on the graph of points and a diffusion distance between any two points. We show that the diffusion distance is equal to the Euclidean distance in the embedded space with all eigenvectors of the normalized graph Laplacian. This identity shows that characteristic relaxation times and processes of the random walk on the graph are the key concept that governs the properties of these spectral clustering and spectral embedding algorithms. Specifically, for spectral clustering to succeed, a necessary condition is that the mean exit times from each cluster need to be significantly larger than the largest (slowest) of all relaxation times inside all of the individual clusters. For complex, multiscale data, this condition may not hold and multiscale methods need to be developed to handle such situations.
The problem of model selection arises in a number of contexts, such as subset selection in linear regression, estimation of structures in graphical models, and signal denoising. This paper studies non-asymptotic model...
详细信息
The problem of model selection arises in a number of contexts, such as subset selection in linear regression, estimation of structures in graphical models, and signal denoising. This paper studies non-asymptotic model selection for the general case of arbitrary (random or deterministic) design matrices and arbitrary nonzero entries of the signal. In this regard, it generalizes the notion of incoherence in the existing literature on model selection and introduces two fundamental measures of coherence- termed as the worst-case coherence and the average coherence-among the columns of a design matrix. It utilizes these two measures of coherence to provide an in-depth analysis of a simple, model-order agnostic one-step thresholding (OST) algorithm for model selection and proves that OST is feasible for exact as well as partial model selection as long as the design matrix obeys an easily verifiable property, which is termed as the coherence property. One of the key insights offered by the ensuing analysis in this regard is that OST can successfully carry out model selection even when methods based on convex optimization such as the lasso fail due to the rank deficiency of the submatrices of the design matrix. In addition, the paper establishes that if the design matrix has reasonably small worst-case and average coherence then OST performs near-optimally when either (i) the energy of any nonzero entry of the signal is close to the average signal energy per nonzero entry or (ii) the signal-to-noise ratio in the measurement system is not too high. Finally, two other key contributions of the paper are that (i) it provides bounds on the average coherence of Gaussian matrices and Gabor frames, and (ii) it extends the results on model selection using OST to low-complexity, model-order agnostic recovery of sparse signals with arbitrary nonzero entries. In particular, this part of the analysis in the paper implies that an Alltop Gabor frame together with OST can successfully carr
Understanding the interaction between atomic hydrogen and solid tungsten is important for the development of fusion reactors in which proposed tungsten walls would be bombarded with high energy particles including hyd...
详细信息
We consider the problem of embedding point cloud data sampled from an underlying manifold with an associated flow or velocity. Such data arises in many contexts where static snapshots of dynamic entities are measured,...
详细信息
In the context of the recently developed “equation-free” approach to computer-assisted analysis of complex systems, we extract the self-similar solution describing core collapse of a stellar system from numerical ex...
详细信息
In the context of the recently developed “equation-free” approach to computer-assisted analysis of complex systems, we extract the self-similar solution describing core collapse of a stellar system from numerical experiments. The technique allows us to sidestep the core “bounce” that occurs in direct N-body simulations due to the small-N correlations that develop in the late stages of collapse, and hence to follow the evolution well into the self-similar regime.
We use an “equation-free,” coarse-grained computational approach to accelerate molecular dynamics-based computations of demixing (segregation) of dissimilar particles subject to an upward gas flow (gas-fluidized bed...
详细信息
We use an “equation-free,” coarse-grained computational approach to accelerate molecular dynamics-based computations of demixing (segregation) of dissimilar particles subject to an upward gas flow (gas-fluidized beds). We explore the coarse-grained dynamics of these phenomena in gently fluidized beds of solid mixtures of different densities, typically a slow process for which reasonable continuum models are currently unavailable.
The first computer implementation of the Dantzig-Fulkerson- Johnson cutting-plane method for solving the traveling salesman problem, written by Martin, used subtour inequalities as well as cutting planes of Gomory’s ...
详细信息
Single particle cryo-electron microscopy (EM) is an increasingly popular method for determining the 3-D structure of macromolecules from noisy 2-D images of single macromolecules whose orientations and positions are r...
详细信息
The dynamical triangulation model of 3-dimensional Quantum Gravity is defined and studied. We propose two different algorithms for numerical simulations, leading to consistent results. One is the 3-dimensional general...
The dynamical triangulation model of 3-dimensional Quantum Gravity is defined and studied. We propose two different algorithms for numerical simulations, leading to consistent results. One is the 3-dimensional generalization of the bonds flip, another is more sophisticated algorithm, based on Schwinger–Dyson equations. We found such care necessary, because our results appear to be quite unexpected. We simulated up to 60000 tetrahedra and observed none of the feared pathologies like factorial growth of the partition function with volume, or collapse to the branched polymer phase. The volume of the Universe grows exponentially when the bare cosmological constant λ approaches the critical value λ c from above, but the closed Universe exists and has peculiar continuum limit. The Universe compressibility diverges as (λ − λ c ) −2 and the bare Newton constant linearly approaches negative critical value as λ goes to λ c , provided the average curvature is kept at zero. The fractal properties turned out to be the same, as in two dimensions, namely the effective Hausdorff dimension grows logarithmically with the size of the test geodesic sphere.
We propose the coarse-grained spectral projection method (CGSP), a deep learning-assisted approach for tackling quantum unitary dynamic problems with an emphasis on quench dynamics. We show CGSP can extract spectral c...
详细信息
暂无评论