nonnegative matrix factorization (NMF) is a low-rank decomposition based image representation method under the nonnegativity constraint. However, a lot of NMF based approaches utilize Frobenius-norm or KL-divergence a...
详细信息
ISBN:
(纸本)9783030362041;9783030362034
nonnegative matrix factorization (NMF) is a low-rank decomposition based image representation method under the nonnegativity constraint. However, a lot of NMF based approaches utilize Frobenius-norm or KL-divergence as the metrics to model the loss functions. These metrics are not dilation-invariant and thus sensitive to the scale-change illuminations. To solve this problem, this paper proposes a novel robust NMF method (CSNMF) using cosine similarity induced metric, which is both rotation-invariant and dilation-invariant. The invariant properties are beneficial to improving the performance of our method. Based on cosine similarity induced metric and auxiliary function technique, the update rules of CSNMF are derived and theoretically shown to be convergent. Finally, we empirically evaluate the performance and convergence of the proposed CSNMF algorithm. Compared with the state-of-the-art NMF-based algorithms on face recognition, experimental results demonstrate that the proposed CSNMF method has superior performance and is more robust to the variation of illumination.
In the underwater environment, the active sonar system emits an acoustic wave and receives echo signals to detect a target. However, the echo signals consist of not only the echo from the target but also the reverbera...
详细信息
Random projections belong to the major techniques to process big data and have been successfully applied to nonnegative matrix factorization (NMF). However, they cannot be applied in the case of missing entries in the...
详细信息
ISBN:
(纸本)9789082797039
Random projections belong to the major techniques to process big data and have been successfully applied to nonnegative matrix factorization (NMF). However, they cannot be applied in the case of missing entries in the matrix to factorize, which occurs in many actual problems with large data matrices. In this paper, we thus aim to solve this issue and we propose a novel framework to apply random projections in weighted NMF, where the weight models the confidence in the data (or the absence of confidence in the case of missing data). We experimentally show the proposed framework to significantly speed-up state-of-the-art NMF methods under some mild conditions. In particular, the proposed strategy is particularly efficient when combined with Nesterov gradient or alternating least squares.
nonnegative matrix factorization (NMF) decomposes a nonnegativematrix into the product of two lower-rank nonnegative matrices. Since NMF learns parts-based representation, it has been widely used as a feature learnin...
详细信息
nonnegative matrix factorization (NMF) decomposes a nonnegativematrix into the product of two lower-rank nonnegative matrices. Since NMF learns parts-based representation, it has been widely used as a feature learning component in many fields. However, standard NMF algorithms ignore the training labels as well as unlabeled data in the test domain. In this paper, we propose a transductive nonnegativematrix tri-factorization method (T-NMTF) to simultaneously exploit the label information of training examples and the statistical structure of features in the test domain. Different from standard NMF, nonnegativematrix tri-factorization (NMTF) decomposes a nonnegativematrix into the product of three lower-rank nonnegative matrices, and thus provides a flexible framework to transduce discriminative information of training examples to test examples. In particular, the proposed T-NMTF projects both training examples and test examples into a unified subspace, and expects the coefficients of training examples close to their label vectors. Since training examples and test examples are assumed to identically distributed, it is reasonable to expect the learned coefficients of test examples approximate their label vectors well. To estimate the T-NMTF parameters, we develop an efficient multiplicative update rule and prove its convergence. In addition, we propose a manifold regularized T-NMTF (MT-NMTF) algorithm that exploits the local geometry structure of the dataset to boost discriminant power. Experimental results on face recognition demonstrate the effectiveness of T-NMTF and MT-NMTF.
Accurate analysis of fundamental frequency and chord constitutive notes is a hard problem. However, to solve this problem is important for similar music retrieval and music arrangement etc. Development of an accurate ...
详细信息
One of the most important contributions of topic modeling is to accurately and the ectively discover and classify documents in a collection of texts by a number of clusters/topics. However, finding an appropriate numb...
详细信息
ISBN:
(纸本)9781450366120
One of the most important contributions of topic modeling is to accurately and the ectively discover and classify documents in a collection of texts by a number of clusters/topics. However, finding an appropriate number of topics is a particularly challenging model selection question. In this context, we introduce a new unsupervised conceptual stability framework to access the validity of a clustering solution. We integrate the proposed framework into nonnegative matrix factorization (NMF) to guide the selection of desired number of topics. Our model provides a exible way to enhance the interpretation of NMF for the effective clustering solutions. The work presented in this paper crosses the bridge between stability-based validation of clustering solutions and NMF in the context of unsupervised learning. We perform a thorough evaluation of our approach over a wide range of real-world datasets and compare it to current state-of-the-art which are two NMF-based approaches and four Latent Dirichlet Allocation (LDA) based models. the quantitative experimental results show that integrating such conceptual stability analysis into NMF can lead to significant improvements in the document clustering and information retrieval the ectiveness.
We present a robust and unnoticeable secure image watermarking approach using nonnegative matrix factorization (NMF) and Fast Walsh-Hadamard Transform (FWHT). The core idea of the proposed scheme consist of four key s...
详细信息
We present a robust and unnoticeable secure image watermarking approach using nonnegative matrix factorization (NMF) and Fast Walsh-Hadamard Transform (FWHT). The core idea of the proposed scheme consist of four key steps: The original cover image is divided into small blocks. The NMF is then applied to each block separately, followed by using the FWHT to the generated weight matrix. Finally, the singular values of the watermark image are distributed over the transformed blocks. The experimental results certainly show enhanced visual imperceptibility and exceptional resiliency against various types of attacks.
nonnegative matrix factorization (NMF) technique has been developed successfully to represent the intuitively meaningful feature of data. A suitable representation can faithfully preserve the intrinsic structure of da...
详细信息
nonnegative matrix factorization (NMF) technique has been developed successfully to represent the intuitively meaningful feature of data. A suitable representation can faithfully preserve the intrinsic structure of data. Due to the fact that it introduces the label information, semi-supervised NMF has been demonstrated more advantageous in image representation than original NMF. However, previous semi-supervised NMF variants construct a label indicator matrix only for tagging the labeled data and not being optimized together with the matrixfactorization. It is short of label propagation and fails to work for predicting the attribution of data. Moreover, the transductive semi-supervised NMF variants cannot dispose the prediction of unseen data, restricting the application of NMF. In this paper, a joint optimization framework of linear regression and NMF (LR-NMF) based on the self-organized graph is proposed for a completed task which simultaneously takes into account image representation and attribution prediction. By minimizing the proposed objective, three interactive threads are running: decomposing the data into nonnegative basis matrix and the corresponding representation, linear regression using the nonnegative representation, and label propagation based on the self-organized graph which is defined in the feature space. The products of LR-NMF can be viewed as extracting nonnegative feature for clustering, meanwhile, they can be used to solve the out-of-sample problem for classification. Extensive clustering and classification experiments on the digit, face, and object challenging data sets are presented to show the efficacy of the proposed LR-NMF algorithm.
In multivariate time series clustering, the inter-similarity across distinct variates and the intra-similarity within each variate pose analytical challenges. Here, we propose a novel multivariate time series clusteri...
详细信息
In multivariate time series clustering, the inter-similarity across distinct variates and the intra-similarity within each variate pose analytical challenges. Here, we propose a novel multivariate time series clustering method using multi-nonnegative matrix factorization (MNMF) in multi-relational networks. Specifically, a set of multivariate time series is transformed from the time-space domain into a multi-relational network in the topological domain. Then, the multi-relational network is factorized to identify time series clusters. The transformation from the time-space domain to the topological domain benefits from the ability of networks to characterize both the local and global relationships between the nodes, and MNMF incorporates inter-similarity across distinct variates into clustering. Furthermore, to trace the evolutionary trends of clusters, time series is transformed into a dynamic multi-relational network, thereby extending MNMF to dynamic MNMF. Extensive experiments illustrate the superiority of our approach compared with the current state-of-the-art algorithms.
Search result diversification is an effective way to tackle query ambiguity and enhance result novelty. In the context of large information networks, diversifying search result is also critical for further design of a...
详细信息
Search result diversification is an effective way to tackle query ambiguity and enhance result novelty. In the context of large information networks, diversifying search result is also critical for further design of applications such as link prediction and citation recommendation. In previous work, this problem has mainly been tackled in a way of implicit query intent. To further enhance the performance on attributed networks, we propose a novel search result diversification approach via nonnegative matrix factorization. Our approach encodes latent query intents as well as nodes as representation vectors by a novel nonnegative matrix factorization model, and the diversity of the results accounts for the query relevance and the novelty w.r.t. these vectors. To learn the representation vectors of nodes, we derive the multiplicative updating rules to train the nonnegative matrix factorization model. We perform a comprehensive evaluation on our approach with various baselines. The results show the effectiveness of our proposed solution, and verify that attributes do help improve diversification performance.
暂无评论