A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization
نویسندگان
چکیده
The symmetric Nonnegative Matrix Factorization (NMF), a special but important class of the general NMF, has found numerous applications in data analysis such as various clustering tasks. Unfortunately, designing fast algorithms for NMF is not easy its nonsymmetric counterpart, since latter admits splitting property that allows state-of-the-art alternating-type algorithms. To overcome this issue, we first split decision variable and transform to penalized one, paving way efficient We then show solving reformulation returns solution original NMF. Moreover, design family they all admit strong convergence guarantee: generated sequence iterates convergent converges at least sublinearly critical point Finally, conduct experiments on both synthetic real image support our theoretical results demonstrate performance
منابع مشابه
A Stochastic Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization
where (a) because that E and Tr are both linear operators and Tr[E[ZZ ]] is certain positive number which is independent on the optimization variables, then this term can be replaced by another positive constant Tr[EZ[Z ]EZ[Z]]. Based on the equivalence between (13) and (14), we can apply the result shown in [28, Lemma 2]. Since the constraint set is polyhedral in the formulation (3), the linea...
متن کاملSymmetric Nonnegative Matrix Factorization for Graph Clustering
Nonnegative matrix factorization (NMF) provides a lower rank approximation of a nonnegative matrix, and has been successfully used as a clustering method. In this paper, we offer some conceptual understanding for the capabilities and shortcomings of NMF as a clustering method. Then, we propose Symmetric NMF (SymNMF) as a general framework for graph clustering, which inherits the advantages of N...
متن کاملA Projected Alternating Least square Approach for Computation of Nonnegative Matrix Factorization
Nonnegative matrix factorization (NMF) is a common method in data mining that have been used in different applications as a dimension reduction, classification or clustering method. Methods in alternating least square (ALS) approach usually used to solve this non-convex minimization problem. At each step of ALS algorithms two convex least square problems should be solved, which causes high com...
متن کاملOn Reduced Rank Nonnegative Matrix Factorization for Symmetric Nonnegative Matrices
Let V ∈ R be a nonnegative matrix. The nonnegative matrix factorization (NNMF) problem consists of finding nonnegative matrix factors W ∈ R and H ∈ R such that V ≈ WH. Lee and Seung proposed two algorithms which find nonnegative W and H such that ‖V −WH‖F is minimized. After examining the case in which r = 1 about which a complete characterization of the solution is possible, we consider the ca...
متن کاملA multilevel approach for nonnegative matrix factorization
Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image processing, computational biology, etc. In this paper, we explain how algorithms for NMF can be embedded into the framework of multilevel methods in order t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering
سال: 2021
ISSN: ['1558-2191', '1041-4347', '2326-3865']
DOI: https://doi.org/10.1109/tkde.2021.3125947