A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization

نویسندگان

چکیده

The symmetric Nonnegative Matrix Factorization (NMF), a special but important class of the general NMF, has found numerous applications in data analysis such as various clustering tasks. Unfortunately, designing fast algorithms for NMF is not easy its nonsymmetric counterpart, since latter admits splitting property that allows state-of-the-art alternating-type algorithms. To overcome this issue, we first split decision variable and transform to penalized one, paving way efficient We then show solving reformulation returns solution original NMF. Moreover, design family they all admit strong convergence guarantee: generated sequence iterates convergent converges at least sublinearly critical point Finally, conduct experiments on both synthetic real image support our theoretical results demonstrate performance

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Stochastic Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization

where (a) because that E and Tr are both linear operators and Tr[E[ZZ ]] is certain positive number which is independent on the optimization variables, then this term can be replaced by another positive constant Tr[EZ[Z ]EZ[Z]]. Based on the equivalence between (13) and (14), we can apply the result shown in [28, Lemma 2]. Since the constraint set is polyhedral in the formulation (3), the linea...

متن کامل

Symmetric Nonnegative Matrix Factorization for Graph Clustering

Nonnegative matrix factorization (NMF) provides a lower rank approximation of a nonnegative matrix, and has been successfully used as a clustering method. In this paper, we offer some conceptual understanding for the capabilities and shortcomings of NMF as a clustering method. Then, we propose Symmetric NMF (SymNMF) as a general framework for graph clustering, which inherits the advantages of N...

متن کامل

A Projected Alternating Least square Approach for Computation of Nonnegative Matrix Factorization

Nonnegative matrix factorization (NMF) is a common method in data mining that have been used in different applications as a dimension reduction, classification or clustering method. Methods in alternating least square (ALS) approach usually used to solve this non-convex minimization problem.  At each step of ALS algorithms two convex least square problems should be solved, which causes high com...

متن کامل

On Reduced Rank Nonnegative Matrix Factorization for Symmetric Nonnegative Matrices

Let V ∈ R be a nonnegative matrix. The nonnegative matrix factorization (NNMF) problem consists of finding nonnegative matrix factors W ∈ R and H ∈ R such that V ≈ WH. Lee and Seung proposed two algorithms which find nonnegative W and H such that ‖V −WH‖F is minimized. After examining the case in which r = 1 about which a complete characterization of the solution is possible, we consider the ca...

متن کامل

A multilevel approach for nonnegative matrix factorization

Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image processing, computational biology, etc. In this paper, we explain how algorithms for NMF can be embedded into the framework of multilevel methods in order t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering

سال: 2021

ISSN: ['1558-2191', '1041-4347', '2326-3865']

DOI: https://doi.org/10.1109/tkde.2021.3125947