Geometry and homotopy for l1 sparse representations
نویسنده
چکیده
We explore the geometry of l1 sparse representations in both the noiseless (Basis Pursuit) and noisy (Basis Pursuit De-Noising) case using a homotopy method. We will see that the concept of the basis vertex c, which has unit inner product with active basis vectors, is a useful geometric concept, both for visualization and for algorithm construction. We derive an explicit homotopy continuation algorithm and find that this method has interesting parallels with the Polytope Faces Pursuit algorithm for the noiseless case. Numerical results confirm the operation of the algorithm.
منابع مشابه
A Simple Homotopy Proximal Mapping for Compressive Sensing
In this paper, we present a novel yet simple homotopy proximal mapping algorithm for compressive sensing. The algorithm adopts a simple proximal mapping of the l1 norm at each iteration and gradually reduces the regularization parameter for the l1 norm. We prove a global linear convergence of the proposed homotopy proximal mapping (HPM) algorithm for solving compressive sensing under three diff...
متن کاملA Simple Homotopy Proximal Mapping Algorithm for Compressive Sensing
In this paper, we present a novel yet simple homotopy proximal mapping algorithm for compressive sensing. The algorithm adopts a simple proximal mapping for l1 norm regularization at each iteration and gradually reduces the regularization parameter of the l1 norm. We prove a global linear convergence for the proposed homotopy proximal mapping (HPM) algorithm for solving compressive sensing unde...
متن کاملRegularized l1-Graph for Data Clustering
l1-Graph has been proven to be effective in data clustering, which partitions the data space by using the sparse representation of the data as the similarity measure. However, the sparse representation is performed for each datum independently without taking into account the geometric structure of the data. Motivated by l1-Graph and manifold leaning, we propose Regularized l1-Graph (Rl1-Graph) ...
متن کاملPolar Polytopes and Recovery of Sparse Representations
Suppose we have a signal y which we wish to represent using a linear combination of a number of basis atoms ai, y = ∑ i xiai = Ax. The problem of finding the minimum l0 norm representation for y is a hard problem. The Basis Pursuit (BP) approach proposes to find the minimum l1 norm representation instead, which corresponds to a linear program (LP) that can be solved using modern LP techniques, ...
متن کاملThe lost honour of l2-based regularization
In the past two decades, regularization methods based on the l1 norm, including sparse wavelet representations and total variation, have become immensely popular. So much so, that there have even been recent suggestions that l1-based techniques ought to altogether replace the simpler, faster and better known l2-based alternatives as the default approach to regularization techniques. The occasio...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005