Direct and Iterative Kaczmarz - like Solvers

نویسنده

  • CONSTANTIN POPA
چکیده

Starting from an extension of the classical Kaczmarz’s iterative method, presented by the author in a previous work, we construct in the present paper a direct solver for the computation of the minimal norm solution of inconsistent and rank-deficient leastsquares problems. The construction is made by introducing in the original iteration a set of supplementary directions for projection. In the second part of the paper we analyse the possibility to introduce in each iteration of the classical Kaczmarz’s algorithm some supplementary projections, like those used for the construction of the previously mentioned direct solver. In this way we obtain a faster iterative version of Kaczmarz’s method. Numerical experiments, with both clases of methods are described in the last section of the paper.1 1 The classical and extended Kaczmarz algorithms for arbitrary least-squares problems. Fundamental results Let A be an m × n real matrix and b ∈ IR a given vector. In order to simplify the presentation, but without any restriction of the generality, we shall suppose that n ≤ m. By 〈·, ·〉, ‖ · ‖ we shall denote the Euclidean scalar product and associated norm, respectively on some space IR. Let (AMS) Subject Classification 65F10, 65F20.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Weights in block iterative methods

In this paper we introduce a sequential block iterative method and its simultaneous version with op-timal combination of weights (instead of convex combination) for solving convex feasibility problems.When the intersection of the given family of convex sets is nonempty, it is shown that any sequencegenerated by the given algorithms converges to a feasible point. Additionally for linear feasibil...

متن کامل

Accelerating Random Kaczmarz Algorithm Based on Clustering Information

Kaczmarz algorithm is an efficient iterative algorithm to solve overdetermined consistent system of linear equations. During each updating step, Kaczmarz chooses a hyperplane based on an individual equation and projects the current estimate for the exact solution onto that space to get a new estimate. Many vairants of Kaczmarz algorithms are proposed on how to choose better hyperplanes. Using t...

متن کامل

A Sampling Kaczmarz-Motzkin Algorithm for Linear Feasibility

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. We obtain a family of algorithms that generalize and extend both projection-based techniques. We prove several convergence results, and our computational experiments show our algorithms often outperform the original methods.

متن کامل

Accelerated Kaczmarz Algorithms using History Information

The Kaczmarz algorithm is a well known iterative method for solving overdetermined linear systems. Its randomized version yields provably exponential convergence in expectation. In this paper, we propose two new methods to speed up the randomized Kaczmarz algorithm by utilizing the past estimates in the iterations. The first one utilize the past estimates to get a preconditioner. The second one...

متن کامل

Randomized Block Kaczmarz Method with Projection for Solving Least Squares

The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations Ax = b. The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution space given by a single row of the matrix A and converges exponentially in expectation to the solution of a consistent system. In this paper we analyze two bl...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006