The Lanczos and Conjugate Gradient Algorithms

The Lanczos and Conjugate Gradient Algorithms

Author: Gerard Meurant

Publisher: SIAM

Published: 2006-08-01

Total Pages: 374

ISBN-13: 0898716160

DOWNLOAD EBOOK

The most comprehensive and up-to-date discussion available of the Lanczos and CG methods for computing eigenvalues and solving linear systems.


The Lanczos and Conjugate Gradient Algorithms

The Lanczos and Conjugate Gradient Algorithms

Author: Gerard Meurant

Publisher: SIAM

Published: 2006-01-01

Total Pages: 380

ISBN-13: 9780898718140

DOWNLOAD EBOOK

The Lanczos and conjugate gradient (CG) algorithms are fascinating numerical algorithms. This book presents the most comprehensive discussion to date of the use of these methods for computing eigenvalues and solving linear systems in both exact and floating point arithmetic. The author synthesizes the research done over the past 30 years, describing and explaining the "average" behavior of these methods and providing new insight into their properties in finite precision. Many examples are given that show significant results obtained by researchers in the field. The author emphasizes how both algorithms can be used efficiently in finite precision arithmetic, regardless of the growth of rounding errors that occurs. He details the mathematical properties of both algorithms and demonstrates how the CG algorithm is derived from the Lanczos algorithm. Loss of orthogonality involved with using the Lanczos algorithm, ways to improve the maximum attainable accuracy of CG computations, and what modifications need to be made when the CG method is used with a preconditioner are addressed.


The Symmetric Eigenvalue Problem

The Symmetric Eigenvalue Problem

Author: Beresford N. Parlett

Publisher: SIAM

Published: 1998-01-01

Total Pages: 422

ISBN-13: 9781611971163

DOWNLOAD EBOOK

According to Parlett, "Vibrations are everywhere, and so too are the eigenvalues associated with them. As mathematical models invade more and more disciplines, we can anticipate a demand for eigenvalue calculations in an ever richer variety of contexts." Anyone who performs these calculations will welcome the reprinting of Parlett's book (originally published in 1980). In this unabridged, amended version, Parlett covers aspects of the problem that are not easily found elsewhere. The chapter titles convey the scope of the material succinctly. The aim of the book is to present mathematical knowledge that is needed in order to understand the art of computing eigenvalues of real symmetric matrices, either all of them or only a few. The author explains why the selected information really matters and he is not shy about making judgments. The commentary is lively but the proofs are terse. The first nine chapters are based on a matrix on which it is possible to make similarity transformations explicitly. The only source of error is inexact arithmetic. The last five chapters turn to large sparse matrices and the task of making approximations and judging them.


Preconditioning and the Conjugate Gradient Method in the Context of Solving PDEs

Preconditioning and the Conjugate Gradient Method in the Context of Solving PDEs

Author: Josef Malek

Publisher: SIAM

Published: 2014-12-22

Total Pages: 106

ISBN-13: 161197383X

DOWNLOAD EBOOK

Preconditioning and the Conjugate Gradient Method in the Context of Solving PDEs?is about the interplay between modeling, analysis, discretization, matrix computation, and model reduction. The authors link PDE analysis, functional analysis, and calculus of variations with matrix iterative computation using Krylov subspace methods and address the challenges that arise during formulation of the mathematical model through to efficient numerical solution of the algebraic problem. The book?s central concept, preconditioning of the conjugate gradient method, is traditionally developed algebraically using the preconditioned finite-dimensional algebraic system. In this text, however, preconditioning is connected to the PDE analysis, and the infinite-dimensional formulation of the conjugate gradient method and its discretization and preconditioning are linked together. This text challenges commonly held views, addresses widespread misunderstandings, and formulates thought-provoking open questions for further research.?


Conjugate Direction Methods in Optimization

Conjugate Direction Methods in Optimization

Author: M.R. Hestenes

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 334

ISBN-13: 1461260485

DOWNLOAD EBOOK

Shortly after the end of World War II high-speed digital computing machines were being developed. It was clear that the mathematical aspects of com putation needed to be reexamined in order to make efficient use of high-speed digital computers for mathematical computations. Accordingly, under the leadership of Min a Rees, John Curtiss, and others, an Institute for Numerical Analysis was set up at the University of California at Los Angeles under the sponsorship of the National Bureau of Standards. A similar institute was formed at the National Bureau of Standards in Washington, D. C. In 1949 J. Barkeley Rosser became Director of the group at UCLA for a period of two years. During this period we organized a seminar on the study of solu tions of simultaneous linear equations and on the determination of eigen values. G. Forsythe, W. Karush, C. Lanczos, T. Motzkin, L. J. Paige, and others attended this seminar. We discovered, for example, that even Gaus sian elimination was not well understood from a machine point of view and that no effective machine oriented elimination algorithm had been developed. During this period Lanczos developed his three-term relationship and I had the good fortune of suggesting the method of conjugate gradients. We dis covered afterward that the basic ideas underlying the two procedures are essentially the same. The concept of conjugacy was not new to me. In a joint paper with G. D.


Matrices, Moments and Quadrature with Applications

Matrices, Moments and Quadrature with Applications

Author: Gene H. Golub

Publisher: Princeton University Press

Published: 2009-12-07

Total Pages: 376

ISBN-13: 1400833884

DOWNLOAD EBOOK

This computationally oriented book describes and explains the mathematical relationships among matrices, moments, orthogonal polynomials, quadrature rules, and the Lanczos and conjugate gradient algorithms. The book bridges different mathematical areas to obtain algorithms to estimate bilinear forms involving two vectors and a function of the matrix. The first part of the book provides the necessary mathematical background and explains the theory. The second part describes the applications and gives numerical examples of the algorithms and techniques developed in the first part. Applications addressed in the book include computing elements of functions of matrices; obtaining estimates of the error norm in iterative methods for solving linear systems and computing parameters in least squares and total least squares; and solving ill-posed problems using Tikhonov regularization. This book will interest researchers in numerical linear algebra and matrix computations, as well as scientists and engineers working on problems involving computation of bilinear forms.


Templates for the Solution of Linear Systems

Templates for the Solution of Linear Systems

Author: Richard Barrett

Publisher: SIAM

Published: 1994-01-01

Total Pages: 141

ISBN-13: 9781611971538

DOWNLOAD EBOOK

In this book, which focuses on the use of iterative methods for solving large sparse systems of linear equations, templates are introduced to meet the needs of both the traditional user and the high-performance specialist. Templates, a description of a general algorithm rather than the executable object or source code more commonly found in a conventional software library, offer whatever degree of customization the user may desire. Templates offer three distinct advantages: they are general and reusable; they are not language specific; and they exploit the expertise of both the numerical analyst, who creates a template reflecting in-depth knowledge of a specific numerical technique, and the computational scientist, who then provides "value-added" capability to the general template description, customizing it for specific needs. For each template that is presented, the authors provide: a mathematical description of the flow of algorithm; discussion of convergence and stopping criteria to use in the iteration; suggestions for applying a method to special matrix types; advice for tuning the template; tips on parallel implementations; and hints as to when and why a method is useful.


Sparse Matrix Computations

Sparse Matrix Computations

Author: James R. Bunch

Publisher: Academic Press

Published: 2014-05-10

Total Pages: 468

ISBN-13: 1483263401

DOWNLOAD EBOOK

Sparse Matrix Computations is a collection of papers presented at the 1975 Symposium by the same title, held at Argonne National Laboratory. This book is composed of six parts encompassing 27 chapters that contain contributions in several areas of matrix computations and some of the most potential research in numerical linear algebra. The papers are organized into general categories that deal, respectively, with sparse elimination, sparse eigenvalue calculations, optimization, mathematical software for sparse matrix computations, partial differential equations, and applications involving sparse matrix technology. This text presents research on applied numerical analysis but with considerable influence from computer science. In particular, most of the papers deal with the design, analysis, implementation, and application of computer algorithms. Such an emphasis includes the establishment of space and time complexity bounds and to understand the algorithms and the computing environment. This book will prove useful to mathematicians and computer scientists.