Randomized Algorithms for Matrices and Data provides a detailed overview, appropriate for both students and researchers from all of these areas, of recent work on the theory of randomized matrix algorithms as well as the application of those ideas to the solution of practical problems in large-scale data analysis
The presence of uncertainty in a system description has always been a critical issue in control. The main objective of Randomized Algorithms for Analysis and Control of Uncertain Systems, with Applications (Second Edition) is to introduce the reader to the fundamentals of probabilistic methods in the analysis and design of systems subject to deterministic and stochastic uncertainty. The approach propounded by this text guarantees a reduction in the computational complexity of classical control algorithms and in the conservativeness of standard robust control techniques. The second edition has been thoroughly updated to reflect recent research and new applications with chapters on statistical learning theory, sequential methods for control and the scenario approach being completely rewritten. Features: · self-contained treatment explaining Monte Carlo and Las Vegas randomized algorithms from their genesis in the principles of probability theory to their use for system analysis; · development of a novel paradigm for (convex and nonconvex) controller synthesis in the presence of uncertainty and in the context of randomized algorithms; · comprehensive treatment of multivariate sample generation techniques, including consideration of the difficulties involved in obtaining identically and independently distributed samples; · applications of randomized algorithms in various endeavours, such as PageRank computation for the Google Web search engine, unmanned aerial vehicle design (both new in the second edition), congestion control of high-speed communications networks and stability of quantized sampled-data systems. Randomized Algorithms for Analysis and Control of Uncertain Systems (second edition) is certain to interest academic researchers and graduate control students working in probabilistic, robust or optimal control methods and control engineers dealing with system uncertainties. The present book is a very timely contribution to the literature. I have no hesitation in asserting that it will remain a widely cited reference work for many years. M. Vidyasagar
For many applications a randomized algorithm is either the simplest algorithm available, or the fastest, or both. This tutorial presents the basic concepts in the design and analysis of randomized algorithms. The first part of the book presents tools from probability theory and probabilistic analysis that are recurrent in algorithmic applications. Algorithmic examples are given to illustrate the use of each tool in a concrete setting. In the second part of the book, each of the seven chapters focuses on one important area of application of randomized algorithms: data structures; geometric algorithms; graph algorithms; number theory; enumeration; parallel algorithms; and on-line algorithms. A comprehensive and representative selection of the algorithms in these areas is also given. This book should prove invaluable as a reference for researchers and professional programmers, as well as for students.
Spectral methods refer to the use of eigenvalues, eigenvectors, singular values and singular vectors. They are widely used in Engineering, Applied Mathematics and Statistics. More recently, spectral methods have found numerous applications in Computer Science to "discrete" as well as "continuous" problems. Spectral Algorithms describes modern applications of spectral methods, and novel algorithms for estimating spectral parameters. The first part of the book presents applications of spectral methods to problems from a variety of topics including combinatorial optimization, learning and clustering. The second part of the book is motivated by efficiency considerations. A feature of many modern applications is the massive amount of input data. While sophisticated algorithms for matrix computations have been developed over a century, a more recent development is algorithms based on "sampling on the fly" from massive matrices. Good estimates of singular values and low rank approximations of the whole matrix can be provably derived from a sample. The main emphasis in the second part of the book is to present these sampling methods with rigorous error bounds. It also presents recent extensions of spectral methods from matrices to tensors and their applications to some combinatorial optimization problems.
Randomized algorithms have become a central part of the algorithms curriculum, based on their increasingly widespread use in modern applications. This book presents a coherent and unified treatment of probabilistic techniques for obtaining high probability estimates on the performance of randomized algorithms. It covers the basic toolkit from the Chernoff–Hoeffding bounds to more sophisticated techniques like martingales and isoperimetric inequalities, as well as some recent developments like Talagrand's inequality, transportation cost inequalities and log-Sobolev inequalities. Along the way, variations on the basic theme are examined, such as Chernoff–Hoeffding bounds in dependent settings. The authors emphasise comparative study of the different methods, highlighting respective strengths and weaknesses in concrete example applications. The exposition is tailored to discrete settings sufficient for the analysis of algorithms, avoiding unnecessary measure-theoretic details, thus making the book accessible to computer scientists as well as probabilists and discrete mathematicians.
Randomization and probabilistic techniques play an important role in modern computer science, with applications ranging from combinatorial optimization and machine learning to communication networks and secure protocols. This 2005 textbook is designed to accompany a one- or two-semester course for advanced undergraduates or beginning graduate students in computer science and applied mathematics. It gives an excellent introduction to the probabilistic techniques and paradigms used in the development of probabilistic algorithms and analyses. It assumes only an elementary background in discrete mathematics and gives a rigorous yet accessible treatment of the material, with numerous examples and applications. The first half of the book covers core material, including random sampling, expectations, Markov's inequality, Chevyshev's inequality, Chernoff bounds, the probabilistic method and Markov chains. The second half covers more advanced topics such as continuous probability, applications of limited independence, entropy, Markov chain Monte Carlo methods and balanced allocations. With its comprehensive selection of topics, along with many examples and exercises, this book is an indispensable teaching tool.
Fast solvers for elliptic PDEs form a pillar of scientific computing. They enable detailed and accurate simulations of electromagnetic fields, fluid flows, biochemical processes, and much more. This textbook provides an introduction to fast solvers from the point of view of integral equation formulations, which lead to unparalleled accuracy and speed in many applications. The focus is on fast algorithms for handling dense matrices that arise in the discretization of integral operators, such as the fast multipole method and fast direct solvers. While the emphasis is on techniques for dense matrices, the text also describes how similar techniques give rise to linear complexity algorithms for computing the inverse or the LU factorization of a sparse matrix resulting from the direct discretization of an elliptic PDE. This is the first textbook to detail the active field of fast direct solvers, introducing readers to modern linear algebraic techniques for accelerating computations, such as randomized algorithms, interpolative decompositions, and data-sparse hierarchical matrix representations. Written with an emphasis on mathematical intuition rather than theoretical details, it is richly illustrated and provides pseudocode for all key techniques. Fast Direct Solvers for Elliptic PDEs is appropriate for graduate students in applied mathematics and scientific computing, engineers and scientists looking for an accessible introduction to integral equation methods and fast solvers, and researchers in computational mathematics who want to quickly catch up on recent advances in randomized algorithms and techniques for working with data-sparse matrices.
The book provides an introduction of very recent results about the tensors and mainly focuses on the authors' work and perspective. A systematic description about how to extend the numerical linear algebra to the numerical multi-linear algebra is also delivered in this book. The authors design the neural network model for the computation of the rank-one approximation of real tensors, a normalization algorithm to convert some nonnegative tensors to plane stochastic tensors and a probabilistic algorithm for locating a positive diagonal in a nonnegative tensors, adaptive randomized algorithms for computing the approximate tensor decompositions, and the QR type method for computing U-eigenpairs of complex tensors. This book could be used for the Graduate course, such as Introduction to Tensor. Researchers may also find it helpful as a reference in tensor research.