Random Matrix Methods for Machine Learning

Random Matrix Methods for Machine Learning

Author: Romain Couillet

Publisher: Cambridge University Press

Published: 2022-07-21

Total Pages: 412

ISBN-13: 1009301896

DOWNLOAD EBOOK

This book presents a unified theory of random matrices for applications in machine learning, offering a large-dimensional data vision that exploits concentration and universality phenomena. This enables a precise understanding, and possible improvements, of the core mechanisms at play in real-world machine learning algorithms. The book opens with a thorough introduction to the theoretical basics of random matrices, which serves as a support to a wide scope of applications ranging from SVMs, through semi-supervised learning, unsupervised spectral clustering, and graph methods, to neural networks and deep learning. For each application, the authors discuss small- versus large-dimensional intuitions of the problem, followed by a systematic random matrix analysis of the resulting performance and possible improvements. All concepts, applications, and variations are illustrated numerically on synthetic as well as real-world data, with MATLAB and Python code provided on the accompanying website.


A First Course in Random Matrix Theory

A First Course in Random Matrix Theory

Author: Marc Potters

Publisher: Cambridge University Press

Published: 2020-12-03

Total Pages: 371

ISBN-13: 1108488080

DOWNLOAD EBOOK

An intuitive, up-to-date introduction to random matrix theory and free calculus, with real world illustrations and Big Data applications.


Matrix Methods in Data Mining and Pattern Recognition

Matrix Methods in Data Mining and Pattern Recognition

Author: Lars Elden

Publisher: SIAM

Published: 2007-07-12

Total Pages: 226

ISBN-13: 0898716268

DOWNLOAD EBOOK

Several very powerful numerical linear algebra techniques are available for solving problems in data mining and pattern recognition. This application-oriented book describes how modern matrix methods can be used to solve these problems, gives an introduction to matrix theory and decompositions, and provides students with a set of tools that can be modified for a particular application.Matrix Methods in Data Mining and Pattern Recognition is divided into three parts. Part I gives a short introduction to a few application areas before presenting linear algebra concepts and matrix decompositions that students can use in problem-solving environments such as MATLAB®. Some mathematical proofs that emphasize the existence and properties of the matrix decompositions are included. In Part II, linear algebra techniques are applied to data mining problems. Part III is a brief introduction to eigenvalue and singular value algorithms. The applications discussed by the author are: classification of handwritten digits, text mining, text summarization, pagerank computations related to the GoogleÔ search engine, and face recognition. Exercises and computer assignments are available on a Web page that supplements the book.Audience The book is intended for undergraduate students who have previously taken an introductory scientific computing/numerical analysis course. Graduate students in various data mining and pattern recognition areas who need an introduction to linear algebra techniques will also find the book useful.Contents Preface; Part I: Linear Algebra Concepts and Matrix Decompositions. Chapter 1: Vectors and Matrices in Data Mining and Pattern Recognition; Chapter 2: Vectors and Matrices; Chapter 3: Linear Systems and Least Squares; Chapter 4: Orthogonality; Chapter 5: QR Decomposition; Chapter 6: Singular Value Decomposition; Chapter 7: Reduced-Rank Least Squares Models; Chapter 8: Tensor Decomposition; Chapter 9: Clustering and Nonnegative Matrix Factorization; Part II: Data Mining Applications. Chapter 10: Classification of Handwritten Digits; Chapter 11: Text Mining; Chapter 12: Page Ranking for a Web Search Engine; Chapter 13: Automatic Key Word and Key Sentence Extraction; Chapter 14: Face Recognition Using Tensor SVD. Part III: Computing the Matrix Decompositions. Chapter 15: Computing Eigenvalues and Singular Values; Bibliography; Index.


An Introduction to Matrix Concentration Inequalities

An Introduction to Matrix Concentration Inequalities

Author: Joel Tropp

Publisher:

Published: 2015-05-27

Total Pages: 256

ISBN-13: 9781601988386

DOWNLOAD EBOOK

Random matrices now play a role in many areas of theoretical, applied, and computational mathematics. It is therefore desirable to have tools for studying random matrices that are flexible, easy to use, and powerful. Over the last fifteen years, researchers have developed a remarkable family of results, called matrix concentration inequalities, that achieve all of these goals. This monograph offers an invitation to the field of matrix concentration inequalities. It begins with some history of random matrix theory; it describes a flexible model for random matrices that is suitable for many problems; and it discusses the most important matrix concentration results. To demonstrate the value of these techniques, the presentation includes examples drawn from statistics, machine learning, optimization, combinatorics, algorithms, scientific computing, and beyond.


Topics in Random Matrix Theory

Topics in Random Matrix Theory

Author: Terence Tao

Publisher: American Mathematical Soc.

Published: 2012-03-21

Total Pages: 298

ISBN-13: 0821874306

DOWNLOAD EBOOK

The field of random matrix theory has seen an explosion of activity in recent years, with connections to many areas of mathematics and physics. However, this makes the current state of the field almost too large to survey in a single book. In this graduate text, we focus on one specific sector of the field, namely the spectral distribution of random Wigner matrix ensembles (such as the Gaussian Unitary Ensemble), as well as iid matrix ensembles. The text is largely self-contained and starts with a review of relevant aspects of probability theory and linear algebra. With over 200 exercises, the book is suitable as an introductory text for beginning graduate students seeking to enter the field.


An Introduction to Random Matrices

An Introduction to Random Matrices

Author: Greg W. Anderson

Publisher: Cambridge University Press

Published: 2010

Total Pages: 507

ISBN-13: 0521194520

DOWNLOAD EBOOK

A rigorous introduction to the basic theory of random matrices designed for graduate students with a background in probability theory.


Mathematics for Machine Learning

Mathematics for Machine Learning

Author: Marc Peter Deisenroth

Publisher: Cambridge University Press

Published: 2020-04-23

Total Pages: 392

ISBN-13: 1108569323

DOWNLOAD EBOOK

The fundamental mathematical tools needed to understand machine learning include linear algebra, analytic geometry, matrix decompositions, vector calculus, optimization, probability and statistics. These topics are traditionally taught in disparate courses, making it hard for data science or computer science students, or professionals, to efficiently learn the mathematics. This self-contained textbook bridges the gap between mathematical and machine learning texts, introducing the mathematical concepts with a minimum of prerequisites. It uses these concepts to derive four central machine learning methods: linear regression, principal component analysis, Gaussian mixture models and support vector machines. For students and others with a mathematical background, these derivations provide a starting point to machine learning texts. For those learning the mathematics for the first time, the methods help build intuition and practical experience with applying mathematical concepts. Every chapter includes worked examples and exercises to test understanding. Programming tutorials are offered on the book's web site.


Asymptotic Statistics

Asymptotic Statistics

Author: A. W. van der Vaart

Publisher: Cambridge University Press

Published: 2000-06-19

Total Pages: 470

ISBN-13: 9780521784504

DOWNLOAD EBOOK

This book is an introduction to the field of asymptotic statistics. The treatment is both practical and mathematically rigorous. In addition to most of the standard topics of an asymptotics course, including likelihood inference, M-estimation, the theory of asymptotic efficiency, U-statistics, and rank procedures, the book also presents recent research topics such as semiparametric models, the bootstrap, and empirical processes and their applications. The topics are organized from the central idea of approximation by limit experiments, which gives the book one of its unifying themes. This entails mainly the local approximation of the classical i.i.d. set up with smooth parameters by location experiments involving a single, normally distributed observation. Thus, even the standard subjects of asymptotic statistics are presented in a novel way. Suitable as a graduate or Master s level statistics text, this book will also give researchers an overview of the latest research in asymptotic statistics.


Spectral Algorithms

Spectral Algorithms

Author: Ravindran Kannan

Publisher: Now Publishers Inc

Published: 2009

Total Pages: 153

ISBN-13: 1601982747

DOWNLOAD EBOOK

Spectral methods refer to the use of eigenvalues, eigenvectors, singular values and singular vectors. They are widely used in Engineering, Applied Mathematics and Statistics. More recently, spectral methods have found numerous applications in Computer Science to "discrete" as well as "continuous" problems. Spectral Algorithms describes modern applications of spectral methods, and novel algorithms for estimating spectral parameters. The first part of the book presents applications of spectral methods to problems from a variety of topics including combinatorial optimization, learning and clustering. The second part of the book is motivated by efficiency considerations. A feature of many modern applications is the massive amount of input data. While sophisticated algorithms for matrix computations have been developed over a century, a more recent development is algorithms based on "sampling on the fly" from massive matrices. Good estimates of singular values and low rank approximations of the whole matrix can be provably derived from a sample. The main emphasis in the second part of the book is to present these sampling methods with rigorous error bounds. It also presents recent extensions of spectral methods from matrices to tensors and their applications to some combinatorial optimization problems.


Algorithmic Aspects of Machine Learning

Algorithmic Aspects of Machine Learning

Author: Ankur Moitra

Publisher: Cambridge University Press

Published: 2018-09-27

Total Pages: 161

ISBN-13: 1107184584

DOWNLOAD EBOOK

Introduces cutting-edge research on machine learning theory and practice, providing an accessible, modern algorithmic toolkit.