Concentration Inequalities and Model Selection
Concentration Inequalities and Model Selection

Author: Pascal Massart

Publisher: Springer

Published: 2007-04-26

Total Pages: 346

ISBN-13: 3540485031

DOWNLOAD EBOOK

Concentration inequalities have been recognized as fundamental tools in several domains such as geometry of Banach spaces or random combinatorics. They also turn to be essential tools to develop a non asymptotic theory in statistics. This volume provides an overview of a non asymptotic theory for model selection. It also discusses some selected applications to variable selection, change points detection and statistical learning.

Concentration Inequalities and Model Selection
Concentration Inequalities and Model Selection

Author: Pascal Massart

Publisher: Springer

Published: 2007

Total Pages: 337

ISBN-13: 9786610853335

DOWNLOAD EBOOK

Since the impressive works of Talagrand, concentration inequalities have been recognized as fundamental tools in several domains such as geometry of Banach spaces or random combinatorics. They also turn out to be essential tools to develop a non-asymptotic theory in statistics, exactly as the central limit theorem and large deviations are known to play a central part in the asymptotic theory. An overview of a non-asymptotic theory for model selection is given here and some selected applications to variable selection, change points detection and statistical learning are discussed. This volume reflects the content of the course given by P. Massart in St. Flour in 2003. It is mostly self-contained and accessible to graduate students.

Concentration Inequalities
Concentration Inequalities

Author: Stéphane Boucheron

Publisher: Oxford University Press

Published: 2013-02-07

Total Pages: 492

ISBN-13: 0199535256

DOWNLOAD EBOOK

Describes the interplay between the probabilistic structure (independence) and a variety of tools ranging from functional inequalities to transportation arguments to information theory. Applications to the study of empirical processes, random projections, random matrix theory, and threshold phenomena are also presented.

Stochastic Inequalities and Applications
Stochastic Inequalities and Applications

Author: Evariste Giné

Publisher: Birkhäuser

Published: 2012-12-06

Total Pages: 362

ISBN-13: 3034880693

DOWNLOAD EBOOK

Concentration inequalities, which express the fact that certain complicated random variables are almost constant, have proven of utmost importance in many areas of probability and statistics. This volume contains refined versions of these inequalities, and their relationship to many applications particularly in stochastic analysis. The broad range and the high quality of the contributions make this book highly attractive for graduates, postgraduates and researchers in the above areas.

An Introduction to Matrix Concentration Inequalities
An Introduction to Matrix Concentration Inequalities

Author: Joel Tropp

Publisher:

Published: 2015-05-27

Total Pages: 256

ISBN-13: 9781601988386

DOWNLOAD EBOOK

Random matrices now play a role in many areas of theoretical, applied, and computational mathematics. It is therefore desirable to have tools for studying random matrices that are flexible, easy to use, and powerful. Over the last fifteen years, researchers have developed a remarkable family of results, called matrix concentration inequalities, that achieve all of these goals. This monograph offers an invitation to the field of matrix concentration inequalities. It begins with some history of random matrix theory; it describes a flexible model for random matrices that is suitable for many problems; and it discusses the most important matrix concentration results. To demonstrate the value of these techniques, the presentation includes examples drawn from statistics, machine learning, optimization, combinatorics, algorithms, scientific computing, and beyond.

Universal Coding and Order Identification by Model Selection Methods
Universal Coding and Order Identification by Model Selection Methods

Author: Élisabeth Gassiat

Publisher: Springer

Published: 2018-07-28

Total Pages: 158

ISBN-13: 3319962620

DOWNLOAD EBOOK

The purpose of these notes is to highlight the far-reaching connections between Information Theory and Statistics. Universal coding and adaptive compression are indeed closely related to statistical inference concerning processes and using maximum likelihood or Bayesian methods. The book is divided into four chapters, the first of which introduces readers to lossless coding, provides an intrinsic lower bound on the codeword length in terms of Shannon’s entropy, and presents some coding methods that can achieve this lower bound, provided the source distribution is known. In turn, Chapter 2 addresses universal coding on finite alphabets, and seeks to find coding procedures that can achieve the optimal compression rate, regardless of the source distribution. It also quantifies the speed of convergence of the compression rate to the source entropy rate. These powerful results do not extend to infinite alphabets. In Chapter 3, it is shown that there are no universal codes over the class of stationary ergodic sources over a countable alphabet. This negative result prompts at least two different approaches: the introduction of smaller sub-classes of sources known as envelope classes, over which adaptive coding may be feasible, and the redefinition of the performance criterion by focusing on compressing the message pattern. Finally, Chapter 4 deals with the question of order identification in statistics. This question belongs to the class of model selection problems and arises in various practical situations in which the goal is to identify an integer characterizing the model: the length of dependency for a Markov chain, number of hidden states for a hidden Markov chain, and number of populations for a population mixture. The coding ideas and techniques developed in previous chapters allow us to obtain new results in this area. This book is accessible to anyone with a graduate level in Mathematics, and will appeal to information theoreticians and mathematical statisticians alike. Except for Chapter 4, all proofs are detailed and all tools needed to understand the text are reviewed.

High-Dimensional Probability
High-Dimensional Probability

Author: Roman Vershynin

Publisher: Cambridge University Press

Published: 2018-09-27

Total Pages: 299

ISBN-13: 1108415199

DOWNLOAD EBOOK

An integrated package of powerful probabilistic tools and key applications in modern mathematical data science.

Learning Theory
Learning Theory

Author: John Shawe-Taylor

Publisher: Springer Science & Business Media

Published: 2004-06-17

Total Pages: 657

ISBN-13: 3540222820

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 17th Annual Conference on Learning Theory, COLT 2004, held in Banff, Canada in July 2004. The 46 revised full papers presented were carefully reviewed and selected from a total of 113 submissions. The papers are organized in topical sections on economics and game theory, online learning, inductive inference, probabilistic models, Boolean function learning, empirical processes, MDL, generalisation, clustering and distributed learning, boosting, kernels and probabilities, kernels and kernel matrices, and open problems.

Concentration of Measure for the Analysis of Randomized Algorithms
Concentration of Measure for the Analysis of Randomized Algorithms

Author: Devdatt P. Dubhashi

Publisher: Cambridge University Press

Published: 2009-06-15

Total Pages: 213

ISBN-13: 1139480995

DOWNLOAD EBOOK

Randomized algorithms have become a central part of the algorithms curriculum, based on their increasingly widespread use in modern applications. This book presents a coherent and unified treatment of probabilistic techniques for obtaining high probability estimates on the performance of randomized algorithms. It covers the basic toolkit from the Chernoff–Hoeffding bounds to more sophisticated techniques like martingales and isoperimetric inequalities, as well as some recent developments like Talagrand's inequality, transportation cost inequalities and log-Sobolev inequalities. Along the way, variations on the basic theme are examined, such as Chernoff–Hoeffding bounds in dependent settings. The authors emphasise comparative study of the different methods, highlighting respective strengths and weaknesses in concrete example applications. The exposition is tailored to discrete settings sufficient for the analysis of algorithms, avoiding unnecessary measure-theoretic details, thus making the book accessible to computer scientists as well as probabilists and discrete mathematicians.

High Dimensional Probability VII
High Dimensional Probability VII

Author: Christian Houdré

Publisher: Birkhäuser

Published: 2016-09-21

Total Pages: 480

ISBN-13: 3319405195

DOWNLOAD EBOOK

This volume collects selected papers from the 7th High Dimensional Probability meeting held at the Institut d'Études Scientifiques de Cargèse (IESC) in Corsica, France. High Dimensional Probability (HDP) is an area of mathematics that includes the study of probability distributions and limit theorems in infinite-dimensional spaces such as Hilbert spaces and Banach spaces. The most remarkable feature of this area is that it has resulted in the creation of powerful new tools and perspectives, whose range of application has led to interactions with other subfields of mathematics, statistics, and computer science. These include random matrices, nonparametric statistics, empirical processes, statistical learning theory, concentration of measure phenomena, strong and weak approximations, functional estimation, combinatorial optimization, and random graphs. The contributions in this volume show that HDP theory continues to thrive and develop new tools, methods, techniques and perspectives to analyze random phenomena.