This book treats the very special and fundamental mathematical properties that hold for a family of Gaussian (or normal) random variables. Such random variables have many applications in probability theory, other parts of mathematics, statistics and theoretical physics. The emphasis throughout this book is on the mathematical structures common to all these applications. This will be an excellent resource for all researchers whose work involves random variables.
The book covers theoretical questions including the latest extension of the formalism, and computational issues and focuses on some of the more fruitful and promising applications, including statistical signal processing, nonparametric curve estimation, random measures, limit theorems, learning theory and some applications at the fringe between Statistics and Approximation Theory. It is geared to graduate students in Statistics, Mathematics or Engineering, or to scientists with an equivalent level.
Based on well-known lectures given at Scuola Normale Superiore in Pisa, this book introduces analysis in a separable Hilbert space of infinite dimension. It starts from the definition of Gaussian measures in Hilbert spaces, concepts such as the Cameron-Martin formula, Brownian motion and Wiener integral are introduced in a simple way. These concepts are then used to illustrate basic stochastic dynamical systems and Markov semi-groups, paying attention to their long-time behavior.
This text offers background in function theory, Hardy functions, and probability as preparation for surveys of Gaussian processes, strings and spectral functions, and strings and spaces of integral functions. It addresses the relationship between the past and the future of a real, one-dimensional, stationary Gaussian process. 1976 edition.
This text presents selected areas of functional analysis that can facilitate an understanding of ideas in probability and stochastic processes. Topics covered include basic Hilbert and Banach spaces, weak topologies and Banach algebras, and the theory ofsemigroups of bounded linear operators.
Second order linear parabolic and elliptic equations arise frequently in mathematics and other disciplines. For example parabolic equations are to be found in statistical mechanics and solid state theory, their infinite dimensional counterparts are important in fluid mechanics, mathematical finance and population biology, whereas nonlinear parabolic equations arise in control theory. Here the authors present a state of the art treatment of the subject from a new perspective. The main tools used are probability measures in Hilbert and Banach spaces and stochastic evolution equations. There is then a discussion of how the results in the book can be applied to control theory. This area is developing very rapidly and there are numerous notes and references that point the reader to more specialised results not covered in the book. Coverage of some essential background material will help make the book self-contained and increase its appeal to those entering the subject.
The book deals mainly with three problems involving Gaussian stationary processes. The first problem consists of clarifying the conditions for mutual absolute continuity (equivalence) of probability distributions of a "random process segment" and of finding effective formulas for densities of the equiva lent distributions. Our second problem is to describe the classes of spectral measures corresponding in some sense to regular stationary processes (in par ticular, satisfying the well-known "strong mixing condition") as well as to describe the subclasses associated with "mixing rate". The third problem involves estimation of an unknown mean value of a random process, this random process being stationary except for its mean, i. e. , it is the problem of "distinguishing a signal from stationary noise". Furthermore, we give here auxiliary information (on distributions in Hilbert spaces, properties of sam ple functions, theorems on functions of a complex variable, etc. ). Since 1958 many mathematicians have studied the problem of equivalence of various infinite-dimensional Gaussian distributions (detailed and sys tematic presentation of the basic results can be found, for instance, in [23]). In this book we have considered Gaussian stationary processes and arrived, we believe, at rather definite solutions. The second problem mentioned above is closely related with problems involving ergodic theory of Gaussian dynamic systems as well as prediction theory of stationary processes.
A comprehensive and self-contained introduction to Gaussian processes, which provide a principled, practical, probabilistic approach to learning in kernel machines. Gaussian processes (GPs) provide a principled, practical, probabilistic approach to learning in kernel machines. GPs have received increased attention in the machine-learning community over the past decade, and this book provides a long-needed systematic and unified treatment of theoretical and practical aspects of GPs in machine learning. The treatment is comprehensive and self-contained, targeted at researchers and students in machine learning and applied statistics. The book deals with the supervised-learning problem for both regression and classification, and includes detailed algorithms. A wide variety of covariance (kernel) functions are presented and their properties discussed. Model selection is discussed both from a Bayesian and a classical perspective. Many connections to other well-known techniques from machine learning and statistics are discussed, including support-vector machines, neural networks, splines, regularization networks, relevance vector machines and others. Theoretical issues including learning curves and the PAC-Bayesian framework are treated, and several approximation methods for learning with large datasets are discussed. The book contains illustrative examples and exercises, and code and datasets are available on the Web. Appendixes provide mathematical background and a discussion of Gaussian Markov processes.