This book provides a rigorous mathematical treatment of the non-linear stochastic filtering problem using modern methods. Particular emphasis is placed on the theoretical analysis of numerical methods for the solution of the filtering problem via particle methods. The book should provide sufficient background to enable study of the recent literature. While no prior knowledge of stochastic filtering is required, readers are assumed to be familiar with measure theory, probability theory and the basics of stochastic processes. Most of the technical results that are required are stated and proved in the appendices. Exercises and solutions are included.
The book combines both rigor and intuition to derive most of the classical results of linear and nonlinear filtering and beyond. Many fundamental results recently discovered by the author are included. Furthermore, many results that have appeared in recent years in the literature are also presented. The most interesting feature of the book is that all the derivations of the linear filter equations given in Chapters 3-11, beginning from the classical Kalman filter presented in Chapters 3 and 5, are based on one basic principle which is fully rigorous but also very intuitive and easily understandable. The second most interesting feature is that the book provides a rigorous theoretical basis for the numerical solution of nonlinear filter equations illustrated by multidimensional examples. The book also provides a strong foundation for theoretical understanding of the subject based on the theory of stochastic differential equations.
Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest developments. It covers effective numerical methods for stochastic control problems in continuous time on two levels, that of practice and that of mathematical development. It is broadly accessible for graduate students and researchers.
Stochastic Filtering Theory uses probability tools to estimate unobservable stochastic processes that arise in many applied fields including communication, target-tracking, and mathematical finance.As a topic, Stochastic Filtering Theory has progressed rapidly in recent years. For example, the (branching) particle system representation of the optimal filter has been extensively studied to seek more effective numerical approximations of the optimal filter; the stability of the filter with "incorrect" initial state, as well as the long-term behavior of the optimal filter, has attracted the attention of many researchers; and although still in its infancy, the study of singular filteringmodels has yielded exciting results.In this text, Jie Xiong introduces the reader to the basics of Stochastic Filtering Theory before covering these key recent advances. The text is written in a style suitable for graduates in mathematics and engineering with a background in basic probability.
This book covers numerical methods for stochastic partial differential equations with white noise using the framework of Wong-Zakai approximation. The book begins with some motivational and background material in the introductory chapters and is divided into three parts. Part I covers numerical stochastic ordinary differential equations. Here the authors start with numerical methods for SDEs with delay using the Wong-Zakai approximation and finite difference in time. Part II covers temporal white noise. Here the authors consider SPDEs as PDEs driven by white noise, where discretization of white noise (Brownian motion) leads to PDEs with smooth noise, which can then be treated by numerical methods for PDEs. In this part, recursive algorithms based on Wiener chaos expansion and stochastic collocation methods are presented for linear stochastic advection-diffusion-reaction equations. In addition, stochastic Euler equations are exploited as an application of stochastic collocation methods, where a numerical comparison with other integration methods in random space is made. Part III covers spatial white noise. Here the authors discuss numerical methods for nonlinear elliptic equations as well as other equations with additive noise. Numerical methods for SPDEs with multiplicative noise are also discussed using the Wiener chaos expansion method. In addition, some SPDEs driven by non-Gaussian white noise are discussed and some model reduction methods (based on Wick-Malliavin calculus) are presented for generalized polynomial chaos expansion methods. Powerful techniques are provided for solving stochastic partial differential equations. This book can be considered as self-contained. Necessary background knowledge is presented in the appendices. Basic knowledge of probability theory and stochastic calculus is presented in Appendix A. In Appendix B some semi-analytical methods for SPDEs are presented. In Appendix C an introduction to Gauss quadrature is provided. In Appendix D, all the conclusions which are needed for proofs are presented, and in Appendix E a method to compute the convergence rate empirically is included. In addition, the authors provide a thorough review of the topics, both theoretical and computational exercises in the book with practical discussion of the effectiveness of the methods. Supporting Matlab files are made available to help illustrate some of the concepts further. Bibliographic notes are included at the end of each chapter. This book serves as a reference for graduate students and researchers in the mathematical sciences who would like to understand state-of-the-art numerical methods for stochastic partial differential equations with white noise.
This volume represents the proceedings of the Workshop on Numerical Methods and Stochastics held at The Fields Institute in April 1999. The goal of the workshop was to identify emerging ideas in probability theory that influence future work in both probability and numerical computation. The book focuses on up-to-date results and gives novel approaches to computational problems based on cutting-edge techniques from the theory of probability and stochastic processes. Three papers discuss particle system approximations to solutions of the stochastic filtering problem. Two papers treat particle system equations. The paper on rough paths describes how to generate good approximations to stochastic integrals. An expository paper discusses a long-standing conjecture: the stochastic fast dynamo effect. A final paper gives an analysis of the error in binomial and trinomial approximations to solutions of the Black-Scholes stochastic differential equations. The book is intended for graduate students and research mathematicians interested in probability theory.
Nonlinear Filtering covers linear and nonlinear filtering in a comprehensive manner, with appropriate theoretic and practical development. Aspects of modeling, estimation, recursive filtering, linear filtering, and nonlinear filtering are presented with appropriate and sufficient mathematics. A modeling-control-system approach is used when applicable, and detailed practical applications are presented to elucidate the analysis and filtering concepts. MATLAB routines are included, and examples from a wide range of engineering applications - including aerospace, automated manufacturing, robotics, and advanced control systems - are referenced throughout the text.
The numerical analysis of stochastic differential equations (SDEs) differs significantly from that of ordinary differential equations. This book provides an easily accessible introduction to SDEs, their applications and the numerical methods to solve such equations. From the reviews: "The authors draw upon their own research and experiences in obviously many disciplines... considerable time has obviously been spent writing this in the simplest language possible." --ZAMP
This book is a substantially revised and expanded edition reflecting major developments in stochastic numerics since the first edition was published in 2004. The new topics, in particular, include mean-square and weak approximations in the case of nonglobally Lipschitz coefficients of Stochastic Differential Equations (SDEs) including the concept of rejecting trajectories; conditional probabilistic representations and their application to practical variance reduction using regression methods; multi-level Monte Carlo method; computing ergodic limits and additional classes of geometric integrators used in molecular dynamics; numerical methods for FBSDEs; approximation of parabolic SPDEs and nonlinear filtering problem based on the method of characteristics. SDEs have many applications in the natural sciences and in finance. Besides, the employment of probabilistic representations together with the Monte Carlo technique allows us to reduce the solution of multi-dimensional problems for partial differential equations to the integration of stochastic equations. This approach leads to powerful computational mathematics that is presented in the treatise. Many special schemes for SDEs are presented. In the second part of the book numerical methods for solving complicated problems for partial differential equations occurring in practical applications, both linear and nonlinear, are constructed. All the methods are presented with proofs and hence founded on rigorous reasoning, thus giving the book textbook potential. An overwhelming majority of the methods are accompanied by the corresponding numerical algorithms which are ready for implementation in practice. The book addresses researchers and graduate students in numerical analysis, applied probability, physics, chemistry, and engineering as well as mathematical biology and financial mathematics.
