Stochastic differential equations in infinite dimensional spaces are motivated by the theory and analysis of stochastic processes and by applications such as stochastic control, population biology, and turbulence, where the analysis and control of such systems involves investigating their stability. While the theory of such equations is well establ
Linear Stochastic Control Systems presents a thorough description of the mathematical theory and fundamental principles of linear stochastic control systems. Both continuous-time and discrete-time systems are thoroughly covered. Reviews of the modern probability and random processes theories and the Itô stochastic differential equations are provided. Discrete-time stochastic systems theory, optimal estimation and Kalman filtering, and optimal stochastic control theory are studied in detail. A modern treatment of these same topics for continuous-time stochastic control systems is included. The text is written in an easy-to-understand style, and the reader needs only to have a background of elementary real analysis and linear deterministic systems theory to comprehend the subject matter. This graduate textbook is also suitable for self-study, professional training, and as a handy research reference. Linear Stochastic Control Systems is self-contained and provides a step-by-step development of the theory, with many illustrative examples, exercises, and engineering applications.
This textbook provides the first systematic presentation of the theory of stochastic differential equations with Markovian switching. It presents the basic principles at an introductory level but emphasizes current advanced level research trends. The material takes into account all the features of Ito equations, Markovian switching, interval systems and time-lag. The theory developed is applicable in different and complicated situations in many branches of science and industry.
Stochastic differential equations (SDEs) are a powerful tool in science, mathematics, economics and finance. This book will help the reader to master the basic theory and learn some applications of SDEs. In particular, the reader will be provided with the backward SDE technique for use in research when considering financial problems in the market, and with the reflecting SDE technique to enable study of optimal stochastic population control problems. These two techniques are powerful and efficient, and can also be applied to research in many other problems in nature, science and elsewhere.
Numerous examples highlight this treatment of the use of linear quadratic Gaussian methods for control system design. It explores linear optimal control theory from an engineering viewpoint, with illustrations of practical applications. Key topics include loop-recovery techniques, frequency shaping, and controller reduction. Numerous examples and complete solutions. 1990 edition.
This book collects some recent developments in stochastic control theory with applications to financial mathematics. We first address standard stochastic control problems from the viewpoint of the recently developed weak dynamic programming principle. A special emphasis is put on the regularity issues and, in particular, on the behavior of the value function near the boundary. We then provide a quick review of the main tools from viscosity solutions which allow to overcome all regularity problems. We next address the class of stochastic target problems which extends in a nontrivial way the standard stochastic control problems. Here the theory of viscosity solutions plays a crucial role in the derivation of the dynamic programming equation as the infinitesimal counterpart of the corresponding geometric dynamic programming equation. The various developments of this theory have been stimulated by applications in finance and by relevant connections with geometric flows. Namely, the second order extension was motivated by illiquidity modeling, and the controlled loss version was introduced following the problem of quantile hedging. The third part specializes to an overview of Backward stochastic differential equations, and their extensions to the quadratic case.
The book covers the necessary pre-requisites from probability theory, stochastic processes, stochastic integrals and stochastic differential equations. It includes detailed treatment of the fundamental properties of stochastic systems subjected both to multiplicative white noise and to jump Markovian perturbations. Systematic presentation leads the reader in a natural way to the original results. New theoretical results accompanied by detailed numerical examples, and the book proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations.
Since the publication of the first edition of the present volume in 1980, the stochastic stability of differential equations has become a very popular subject of research in mathematics and engineering. To date exact formulas for the Lyapunov exponent, the criteria for the moment and almost sure stability, and for the existence of stationary and periodic solutions of stochastic differential equations have been widely used in the literature. In this updated volume readers will find important new results on the moment Lyapunov exponent, stability index and some other fields, obtained after publication of the first edition, and a significantly expanded bibliography. This volume provides a solid foundation for students in graduate courses in mathematics and its applications. It is also useful for those researchers who would like to learn more about this subject, to start their research in this area or to study the properties of concrete mechanical systems subjected to random perturbations.
This book is the first comprehensive treatment of rational matrix equations in stochastic systems, including various aspects of the field, previously unpublished results and explicit examples. Topics include modelling with stochastic differential equations, stochastic stability, reformulation of stochastic control problems, analysis of the rational matrix equation and numerical solutions. Primarily a survey in character, this monograph is intended for researchers, graduate students and engineers in control theory and applied linear algebra.
