The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. The book is the first on the subject and will be of great interest to all those who work with stochastic delay equations and whose main interest is either in the use of the algorithms or in the mathematics. An excellent resource for graduate students, researchers, and practitioners, the work may be used as a graduate-level textbook for a special topics course or seminar on numerical methods in stochastic control.
In financial and actuarial modeling and other areas of application, stochastic differential equations with jumps have been employed to describe the dynamics of various state variables. The numerical solution of such equations is more complex than that of those only driven by Wiener processes, described in Kloeden & Platen: Numerical Solution of Stochastic Differential Equations (1992). The present monograph builds on the above-mentioned work and provides an introduction to stochastic differential equations with jumps, in both theory and application, emphasizing the numerical methods needed to solve such equations. It presents many new results on higher-order methods for scenario and Monte Carlo simulation, including implicit, predictor corrector, extrapolation, Markov chain and variance reduction methods, stressing the importance of their numerical stability. Furthermore, it includes chapters on exact simulation, estimation and filtering. Besides serving as a basic text on quantitative methods, it offers ready access to a large number of potential research problems in an area that is widely applicable and rapidly expanding. Finance is chosen as the area of application because much of the recent research on stochastic numerical methods has been driven by challenges in quantitative finance. Moreover, the volume introduces readers to the modern benchmark approach that provides a general framework for modeling in finance and insurance beyond the standard risk-neutral approach. It requires undergraduate background in mathematical or quantitative methods, is accessible to a broad readership, including those who are only seeking numerical recipes, and includes exercises that help the reader develop a deeper understanding of the underlying mathematics.
This paper introduces time-continuous numerical schemes to simulate stochastic differential equations (SDEs) arising in mathematical finance, population dynamics, chemical kinetics, epidemiology, biophysics, and polymeric fluids. These schemes are obtained by spatially discretizing the Kolmogorov equation associated with the SDE in such a way that the resulting semi-discrete equation generates a Markov jump process that can be realized exactly using a Monte Carlo method. In this construction the jump size of the approximation can be bounded uniformly in space, which often guarantees that the schemes are numerically stable for both finite and long time simulation of SDEs.
Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest developments. It covers effective numerical methods for stochastic control problems in continuous time on two levels, that of practice and that of mathematical development. It is broadly accessible for graduate students and researchers.
Non-linear stochastic systems are at the center of many engineering disciplines and progress in theoretical research had led to a better understanding of non-linear phenomena. This book provides information on new fundamental results and their applications which are beginning to appear across the entire spectrum of mechanics. The outstanding points of these proceedings are Coherent compendium of the current state of modelling and analysis of non-linear stochastic systems from engineering, applied mathematics and physics point of view. Subject areas include: Multiscale phenomena, stability and bifurcations, control and estimation, computational methods and modelling. For the Engineering and Physics communities, this book will provide first-hand information on recent mathematical developments. The applied mathematics community will benefit from the modelling and information on various possible applications.
The nonequilibrium behavior of nanoscopic and biological systems, which are typically strongly fluctuating, is a major focus of current research. Lately, much progress has been made in understanding such systems from a thermodynamic perspective. However, new theoretical challenges emerge when the fluctuating system is additionally subject to time delay, e.g. due to the presence of feedback loops. This thesis advances this young and vibrant research field in several directions. The first main contribution concerns the probabilistic description of time-delayed systems; e.g. by introducing a versatile approximation scheme for nonlinear delay systems. Second, it reveals that delay can induce intriguing thermodynamic properties such as anomalous (reversed) heat flow. More generally, the thesis shows how to treat the thermodynamics of non-Markovian systems by introducing auxiliary variables. It turns out that delayed feedback is inextricably linked to nonreciprocal coupling, information flow, and to net energy input on the fluctuating level.
Paul M. Geffert analyses the interplay of noise and time delay in non-excitable nonlinear systems and the modulation of stochastic effects. In particular, the author studies coherence resonance, which is a constructive effect of noise that occurs in nonlinear systems, and demonstrates that it can be modulated by time-delayed feedback. Analytical methods for the investigation of stochastic delay differential equations are developed. Noise or random perturbations and time delay are two phenomena which arise in many fields of physics, chemistry, or biology, just to mention a few examples. The investigated model is a generic Hopf normal form so that these methods and results can be transferred to many different areas of science.
Nonlinear Stochastic Operator Equations deals with realistic solutions of the nonlinear stochastic equations arising from the modeling of frontier problems in many fields of science. This book also discusses a wide class of equations to provide modeling of problems concerning physics, engineering, operations research, systems analysis, biology, medicine. This text discusses operator equations and the decomposition method. This book also explains the limitations, restrictions and assumptions made in differential equations involving stochastic process coefficients (the stochastic operator case), which yield results very different from the needs of the actual physical problem. Real-world application of mathematics to actual physical problems, requires making a reasonable model that is both realistic and solvable. The decomposition approach or model is an approximation method to solve a wide range of problems. This book explains an inherent feature of real systems—known as nonlinear behavior—that occurs frequently in nuclear reactors, in physiological systems, or in cellular growth. This text also discusses stochastic operator equations with linear boundary conditions. This book is intended for students with a mathematics background, particularly senior undergraduate and graduate students of advanced mathematics, of the physical or engineering sciences.
This textbook provides the first systematic presentation of the theory of stochastic differential equations with Markovian switching. It presents the basic principles at an introductory level but emphasizes current advanced level research trends. The material takes into account all the features of Ito equations, Markovian switching, interval systems and time-lag. The theory developed is applicable in different and complicated situations in many branches of science and industry.
