Markov Processes from K. Itô's Perspective

Markov Processes from K. Itô's Perspective

Author: Daniel W. Stroock

Publisher: Princeton University Press

Published: 2003-05-26

Total Pages: 292

ISBN-13: 9780691115436

DOWNLOAD EBOOK

Kiyosi Itô's greatest contribution to probability theory may be his introduction of stochastic differential equations to explain the Kolmogorov-Feller theory of Markov processes. Starting with the geometric ideas that guided him, this book gives an account of Itô's program. The modern theory of Markov processes was initiated by A. N. Kolmogorov. However, Kolmogorov's approach was too analytic to reveal the probabilistic foundations on which it rests. In particular, it hides the central role played by the simplest Markov processes: those with independent, identically distributed increments. To remedy this defect, Itô interpreted Kolmogorov's famous forward equation as an equation that describes the integral curve of a vector field on the space of probability measures. Thus, in order to show how Itô's thinking leads to his theory of stochastic integral equations, Stroock begins with an account of integral curves on the space of probability measures and then arrives at stochastic integral equations when he moves to a pathspace setting. In the first half of the book, everything is done in the context of general independent increment processes and without explicit use of Itô's stochastic integral calculus. In the second half, the author provides a systematic development of Itô's theory of stochastic integration: first for Brownian motion and then for continuous martingales. The final chapter presents Stratonovich's variation on Itô's theme and ends with an application to the characterization of the paths on which a diffusion is supported. The book should be accessible to readers who have mastered the essentials of modern probability theory and should provide such readers with a reasonably thorough introduction to continuous-time, stochastic processes.


Markov Processes

Markov Processes

Author: E. B. Dynkin

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 377

ISBN-13: 3662000318

DOWNLOAD EBOOK

The modem theory of Markov processes has its origins in the studies of A. A. MARKOV (1906-1907) on sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian motion (L. BACHELlER 1900, A. EIN STEIN 1905). The first correct mathematical construction of a Markov process with continuous trajectories was given by N. WIENER in 1923. (This process is often called the Wiener process.) The general theory of Markov processes was developed in the 1930's and 1940's by A. N. KOL MOGOROV, W. FELLER, W. DOEBLlN, P. LEVY, J. L. DOOB, and others. During the past ten years the theory of Markov processes has entered a new period of intensive development. The methods of the theory of semigroups of linear operators made possible further progress in the classification of Markov processes by their infinitesimal characteristics. The broad classes of Markov processes with continuous trajectories be came the main object of study. The connections between Markov pro cesses and classical analysis were further developed. It has become possible not only to apply the results and methods of analysis to the problems of probability theory, but also to investigate analytic problems using probabilistic methods. Remarkable new connections between Markov processes and potential theory were revealed. The foundations of the theory were reviewed critically: the new concept of strong Markov process acquired for the whole theory of Markov processes great importance.


Markov Processes and Applications

Markov Processes and Applications

Author: Etienne Pardoux

Publisher: John Wiley & Sons

Published: 2008-11-20

Total Pages: 322

ISBN-13: 0470721863

DOWNLOAD EBOOK

"This well-written book provides a clear and accessible treatment of the theory of discrete and continuous-time Markov chains, with an emphasis towards applications. The mathematical treatment is precise and rigorous without superfluous details, and the results are immediately illustrated in illuminating examples. This book will be extremely useful to anybody teaching a course on Markov processes." Jean-François Le Gall, Professor at Université de Paris-Orsay, France. Markov processes is the class of stochastic processes whose past and future are conditionally independent, given their present state. They constitute important models in many applied fields. After an introduction to the Monte Carlo method, this book describes discrete time Markov chains, the Poisson process and continuous time Markov chains. It also presents numerous applications including Markov Chain Monte Carlo, Simulated Annealing, Hidden Markov Models, Annotation and Alignment of Genomic sequences, Control and Filtering, Phylogenetic tree reconstruction and Queuing networks. The last chapter is an introduction to stochastic calculus and mathematical finance. Features include: The Monte Carlo method, discrete time Markov chains, the Poisson process and continuous time jump Markov processes. An introduction to diffusion processes, mathematical finance and stochastic calculus. Applications of Markov processes to various fields, ranging from mathematical biology, to financial engineering and computer science. Numerous exercises and problems with solutions to most of them


The Dynkin Festschrift

The Dynkin Festschrift

Author: Mark Iosifovich Freĭdlin

Publisher: Springer Science & Business Media

Published: 1994

Total Pages: 460

ISBN-13: 9780817636968

DOWNLOAD EBOOK

Eugene B. Dynkin published his first paper, on Markov chain theory, whilst still an undergraduate student at Moscow State University. He went on to make fundamental contributions to the theory of Markov processes and to Lie groups, generating entire schools in these areas.


Markov Processes, Brownian Motion, and Time Symmetry

Markov Processes, Brownian Motion, and Time Symmetry

Author: Kai Lai Chung

Publisher: Springer Science & Business Media

Published: 2006-01-18

Total Pages: 444

ISBN-13: 0387286969

DOWNLOAD EBOOK

From the reviews of the First Edition: "This excellent book is based on several sets of lecture notes written over a decade and has its origin in a one-semester course given by the author at the ETH, Zürich, in the spring of 1970. The author's aim was to present some of the best features of Markov processes and, in particular, of Brownian motion with a minimum of prerequisites and technicalities. The reader who becomes acquainted with the volume cannot but agree with the reviewer that the author was very successful in accomplishing this goal...The volume is very useful for people who wish to learn Markov processes but it seems to the reviewer that it is also of great interest to specialists in this area who could derive much stimulus from it. One can be convinced that it will receive wide circulation." (Mathematical Reviews) This new edition contains 9 new chapters which include new exercises, references, and multiple corrections throughout the original text.


Markov Processes

Markov Processes

Author: James R. Kirkwood

Publisher: CRC Press

Published: 2015-02-09

Total Pages: 336

ISBN-13: 1482240742

DOWNLOAD EBOOK

Clear, rigorous, and intuitive, Markov Processes provides a bridge from an undergraduate probability course to a course in stochastic processes and also as a reference for those that want to see detailed proofs of the theorems of Markov processes. It contains copious computational examples that motivate and illustrate the theorems. The text is desi


Markov Processes for Stochastic Modeling

Markov Processes for Stochastic Modeling

Author: Oliver Ibe

Publisher: Newnes

Published: 2013-05-22

Total Pages: 515

ISBN-13: 0124078397

DOWNLOAD EBOOK

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader. - Presents both the theory and applications of the different aspects of Markov processes - Includes numerous solved examples as well as detailed diagrams that make it easier to understand the principle being presented - Discusses different applications of hidden Markov models, such as DNA sequence analysis and speech analysis.


Markov Processes

Markov Processes

Author: Daniel T. Gillespie

Publisher: Gulf Professional Publishing

Published: 1992

Total Pages: 600

ISBN-13: 9780122839559

DOWNLOAD EBOOK

Markov process theory provides a mathematical framework for analyzing the elements of randomness that are involved in most real-world dynamical processes. This introductory text, which requires an understanding of ordinary calculus, develops the concepts and results of random variable theory.


Markov Processes and Related Problems of Analysis

Markov Processes and Related Problems of Analysis

Author: Evgeniĭ Borisovich Dynkin

Publisher: Cambridge University Press

Published: 1982-09-23

Total Pages: 325

ISBN-13: 0521285127

DOWNLOAD EBOOK

The theory of Markov Processes has become a powerful tool in partial differential equations and potential theory with important applications to physics. Professor Dynkin has made many profound contributions to the subject and in this volume are collected several of his most important expository and survey articles. The content of these articles has not been covered in any monograph as yet. This account is accessible to graduate students in mathematics and operations research and will be welcomed by all those interested in stochastic processes and their applications.