Continuous Average Control of Piecewise Deterministic Markov Processes

Continuous Average Control of Piecewise Deterministic Markov Processes

Author: Oswaldo Luiz do Valle Costa

Publisher: Springer Science & Business Media

Published: 2013-04-12

Total Pages: 124

ISBN-13: 146146983X

DOWNLOAD EBOOK

The intent of this book is to present recent results in the control theory for the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs). The book focuses mainly on the long run average cost criteria and extends to the PDMPs some well-known techniques related to discrete-time and continuous-time Markov decision processes, including the so-called ``average inequality approach'', ``vanishing discount technique'' and ``policy iteration algorithm''. We believe that what is unique about our approach is that, by using the special features of the PDMPs, we trace a parallel with the general theory for discrete-time Markov Decision Processes rather than the continuous-time case. The two main reasons for doing that is to use the powerful tools developed in the discrete-time framework and to avoid working with the infinitesimal generator associated to a PDMP, which in most cases has its domain of definition difficult to be characterized. Although the book is mainly intended to be a theoretically oriented text, it also contains some motivational examples. The book is targeted primarily for advanced students and practitioners of control theory. The book will be a valuable source for experts in the field of Markov decision processes. Moreover, the book should be suitable for certain advanced courses or seminars. As background, one needs an acquaintance with the theory of Markov decision processes and some knowledge of stochastic processes and modern analysis.


Stochastic Analysis, Filtering, and Stochastic Optimization

Stochastic Analysis, Filtering, and Stochastic Optimization

Author: George Yin

Publisher: Springer Nature

Published: 2022-04-22

Total Pages: 466

ISBN-13: 3030985199

DOWNLOAD EBOOK

This volume is a collection of research works to honor the late Professor Mark H.A. Davis, whose pioneering work in the areas of Stochastic Processes, Filtering, and Stochastic Optimization spans more than five decades. Invited authors include his dissertation advisor, past collaborators, colleagues, mentees, and graduate students of Professor Davis, as well as scholars who have worked in the above areas. Their contributions may expand upon topics in piecewise deterministic processes, pathwise stochastic calculus, martingale methods in stochastic optimization, filtering, mean-field games, time-inconsistency, as well as impulse, singular, risk-sensitive and robust stochastic control.


Stochastic Processes, Finance And Control: A Festschrift In Honor Of Robert J Elliott

Stochastic Processes, Finance And Control: A Festschrift In Honor Of Robert J Elliott

Author: Samuel N Cohen

Publisher: World Scientific

Published: 2012-08-10

Total Pages: 605

ISBN-13: 9814483915

DOWNLOAD EBOOK

This book consists of a series of new, peer-reviewed papers in stochastic processes, analysis, filtering and control, with particular emphasis on mathematical finance, actuarial science and engineering. Paper contributors include colleagues, collaborators and former students of Robert Elliott, many of whom are world-leading experts and have made fundamental and significant contributions to these areas.This book provides new important insights and results by eminent researchers in the considered areas, which will be of interest to researchers and practitioners. The topics considered will be diverse in applications, and will provide contemporary approaches to the problems considered. The areas considered are rapidly evolving. This volume will contribute to their development, and present the current state-of-the-art stochastic processes, analysis, filtering and control.Contributing authors include: H Albrecher, T Bielecki, F Dufour, M Jeanblanc, I Karatzas, H-H Kuo, A Melnikov, E Platen, G Yin, Q Zhang, C Chiarella, W Fleming, D Madan, R Mamon, J Yan, V Krishnamurthy.


Stochastic Processes, Finance and Control

Stochastic Processes, Finance and Control

Author: Robert J. Elliot

Publisher: World Scientific

Published: 2012

Total Pages: 605

ISBN-13: 9814383309

DOWNLOAD EBOOK

This Festschrift is dedicated to Robert J Elliott on the occasion of his 70th birthday It brings together a collection of chapters by distinguished and eminent scholars in the fields of stochastic processes, filtering and control, as well as their applications to mathematical finance It presents cutting edge developments in these fields and is a valuable source of references for researchers, graduate students and market practitioners in mathematical finance and financial engineering Topics include the theory of stochastic processes, differential and stochastic games, mathematical finance, filtering and control.


Mathematical Modeling of Random and Deterministic Phenomena

Mathematical Modeling of Random and Deterministic Phenomena

Author: Solym Mawaki Manou-Abi

Publisher: John Wiley & Sons

Published: 2020-04-28

Total Pages: 308

ISBN-13: 1786304546

DOWNLOAD EBOOK

This book highlights mathematical research interests that appear in real life, such as the study and modeling of random and deterministic phenomena. As such, it provides current research in mathematics, with applications in biological and environmental sciences, ecology, epidemiology and social perspectives. The chapters can be read independently of each other, with dedicated references specific to each chapter. The book is organized in two main parts. The first is devoted to some advanced mathematical problems regarding epidemic models; predictions of biomass; space-time modeling of extreme rainfall; modeling with the piecewise deterministic Markov process; optimal control problems; evolution equations in a periodic environment; and the analysis of the heat equation. The second is devoted to a modelization with interdisciplinarity in ecological, socio-economic, epistemological, demographic and social problems. Mathematical Modeling of Random and Deterministic Phenomena is aimed at expert readers, young researchers, plus graduate and advanced undergraduate students who are interested in probability, statistics, modeling and mathematical analysis.


Continuous-Time Markov Decision Processes

Continuous-Time Markov Decision Processes

Author: Alexey Piunovskiy

Publisher: Springer Nature

Published: 2020-11-09

Total Pages: 605

ISBN-13: 3030549879

DOWNLOAD EBOOK

This book offers a systematic and rigorous treatment of continuous-time Markov decision processes, covering both theory and possible applications to queueing systems, epidemiology, finance, and other fields. Unlike most books on the subject, much attention is paid to problems with functional constraints and the realizability of strategies. Three major methods of investigations are presented, based on dynamic programming, linear programming, and reduction to discrete-time problems. Although the main focus is on models with total (discounted or undiscounted) cost criteria, models with average cost criteria and with impulsive controls are also discussed in depth. The book is self-contained. A separate chapter is devoted to Markov pure jump processes and the appendices collect the requisite background on real analysis and applied probability. All the statements in the main text are proved in detail. Researchers and graduate students in applied probability, operational research, statistics and engineering will find this monograph interesting, useful and valuable.


Telegraph Processes and Option Pricing

Telegraph Processes and Option Pricing

Author: Nikita Ratanov

Publisher: Springer Nature

Published: 2023-01-04

Total Pages: 451

ISBN-13: 3662658275

DOWNLOAD EBOOK

This book provides an extensive, systematic overview of the modern theory of telegraph processes and their multidimensional counterparts, together with numerous fruitful applications in financial modelling. Focusing on stochastic processes of bounded variation instead of classical diffusion, or more generally, Lévy processes, has two obvious benefits. First, the mathematical technique is much simpler, which helps to concentrate on the key problems of stochastic analysis and applications, including financial market modelling. Second, this approach overcomes some shortcomings of the (parabolic) nature of classical diffusions that contradict physical intuition, such as infinite propagation velocity and infinite total variation of paths. In this second edition, some sections of the previous text are included without any changes, while most others have been expanded and significantly revised. These are supplemented by predominantly new results concerning piecewise linear processes with arbitrary sequences of velocities, jump amplitudes, and switching intensities. The chapter on functionals of the telegraph process has been significantly expanded by adding sections on exponential functionals, telegraph meanders and running extrema, the times of the first passages of telegraph processes with alternating random jumps, and distribution of the Euclidean distance between two independent telegraph processes. A new chapter on the multidimensional counterparts of the telegraph processes is also included. The book is intended for graduate students in mathematics, probability, statistics and quantitative finance, and for researchers working at academic institutions, in industry and engineering. It can also be used by university lecturers and professionals in various applied areas.


Numerical Methods for Simulation and Optimization of Piecewise Deterministic Markov Processes

Numerical Methods for Simulation and Optimization of Piecewise Deterministic Markov Processes

Author: Benoîte de Saporta

Publisher: John Wiley & Sons

Published: 2016-01-26

Total Pages: 298

ISBN-13: 1848218397

DOWNLOAD EBOOK

Mark H.A. Davis introduced the Piecewise-Deterministic Markov Process (PDMP) class of stochastic hybrid models in an article in 1984. Today it is used to model a variety of complex systems in the fields of engineering, economics, management sciences, biology, Internet traffic, networks and many more. Yet, despite this, there is very little in the way of literature devoted to the development of numerical methods for PDMDs to solve problems of practical importance, or the computational control of PDMPs. This book therefore presents a collection of mathematical tools that have been recently developed to tackle such problems. It begins by doing so through examples in several application domains such as reliability. The second part is devoted to the study and simulation of expectations of functionals of PDMPs. Finally, the third part introduces the development of numerical techniques for optimal control problems such as stopping and impulse control problems.


Optimization, Control, and Applications of Stochastic Systems

Optimization, Control, and Applications of Stochastic Systems

Author: Daniel Hernández-Hernández

Publisher: Springer Science & Business Media

Published: 2012-08-15

Total Pages: 331

ISBN-13: 0817683372

DOWNLOAD EBOOK

This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include various aspects of dynamic programming, approximation algorithms, and infinite-dimensional linear programming. In all, the work comprises 18 carefully selected papers written by experts in their respective fields. Optimization, Control, and Applications of Stochastic Systems will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and dynamic games.


Stochastic Processes: Modeling and Simulation

Stochastic Processes: Modeling and Simulation

Author: D N Shanbhag

Publisher: Gulf Professional Publishing

Published: 2003-02-24

Total Pages: 1028

ISBN-13: 9780444500137

DOWNLOAD EBOOK

This sequel to volume 19 of Handbook on Statistics on Stochastic Processes: Modelling and Simulation is concerned mainly with the theme of reviewing and, in some cases, unifying with new ideas the different lines of research and developments in stochastic processes of applied flavour. This volume consists of 23 chapters addressing various topics in stochastic processes. These include, among others, those on manufacturing systems, random graphs, reliability, epidemic modelling, self-similar processes, empirical processes, time series models, extreme value therapy, applications of Markov chains, modelling with Monte Carlo techniques, and stochastic processes in subjects such as engineering, telecommunications, biology, astronomy and chemistry. particular with modelling, simulation techniques and numerical methods concerned with stochastic processes. The scope of the project involving this volume as well as volume 19 is already clarified in the preface of volume 19. The present volume completes the aim of the project and should serve as an aid to students, teachers, researchers and practitioners interested in applied stochastic processes.