Numerical Methods for Structured Markov Chains

Numerical Methods for Structured Markov Chains

Author: Dario A. Bini

Publisher: Oxford University Press, USA

Published: 2005-02-03

Total Pages: 340

ISBN-13: 0198527683

DOWNLOAD EBOOK

Intersecting two large research areas - numerical analysis and applied probability/queuing theory - this book is a self-contained introduction to the numerical solution of structured Markov chains, which have a wide applicability in queuing theory and stochastic modeling and include M/G/1 and GI/M/1-type Markov chain, quasi-birth-death processes, non-skip free queues and tree-like stochastic processes. Written for applied probabilists and numerical analysts, but accessible toengineers and scientists working on telecommunications and evaluation of computer systems performances, it provides a systematic treatment of the theory and algorithms for important families of structured Markov chains and a thorough overview of the current literature.The book, consisting of nine Chapters, is presented in three parts. Part 1 covers a basic description of the fundamental concepts related to Markov chains, a systematic treatment of the structure matrix tools, including finite Toeplitz matrices, displacement operators, FFT, and the infinite block Toeplitz matrices, their relationship with matrix power series and the fundamental problems of solving matrix equations and computing canonical factorizations. Part 2 deals with the description andanalysis of structure Markov chains and includes M/G/1, quasi-birth-death processes, non-skip-free queues and tree-like processes. Part 3 covers solution algorithms where new convergence and applicability results are proved. Each chapter ends with bibliographic notes for further reading, and the bookends with an appendix collecting the main general concepts and results used in the book, a list of the main annotations and algorithms used in the book, and an extensive index.


Introduction to the Numerical Solution of Markov Chains

Introduction to the Numerical Solution of Markov Chains

Author: William J. Stewart

Publisher: Princeton University Press

Published: 1994-12-04

Total Pages: 561

ISBN-13: 0691036993

DOWNLOAD EBOOK

Markov Chains -- Direct Methods -- Iterative Methods -- Projection Methods -- Block Hessenberg Matrices -- Decompositional Methods -- LI-Cyclic Markov -- Chains -- Transient Solutions -- Stochastic Automata Networks -- Software.


Numerical Methods for Solving Discrete Event Systems

Numerical Methods for Solving Discrete Event Systems

Author: Winfried Grassmann

Publisher: Springer Nature

Published: 2022-11-05

Total Pages: 370

ISBN-13: 3031100824

DOWNLOAD EBOOK

This graduate textbook provides an alternative to discrete event simulation. It describes how to formulate discrete event systems, how to convert them into Markov chains, and how to calculate their transient and equilibrium probabilities. The most appropriate methods for finding these probabilities are described in some detail, and templates for efficient algorithms are provided. These algorithms can be executed on any laptop, even in cases where the Markov chain has hundreds of thousands of states. This book features the probabilistic interpretation of Gaussian elimination, a concept that unifies many of the topics covered, such as embedded Markov chains and matrix analytic methods. The material provided should aid practitioners significantly to solve their problems. This book also provides an interesting approach to teaching courses of stochastic processes.


Numerical Solution of Markov Chains

Numerical Solution of Markov Chains

Author: William J. Stewart

Publisher: CRC Press

Published: 1991-05-23

Total Pages: 738

ISBN-13: 9780824784058

DOWNLOAD EBOOK

Papers presented at a workshop held January 1990 (location unspecified) cover just about all aspects of solving Markov models numerically. There are papers on matrix generation techniques and generalized stochastic Petri nets; the computation of stationary distributions, including aggregation/disagg


Chaînes de Markov : Théorie, algorithmes et applications

Chaînes de Markov : Théorie, algorithmes et applications

Author: SERICOLA Bruno

Publisher: Lavoisier

Published: 2013-05-01

Total Pages: 391

ISBN-13: 2746289164

DOWNLOAD EBOOK

Les chaînes de Markov sont des modèles probabilistes utilisés dans des domaines variés comme la logistique, l'informatique, la fiabilité, les télécommunications, ou encore la biologie et la physique-chimie. On les retrouve également dans la finance, l’économie et les sciences sociales. Cet ouvrage présente une étude approfondie des chaînes de Markov à temps discret et à temps continu avec des applications détaillées aux processus de naissance et mort et aux files d'attente. Ces applications sont illustrées par des algorithmes généraux de calcul de probabilités d'état et de distribution de temps de passage. Le développement de ces algorithmes repose sur l'utilisation de la technique d'uniformisation des chaînes de Markov qui est présentée de manière théorique et intuitive. Ce livre s'adresse aux ingénieurs et chercheurs ayant besoin de modèles probabilistes pour évaluer et prédire le comportement des systèmes qu'ils étudient ou qu'ils développent. Il est aussi très bien adapté pour un cours de master.


Numerical Solution of Algebraic Riccati Equations

Numerical Solution of Algebraic Riccati Equations

Author: Dario A. Bini

Publisher: SIAM

Published: 2012-03-31

Total Pages: 261

ISBN-13: 1611972086

DOWNLOAD EBOOK

This treatment of the basic theory of algebraic Riccati equations describes the classical as well as the more advanced algorithms for their solution in a manner that is accessible to both practitioners and scholars. It is the first book in which nonsymmetric algebraic Riccati equations are treated in a clear and systematic way. Some proofs of theoretical results have been simplified and a unified notation has been adopted. Readers will find a unified discussion of doubling algorithms, which are effective in solving algebraic Riccati equations as well as a detailed description of all classical and advanced algorithms for solving algebraic Riccati equations and their MATLAB codes. This will help the reader gain an understanding of the computational issues and provide ready-to-use implementation of the different solution techniques.


Matrix-Analytic Methods in Stochastic Models

Matrix-Analytic Methods in Stochastic Models

Author: Guy Latouche

Publisher: Springer Science & Business Media

Published: 2012-12-04

Total Pages: 265

ISBN-13: 146144909X

DOWNLOAD EBOOK

Matrix-analytic and related methods have become recognized as an important and fundamental approach for the mathematical analysis of general classes of complex stochastic models. Research in the area of matrix-analytic and related methods seeks to discover underlying probabilistic structures intrinsic in such stochastic models, develop numerical algorithms for computing functionals (e.g., performance measures) of the underlying stochastic processes, and apply these probabilistic structures and/or computational algorithms within a wide variety of fields. This volume presents recent research results on: the theory, algorithms and methodologies concerning matrix-analytic and related methods in stochastic models; and the application of matrix-analytic and related methods in various fields, which includes but is not limited to computer science and engineering, communication networks and telephony, electrical and industrial engineering, operations research, management science, financial and risk analysis, and bio-statistics. These research studies provide deep insights and understanding of the stochastic models of interest from a mathematics and/or applications perspective, as well as identify directions for future research.


Princeton Companion to Applied Mathematics

Princeton Companion to Applied Mathematics

Author: Nicholas J. Higham

Publisher: Princeton University Press

Published: 2015-09-09

Total Pages: 1014

ISBN-13: 0691150397

DOWNLOAD EBOOK

The must-have compendium on applied mathematics This is the most authoritative and accessible single-volume reference book on applied mathematics. Featuring numerous entries by leading experts and organized thematically, it introduces readers to applied mathematics and its uses; explains key concepts; describes important equations, laws, and functions; looks at exciting areas of research; covers modeling and simulation; explores areas of application; and more. Modeled on the popular Princeton Companion to Mathematics, this volume is an indispensable resource for undergraduate and graduate students, researchers, and practitioners in other disciplines seeking a user-friendly reference book on applied mathematics. Features nearly 200 entries organized thematically and written by an international team of distinguished contributors Presents the major ideas and branches of applied mathematics in a clear and accessible way Explains important mathematical concepts, methods, equations, and applications Introduces the language of applied mathematics and the goals of applied mathematical research Gives a wide range of examples of mathematical modeling Covers continuum mechanics, dynamical systems, numerical analysis, discrete and combinatorial mathematics, mathematical physics, and much more Explores the connections between applied mathematics and other disciplines Includes suggestions for further reading, cross-references, and a comprehensive index


Fundamentals of Matrix-Analytic Methods

Fundamentals of Matrix-Analytic Methods

Author: Qi-Ming He

Publisher: Springer Science & Business Media

Published: 2013-08-13

Total Pages: 363

ISBN-13: 1461473306

DOWNLOAD EBOOK

Fundamentals of Matrix-Analytic Methods targets advanced-level students in mathematics, engineering and computer science. It focuses on the fundamental parts of Matrix-Analytic Methods, Phase-Type Distributions, Markovian arrival processes and Structured Markov chains and matrix geometric solutions. New materials and techniques are presented for the first time in research and engineering design. This book emphasizes stochastic modeling by offering probabilistic interpretation and constructive proofs for Matrix-Analytic Methods. Such an approach is especially useful for engineering analysis and design. Exercises and examples are provided throughout the book.


Markov Chains: Models, Algorithms and Applications

Markov Chains: Models, Algorithms and Applications

Author: Wai-Ki Ching

Publisher: Springer Science & Business Media

Published: 2006-06-05

Total Pages: 212

ISBN-13: 038729337X

DOWNLOAD EBOOK

Markov chains are a particularly powerful and widely used tool for analyzing a variety of stochastic (probabilistic) systems over time. This monograph will present a series of Markov models, starting from the basic models and then building up to higher-order models. Included in the higher-order discussions are multivariate models, higher-order multivariate models, and higher-order hidden models. In each case, the focus is on the important kinds of applications that can be made with the class of models being considered in the current chapter. Special attention is given to numerical algorithms that can efficiently solve the models. Therefore, Markov Chains: Models, Algorithms and Applications outlines recent developments of Markov chain models for modeling queueing sequences, Internet, re-manufacturing systems, reverse logistics, inventory systems, bio-informatics, DNA sequences, genetic networks, data mining, and many other practical systems.