Mathematical Aspects of Mixing Times in Markov Chains

Mathematical Aspects of Mixing Times in Markov Chains

Author: Ravi R. Montenegro

Publisher: Now Publishers Inc

Published: 2006

Total Pages: 133

ISBN-13: 1933019298

DOWNLOAD EBOOK

Mathematical Aspects of Mixing Times in Markov Chains is a comprehensive, well-written review of the subject that will be of interest to researchers and students in computer and mathematical sciences.


Introduction to Markov Chains

Introduction to Markov Chains

Author: Ehrhard Behrends

Publisher: Vieweg+Teubner Verlag

Published: 2014-07-08

Total Pages: 237

ISBN-13: 3322901572

DOWNLOAD EBOOK

Besides the investigation of general chains the book contains chapters which are concerned with eigenvalue techniques, conductance, stopping times, the strong Markov property, couplings, strong uniform times, Markov chains on arbitrary finite groups (including a crash-course in harmonic analysis), random generation and counting, Markov random fields, Gibbs fields, the Metropolis sampler, and simulated annealing. With 170 exercises.


Markov Chains and Mixing Times

Markov Chains and Mixing Times

Author: David A. Levin

Publisher: American Mathematical Soc.

Published: 2017-10-31

Total Pages: 465

ISBN-13: 1470429624

DOWNLOAD EBOOK

This book is an introduction to the modern theory of Markov chains, whose goal is to determine the rate of convergence to the stationary distribution, as a function of state space size and geometry. This topic has important connections to combinatorics, statistical physics, and theoretical computer science. Many of the techniques presented originate in these disciplines. The central tools for estimating convergence times, including coupling, strong stationary times, and spectral methods, are developed. The authors discuss many examples, including card shuffling and the Ising model, from statistical mechanics, and present the connection of random walks to electrical networks and apply it to estimate hitting and cover times. The first edition has been used in courses in mathematics and computer science departments of numerous universities. The second edition features three new chapters (on monotone chains, the exclusion process, and stationary times) and also includes smaller additions and corrections throughout. Updated notes at the end of each chapter inform the reader of recent research developments.


Markov Chains and Stochastic Stability

Markov Chains and Stochastic Stability

Author: Sean Meyn

Publisher: Cambridge University Press

Published: 2009-04-02

Total Pages: 623

ISBN-13: 0521731828

DOWNLOAD EBOOK

New up-to-date edition of this influential classic on Markov chains in general state spaces. Proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background. New commentary by Sean Meyn, including updated references, reflects developments since 1996.


Non-negative Matrices and Markov Chains

Non-negative Matrices and Markov Chains

Author: E. Seneta

Publisher: Springer Science & Business Media

Published: 2006-07-02

Total Pages: 295

ISBN-13: 0387327924

DOWNLOAD EBOOK

Since its inception by Perron and Frobenius, the theory of non-negative matrices has developed enormously and is now being used and extended in applied fields of study as diverse as probability theory, numerical analysis, demography, mathematical economics, and dynamic programming, while its development is still proceeding rapidly as a branch of pure mathematics in its own right. While there are books which cover this or that aspect of the theory, it is nevertheless not uncommon for workers in one or another branch of its development to be unaware of what is known in other branches, even though there is often formal overlap. One of the purposes of this book is to relate several aspects of the theory, insofar as this is possible. The author hopes that the book will be useful to mathematicians; but in particular to the workers in applied fields, so the mathematics has been kept as simple as could be managed. The mathematical requisites for reading it are: some knowledge of real-variable theory, and matrix theory; and a little knowledge of complex-variable; the emphasis is on real-variable methods. (There is only one part of the book, the second part of 55.5, which is of rather specialist interest, and requires deeper knowledge.) Appendices provide brief expositions of those areas of mathematics needed which may be less g- erally known to the average reader.


Markov Chains

Markov Chains

Author: Pierre Bremaud

Publisher: Springer Science & Business Media

Published: 2013-03-09

Total Pages: 456

ISBN-13: 1475731248

DOWNLOAD EBOOK

Primarily an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level, the primary objective of this book is to initiate students in the art of stochastic modelling. However it is motivated by significant applications and progressively brings the student to the borders of contemporary research. Examples are from a wide range of domains, including operations research and electrical engineering. Researchers and students in these areas as well as in physics, biology and the social sciences will find this book of interest.


Essentials of Stochastic Processes

Essentials of Stochastic Processes

Author: Richard Durrett

Publisher: Springer

Published: 2016-11-07

Total Pages: 282

ISBN-13: 3319456148

DOWNLOAD EBOOK

Building upon the previous editions, this textbook is a first course in stochastic processes taken by undergraduate and graduate students (MS and PhD students from math, statistics, economics, computer science, engineering, and finance departments) who have had a course in probability theory. It covers Markov chains in discrete and continuous time, Poisson processes, renewal processes, martingales, and option pricing. One can only learn a subject by seeing it in action, so there are a large number of examples and more than 300 carefully chosen exercises to deepen the reader’s understanding. Drawing from teaching experience and student feedback, there are many new examples and problems with solutions that use TI-83 to eliminate the tedious details of solving linear equations by hand, and the collection of exercises is much improved, with many more biological examples. Originally included in previous editions, material too advanced for this first course in stochastic processes has been eliminated while treatment of other topics useful for applications has been expanded. In addition, the ordering of topics has been improved; for example, the difficult subject of martingales is delayed until its usefulness can be applied in the treatment of mathematical finance.


Probability on Trees and Networks

Probability on Trees and Networks

Author: Russell Lyons

Publisher: Cambridge University Press

Published: 2017-01-20

Total Pages: 1023

ISBN-13: 1316785335

DOWNLOAD EBOOK

Starting around the late 1950s, several research communities began relating the geometry of graphs to stochastic processes on these graphs. This book, twenty years in the making, ties together research in the field, encompassing work on percolation, isoperimetric inequalities, eigenvalues, transition probabilities, and random walks. Written by two leading researchers, the text emphasizes intuition, while giving complete proofs and more than 850 exercises. Many recent developments, in which the authors have played a leading role, are discussed, including percolation on trees and Cayley graphs, uniform spanning forests, the mass-transport technique, and connections on random walks on graphs to embedding in Hilbert space. This state-of-the-art account of probability on networks will be indispensable for graduate students and researchers alike.


Sensitivity Analysis: Matrix Methods in Demography and Ecology

Sensitivity Analysis: Matrix Methods in Demography and Ecology

Author: Hal Caswell

Publisher: Springer

Published: 2019-04-02

Total Pages: 308

ISBN-13: 3030105342

DOWNLOAD EBOOK

This open access book shows how to use sensitivity analysis in demography. It presents new methods for individuals, cohorts, and populations, with applications to humans, other animals, and plants. The analyses are based on matrix formulations of age-classified, stage-classified, and multistate population models. Methods are presented for linear and nonlinear, deterministic and stochastic, and time-invariant and time-varying cases. Readers will discover results on the sensitivity of statistics of longevity, life disparity, occupancy times, the net reproductive rate, and statistics of Markov chain models in demography. They will also see applications of sensitivity analysis to population growth rates, stable population structures, reproductive value, equilibria under immigration and nonlinearity, and population cycles. Individual stochasticity is a theme throughout, with a focus that goes beyond expected values to include variances in demographic outcomes. The calculations are easily and accurately implemented in matrix-oriented programming languages such as Matlab or R. Sensitivity analysis will help readers create models to predict the effect of future changes, to evaluate policy effects, and to identify possible evolutionary responses to the environment. Complete with many examples of the application, the book will be of interest to researchers and graduate students in human demography and population biology. The material will also appeal to those in mathematical biology and applied mathematics.


Random Walks and Electric Networks

Random Walks and Electric Networks

Author: Peter G. Doyle

Publisher: American Mathematical Soc.

Published: 1984-12-31

Total Pages: 174

ISBN-13: 1614440220

DOWNLOAD EBOOK

Probability theory, like much of mathematics, is indebted to physics as a source of problems and intuition for solving these problems. Unfortunately, the level of abstraction of current mathematics often makes it difficult for anyone but an expert to appreciate this fact. Random Walks and electric networks looks at the interplay of physics and mathematics in terms of an example—the relation between elementary electric network theory and random walks —where the mathematics involved is at the college level.