Bayesian Inference of State Space Models

Bayesian Inference of State Space Models

Author: Kostas Triantafyllopoulos

Publisher: Springer Nature

Published: 2021-11-12

Total Pages: 503

ISBN-13: 303076124X

DOWNLOAD EBOOK

Bayesian Inference of State Space Models: Kalman Filtering and Beyond offers a comprehensive introduction to Bayesian estimation and forecasting for state space models. The celebrated Kalman filter, with its numerous extensions, takes centre stage in the book. Univariate and multivariate models, linear Gaussian, non-linear and non-Gaussian models are discussed with applications to signal processing, environmetrics, economics and systems engineering. Over the past years there has been a growing literature on Bayesian inference of state space models, focusing on multivariate models as well as on non-linear and non-Gaussian models. The availability of time series data in many fields of science and industry on the one hand, and the development of low-cost computational capabilities on the other, have resulted in a wealth of statistical methods aimed at parameter estimation and forecasting. This book brings together many of these methods, presenting an accessible and comprehensive introduction to state space models. A number of data sets from different disciplines are used to illustrate the methods and show how they are applied in practice. The R package BTSA, created for the book, includes many of the algorithms and examples presented. The book is essentially self-contained and includes a chapter summarising the prerequisites in undergraduate linear algebra, probability and statistics. An up-to-date and complete account of state space methods, illustrated by real-life data sets and R code, this textbook will appeal to a wide range of students and scientists, notably in the disciplines of statistics, systems engineering, signal processing, data science, finance and econometrics. With numerous exercises in each chapter, and prerequisite knowledge conveniently recalled, it is suitable for upper undergraduate and graduate courses.


Probabilistic Boolean Networks

Probabilistic Boolean Networks

Author: Ilya Shmulevich

Publisher: SIAM

Published: 2010-01-21

Total Pages: 276

ISBN-13: 0898716926

DOWNLOAD EBOOK

The first comprehensive treatment of probabilistic Boolean networks, unifying different strands of current research and addressing emerging issues.


Partially Observed Markov Decision Processes

Partially Observed Markov Decision Processes

Author: Vikram Krishnamurthy

Publisher: Cambridge University Press

Published: 2016-03-21

Total Pages: 491

ISBN-13: 1107134609

DOWNLOAD EBOOK

This book covers formulation, algorithms, and structural results of partially observed Markov decision processes, whilst linking theory to real-world applications in controlled sensing. Computations are kept to a minimum, enabling students and researchers in engineering, operations research, and economics to understand the methods and determine the structure of their optimal solution.


State Space and Unobserved Component Models

State Space and Unobserved Component Models

Author: James Durbin

Publisher: Cambridge University Press

Published: 2004-06-10

Total Pages: 398

ISBN-13: 9780521835954

DOWNLOAD EBOOK

A comprehensive overview of developments in the theory and application of state space modeling, first published in 2004.


Bayesian Filtering and Smoothing

Bayesian Filtering and Smoothing

Author: Simo Särkkä

Publisher: Cambridge University Press

Published: 2013-09-05

Total Pages: 255

ISBN-13: 110703065X

DOWNLOAD EBOOK

A unified Bayesian treatment of the state-of-the-art filtering, smoothing, and parameter estimation algorithms for non-linear state space models.


Probability and Bayesian Modeling

Probability and Bayesian Modeling

Author: Jim Albert

Publisher: CRC Press

Published: 2019-12-06

Total Pages: 553

ISBN-13: 1351030132

DOWNLOAD EBOOK

Probability and Bayesian Modeling is an introduction to probability and Bayesian thinking for undergraduate students with a calculus background. The first part of the book provides a broad view of probability including foundations, conditional probability, discrete and continuous distributions, and joint distributions. Statistical inference is presented completely from a Bayesian perspective. The text introduces inference and prediction for a single proportion and a single mean from Normal sampling. After fundamentals of Markov Chain Monte Carlo algorithms are introduced, Bayesian inference is described for hierarchical and regression models including logistic regression. The book presents several case studies motivated by some historical Bayesian studies and the authors’ research. This text reflects modern Bayesian statistical practice. Simulation is introduced in all the probability chapters and extensively used in the Bayesian material to simulate from the posterior and predictive distributions. One chapter describes the basic tenets of Metropolis and Gibbs sampling algorithms; however several chapters introduce the fundamentals of Bayesian inference for conjugate priors to deepen understanding. Strategies for constructing prior distributions are described in situations when one has substantial prior information and for cases where one has weak prior knowledge. One chapter introduces hierarchical Bayesian modeling as a practical way of combining data from different groups. There is an extensive discussion of Bayesian regression models including the construction of informative priors, inference about functions of the parameters of interest, prediction, and model selection. The text uses JAGS (Just Another Gibbs Sampler) as a general-purpose computational method for simulating from posterior distributions for a variety of Bayesian models. An R package ProbBayes is available containing all of the book datasets and special functions for illustrating concepts from the book. A complete solutions manual is available for instructors who adopt the book in the Additional Resources section.


Bayesian Econometric Methods

Bayesian Econometric Methods

Author: Joshua Chan

Publisher: Cambridge University Press

Published: 2019-08-15

Total Pages: 491

ISBN-13: 1108423388

DOWNLOAD EBOOK

Illustrates Bayesian theory and application through a series of exercises in question and answer format.


Bayesian Estimation of DSGE Models

Bayesian Estimation of DSGE Models

Author: Edward P. Herbst

Publisher: Princeton University Press

Published: 2015-12-29

Total Pages: 295

ISBN-13: 0691161089

DOWNLOAD EBOOK

Dynamic stochastic general equilibrium (DSGE) models have become one of the workhorses of modern macroeconomics and are extensively used for academic research as well as forecasting and policy analysis at central banks. This book introduces readers to state-of-the-art computational techniques used in the Bayesian analysis of DSGE models. The book covers Markov chain Monte Carlo techniques for linearized DSGE models, novel sequential Monte Carlo methods that can be used for parameter inference, and the estimation of nonlinear DSGE models based on particle filter approximations of the likelihood function. The theoretical foundations of the algorithms are discussed in depth, and detailed empirical applications and numerical illustrations are provided. The book also gives invaluable advice on how to tailor these algorithms to specific applications and assess the accuracy and reliability of the computations. Bayesian Estimation of DSGE Models is essential reading for graduate students, academic researchers, and practitioners at policy institutions.


An Introduction to Sequential Monte Carlo

An Introduction to Sequential Monte Carlo

Author: Nicolas Chopin

Publisher: Springer Nature

Published: 2020-10-01

Total Pages: 390

ISBN-13: 3030478459

DOWNLOAD EBOOK

This book provides a general introduction to Sequential Monte Carlo (SMC) methods, also known as particle filters. These methods have become a staple for the sequential analysis of data in such diverse fields as signal processing, epidemiology, machine learning, population ecology, quantitative finance, and robotics. The coverage is comprehensive, ranging from the underlying theory to computational implementation, methodology, and diverse applications in various areas of science. This is achieved by describing SMC algorithms as particular cases of a general framework, which involves concepts such as Feynman-Kac distributions, and tools such as importance sampling and resampling. This general framework is used consistently throughout the book. Extensive coverage is provided on sequential learning (filtering, smoothing) of state-space (hidden Markov) models, as this remains an important application of SMC methods. More recent applications, such as parameter estimation of these models (through e.g. particle Markov chain Monte Carlo techniques) and the simulation of challenging probability distributions (in e.g. Bayesian inference or rare-event problems), are also discussed. The book may be used either as a graduate text on Sequential Monte Carlo methods and state-space modeling, or as a general reference work on the area. Each chapter includes a set of exercises for self-study, a comprehensive bibliography, and a “Python corner,” which discusses the practical implementation of the methods covered. In addition, the book comes with an open source Python library, which implements all the algorithms described in the book, and contains all the programs that were used to perform the numerical experiments.


Dynamic Linear Models with R

Dynamic Linear Models with R

Author: Giovanni Petris

Publisher: Springer Science & Business Media

Published: 2009-06-12

Total Pages: 258

ISBN-13: 0387772383

DOWNLOAD EBOOK

State space models have gained tremendous popularity in recent years in as disparate fields as engineering, economics, genetics and ecology. After a detailed introduction to general state space models, this book focuses on dynamic linear models, emphasizing their Bayesian analysis. Whenever possible it is shown how to compute estimates and forecasts in closed form; for more complex models, simulation techniques are used. A final chapter covers modern sequential Monte Carlo algorithms. The book illustrates all the fundamental steps needed to use dynamic linear models in practice, using R. Many detailed examples based on real data sets are provided to show how to set up a specific model, estimate its parameters, and use it for forecasting. All the code used in the book is available online. No prior knowledge of Bayesian statistics or time series analysis is required, although familiarity with basic statistics and R is assumed.