Stochastic Models, Estimation, and Control

Stochastic Models, Estimation, and Control

Author: Peter S. Maybeck

Publisher: Academic Press

Published: 1982-08-25

Total Pages: 311

ISBN-13: 0080960030

DOWNLOAD EBOOK

This volume builds upon the foundations set in Volumes 1 and 2. Chapter 13 introduces the basic concepts of stochastic control and dynamic programming as the fundamental means of synthesizing optimal stochastic control laws.


Hidden Markov Models

Hidden Markov Models

Author: Robert J Elliott

Publisher: Springer Science & Business Media

Published: 2008-09-27

Total Pages: 374

ISBN-13: 0387848541

DOWNLOAD EBOOK

As more applications are found, interest in Hidden Markov Models continues to grow. Following comments and feedback from colleagues, students and other working with Hidden Markov Models the corrected 3rd printing of this volume contains clarifications, improvements and some new material, including results on smoothing for linear Gaussian dynamics. In Chapter 2 the derivation of the basic filters related to the Markov chain are each presented explicitly, rather than as special cases of one general filter. Furthermore, equations for smoothed estimates are given. The dynamics for the Kalman filter are derived as special cases of the authors’ general results and new expressions for a Kalman smoother are given. The Chapters on the control of Hidden Markov Chains are expanded and clarified. The revised Chapter 4 includes state estimation for discrete time Markov processes and Chapter 12 has a new section on robust control.


Discrete-time Stochastic Systems

Discrete-time Stochastic Systems

Author: Torsten Söderström

Publisher: Springer Science & Business Media

Published: 2002-07-26

Total Pages: 410

ISBN-13: 9781852336493

DOWNLOAD EBOOK

This comprehensive introduction to the estimation and control of dynamic stochastic systems provides complete derivations of key results. The second edition includes improved and updated material, and a new presentation of polynomial control and new derivation of linear-quadratic-Gaussian control.


Stochastic Modelling and Control

Stochastic Modelling and Control

Author: M. H. A. Davis

Publisher: Springer

Published: 1985

Total Pages: 416

ISBN-13:

DOWNLOAD EBOOK

This book aims to provide a unified treatment of input/output modelling and of control for discrete-time dynamical systems subject to random disturbances. The results presented are of wide applica bility in control engineering, operations research, econometric modelling and many other areas. There are two distinct approaches to mathematical modelling of physical systems: a direct analysis of the physical mechanisms that comprise the process, or a 'black box' approach based on analysis of input/output data. The second approach is adopted here, although of course the properties ofthe models we study, which within the limits of linearity are very general, are also relevant to the behaviour of systems represented by such models, however they are arrived at. The type of system we are interested in is a discrete-time or sampled-data system where the relation between input and output is (at least approximately) linear and where additive random dis turbances are also present, so that the behaviour of the system must be investigated by statistical methods. After a preliminary chapter summarizing elements of probability and linear system theory, we introduce in Chapter 2 some general linear stochastic models, both in input/output and state-space form. Chapter 3 concerns filtering theory: estimation of the state of a dynamical system from noisy observations. As well as being an important topic in its own right, filtering theory provides the link, via the so-called innovations representation, between input/output models (as identified by data analysis) and state-space models, as required for much contemporary control theory.


Stochastic Processes, Estimation, and Control

Stochastic Processes, Estimation, and Control

Author: Jason L. Speyer

Publisher: SIAM

Published: 2008-11-06

Total Pages: 391

ISBN-13: 0898716551

DOWNLOAD EBOOK

The authors provide a comprehensive treatment of stochastic systems from the foundations of probability to stochastic optimal control. The book covers discrete- and continuous-time stochastic dynamic systems leading to the derivation of the Kalman filter, its properties, and its relation to the frequency domain Wiener filter aswell as the dynamic programming derivation of the linear quadratic Gaussian (LQG) and the linear exponential Gaussian (LEG) controllers and their relation to HÝsubscript 2¨ and HÝsubscript Ýinfinity¨¨ controllers and system robustness. This book is suitable for first-year graduate students in electrical, mechanical, chemical, and aerospace engineering specializing in systems and control. Students in computer science, economics, and possibly business will also find it useful.


Stochastic Systems

Stochastic Systems

Author: P. R. Kumar

Publisher: SIAM

Published: 2015-12-15

Total Pages: 371

ISBN-13: 1611974259

DOWNLOAD EBOOK

Since its origins in the 1940s, the subject of decision making under uncertainty has grown into a diversified area with application in several branches of engineering and in those areas of the social sciences concerned with policy analysis and prescription. These approaches required a computing capacity too expensive for the time, until the ability to collect and process huge quantities of data engendered an explosion of work in the area. This book provides succinct and rigorous treatment of the foundations of stochastic control; a unified approach to filtering, estimation, prediction, and stochastic and adaptive control; and the conceptual framework necessary to understand current trends in stochastic control, data mining, machine learning, and robotics.