Adaptive Discretization and Sequential Linear Quadratic Strategies in Optimal Control

Adaptive Discretization and Sequential Linear Quadratic Strategies in Optimal Control

Author: Luis Alberto Rodriguez

Publisher:

Published: 2010

Total Pages: 231

ISBN-13: 9781124208787

DOWNLOAD EBOOK

In disciplines such as robotics and aerospace engineering, there is an increasing demand to find control policies that maximize system performance specified in terms of decreasing effort, reducing fuel consumption, or generating graceful motions to achieve complex tasks. Such objectives can be expressed in terms of a scalar cost function that must be minimized subject to various physical constraints. Due to the importance of solving these optimal control problems, numerous algorithms have been proposed. A common approach employed in many of these algorithms is to discretize the continuous-time problem and obtain a finite-dimensional nonlinear problem that can be solved using a general-purpose nonlinear optimization solver. However, casting the problem in this manner destroys the inherent structure of the optimal control problem and results in large-scale problems that are computationally expensive to solve. Another problem is that the choice of an appropriate discretization to accurately represent the solution is left entirely to the expertise of the user. As a consequence, inefficient discretization schemes are often chosen that either do not provide sufficient control resolution to capture important characteristics such as discontinuities or are too dense, requiring intense computational effort. To address these issues, we propose a Runge-Kutta based algorithm that iteratively solves a sequence of discrete-time optimal control problems (DT-OCP) that consistently approximate the continuous-time optimal control problem. To solve these DT-OCPs efficiently we developed a custom SQP method which we refer to as the Constrained Sequential Linear Quadratic (CSLQ) algorithm. The SQP algorithm handles general inequality path constraints including mixed state-control and state-only constraints, preserves the structure of the optimal control problem and exhibits favorable computational complexities with respect to the problem variables. The efficiency of the CSLQ is derived from the implementation of a Riccati based active-set method for solving general inequality constrained linear quadratic optimal control problems. The associated difficulties in selecting an adequate time discretization grid are alleviated by the implementation of a sensitivity-based adaptive algorithm that efficiently refines the discretization by examining where the largest violations in the optimality conditions occur.


A Sequential Linear Quadratic Approach for Constrained Nonlinear Optimal Control with Adaptive Time Discretization and Application to Higher Elevation Mars Landing Problem

A Sequential Linear Quadratic Approach for Constrained Nonlinear Optimal Control with Adaptive Time Discretization and Application to Higher Elevation Mars Landing Problem

Author: Amit Sandhu

Publisher:

Published: 2015

Total Pages: 45

ISBN-13: 9781321646412

DOWNLOAD EBOOK

A sequential quadratic programming method is proposed for solving nonlinear optimal control problems subject to general path constraints including mixed state-control and state only constraints. The proposed algorithm further develops on the approach proposed in [1] with objective to eliminate the use of a high number of time intervals for arriving at an optimal solution. This is done by introducing an adaptive time discretization to allow formation of a desirable control profile without utilizing a lot of intervals. The use of fewer time intervals reduces the computation time considerably. This algorithm is further used in this thesis to solve a trajectory planning problem for higher elevation Mars landing.


Linear-Quadratic Controls in Risk-Averse Decision Making

Linear-Quadratic Controls in Risk-Averse Decision Making

Author: Khanh D. Pham

Publisher: Springer Science & Business Media

Published: 2012-10-23

Total Pages: 157

ISBN-13: 1461450780

DOWNLOAD EBOOK

​​Linear-Quadratic Controls in Risk-Averse Decision Making cuts across control engineering (control feedback and decision optimization) and statistics (post-design performance analysis) with a common theme: reliability increase seen from the responsive angle of incorporating and engineering multi-level performance robustness beyond the long-run average performance into control feedback design and decision making and complex dynamic systems from the start. This monograph provides a complete description of statistical optimal control (also known as cost-cumulant control) theory. In control problems and topics, emphasis is primarily placed on major developments attained and explicit connections between mathematical statistics of performance appraisals and decision and control optimization. Chapter summaries shed light on the relevance of developed results, which makes this monograph suitable for graduate-level lectures in applied mathematics and electrical engineering with systems-theoretic concentration, elective study or a reference for interested readers, researchers, and graduate students who are interested in theoretical constructs and design principles for stochastic controlled systems.​


Extensions of Linear-Quadratic Control, Optimization and Matrix Theory

Extensions of Linear-Quadratic Control, Optimization and Matrix Theory

Author:

Publisher: Academic Press

Published: 2000-04-01

Total Pages: 229

ISBN-13: 0080956424

DOWNLOAD EBOOK

In this book, we study theoretical and practical aspects of computing methods for mathematical modelling of nonlinear systems. A number of computing techniques are considered, such as methods of operator approximation with any given accuracy; operator interpolation techniques including a non-Lagrange interpolation; methods of system representation subject to constraints associated with concepts of causality, memory and stationarity; methods of system representation with an accuracy that is the best within a given class of models; methods of covariance matrix estimation; methods for low-rank matrix approximations; hybrid methods based on a combination of iterative procedures and best operator approximation; and methods for information compression and filtering under condition that a filter model should satisfy restrictions associated with causality and different types of memory. As a result, the book represents a blend of new methods in general computational analysis, and specific, but also generic, techniques for study of systems theory ant its particular branches, such as optimal filtering and information compression. - Best operator approximation, - Non-Lagrange interpolation, - Generic Karhunen-Loeve transform - Generalised low-rank matrix approximation - Optimal data compression - Optimal nonlinear filtering


Dynamic Programming and Optimal Control

Dynamic Programming and Optimal Control

Author: Dimitri Bertsekas

Publisher: Athena Scientific

Published:

Total Pages: 613

ISBN-13: 1886529434

DOWNLOAD EBOOK

This is the leading and most up-to-date textbook on the far-ranging algorithmic methododogy of Dynamic Programming, which can be used for optimal control, Markovian decision problems, planning and sequential decision making under uncertainty, and discrete/combinatorial optimization. The treatment focuses on basic unifying themes, and conceptual foundations. It illustrates the versatility, power, and generality of the method with many examples and applications from engineering, operations research, and other fields. It also addresses extensively the practical application of the methodology, possibly through the use of approximations, and provides an extensive treatment of the far-reaching methodology of Neuro-Dynamic Programming/Reinforcement Learning. Among its special features, the book 1) provides a unifying framework for sequential decision making, 2) treats simultaneously deterministic and stochastic control problems popular in modern control theory and Markovian decision popular in operations research, 3) develops the theory of deterministic optimal control problems including the Pontryagin Minimum Principle, 4) introduces recent suboptimal control and simulation-based approximation techniques (neuro-dynamic programming), which allow the practical application of dynamic programming to complex problems that involve the dual curse of large dimension and lack of an accurate mathematical model, 5) provides a comprehensive treatment of infinite horizon problems in the second volume, and an introductory treatment in the first volume The electronic version of the book includes 29 theoretical problems, with high-quality solutions, which enhance the range of coverage of the book.


Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems

Author: Jingrui Sun

Publisher: Springer Nature

Published: 2020-06-29

Total Pages: 138

ISBN-13: 3030483061

DOWNLOAD EBOOK

This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.