This monograph deals with cases where optimal control either does not exist or is not unique, cases where optimality conditions are insufficient of degenerate, or where extremum problems in the sense of Tikhonov and Hadamard are ill-posed, and other situations. A formal application of classical optimisation methods in such cases either leads to wrong results or has no effect. The detailed analysis of these examples should provide a better understanding of the modern theory of optimal control and the practical difficulties of solving extremum problems.
This monograph deals with cases where optimal control either does not exist or is not unique, cases where optimality conditions are insufficient of degenerate, or where extremum problems in the sense of Tikhonov and Hadamard are ill-posed, and other situations. A formal application of classical optimisation methods in such cases either leads to wrong results or has no effect. The detailed analysis of these examples should provide a better understanding of the modern theory of optimal control and the practical difficulties of solving extremum problems.
Professor Xunjing Li (1935–2003) was a pioneer in control theory in China. He was influential in the Chinese community of applied mathematics, and the global community of optimal control theory of distributed parameter systems. He has made very important contributions to the optimal control theory of distributed parameter systems, in particular regarding the first-order necessary conditions (Pontryagin-type maximum principle) for optimal control of nonlinear infinite-dimensional systems. This proceedings volume is a collection of original research papers or reviews authored or co-authored by Professor Li's former students, postdoctoral fellows, and mentored scholars in the areas of control theory, dynamic systems, mathematical finance, and stochastic analysis, among others. These articles show in some degree the influence of Professor Xunjing Li.
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents the results in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, it precisely identifies, for the first time, the interconnections between three well-known, relevant issues – the existence of optimal controls, solvability of the optimality system, and solvability of the associated Riccati equation. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
This new 4th edition offers an introduction to optimal control theory and its diverse applications in management science and economics. It introduces students to the concept of the maximum principle in continuous (as well as discrete) time by combining dynamic programming and Kuhn-Tucker theory. While some mathematical background is needed, the emphasis of the book is not on mathematical rigor, but on modeling realistic situations encountered in business and economics. It applies optimal control theory to the functional areas of management including finance, production and marketing, as well as the economics of growth and of natural resources. In addition, it features material on stochastic Nash and Stackelberg differential games and an adverse selection model in the principal-agent framework. Exercises are included in each chapter, while the answers to selected exercises help deepen readers’ understanding of the material covered. Also included are appendices of supplementary material on the solution of differential equations, the calculus of variations and its ties to the maximum principle, and special topics including the Kalman filter, certainty equivalence, singular control, a global saddle point theorem, Sethi-Skiba points, and distributed parameter systems. Optimal control methods are used to determine optimal ways to control a dynamic system. The theoretical work in this field serves as the foundation for the book, in which the author applies it to business management problems developed from his own research and classroom instruction. The new edition has been refined and updated, making it a valuable resource for graduate courses on applied optimal control theory, but also for financial and industrial engineers, economists, and operational researchers interested in applying dynamic optimization in their fields.
From economics and business to the biological sciences to physics and engineering, professionals successfully use the powerful mathematical tool of optimal control to make management and strategy decisions. Optimal Control Applied to Biological Models thoroughly develops the mathematical aspects of optimal control theory and provides insight into the application of this theory to biological models. Focusing on mathematical concepts, the book first examines the most basic problem for continuous time ordinary differential equations (ODEs) before discussing more complicated problems, such as variations of the initial conditions, imposed bounds on the control, multiple states and controls, linear dependence on the control, and free terminal time. In addition, the authors introduce the optimal control of discrete systems and of partial differential equations (PDEs). Featuring a user-friendly interface, the book contains fourteen interactive sections of various applications, including immunology and epidemic disease models, management decisions in harvesting, and resource allocation models. It also develops the underlying numerical methods of the applications and includes the MATLAB® codes on which the applications are based. Requiring only basic knowledge of multivariable calculus, simple ODEs, and mathematical models, this text shows how to adjust controls in biological systems in order to achieve proper outcomes.
This textbook offers a concise yet rigorous introduction to calculus of variations and optimal control theory, and is a self-contained resource for graduate students in engineering, applied mathematics, and related subjects. Designed specifically for a one-semester course, the book begins with calculus of variations, preparing the ground for optimal control. It then gives a complete proof of the maximum principle and covers key topics such as the Hamilton-Jacobi-Bellman theory of dynamic programming and linear-quadratic optimal control. Calculus of Variations and Optimal Control Theory also traces the historical development of the subject and features numerous exercises, notes and references at the end of each chapter, and suggestions for further study. Offers a concise yet rigorous introduction Requires limited background in control theory or advanced mathematics Provides a complete proof of the maximum principle Uses consistent notation in the exposition of classical and modern topics Traces the historical development of the subject Solutions manual (available only to teachers) Leading universities that have adopted this book include: University of Illinois at Urbana-Champaign ECE 553: Optimum Control Systems Georgia Institute of Technology ECE 6553: Optimal Control and Optimization University of Pennsylvania ESE 680: Optimal Control Theory University of Notre Dame EE 60565: Optimal Control
Xunjing Li (1935-2003) was a pioneer in control theory in China. He was known in the Chinese community of applied mathematics, and in the global community of optimal control theory of distributed parameter systems. He has made important contributions to the optimal control theory of distributed parameter systems, in particular regarding the first-order necessary conditions (Pontryagin-type maximum principle) for optimal control of nonlinear infinite-dimensional systems. He directed the Seminar of Control Theory at Fudan towards stochastic control theory in 1980s, and mathematical finance in 1990s, which has led to several important subsequent developments in both closely interactive fields. These remarkable efforts in scientific research and education, among others, gave birth to the so-called “Fudan School”.This proceedings volume includes a collection of original research papers or reviews authored or co-authored by Xunjing Li's former students, postdoctoral fellows, and mentored scholars in the areas of control theory, dynamic systems, mathematical finance, and stochastic analysis, among others.
The sequential quadratic hamiltonian (SQH) method is a novel numerical optimization procedure for solving optimal control problems governed by differential models. It is based on the characterisation of optimal controls in the framework of the Pontryagin maximum principle (PMP). The SQH method is a powerful computational methodology that is capable of development in many directions. The Sequential Quadratic Hamiltonian Method: Solving Optimal Control Problems discusses its analysis and use in solving nonsmooth ODE control problems, relaxed ODE control problems, stochastic control problems, mixed-integer control problems, PDE control problems, inverse PDE problems, differential Nash game problems, and problems related to residual neural networks. This book may serve as a textbook for undergraduate and graduate students, and as an introduction for researchers in sciences and engineering who intend to further develop the SQH method or wish to use it as a numerical tool for solving challenging optimal control problems and for investigating the Pontryagin maximum principle on new optimisation problems. Features Provides insight into mathematical and computational issues concerning optimal control problems, while discussing many differential models of interest in different disciplines. Suitable for undergraduate and graduate students and as an introduction for researchers in sciences and engineering. Accompanied by codes which allow the reader to apply the SQH method to solve many different optimal control and optimisation problems.
Optimization: 100 Examples is a book devoted to the analysis of scenarios for which the use of well-known optimization methods encounter certain difficulties. Analysing such examples allows a deeper understanding of the features of these optimization methods, including the limits of their applicability. In this way, the book seeks to stimulate further development and understanding of the theory of optimal control. The study of the presented examples makes it possible to more effectively diagnose problems that arise in the practical solution of optimal control problems, and to find ways to overcome the difficulties that have arisen. Features Vast collection of examples Simple. accessible presentation Suitable as a research reference for anyone with an interest in optimization and optimal control theory, including mathematicians and engineers Examples differ in properties, i.e. each effect for each class of problems is illustrated by a unique example. Simon Serovajsky is a professor of mathematics at Al-Farabi Kazakh National University in Kazakhstan. He is the author of many books published in the area of optimization and optimal control theory, mathematical physics, mathematical modelling, philosophy and history of mathematics as well as a long list of high-quality publications in learned journals.
