Primal-Dual Path-Following Methods For Nonlinear Programming

Primal-Dual Path-Following Methods For Nonlinear Programming

Author: Fangyao Su

Publisher:

Published: 2019

Total Pages: 141

ISBN-13:

DOWNLOAD EBOOK

The main goal of this dissertation is to study the formulation and analysis of primal-dual path-following methods for nonlinear programming (NLP), which involves the minimization or maximization of a nonlinear objective function subject to constraints on the variables. Two important types of nonlinear program are problems with nonlinear equality constraints and problems with nonlinear inequality constraints. In this dissertation, two new methods are proposed for nonlinear programming. The first is a new primal-dual path-following augmented Lagrangian method (PDAL) for solving a nonlinear program with equality constraints only. The second is a new primal-dual path-following shifted penalty-barrier method (PDPB) for solving a nonlinear program with a mixture of equality and inequality constraints. The method of PDPB may be regarded as an extension of PDAL to handle nonlinear inequality constraints. Algorithms PDAL and PDPB are iterative methods that share the same "two-level" structure involving outer and inner iterations. In the outer iteration of PDAL, the optimality conditions are perturbed to define a "path-following trajectory" parameterized by a set of Lagrange multiplier estimates and a penalty parameter. The iterates are constructed to closely follow the trajectory towards a constrained local minimizer of the nonlinear program. If an outer iterate deviates significantly from the trajectory, then an inner iteration is invoked in which a primal-dual augmented Lagrangian merit function is minimized to force the iterates back to a neighborhood of the trajectory. A similar approach is used to handle the inequality constraints in PDPB. In this case, the trajectory is followed towards a local solution of the mixed-constraint nonlinear program. This trajectory is parameterized by a set of Lagrange multiplier estimates and penalty and barrier parameters associated with the equality and inequality constraints. If an iterate moves away from the trajectory, a primal-dual shifted penalty-barrier merit function is minimized using a trust-region method. By introducing slack variables, global convergence can be achieved from any starting point without the need for an initial strictly feasible point. Furthermore, numerical experiments indicate that when minimizing the shifted barrier function, the trust-region method requires fewer matrix factorizations and iterations than a comparable line-search method.


Introduction to Methods for Nonlinear Optimization

Introduction to Methods for Nonlinear Optimization

Author: Luigi Grippo

Publisher: Springer Nature

Published: 2023-05-27

Total Pages: 721

ISBN-13: 3031267907

DOWNLOAD EBOOK

This book has two main objectives: • to provide a concise introduction to nonlinear optimization methods, which can be used as a textbook at a graduate or upper undergraduate level; • to collect and organize selected important topics on optimization algorithms, not easily found in textbooks, which can provide material for advanced courses or can serve as a reference text for self-study and research. The basic material on unconstrained and constrained optimization is organized into two blocks of chapters: • basic theory and optimality conditions • unconstrained and constrained algorithms. These topics are treated in short chapters that contain the most important results in theory and algorithms, in a way that, in the authors’ experience, is suitable for introductory courses. A third block of chapters addresses methods that are of increasing interest for solving difficult optimization problems. Difficulty can be typically due to the high nonlinearity of the objective function, ill-conditioning of the Hessian matrix, lack of information on first-order derivatives, the need to solve large-scale problems. In the book various key subjects are addressed, including: exact penalty functions and exact augmented Lagrangian functions, non monotone methods, decomposition algorithms, derivative free methods for nonlinear equations and optimization problems. The appendices at the end of the book offer a review of the essential mathematical background, including an introduction to convex analysis that can make part of an introductory course.


Nonlinear Programming

Nonlinear Programming

Author: Anthony V. Fiacco

Publisher: SIAM

Published: 1990-01-01

Total Pages: 226

ISBN-13: 9781611971316

DOWNLOAD EBOOK

Recent interest in interior point methods generated by Karmarkar's Projective Scaling Algorithm has created a new demand for this book because the methods that have followed from Karmarkar's bear a close resemblance to those described. There is no other source for the theoretical background of the logarithmic barrier function and other classical penalty functions. Analyzes in detail the "central" or "dual" trajectory used by modern path following and primal/dual methods for convex and general linear programming. As researchers begin to extend these methods to convex and general nonlinear programming problems, this book will become indispensable to them.


Advances in Nonlinear Programming

Advances in Nonlinear Programming

Author: Ya-xiang Yuan

Publisher: Springer Science & Business Media

Published: 2013-12-01

Total Pages: 353

ISBN-13: 1461333350

DOWNLOAD EBOOK

About 60 scientists and students attended the 96' International Conference on Nonlinear Programming, which was held September 2-5 at Institute of Compu tational Mathematics and Scientific/Engineering Computing (ICMSEC), Chi nese Academy of Sciences, Beijing, China. 25 participants were from outside China and 35 from China. The conference was to celebrate the 60's birthday of Professor M.J.D. Powell (Fellow of Royal Society, University of Cambridge) for his many contributions to nonlinear optimization. On behalf of the Chinese Academy of Sciences, vice president Professor Zhi hong Xu attended the opening ceremony of the conference to express his warm welcome to all the participants. After the opening ceremony, Professor M.J.D. Powell gave the keynote lecture "The use of band matrices for second derivative approximations in trust region methods". 13 other invited lectures on recent advances of nonlinear programming were given during the four day meeting: "Primal-dual methods for nonconvex optimization" by M. H. Wright (SIAM President, Bell Labs), "Interior point trajectories in semidefinite programming" by D. Goldfarb (Columbia University, Editor-in-Chief for Series A of Mathe matical Programming), "An approach to derivative free optimization" by A.


Nonlinear Optimization

Nonlinear Optimization

Author: Francisco J. Aragón

Publisher: Springer

Published: 2019-02-27

Total Pages: 350

ISBN-13: 3030111849

DOWNLOAD EBOOK

This textbook on nonlinear optimization focuses on model building, real world problems, and applications of optimization models to natural and social sciences. Organized into two parts, this book may be used as a primary text for courses on convex optimization and non-convex optimization. Definitions, proofs, and numerical methods are well illustrated and all chapters contain compelling exercises. The exercises emphasize fundamental theoretical results on optimality and duality theorems, numerical methods with or without constraints, and derivative-free optimization. Selected solutions are given. Applications to theoretical results and numerical methods are highlighted to help students comprehend methods and techniques.


Nonlinear Optimization

Nonlinear Optimization

Author: H. A. Eiselt

Publisher: Springer Nature

Published: 2019-11-09

Total Pages: 366

ISBN-13: 3030194620

DOWNLOAD EBOOK

This book provides a comprehensive introduction to nonlinear programming, featuring a broad range of applications and solution methods in the field of continuous optimization. It begins with a summary of classical results on unconstrained optimization, followed by a wealth of applications from a diverse mix of fields, e.g. location analysis, traffic planning, and water quality management, to name but a few. In turn, the book presents a formal description of optimality conditions, followed by an in-depth discussion of the main solution techniques. Each method is formally described, and then fully solved using a numerical example.


Linear and Nonlinear Optimization

Linear and Nonlinear Optimization

Author: Igor Griva

Publisher: SIAM

Published: 2009-01-01

Total Pages: 743

ISBN-13: 0898717736

DOWNLOAD EBOOK

Provides an introduction to the applications, theory, and algorithms of linear and nonlinear optimization. The emphasis is on practical aspects - discussing modern algorithms, as well as the influence of theory on the interpretation of solutions or on the design of software. The book includes several examples of realistic optimization models that address important applications. The succinct style of this second edition is punctuated with numerous real-life examples and exercises, and the authors include accessible explanations of topics that are not often mentioned in textbooks, such as duality in nonlinear optimization, primal-dual methods for nonlinear optimization, filter methods, and applications such as support-vector machines. The book is designed to be flexible. It has a modular structure, and uses consistent notation and terminology throughout. It can be used in many different ways, in many different courses, and at many different levels of sophistication.


Modern Robotics

Modern Robotics

Author: Kevin M. Lynch

Publisher: Cambridge University Press

Published: 2017-05-25

Total Pages: 545

ISBN-13: 1107156300

DOWNLOAD EBOOK

A modern and unified treatment of the mechanics, planning, and control of robots, suitable for a first course in robotics.


Acta Numerica 2008: Volume 17

Acta Numerica 2008: Volume 17

Author: A. Iserles

Publisher: Cambridge University Press

Published: 2008-06-12

Total Pages: 424

ISBN-13: 9780521516426

DOWNLOAD EBOOK

A high-impact, prestigious annual publication containing invited surveys by subject leaders: essential reading for all practitioners and researchers.


Interior-point Polynomial Algorithms in Convex Programming

Interior-point Polynomial Algorithms in Convex Programming

Author: Yurii Nesterov

Publisher: SIAM

Published: 1994-01-01

Total Pages: 414

ISBN-13: 9781611970791

DOWNLOAD EBOOK

Specialists working in the areas of optimization, mathematical programming, or control theory will find this book invaluable for studying interior-point methods for linear and quadratic programming, polynomial-time methods for nonlinear convex programming, and efficient computational methods for control problems and variational inequalities. A background in linear algebra and mathematical programming is necessary to understand the book. The detailed proofs and lack of "numerical examples" might suggest that the book is of limited value to the reader interested in the practical aspects of convex optimization, but nothing could be further from the truth. An entire chapter is devoted to potential reduction methods precisely because of their great efficiency in practice.