A Sequential Quadratic Programming Algorithm for Solving Large, Sparse Nonlinear Programs
A Sequential Quadratic Programming Algorithm for Solving Large, Sparse Nonlinear Programs

Author: Ronald Harlan Nickel

Publisher:

Published: 1984

Total Pages: 180

ISBN-13:

DOWNLOAD EBOOK

This document describes the structure and theory for a sequential quadratic programming algorithm for solving large, sparse nonlinear optimization problems. Also provided are the details of a computer implementation of the algorithm, along with test results. The algorithm is based on Han's sequential quadratic programming method. It maintains a sparse approximation to the Cholesky factor of the Hessian of the Lagrangian and stores all gradients in a sparse format. The solution to the quadratic program generated at each step is obtained by solving the dual quadratic program using a projected conjugate gradient algorithm. Sine only active constraints are considered in forming the dual, the dual problem will normally be much smaller than the primal quadratic program and, hence, much easier to solve. An updating procedure is employed that does not destroy sparsity. Several test problems, ranging in size from 5 to 60 variables were solved with the algorithm. These results indicate that the algorithm has the potential to solve large, sparse nonlinear programs. The algorithm is especially attractive for solving problems having nonlinear constraints. (Author).

Optimal Quadratic Programming Algorithms
Optimal Quadratic Programming Algorithms

Author: Zdenek Dostál

Publisher: Springer Science & Business Media

Published: 2009-04-03

Total Pages: 293

ISBN-13: 0387848061

DOWNLOAD EBOOK

Quadratic programming (QP) is one advanced mathematical technique that allows for the optimization of a quadratic function in several variables in the presence of linear constraints. This book presents recently developed algorithms for solving large QP problems and focuses on algorithms which are, in a sense optimal, i.e., they can solve important classes of problems at a cost proportional to the number of unknowns. For each algorithm presented, the book details its classical predecessor, describes its drawbacks, introduces modifications that improve its performance, and demonstrates these improvements through numerical experiments. This self-contained monograph can serve as an introductory text on quadratic programming for graduate students and researchers. Additionally, since the solution of many nonlinear problems can be reduced to the solution of a sequence of QP problems, it can also be used as a convenient introduction to nonlinear programming.

Large-scale Sequential Quadratic Programming Algorithms
Large-scale Sequential Quadratic Programming Algorithms

Author:

Publisher:

Published: 1992

Total Pages: 91

ISBN-13:

DOWNLOAD EBOOK

The problem addressed is the general nonlinear programming problem: finding a local minimizer for a nonlinear function subject to a mixture of nonlinear equality and inequality constraints. The methods studied are in the class of sequential quadratic programming (SQP) algorithms, which have previously proved successful for problems of moderate size. Our goal is to devise an SQP algorithm that is applicable to large-scale optimization problems, using sparse data structures and storing less curvature information but maintaining the property of superlinear convergence. The main features are: 1. The use of a quasi-Newton approximation to the reduced Hessian of the Lagrangian function. Only an estimate of the reduced Hessian matrix is required by our algorithm. The impact of not having available the full Hessian approximation is studied and alternative estimates are constructed. 2. The use of a transformation matrix Q. This allows the QP gradient to be computed easily when only the reduced Hessian approximation is maintained. 3. The use of a reduced-gradient form of the basis for the null space of the working set. This choice of basis is more practical than an orthogonal null-space basis for large-scale problems. The continuity condition for this choice is proven. 4. The use of incomplete solutions of quadratic programming subproblems. Certain iterates generated by an active-set method for the QP subproblem are used in place of the QP minimizer to define the search direction for the nonlinear problem. An implementation of the new algorithm has been obtained by modifying the code MINOS. Results and comparisons with MINOS and NPSOL are given for the new algorithm on a set of 92 test problems.

Mixed Integer Nonlinear Programming
Mixed Integer Nonlinear Programming

Author: Jon Lee

Publisher: Springer Science & Business Media

Published: 2011-12-02

Total Pages: 687

ISBN-13: 1461419271

DOWNLOAD EBOOK

Many engineering, operations, and scientific applications include a mixture of discrete and continuous decision variables and nonlinear relationships involving the decision variables that have a pronounced effect on the set of feasible and optimal solutions. Mixed-integer nonlinear programming (MINLP) problems combine the numerical difficulties of handling nonlinear functions with the challenge of optimizing in the context of nonconvex functions and discrete variables. MINLP is one of the most flexible modeling paradigms available for optimization; but because its scope is so broad, in the most general cases it is hopelessly intractable. Nonetheless, an expanding body of researchers and practitioners — including chemical engineers, operations researchers, industrial engineers, mechanical engineers, economists, statisticians, computer scientists, operations managers, and mathematical programmers — are interested in solving large-scale MINLP instances.

ICIAM 91
ICIAM 91

Author: Robert E. O'Malley

Publisher: SIAM

Published: 1992-01-01

Total Pages: 424

ISBN-13: 9780898713022

DOWNLOAD EBOOK

Proceedings -- Computer Arithmetic, Algebra, OOP.

Optimal Quadratic Programming Algorithms
Optimal Quadratic Programming Algorithms

Author: Zdenek Dostál

Publisher: Springer

Published: 2008-11-01

Total Pages: 0

ISBN-13: 9780387571447

DOWNLOAD EBOOK

Quadratic programming (QP) is one advanced mathematical technique that allows for the optimization of a quadratic function in several variables in the presence of linear constraints. This book presents recently developed algorithms for solving large QP problems and focuses on algorithms which are, in a sense optimal, i.e., they can solve important classes of problems at a cost proportional to the number of unknowns. For each algorithm presented, the book details its classical predecessor, describes its drawbacks, introduces modifications that improve its performance, and demonstrates these improvements through numerical experiments. This self-contained monograph can serve as an introductory text on quadratic programming for graduate students and researchers. Additionally, since the solution of many nonlinear problems can be reduced to the solution of a sequence of QP problems, it can also be used as a convenient introduction to nonlinear programming.

A Regularized Active-set Method for Sparse Convex Quadratic Programming
A Regularized Active-set Method for Sparse Convex Quadratic Programming

Author: Christopher Mario Maes

Publisher:

Published: 2010

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

An active-set algorithm is developed for solving convex quadratic programs (QPs). The algorithm employs primal regularization within a bound-constrained augmented Lagrangian method. This leads to a sequence of QP subproblems that are feasible and strictly convex, and whose KKT systems are guaranteed to be nonsingular for any active set. A simplified, single-phase algorithm becomes possible for each QP subproblem. There is no need to control the inertia of the KKT system defining each search direction, and a simple step-length procedure may be used without risk of cycling in the presence of degeneracy. Since all KKT systems are nonsingular, they can be factored with a variety of sparse direct linear solvers. Block-LU updates of the KKT factors allow for active-set changes. The principal benefit of primal and dual regularization is that warm starts are possible from any given active set. This is vital inside sequential quadratic programming (SQP) methods for nonlinear optimization, such as the SNOPT solver. The method provides a reliable approach to solving sparse generalized least-squares problems. Ordinary least-squares problems with Tikhonov regularization and bounds can be solved as a single QP subproblem. The algorithm is implemented as the QPBLUR solver (Matlab and Fortran 95 versions) and the Fortran version has been integrated into SNOPT. The performance of QPBLUR is evaluated on a test set of large convex QPs, and on the sequences of QPs arising from SNOPT's SQP method.