This book focuses on Augmented Lagrangian techniques for solving practical constrained optimization problems. The authors: rigorously delineate mathematical convergence theory based on sequential optimality conditions and novel constraint qualifications; orient the book to practitioners by giving priority to results that provide insight on the practical behavior of algorithms and by providing geometrical and algorithmic interpretations of every mathematical result; and fully describe a freely available computational package for constrained optimization and illustrate its usefulness with applications.
This book focuses on Augmented Lagrangian techniques for solving practical constrained optimization problems. The authors rigorously delineate mathematical convergence theory based on sequential optimality conditions and novel constraint qualifications. They also orient the book to practitioners by giving priority to results that provide insight on the practical behavior of algorithms and by providing geometrical and algorithmic interpretations of every mathematical result, and they fully describe a freely available computational package for constrained optimization and illustrate its usefulness with applications.
Computer Science and Applied Mathematics: Constrained Optimization and Lagrange Multiplier Methods focuses on the advancements in the applications of the Lagrange multiplier methods for constrained minimization. The publication first offers information on the method of multipliers for equality constrained problems and the method of multipliers for inequality constrained and nondifferentiable optimization problems. Discussions focus on approximation procedures for nondifferentiable and ill-conditioned optimization problems; asymptotically exact minimization in the methods of multipliers; duality framework for the method of multipliers; and the quadratic penalty function method. The text then examines exact penalty methods, including nondifferentiable exact penalty functions; linearization algorithms based on nondifferentiable exact penalty functions; differentiable exact penalty functions; and local and global convergence of Lagrangian methods. The book ponders on the nonquadratic penalty functions of convex programming. Topics include large scale separable integer programming problems and the exponential method of multipliers; classes of penalty functions and corresponding methods of multipliers; and convergence analysis of multiplier methods. The text is a valuable reference for mathematicians and researchers interested in the Lagrange multiplier methods.
Many of the most challenging problems in the applied sciences involve non-differentiable structures as well as partial differential operators, thus leading to non-smooth distributed parameter systems. This edited volume aims to establish a theoretical and numerical foundation and develop new algorithmic paradigms for the treatment of non-smooth phenomena and associated parameter influences. Other goals include the realization and further advancement of these concepts in the context of robust and hierarchical optimization, partial differential games, and nonlinear partial differential complementarity problems, as well as their validation in the context of complex applications. Areas for which applications are considered include optimal control of multiphase fluids and of superconductors, image processing, thermoforming, and the formation of rivers and networks. Chapters are written by leading researchers and present results obtained in the first funding phase of the DFG Special Priority Program on Nonsmooth and Complementarity Based Distributed Parameter Systems: Simulation and Hierarchical Optimization that ran from 2016 to 2019.
In the intervening years since this book was published in 1981, the field of optimization has been exceptionally lively. This fertility has involved not only progress in theory, but also faster numerical algorithms and extensions into unexpected or previously unknown areas such as semidefinite programming. Despite these changes, many of the important principles and much of the intuition can be found in this Classics version of Practical Optimization. This book provides model algorithms and pseudocode, useful tools for users who prefer to write their own code as well as for those who want to understand externally provided code. It presents algorithms in a step-by-step format, revealing the overall structure of the underlying procedures and thereby allowing a high-level perspective on the fundamental differences. And it contains a wealth of techniques and strategies that are well suited for optimization in the twenty-first century, and particularly in the now-flourishing fields of data science, big data, and machine learning. Practical Optimization is appropriate for advanced undergraduates, graduate students, and researchers interested in methods for solving optimization problems.
A popular way to assess the “effort” needed to solve a problem is to count how many evaluations of the problem functions (and their derivatives) are required. In many cases, this is often the dominating computational cost. Given an optimization problem satisfying reasonable assumptions—and given access to problem-function values and derivatives of various degrees—how many evaluations might be required to approximately solve the problem? Evaluation Complexity of Algorithms for Nonconvex Optimization: Theory, Computation, and Perspectives addresses this question for nonconvex optimization problems, those that may have local minimizers and appear most often in practice. This is the first book on complexity to cover topics such as composite and constrained optimization, derivative-free optimization, subproblem solution, and optimal (lower and sharpness) bounds for nonconvex problems. It is also the first to address the disadvantages of traditional optimality measures and propose useful surrogates leading to algorithms that compute approximate high-order critical points, and to compare traditional and new methods, highlighting the advantages of the latter from a complexity point of view. This is the go-to book for those interested in solving nonconvex optimization problems. It is suitable for advanced undergraduate and graduate students in courses on advanced numerical analysis, data science, numerical optimization, and approximation theory.
This book celebrates the 50th anniversary of the Institute of Mathematics, Statistics and Scientific Computing (IMECC) of the University of Campinas, Brazil, by offering reviews of selected research developed at one of the most prestigious mathematics institutes in Latin America. Written by senior professors at the IMECC, it covers topics in pure and applied mathematics and statistics ranging from differential geometry, dynamical systems, Lie groups, and partial differential equations to computational optimization, mathematical physics, stochastic process, time series, and more. A report on the challenges and opportunities of research in applied mathematics - a highly active field of research in the country - and highlights of the Institute since its foundation in 1968 completes this historical volume, which is unveiled in the same year that the International Mathematical Union (IMU) names Brazil as a member of the Group V of countries with the most relevant contributions in mathematics.
This book discusses the basic ideas, underlying principles, mathematical formulations, analysis and applications of the different combinatorial problems under uncertainty and attempts to provide solutions for the same. Uncertainty influences the behaviour of the market to a great extent. Global pandemics and calamities are other factors which affect and augment unpredictability in the market. The intent of this book is to develop mathematical structures for different aspects of allocation problems depicting real life scenarios. The novel methods which are incorporated in practical scenarios under uncertain circumstances include the STAR heuristic approach, Matrix geometric method, Ranking function and Pythagorean fuzzy numbers, to name a few. Distinct problems which are considered in this book under uncertainty include scheduling, cyclic bottleneck assignment problem, bilevel transportation problem, multi-index transportation problem, retrial queuing, uncertain matrix games, optimal production evaluation of cotton in different soil and water conditions, the healthcare sector, intuitionistic fuzzy quadratic programming problem, and multi-objective optimization problem. This book may serve as a valuable reference for researchers working in the domain of optimization for solving combinatorial problems under uncertainty. The contributions of this book may further help to explore new avenues leading toward multidisciplinary research discussions.
This book is a collection of papers presented at the conference “Forum Math-for-Industry 2014” for which the unifying theme was “Applications + Practical Conceptualization + Mathematics = fruitful Innovation” in October 2014. This epigram encapsulates the dynamics of the process that takes an application through to an innovation. Industrial mathematics can be viewed as the causal engine that implements the epigram by taking an Application such as input and convolving it with a mixture of Practical Conceptualization and Mathematics to generate a fruitful Innovation as output. The book illustrates various aspects of the two-way interaction between applications and their association highlighting how practical conceptualization assists with the linking of the question that encapsulates the current application to the relevant mathematics. The contents of this volume address productive and successful interaction between industry and mathematicians, as well as the cross-fertilization and collaboration that result when mathematics is involved with the advancement of science and technology.
