Derivative-Free and Blackbox Optimization
Derivative-Free and Blackbox Optimization

Author: Charles Audet

Publisher: Springer

Published: 2017-12-02

Total Pages: 307

ISBN-13: 3319689134

DOWNLOAD EBOOK

This book is designed as a textbook, suitable for self-learning or for teaching an upper-year university course on derivative-free and blackbox optimization. The book is split into 5 parts and is designed to be modular; any individual part depends only on the material in Part I. Part I of the book discusses what is meant by Derivative-Free and Blackbox Optimization, provides background material, and early basics while Part II focuses on heuristic methods (Genetic Algorithms and Nelder-Mead). Part III presents direct search methods (Generalized Pattern Search and Mesh Adaptive Direct Search) and Part IV focuses on model-based methods (Simplex Gradient and Trust Region). Part V discusses dealing with constraints, using surrogates, and bi-objective optimization. End of chapter exercises are included throughout as well as 15 end of chapter projects and over 40 figures. Benchmarking techniques are also presented in the appendix.

Introduction to Derivative-Free Optimization
Introduction to Derivative-Free Optimization

Author: Andrew R. Conn

Publisher: SIAM

Published: 2009-04-16

Total Pages: 276

ISBN-13: 0898716683

DOWNLOAD EBOOK

The first contemporary comprehensive treatment of optimization without derivatives. This text explains how sampling and model techniques are used in derivative-free methods and how they are designed to solve optimization problems. It is designed to be readily accessible to both researchers and those with a modest background in computational mathematics.

Computational Optimization, Methods and Algorithms
Computational Optimization, Methods and Algorithms

Author: Slawomir Koziel

Publisher: Springer

Published: 2011-06-17

Total Pages: 292

ISBN-13: 3642208592

DOWNLOAD EBOOK

Computational optimization is an important paradigm with a wide range of applications. In virtually all branches of engineering and industry, we almost always try to optimize something - whether to minimize the cost and energy consumption, or to maximize profits, outputs, performance and efficiency. In many cases, this search for optimality is challenging, either because of the high computational cost of evaluating objectives and constraints, or because of the nonlinearity, multimodality, discontinuity and uncertainty of the problem functions in the real-world systems. Another complication is that most problems are often NP-hard, that is, the solution time for finding the optimum increases exponentially with the problem size. The development of efficient algorithms and specialized techniques that address these difficulties is of primary importance for contemporary engineering, science and industry. This book consists of 12 self-contained chapters, contributed from worldwide experts who are working in these exciting areas. The book strives to review and discuss the latest developments concerning optimization and modelling with a focus on methods and algorithms for computational optimization. It also covers well-chosen, real-world applications in science, engineering and industry. Main topics include derivative-free optimization, multi-objective evolutionary algorithms, surrogate-based methods, maximum simulated likelihood estimation, support vector machines, and metaheuristic algorithms. Application case studies include aerodynamic shape optimization, microwave engineering, black-box optimization, classification, economics, inventory optimization and structural optimization. This graduate level book can serve as an excellent reference for lecturers, researchers and students in computational science, engineering and industry.

Implicit Filtering
Implicit Filtering

Author: C. T. Kelley

Publisher: SIAM

Published: 2011-09-29

Total Pages: 171

ISBN-13: 1611971896

DOWNLOAD EBOOK

A description of the implicit filtering algorithm, its convergence theory and a new MATLAB® implementation.

Algorithms for Optimization
Algorithms for Optimization

Author: Mykel J. Kochenderfer

Publisher: MIT Press

Published: 2019-03-12

Total Pages: 521

ISBN-13: 0262039427

DOWNLOAD EBOOK

A comprehensive introduction to optimization with a focus on practical algorithms for the design of engineering systems. This book offers a comprehensive introduction to optimization with a focus on practical algorithms. The book approaches optimization from an engineering perspective, where the objective is to design a system that optimizes a set of metrics subject to constraints. Readers will learn about computational approaches for a range of challenges, including searching high-dimensional spaces, handling problems where there are multiple competing objectives, and accommodating uncertainty in the metrics. Figures, examples, and exercises convey the intuition behind the mathematical approaches. The text provides concrete implementations in the Julia programming language. Topics covered include derivatives and their generalization to multiple dimensions; local descent and first- and second-order methods that inform local descent; stochastic methods, which introduce randomness into the optimization process; linear constrained optimization, when both the objective function and the constraints are linear; surrogate models, probabilistic surrogate models, and using probabilistic surrogate models to guide optimization; optimization under uncertainty; uncertainty propagation; expression optimization; and multidisciplinary design optimization. Appendixes offer an introduction to the Julia language, test functions for evaluating algorithm performance, and mathematical concepts used in the derivation and analysis of the optimization methods discussed in the text. The book can be used by advanced undergraduates and graduate students in mathematics, statistics, computer science, any engineering field, (including electrical engineering and aerospace engineering), and operations research, and as a reference for professionals.

Iterative Methods for Optimization
Iterative Methods for Optimization

Author: C. T. Kelley

Publisher: SIAM

Published: 1999-01-01

Total Pages: 195

ISBN-13: 9781611970920

DOWNLOAD EBOOK

This book presents a carefully selected group of methods for unconstrained and bound constrained optimization problems and analyzes them in depth both theoretically and algorithmically. It focuses on clarity in algorithmic description and analysis rather than generality, and while it provides pointers to the literature for the most general theoretical results and robust software, the author thinks it is more important that readers have a complete understanding of special cases that convey essential ideas. A companion to Kelley's book, Iterative Methods for Linear and Nonlinear Equations (SIAM, 1995), this book contains many exercises and examples and can be used as a text, a tutorial for self-study, or a reference. Iterative Methods for Optimization does more than cover traditional gradient-based optimization: it is the first book to treat sampling methods, including the Hooke-Jeeves, implicit filtering, MDS, and Nelder-Mead schemes in a unified way, and also the first book to make connections between sampling methods and the traditional gradient-methods. Each of the main algorithms in the text is described in pseudocode, and a collection of MATLAB codes is available. Thus, readers can experiment with the algorithms in an easy way as well as implement them in other languages.

Deterministic Global Optimization
Deterministic Global Optimization

Author: Yaroslav D. Sergeyev

Publisher: Springer

Published: 2017-06-16

Total Pages: 143

ISBN-13: 1493971999

DOWNLOAD EBOOK

This book begins with a concentrated introduction into deterministic global optimization and moves forward to present new original results from the authors who are well known experts in the field. Multiextremal continuous problems that have an unknown structure with Lipschitz objective functions and functions having the first Lipschitz derivatives defined over hyperintervals are examined. A class of algorithms using several Lipschitz constants is introduced which has its origins in the DIRECT (DIviding RECTangles) method. This new class is based on an efficient strategy that is applied for the search domain partitioning. In addition a survey on derivative free methods and methods using the first derivatives is given for both one-dimensional and multi-dimensional cases. Non-smooth and smooth minorants and acceleration techniques that can speed up several classes of global optimization methods with examples of applications and problems arising in numerical testing of global optimization algorithms are discussed. Theoretical considerations are illustrated through engineering applications. Extensive numerical testing of algorithms described in this book stretches the likelihood of establishing a link between mathematicians and practitioners. The authors conclude by describing applications and a generator of random classes of test functions with known local and global minima that is used in more than 40 countries of the world. This title serves as a starting point for students, researchers, engineers, and other professionals in operations research, management science, computer science, engineering, economics, environmental sciences, industrial and applied mathematics to obtain an overview of deterministic global optimization.

Real-Time Optimization
Real-Time Optimization

Author: Dominique Bonvin

Publisher: MDPI

Published: 2018-07-05

Total Pages: 255

ISBN-13: 303842448X

DOWNLOAD EBOOK

This book is a printed edition of the Special Issue "Real-Time Optimization" that was published in Processes

Convex Optimization
Convex Optimization

Author: Stephen P. Boyd

Publisher: Cambridge University Press

Published: 2004-03-08

Total Pages: 744

ISBN-13: 9780521833783

DOWNLOAD EBOOK

Convex optimization problems arise frequently in many different fields. This book provides a comprehensive introduction to the subject, and shows in detail how such problems can be solved numerically with great efficiency. The book begins with the basic elements of convex sets and functions, and then describes various classes of convex optimization problems. Duality and approximation techniques are then covered, as are statistical estimation techniques. Various geometrical problems are then presented, and there is detailed discussion of unconstrained and constrained minimization problems, and interior-point methods. The focus of the book is on recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples and homework exercises and will appeal to students, researchers and practitioners in fields such as engineering, computer science, mathematics, statistics, finance and economics.

Advances and Trends in Optimization with Engineering Applications
Advances and Trends in Optimization with Engineering Applications

Author: Tamas Terlaky

Publisher: SIAM

Published: 2017-04-26

Total Pages: 730

ISBN-13: 1611974674

DOWNLOAD EBOOK

Optimization is of critical importance in engineering. Engineers constantly strive for the best possible solutions, the most economical use of limited resources, and the greatest efficiency. As system complexity increases, these goals mandate the use of state-of-the-art optimization techniques. In recent years, the theory and methodology of optimization have seen revolutionary improvements. Moreover, the exponential growth in computational power, along with the availability of multicore computing with virtually unlimited memory and storage capacity, has fundamentally changed what engineers can do to optimize their designs. This is a two-way process: engineers benefit from developments in optimization methodology, and challenging new classes of optimization problems arise from novel engineering applications. Advances and Trends in Optimization with Engineering Applications reviews 10 major areas of optimization and related engineering applications, providing a broad summary of state-of-the-art optimization techniques most important to engineering practice. Each part provides a clear overview of a specific area and discusses a range of real-world problems. The book provides a solid foundation for engineers and mathematical optimizers alike who want to understand the importance of optimization methods to engineering and the capabilities of these methods.