Topological and functional analytic preliminaries -- Differential calculus -- Convexity -- Optimality conditions for differentiable optimization -- Problems depending on a parameter -- Convex duality and applications -- Iterative methods for convex minimization -- When optimization and data meet -- An invitation to the calculus of variations.
The quest for the optimal is ubiquitous in nature and human behavior. The field of mathematical optimization has a long history and remains active today, particularly in the development of machine learning.Classical and Modern Optimization presents a self-contained overview of classical and modern ideas and methods in approaching optimization problems. The approach is rich and flexible enough to address smooth and non-smooth, convex and non-convex, finite or infinite-dimensional, static or dynamic situations. The first chapters of the book are devoted to the classical toolbox: topology and functional analysis, differential calculus, convex analysis and necessary conditions for differentiable constrained optimization. The remaining chapters are dedicated to more specialized topics and applications.Valuable to a wide audience, including students in mathematics, engineers, data scientists or economists, Classical and Modern Optimization contains more than 200 exercises to assist with self-study or for anyone teaching a third- or fourth-year optimization class.
Optimization problems were and still are the focus of mathematics from antiquity to the present. Since the beginning of our civilization, the human race has had to confront numerous technological challenges, such as finding the optimal solution of various problems including control technologies, power sources construction, applications in economy, mechanical engineering and energy distribution amongst others. These examples encompass both ancient as well as modern technologies like the first electrical energy distribution network in USA etc. Some of the key principles formulated in the middle ages were done by Johannes Kepler (Problem of the wine barrels), Johan Bernoulli (brachystochrone problem), Leonhard Euler (Calculus of Variations), Lagrange (Principle multipliers), that were formulated primarily in the ancient world and are of a geometric nature. In the beginning of the modern era, works of L.V. Kantorovich and G.B. Dantzig (so-called linear programming) can be considered amongst others. This book discusses a wide spectrum of optimization methods from classical to modern, alike heuristics. Novel as well as classical techniques is also discussed in this book, including its mutual intersection. Together with many interesting chapters, a reader will also encounter various methods used for proposed optimization approaches, such as game theory and evolutionary algorithms or modelling of evolutionary algorithm dynamics like complex networks.
Broad-spectrum approach to important topic. Explores the classic theory of minima and maxima, classical calculus of variations, simplex technique and linear programming, optimality and dynamic programming, more. 1969 edition.
Achieving a better solution or improving the performance of existing system design is an ongoing a process for which scientists, engineers, mathematicians and researchers have been striving for many years. Ever increasingly practical and robust methods have been developed, and every new generation of computers with their increased power and speed allows for the development and wider application of new types of solutions. This book defines the fundamentals, background and theoretical concepts of optimization principles in a comprehensive manner along with their potential applications and implementation strategies. It encompasses linear programming, multivariable methods for risk assessment, nonlinear methods, ant colony optimization, particle swarm optimization, multi-criterion and topology optimization, learning classifier, case studies on six sigma, performance measures and evaluation, multi-objective optimization problems, machine learning approaches, genetic algorithms and quality of service optimizations. The book will be very useful for wide spectrum of target readers including students and researchers in academia and industry.
Classical and Recent Aspects of Power System Optimization presents conventional and meta-heuristic optimization methods and algorithms for power system studies. The classic aspects of optimization in power systems, such as optimal power flow, economic dispatch, unit commitment and power quality optimization are covered, as are issues relating to distributed generation sizing, allocation problems, scheduling of renewable resources, energy storage, power reserve based problems, efficient use of smart grid capabilities, and protection studies in modern power systems. The book brings together innovative research outcomes, programs, algorithms and approaches that consolidate the present state and future challenges for power. Analyzes and compares several aspects of optimization for power systems which has never been addressed in one reference Details real-life industry application examples for each chapter (e.g. energy storage and power reserve problems) Provides practical training on theoretical developments and application of advanced methods for optimum electrical energy for realistic engineering problems
The goal of this book is to gather in a single work the most relevant concepts related in optimization methods, showing how such theories and methods can be addressed using the open source, multi-platform R tool. Modern optimization methods, also known as metaheuristics, are particularly useful for solving complex problems for which no specialized optimization algorithm has been developed. These methods often yield high quality solutions with a more reasonable use of computational resources (e.g. memory and processing effort). Examples of popular modern methods discussed in this book are: simulated annealing; tabu search; genetic algorithms; differential evolution; and particle swarm optimization. This book is suitable for undergraduate and graduate students in computer science, information technology, and related areas, as well as data analysts interested in exploring modern optimization methods using R. This new edition integrates the latest R packages through text and code examples. It also discusses new topics, such as: the impact of artificial intelligence and business analytics in modern optimization tasks; the creation of interactive Web applications; usage of parallel computing; and more modern optimization algorithms (e.g., iterated racing, ant colony optimization, grammatical evolution).
This self-contained textbook is an informal introduction to optimization through the use of numerous illustrations and applications. The focus is on analytically solving optimization problems with a finite number of continuous variables. In addition, the authors provide introductions to classical and modern numerical methods of optimization and to dynamic optimization. The book's overarching point is that most problems may be solved by the direct application of the theorems of Fermat, Lagrange, and Weierstrass. The authors show how the intuition for each of the theoretical results can be supported by simple geometric figures. They include numerous applications through the use of varied classical and practical problems. Even experts may find some of these applications truly surprising. A basic mathematical knowledge is sufficient to understand the topics covered in this book. More advanced readers, even experts, will be surprised to see how all main results can be grounded on the Fermat-Lagrange theorem. The book can be used for courses on continuous optimization, from introductory to advanced, for any field for which optimization is relevant.
"This monograph serves present and future needs where nonconvexity and nondifferentiability are inevitably present in the faithful modeling of real-world applications of optimization"--
