Introduction to Optimization and Hadamard Semidifferential Calculus, Second Edition
Introduction to Optimization and Hadamard Semidifferential Calculus, Second Edition

Author: Michel C. Delfour

Publisher: SIAM

Published: 2019-12-19

Total Pages: 446

ISBN-13: 1611975964

DOWNLOAD EBOOK

This second edition provides an enhanced exposition of the long-overlooked Hadamard semidifferential calculus, first introduced in the 1920s by mathematicians Jacques Hadamard and Maurice René Fréchet. Hadamard semidifferential calculus is possibly the largest family of nondifferentiable functions that retains all the features of classical differential calculus, including the chain rule, making it a natural framework for initiating a large audience of undergraduates and non-mathematicians into the world of nondifferentiable optimization. Introduction to Optimization and Hadamard Semidifferential Calculus, Second Edition builds upon its prior edition’s foundations in Hadamard semidifferential calculus, showcasing new material linked to convex analysis and nonsmooth optimization. It presents a modern treatment of optimization and Hadamard semidifferential calculus while remaining at a level that is accessible to undergraduate students, and challenges students with exercises related to problems in such fields as engineering, mechanics, medicine, physics, and economics. Answers are supplied in Appendix B. Students of mathematics, physics, engineering, economics, and other disciplines that demand a basic knowledge of mathematical analysis and linear algebra will find this a fitting primary or companion resource for their studies. This textbook has been designed and tested for a one-term course at the undergraduate level. In its full version, it is appropriate for a first-year graduate course and as a reference.

Introduction to Optimization and Semidifferential Calculus
Introduction to Optimization and Semidifferential Calculus

Author: Michel C. Delfour

Publisher: SIAM

Published: 2012-01-01

Total Pages: 363

ISBN-13: 9781611972153

DOWNLOAD EBOOK

This primarily undergraduate textbook focuses on finite-dimensional optimization. Readers will find: an original and well integrated treatment of semidifferential calculus and optimization; emphasis on the Hadamard subdifferential, introduced at the beginning of the 20th century and somewhat overlooked for many years, with references to original papers by Hadamard (1923) and Fréchet (1925); fundamentals of convex analysis (convexification, Fenchel duality, linear and quadratic programming, two-person zero-sum games, Lagrange primal and dual problems, semiconvex and semiconcave functions); complete definitions, theorems, and detailed proofs, even though it is not necessary to work through all of them; commentaries that put the subject into historical perspective; numerous examples and exercises throughout each chapter, and answers to the exercises provided in an appendix.

Introduction to Nonlinear Optimization
Introduction to Nonlinear Optimization

Author: Amir Beck

Publisher: SIAM

Published: 2023-06-29

Total Pages: 364

ISBN-13: 1611977622

DOWNLOAD EBOOK

Built on the framework of the successful first edition, this book serves as a modern introduction to the field of optimization. The author’s objective is to provide the foundations of theory and algorithms of nonlinear optimization as well as to present a variety of applications from diverse areas of applied sciences. Introduction to Nonlinear Optimization gradually yet rigorously builds connections between theory, algorithms, applications, and actual implementation. The book contains several topics not typically included in optimization books, such as optimality conditions in sparsity constrained optimization, hidden convexity, and total least squares. Readers will discover a wide array of applications such as circle fitting, Chebyshev center, the Fermat–Weber problem, denoising, clustering, total least squares, and orthogonal regression. These applications are studied both theoretically and algorithmically, illustrating concepts such as duality. Python and MATLAB programs are used to show how the theory can be implemented. The extremely popular CVX toolbox (MATLAB) and CVXPY module (Python) are described and used. More than 250 theoretical, algorithmic, and numerical exercises enhance the reader's understanding of the topics. (More than 70 of the exercises provide detailed solutions, and many others are provided with final answers.) The theoretical and algorithmic topics are illustrated by Python and MATLAB examples. This book is intended for graduate or advanced undergraduate students in mathematics, computer science, electrical engineering, and potentially other engineering disciplines.

Introduction to Nonlinear Optimization
Introduction to Nonlinear Optimization

Author: Amir Beck

Publisher: SIAM

Published: 2014-10-27

Total Pages: 286

ISBN-13: 1611973651

DOWNLOAD EBOOK

This book provides the foundations of the theory of nonlinear optimization as well as some related algorithms and presents a variety of applications from diverse areas of applied sciences. The author combines three pillars of optimization?theoretical and algorithmic foundation, familiarity with various applications, and the ability to apply the theory and algorithms on actual problems?and rigorously and gradually builds the connection between theory, algorithms, applications, and implementation. Readers will find more than 170 theoretical, algorithmic, and numerical exercises that deepen and enhance the reader's understanding of the topics. The author includes offers several subjects not typically found in optimization books?for example, optimality conditions in sparsity-constrained optimization, hidden convexity, and total least squares. The book also offers a large number of applications discussed theoretically and algorithmically, such as circle fitting, Chebyshev center, the Fermat?Weber problem, denoising, clustering, total least squares, and orthogonal regression and theoretical and algorithmic topics demonstrated by the MATLAB? toolbox CVX and a package of m-files that is posted on the book?s web site.

An Introduction to Convexity, Optimization, and Algorithms
An Introduction to Convexity, Optimization, and Algorithms

Author: Heinz H. Bauschke

Publisher: SIAM

Published: 2023-12-20

Total Pages: 192

ISBN-13: 1611977800

DOWNLOAD EBOOK

This concise, self-contained volume introduces convex analysis and optimization algorithms, with an emphasis on bridging the two areas. It explores cutting-edge algorithms—such as the proximal gradient, Douglas–Rachford, Peaceman–Rachford, and FISTA—that have applications in machine learning, signal processing, image reconstruction, and other fields. An Introduction to Convexity, Optimization, and Algorithms contains algorithms illustrated by Julia examples and more than 200 exercises that enhance the reader’s understanding of the topic. Clear explanations and step-by-step algorithmic descriptions facilitate self-study for individuals looking to enhance their expertise in convex analysis and optimization. Designed for courses in convex analysis, numerical optimization, and related subjects, this volume is intended for undergraduate and graduate students in mathematics, computer science, and engineering. Its concise length makes it ideal for a one-semester course. Researchers and professionals in applied areas, such as data science and machine learning, will find insights relevant to their work.

Introduction to the Scenario Approach
Introduction to the Scenario Approach

Author: Marco C. Campi

Publisher: SIAM

Published: 2018-11-15

Total Pages: 121

ISBN-13: 1611975433

DOWNLOAD EBOOK

This book is about making decisions driven by experience. In this context, a scenario is an observation that comes from the environment, and scenario optimization refers to optimizing decisions over a set of available scenarios. Scenario optimization can be applied across a variety of fields, including machine learning, quantitative finance, control, and identification. This concise, practical book provides readers with an easy access point to make the scenario approach understandable to nonexperts, and offers an overview of various decision frameworks in which the method can be used. It contains numerous examples and diverse applications from a broad range of domains, including systems theory, control, biomedical engineering, economics, and finance. Practitioners can find "easy-to-use recipes," while theoreticians will benefit from a rigorous treatment of the theoretical foundations of the method, making it an excellent starting point for scientists interested in doing research in this field. Introduction to the Scenario Approach will appeal to scientists working in optimization, practitioners working in myriad fields involving decision-making, and anyone interested in data-driven decision-making.

Problems and Solutions for Integer and Combinatorial Optimization
Problems and Solutions for Integer and Combinatorial Optimization

Author: Mustafa Ç. Pınar

Publisher: SIAM

Published: 2023-11-10

Total Pages: 148

ISBN-13: 1611977762

DOWNLOAD EBOOK

The only book offering solved exercises for integer and combinatorial optimization, this book contains 102 classroom tested problems of varying scope and difficulty chosen from a plethora of topics and applications. It has an associated website containing additional problems, lecture notes, and suggested readings. Topics covered include modeling capabilities of integer variables, the Branch-and-Bound method, cutting planes, network optimization models, shortest path problems, optimum tree problems, maximal cardinality matching problems, matching-covering duality, symmetric and asymmetric TSP, 2-matching and 1-tree relaxations, VRP formulations, and dynamic programming. Problems and Solutions for Integer and Combinatorial Optimization: Building Skills in Discrete Optimization is meant for undergraduate and beginning graduate students in mathematics, computer science, and engineering to use for self-study and for instructors to use in conjunction with other course material and when teaching courses in discrete optimization.

Modern Nonconvex Nondifferentiable Optimization
Modern Nonconvex Nondifferentiable Optimization

Author: Ying Cui

Publisher: SIAM

Published: 2021-12-02

Total Pages: 792

ISBN-13: 161197674X

DOWNLOAD EBOOK

Starting with the fundamentals of classical smooth optimization and building on established convex programming techniques, this research monograph presents a foundation and methodology for modern nonconvex nondifferentiable optimization. It provides readers with theory, methods, and applications of nonconvex and nondifferentiable optimization in statistical estimation, operations research, machine learning, and decision making. A comprehensive and rigorous treatment of this emergent mathematical topic is urgently needed in today’s complex world of big data and machine learning. This book takes a thorough approach to the subject and includes examples and exercises to enrich the main themes, making it suitable for classroom instruction. Modern Nonconvex Nondifferentiable Optimization is intended for applied and computational mathematicians, optimizers, operations researchers, statisticians, computer scientists, engineers, economists, and machine learners. It could be used in advanced courses on optimization/operations research and nonconvex and nonsmooth optimization.

Moment and Polynomial Optimization
Moment and Polynomial Optimization

Author: Jiawang Nie

Publisher: SIAM

Published: 2023-06-15

Total Pages: 484

ISBN-13: 1611977606

DOWNLOAD EBOOK

Moment and polynomial optimization is an active research field used to solve difficult questions in many areas, including global optimization, tensor computation, saddle points, Nash equilibrium, and bilevel programs, and it has many applications. The author synthesizes current research and applications, providing a systematic introduction to theory and methods, a comprehensive approach for extracting optimizers and solving truncated moment problems, and a creative methodology for using optimality conditions to construct tight Moment-SOS relaxations. This book is intended for applied mathematicians, engineers, and researchers entering the field. It can be used as a textbook for graduate students in courses on convex optimization, polynomial optimization, and matrix and tensor optimization.