From Convexity to Nonconvexity
From Convexity to Nonconvexity

Author: R.P. Gilbert

Publisher: Springer Science & Business Media

Published: 2013-12-01

Total Pages: 395

ISBN-13: 1461302870

DOWNLOAD EBOOK

This collection of papers is dedicated to the memory of Gaetano Fichera, a great mathematician and also a good friend to the editors. Regrettably it took an unusual amount of time to bring this collection out. This was primarily due to the fact that the main editor who had collected all of the materials, for this volume, P. D. Panagiotopoulos, died unexpectedly during the period when we were editing the manuscript. The other two editors in appreciation of Panagiotopoulos' contribution to this field, believe it is therefore fitting that this collection be dedicated to his memory also. The theme of the collection is centered around the seminal research of G. Fichera on the Signorini problem. Variants on this idea enter in different ways. For example, by bringing in friction the problem is no longer self-adjoint and the minimization formulation is not valid. A large portion of this collection is devoted to survey papers concerning hemivariational methods, with a main point of its application to nonsmooth mechanics. Hemivariational inequali ties, which are a generalization of variational inequalities, were pioneered by Panagiotopoulos. There are many applications of this theory to the study of non convex energy functionals occurring in many branches of mechanics. An area of concentration concerns contact problems, in particular, quasistatic and dynamic contact problems with friction and damage. Nonsmooth optimization methods which may be divided into the main groups of subgradient methods and bundle methods are also discussed in this collection.

Non-convex Optimization for Machine Learning
Non-convex Optimization for Machine Learning

Author: Prateek Jain

Publisher: Foundations and Trends in Machine Learning

Published: 2017-12-04

Total Pages: 218

ISBN-13: 9781680833683

DOWNLOAD EBOOK

Non-convex Optimization for Machine Learning takes an in-depth look at the basics of non-convex optimization with applications to machine learning. It introduces the rich literature in this area, as well as equips the reader with the tools and techniques needed to apply and analyze simple but powerful procedures for non-convex problems. Non-convex Optimization for Machine Learning is as self-contained as possible while not losing focus of the main topic of non-convex optimization techniques. The monograph initiates the discussion with entire chapters devoted to presenting a tutorial-like treatment of basic concepts in convex analysis and optimization, as well as their non-convex counterparts. The monograph concludes with a look at four interesting applications in the areas of machine learning and signal processing, and exploring how the non-convex optimization techniques introduced earlier can be used to solve these problems. The monograph also contains, for each of the topics discussed, exercises and figures designed to engage the reader, as well as extensive bibliographic notes pointing towards classical works and recent advances. Non-convex Optimization for Machine Learning can be used for a semester-length course on the basics of non-convex optimization with applications to machine learning. On the other hand, it is also possible to cherry pick individual portions, such the chapter on sparse recovery, or the EM algorithm, for inclusion in a broader course. Several courses such as those in machine learning, optimization, and signal processing may benefit from the inclusion of such topics.

Abstract Convexity and Global Optimization
Abstract Convexity and Global Optimization

Author: Alexander M. Rubinov

Publisher: Springer Science & Business Media

Published: 2000-05-31

Total Pages: 516

ISBN-13: 9780792363231

DOWNLOAD EBOOK

This book consists of two parts. Firstly, the main notions of abstract convexity and their applications in the study of some classes of functions and sets are presented. Secondly, both theoretical and numerical aspects of global optimization based on abstract convexity are examined. Most of the book does not require knowledge of advanced mathematics. Classical methods of nonconvex mathematical programming, being based on a local approximation, cannot be used to examine and solve many problems of global optimization, and so there is a clear need to develop special global tools for solving these problems. Some of these tools are based on abstract convexity, that is, on the representation of a function of a rather complicated nature as the upper envelope of a set of fairly simple functions. Audience: The book will be of interest to specialists in global optimization, mathematical programming, and convex analysis, as well as engineers using mathematical tools and optimization techniques and specialists in mathematical modelling.

Nonsmooth Optimization and Related Topics
Nonsmooth Optimization and Related Topics

Author: F.H. Clarke

Publisher: Springer Science & Business Media

Published: 2013-11-11

Total Pages: 481

ISBN-13: 1475760191

DOWNLOAD EBOOK

This volume contains the edited texts of the lect. nres presented at the International School of Mathematics devoted to Nonsmonth Optimization, held from . June 20 to July I, 1988. The site for the meeting was the "Ettore ~Iajorana" Centre for Sci entific Culture in Erice, Sicily. In the tradition of these meetings the main purpose was to give the state-of-the-art of an important and growing field of mathematics, and to stimulate interactions between finite-dimensional and infinite-dimensional op timization. The School was attended by approximately 80 people from 23 countries; in particular it was possible to have some distinguished lecturers from the SO\·iet Union, whose research institutions are here gratt-fnlly acknowledged. Besides the lectures, several seminars were delivered; a special s·~ssion was devoted to numerical computing aspects. The result was a broad exposure. gi ·. ring a deep knowledge of the present research tendencies in the field. We wish to express our appreciation to all the participants. Special mention 5hould be made of the Ettorc ;. . Iajorana Centre in Erice, which helped provide a stimulating and rewarding experience, and of its staff which was fundamental for the success of the meeting. j\, loreover, WP want to extend uur deep appreci

Totally Convex Functions for Fixed Points Computation and Infinite Dimensional Optimization
Totally Convex Functions for Fixed Points Computation and Infinite Dimensional Optimization

Author: D. Butnariu

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 218

ISBN-13: 9401140669

DOWNLOAD EBOOK

The aim of this work is to present in a unified approach a series of results concerning totally convex functions on Banach spaces and their applications to building iterative algorithms for computing common fixed points of mea surable families of operators and optimization methods in infinite dimen sional settings. The notion of totally convex function was first studied by Butnariu, Censor and Reich [31] in the context of the space lRR because of its usefulness for establishing convergence of a Bregman projection method for finding common points of infinite families of closed convex sets. In this finite dimensional environment total convexity hardly differs from strict convexity. In fact, a function with closed domain in a finite dimensional Banach space is totally convex if and only if it is strictly convex. The relevancy of total convexity as a strengthened form of strict convexity becomes apparent when the Banach space on which the function is defined is infinite dimensional. In this case, total convexity is a property stronger than strict convexity but weaker than locally uniform convexity (see Section 1.3 below). The study of totally convex functions in infinite dimensional Banach spaces was started in [33] where it was shown that they are useful tools for extrapolating properties commonly known to belong to operators satisfying demanding contractivity requirements to classes of operators which are not even mildly nonexpansive.

Convex Optimization
Convex Optimization

Author: Stephen P. Boyd

Publisher: Cambridge University Press

Published: 2004-03-08

Total Pages: 744

ISBN-13: 9780521833783

DOWNLOAD EBOOK

Convex optimization problems arise frequently in many different fields. This book provides a comprehensive introduction to the subject, and shows in detail how such problems can be solved numerically with great efficiency. The book begins with the basic elements of convex sets and functions, and then describes various classes of convex optimization problems. Duality and approximation techniques are then covered, as are statistical estimation techniques. Various geometrical problems are then presented, and there is detailed discussion of unconstrained and constrained minimization problems, and interior-point methods. The focus of the book is on recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples and homework exercises and will appeal to students, researchers and practitioners in fields such as engineering, computer science, mathematics, statistics, finance and economics.

Convex Analysis and Optimization
Convex Analysis and Optimization

Author: Dimitri Bertsekas

Publisher: Athena Scientific

Published: 2003-03-01

Total Pages: 560

ISBN-13: 1886529450

DOWNLOAD EBOOK

A uniquely pedagogical, insightful, and rigorous treatment of the analytical/geometrical foundations of optimization. The book provides a comprehensive development of convexity theory, and its rich applications in optimization, including duality, minimax/saddle point theory, Lagrange multipliers, and Lagrangian relaxation/nondifferentiable optimization. It is an excellent supplement to several of our books: Convex Optimization Theory (Athena Scientific, 2009), Convex Optimization Algorithms (Athena Scientific, 2015), Nonlinear Programming (Athena Scientific, 2016), Network Optimization (Athena Scientific, 1998), and Introduction to Linear Optimization (Athena Scientific, 1997). Aside from a thorough account of convex analysis and optimization, the book aims to restructure the theory of the subject, by introducing several novel unifying lines of analysis, including: 1) A unified development of minimax theory and constrained optimization duality as special cases of duality between two simple geometrical problems. 2) A unified development of conditions for existence of solutions of convex optimization problems, conditions for the minimax equality to hold, and conditions for the absence of a duality gap in constrained optimization. 3) A unification of the major constraint qualifications allowing the use of Lagrange multipliers for nonconvex constrained optimization, using the notion of constraint pseudonormality and an enhanced form of the Fritz John necessary optimality conditions. Among its features the book: a) Develops rigorously and comprehensively the theory of convex sets and functions, in the classical tradition of Fenchel and Rockafellar b) Provides a geometric, highly visual treatment of convex and nonconvex optimization problems, including existence of solutions, optimality conditions, Lagrange multipliers, and duality c) Includes an insightful and comprehensive presentation of minimax theory and zero sum games, and its connection with duality d) Describes dual optimization, the associated computational methods, including the novel incremental subgradient methods, and applications in linear, quadratic, and integer programming e) Contains many examples, illustrations, and exercises with complete solutions (about 200 pages) posted at the publisher's web site http://www.athenasc.com/convexity.html

Convexity and Optimization in Banach Spaces
Convexity and Optimization in Banach Spaces

Author: Viorel Barbu

Publisher: Springer Science & Business Media

Published: 2012-01-03

Total Pages: 376

ISBN-13: 940072246X

DOWNLOAD EBOOK

An updated and revised edition of the 1986 title Convexity and Optimization in Banach Spaces, this book provides a self-contained presentation of basic results of the theory of convex sets and functions in infinite-dimensional spaces. The main emphasis is on applications to convex optimization and convex optimal control problems in Banach spaces. A distinctive feature is a strong emphasis on the connection between theory and application. This edition has been updated to include new results pertaining to advanced concepts of subdifferential for convex functions and new duality results in convex programming. The last chapter, concerned with convex control problems, has been rewritten and completed with new research concerning boundary control systems, the dynamic programming equations in optimal control theory and periodic optimal control problems. Finally, the structure of the book has been modified to highlight the most recent progression in the field including fundamental results on the theory of infinite-dimensional convex analysis and includes helpful bibliographical notes at the end of each chapter.

Handbook of Generalized Convexity and Generalized Monotonicity
Handbook of Generalized Convexity and Generalized Monotonicity

Author: Nicolas Hadjisavvas

Publisher: Springer Science & Business Media

Published: 2006-01-16

Total Pages: 684

ISBN-13: 0387233938

DOWNLOAD EBOOK

Studies in generalized convexity and generalized monotonicity have significantly increased during the last two decades. Researchers with very diverse backgrounds such as mathematical programming, optimization theory, convex analysis, nonlinear analysis, nonsmooth analysis, linear algebra, probability theory, variational inequalities, game theory, economic theory, engineering, management science, equilibrium analysis, for example are attracted to this fast growing field of study. Such enormous research activity is partially due to the discovery of a rich, elegant and deep theory which provides a basis for interesting existing and potential applications in different disciplines. The handbook offers an advanced and broad overview of the current state of the field. It contains fourteen chapters written by the leading experts on the respective subject; eight on generalized convexity and the remaining six on generalized monotonicity.

Ambivalent Joint Production and the Natural Environment
Ambivalent Joint Production and the Natural Environment

Author: Stefan Baumgärtner

Publisher: Springer Science & Business Media

Published: 2000-05-05

Total Pages: 344

ISBN-13: 9783790812909

DOWNLOAD EBOOK

Many environmental damages are caused by substances which come into existence as undesired joint outputs in the production of desired goods. Whether an output is desired or not, however, is not an inherent property of the substance itself but depends on the context of production. This book studies the role of a potential ambivalence of joint outputs for the description and analysis of dynamic economy-environment interactions and for the design of efficient environmental policy. This is done in an interisciplinary way: methods and insights from thermodynamics, engineering sciences, economics and the methodology of economics are combined in order to develop an encompassing view on the complex and multivarious phenomenon of ambivalent joint production. By using the concept of joint production as a unifying framework for describing and analyzing the relations between human economic activity and the surrounding natural environment this book contributes to a critical and constructive assessment of the traditional environmental economic approach.