Large-Scale and Distributed Optimization
Large-Scale and Distributed Optimization

Author: Pontus Giselsson

Publisher: Springer

Published: 2018-11-11

Total Pages: 416

ISBN-13: 3319974785

DOWNLOAD EBOOK

This book presents tools and methods for large-scale and distributed optimization. Since many methods in "Big Data" fields rely on solving large-scale optimization problems, often in distributed fashion, this topic has over the last decade emerged to become very important. As well as specific coverage of this active research field, the book serves as a powerful source of information for practitioners as well as theoreticians. Large-Scale and Distributed Optimization is a unique combination of contributions from leading experts in the field, who were speakers at the LCCC Focus Period on Large-Scale and Distributed Optimization, held in Lund, 14th–16th June 2017. A source of information and innovative ideas for current and future research, this book will appeal to researchers, academics, and students who are interested in large-scale optimization.

Large Scale Linear and Integer Optimization: A Unified Approach
Large Scale Linear and Integer Optimization: A Unified Approach

Author: Richard Kipp Martin

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 739

ISBN-13: 1461549752

DOWNLOAD EBOOK

This is a textbook about linear and integer linear optimization. There is a growing need in industries such as airline, trucking, and financial engineering to solve very large linear and integer linear optimization problems. Building these models requires uniquely trained individuals. Not only must they have a thorough understanding of the theory behind mathematical programming, they must have substantial knowledge of how to solve very large models in today's computing environment. The major goal of the book is to develop the theory of linear and integer linear optimization in a unified manner and then demonstrate how to use this theory in a modern computing environment to solve very large real world problems. After presenting introductory material in Part I, Part II of this book is de voted to the theory of linear and integer linear optimization. This theory is developed using two simple, but unifying ideas: projection and inverse projec tion. Through projection we take a system of linear inequalities and replace some of the variables with additional linear inequalities. Inverse projection, the dual of this process, involves replacing linear inequalities with additional variables. Fundamental results such as weak and strong duality, theorems of the alternative, complementary slackness, sensitivity analysis, finite basis the orems, etc. are all explained using projection or inverse projection. Indeed, a unique feature of this book is that these fundamental results are developed and explained before the simplex and interior point algorithms are presented.

Large-Scale PDE-Constrained Optimization
Large-Scale PDE-Constrained Optimization

Author: Lorenz T. Biegler

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 347

ISBN-13: 364255508X

DOWNLOAD EBOOK

Optimal design, optimal control, and parameter estimation of systems governed by partial differential equations (PDEs) give rise to a class of problems known as PDE-constrained optimization. The size and complexity of the discretized PDEs often pose significant challenges for contemporary optimization methods. With the maturing of technology for PDE simulation, interest has now increased in PDE-based optimization. The chapters in this volume collectively assess the state of the art in PDE-constrained optimization, identify challenges to optimization presented by modern highly parallel PDE simulation codes, and discuss promising algorithmic and software approaches for addressing them. These contributions represent current research of two strong scientific computing communities, in optimization and PDE simulation. This volume merges perspectives in these two different areas and identifies interesting open questions for further research.

Large Scale Optimization in Supply Chains and Smart Manufacturing
Large Scale Optimization in Supply Chains and Smart Manufacturing

Author: Jesús M. Velásquez-Bermúdez

Publisher: Springer

Published: 2020-09-20

Total Pages: 0

ISBN-13: 9783030227906

DOWNLOAD EBOOK

In this book, theory of large scale optimization is introduced with case studies of real-world problems and applications of structured mathematical modeling. The large scale optimization methods are represented by various theories such as Benders’ decomposition, logic-based Benders’ decomposition, Lagrangian relaxation, Dantzig –Wolfe decomposition, multi-tree decomposition, Van Roy’ cross decomposition and parallel decomposition for mathematical programs such as mixed integer nonlinear programming and stochastic programming. Case studies of large scale optimization in supply chain management, smart manufacturing, and Industry 4.0 are investigated with efficient implementation for real-time solutions. The features of case studies cover a wide range of fields including the Internet of things, advanced transportation systems, energy management, supply chain networks, service systems, operations management, risk management, and financial and sales management. Instructors, graduate students, researchers, and practitioners, would benefit from this book finding the applicability of large scale optimization in asynchronous parallel optimization, real-time distributed network, and optimizing the knowledge-based expert system for convex and non-convex problems.

Online Optimization of Large Scale Systems
Online Optimization of Large Scale Systems

Author: Martin Grötschel

Publisher: Springer Science & Business Media

Published: 2013-03-14

Total Pages: 789

ISBN-13: 3662043319

DOWNLOAD EBOOK

In its thousands of years of history, mathematics has made an extraordinary ca reer. It started from rules for bookkeeping and computation of areas to become the language of science. Its potential for decision support was fully recognized in the twentieth century only, vitally aided by the evolution of computing and communi cation technology. Mathematical optimization, in particular, has developed into a powerful machinery to help planners. Whether costs are to be reduced, profits to be maximized, or scarce resources to be used wisely, optimization methods are available to guide decision making. Opti mization is particularly strong if precise models of real phenomena and data of high quality are at hand - often yielding reliable automated control and decision proce dures. But what, if the models are soft and not all data are around? Can mathematics help as well? This book addresses such issues, e. g. , problems of the following type: - An elevator cannot know all transportation requests in advance. In which order should it serve the passengers? - Wing profiles of aircrafts influence the fuel consumption. Is it possible to con tinuously adapt the shape of a wing during the flight under rapidly changing conditions? - Robots are designed to accomplish specific tasks as efficiently as possible. But what if a robot navigates in an unknown environment? - Energy demand changes quickly and is not easily predictable over time. Some types of power plants can only react slowly.

Large-scale Optimization
Large-scale Optimization

Author: Vladimir Tsurkov

Publisher: Springer Science & Business Media

Published: 2013-03-09

Total Pages: 322

ISBN-13: 1475732430

DOWNLOAD EBOOK

Decomposition methods aim to reduce large-scale problems to simpler problems. This monograph presents selected aspects of the dimension-reduction problem. Exact and approximate aggregations of multidimensional systems are developed and from a known model of input-output balance, aggregation methods are categorized. The issues of loss of accuracy, recovery of original variables (disaggregation), and compatibility conditions are analyzed in detail. The method of iterative aggregation in large-scale problems is studied. For fixed weights, successively simpler aggregated problems are solved and the convergence of their solution to that of the original problem is analyzed. An introduction to block integer programming is considered. Duality theory, which is widely used in continuous block programming, does not work for the integer problem. A survey of alternative methods is presented and special attention is given to combined methods of decomposition. Block problems in which the coupling variables do not enter the binding constraints are studied. These models are worthwhile because they permit a decomposition with respect to primal and dual variables by two-level algorithms instead of three-level algorithms. Audience: This book is addressed to specialists in operations research, optimization, and optimal control.

Stochastic Optimization for Large-scale Machine Learning
Stochastic Optimization for Large-scale Machine Learning

Author: Vinod Kumar Chauhan

Publisher: CRC Press

Published: 2021-11-18

Total Pages: 189

ISBN-13: 1000505618

DOWNLOAD EBOOK

Advancements in the technology and availability of data sources have led to the `Big Data' era. Working with large data offers the potential to uncover more fine-grained patterns and take timely and accurate decisions, but it also creates a lot of challenges such as slow training and scalability of machine learning models. One of the major challenges in machine learning is to develop efficient and scalable learning algorithms, i.e., optimization techniques to solve large scale learning problems. Stochastic Optimization for Large-scale Machine Learning identifies different areas of improvement and recent research directions to tackle the challenge. Developed optimisation techniques are also explored to improve machine learning algorithms based on data access and on first and second order optimisation methods. Key Features: Bridges machine learning and Optimisation. Bridges theory and practice in machine learning. Identifies key research areas and recent research directions to solve large-scale machine learning problems. Develops optimisation techniques to improve machine learning algorithms for big data problems. The book will be a valuable reference to practitioners and researchers as well as students in the field of machine learning.

Large-Scale Nonlinear Optimization
Large-Scale Nonlinear Optimization

Author: Gianni Pillo

Publisher: Springer Science & Business Media

Published: 2006-06-03

Total Pages: 297

ISBN-13: 0387300651

DOWNLOAD EBOOK

This book reviews and discusses recent advances in the development of methods and algorithms for nonlinear optimization and its applications, focusing on the large-dimensional case, the current forefront of much research. Individual chapters, contributed by eminent authorities, provide an up-to-date overview of the field from different and complementary standpoints, including theoretical analysis, algorithmic development, implementation issues and applications.

Large Scale Optimization
Large Scale Optimization

Author: William W. Hager

Publisher: Springer Science & Business Media

Published: 2013-12-01

Total Pages: 470

ISBN-13: 1461336325

DOWNLOAD EBOOK

On February 15-17, 1993, a conference on Large Scale Optimization, hosted by the Center for Applied Optimization, was held at the University of Florida. The con ference was supported by the National Science Foundation, the U. S. Army Research Office, and the University of Florida, with endorsements from SIAM, MPS, ORSA and IMACS. Forty one invited speakers presented papers on mathematical program ming and optimal control topics with an emphasis on algorithm development, real world applications and numerical results. Participants from Canada, Japan, Sweden, The Netherlands, Germany, Belgium, Greece, and Denmark gave the meeting an important international component. At tendees also included representatives from IBM, American Airlines, US Air, United Parcel Serice, AT & T Bell Labs, Thinking Machines, Army High Performance Com puting Research Center, and Argonne National Laboratory. In addition, the NSF sponsored attendance of thirteen graduate students from universities in the United States and abroad. Accurate modeling of scientific problems often leads to the formulation of large scale optimization problems involving thousands of continuous and/or discrete vari ables. Large scale optimization has seen a dramatic increase in activities in the past decade. This has been a natural consequence of new algorithmic developments and of the increased power of computers. For example, decomposition ideas proposed by G. Dantzig and P. Wolfe in the 1960's, are now implement able in distributed process ing systems, and today many optimization codes have been implemented on parallel machines.

Optimization for Machine Learning
Optimization for Machine Learning

Author: Suvrit Sra

Publisher: MIT Press

Published: 2012

Total Pages: 509

ISBN-13: 026201646X

DOWNLOAD EBOOK

An up-to-date account of the interplay between optimization and machine learning, accessible to students and researchers in both communities. The interplay between optimization and machine learning is one of the most important developments in modern computational science. Optimization formulations and methods are proving to be vital in designing algorithms to extract essential knowledge from huge volumes of data. Machine learning, however, is not simply a consumer of optimization technology but a rapidly evolving field that is itself generating new optimization ideas. This book captures the state of the art of the interaction between optimization and machine learning in a way that is accessible to researchers in both fields. Optimization approaches have enjoyed prominence in machine learning because of their wide applicability and attractive theoretical properties. The increasing complexity, size, and variety of today's machine learning models call for the reassessment of existing assumptions. This book starts the process of reassessment. It describes the resurgence in novel contexts of established frameworks such as first-order methods, stochastic approximations, convex relaxations, interior-point methods, and proximal methods. It also devotes attention to newer themes such as regularized optimization, robust optimization, gradient and subgradient methods, splitting techniques, and second-order methods. Many of these techniques draw inspiration from other fields, including operations research, theoretical computer science, and subfields of optimization. The book will enrich the ongoing cross-fertilization between the machine learning community and these other fields, and within the broader optimization community.