Large-Scale and Distributed Optimization
Large-Scale and Distributed Optimization

Author: Pontus Giselsson

Publisher: Springer

Published: 2018-11-11

Total Pages: 416

ISBN-13: 3319974785

DOWNLOAD EBOOK

This book presents tools and methods for large-scale and distributed optimization. Since many methods in "Big Data" fields rely on solving large-scale optimization problems, often in distributed fashion, this topic has over the last decade emerged to become very important. As well as specific coverage of this active research field, the book serves as a powerful source of information for practitioners as well as theoreticians. Large-Scale and Distributed Optimization is a unique combination of contributions from leading experts in the field, who were speakers at the LCCC Focus Period on Large-Scale and Distributed Optimization, held in Lund, 14th–16th June 2017. A source of information and innovative ideas for current and future research, this book will appeal to researchers, academics, and students who are interested in large-scale optimization.

Online Optimization of Large Scale Systems
Online Optimization of Large Scale Systems

Author: Martin Grötschel

Publisher: Springer Science & Business Media

Published: 2013-03-14

Total Pages: 789

ISBN-13: 3662043319

DOWNLOAD EBOOK

In its thousands of years of history, mathematics has made an extraordinary ca reer. It started from rules for bookkeeping and computation of areas to become the language of science. Its potential for decision support was fully recognized in the twentieth century only, vitally aided by the evolution of computing and communi cation technology. Mathematical optimization, in particular, has developed into a powerful machinery to help planners. Whether costs are to be reduced, profits to be maximized, or scarce resources to be used wisely, optimization methods are available to guide decision making. Opti mization is particularly strong if precise models of real phenomena and data of high quality are at hand - often yielding reliable automated control and decision proce dures. But what, if the models are soft and not all data are around? Can mathematics help as well? This book addresses such issues, e. g. , problems of the following type: - An elevator cannot know all transportation requests in advance. In which order should it serve the passengers? - Wing profiles of aircrafts influence the fuel consumption. Is it possible to con tinuously adapt the shape of a wing during the flight under rapidly changing conditions? - Robots are designed to accomplish specific tasks as efficiently as possible. But what if a robot navigates in an unknown environment? - Energy demand changes quickly and is not easily predictable over time. Some types of power plants can only react slowly.

Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers
Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers

Author: Stephen Boyd

Publisher: Now Publishers Inc

Published: 2011

Total Pages: 138

ISBN-13: 160198460X

DOWNLOAD EBOOK

Surveys the theory and history of the alternating direction method of multipliers, and discusses its applications to a wide variety of statistical and machine learning problems of recent interest, including the lasso, sparse logistic regression, basis pursuit, covariance selection, support vector machines, and many others.

Large Scale Optimization in Supply Chains and Smart Manufacturing
Large Scale Optimization in Supply Chains and Smart Manufacturing

Author: Jesús M. Velásquez-Bermúdez

Publisher: Springer

Published: 2020-09-20

Total Pages: 0

ISBN-13: 9783030227906

DOWNLOAD EBOOK

In this book, theory of large scale optimization is introduced with case studies of real-world problems and applications of structured mathematical modeling. The large scale optimization methods are represented by various theories such as Benders’ decomposition, logic-based Benders’ decomposition, Lagrangian relaxation, Dantzig –Wolfe decomposition, multi-tree decomposition, Van Roy’ cross decomposition and parallel decomposition for mathematical programs such as mixed integer nonlinear programming and stochastic programming. Case studies of large scale optimization in supply chain management, smart manufacturing, and Industry 4.0 are investigated with efficient implementation for real-time solutions. The features of case studies cover a wide range of fields including the Internet of things, advanced transportation systems, energy management, supply chain networks, service systems, operations management, risk management, and financial and sales management. Instructors, graduate students, researchers, and practitioners, would benefit from this book finding the applicability of large scale optimization in asynchronous parallel optimization, real-time distributed network, and optimizing the knowledge-based expert system for convex and non-convex problems.

Large Scale Linear and Integer Optimization: A Unified Approach
Large Scale Linear and Integer Optimization: A Unified Approach

Author: Richard Kipp Martin

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 739

ISBN-13: 1461549752

DOWNLOAD EBOOK

This is a textbook about linear and integer linear optimization. There is a growing need in industries such as airline, trucking, and financial engineering to solve very large linear and integer linear optimization problems. Building these models requires uniquely trained individuals. Not only must they have a thorough understanding of the theory behind mathematical programming, they must have substantial knowledge of how to solve very large models in today's computing environment. The major goal of the book is to develop the theory of linear and integer linear optimization in a unified manner and then demonstrate how to use this theory in a modern computing environment to solve very large real world problems. After presenting introductory material in Part I, Part II of this book is de voted to the theory of linear and integer linear optimization. This theory is developed using two simple, but unifying ideas: projection and inverse projec tion. Through projection we take a system of linear inequalities and replace some of the variables with additional linear inequalities. Inverse projection, the dual of this process, involves replacing linear inequalities with additional variables. Fundamental results such as weak and strong duality, theorems of the alternative, complementary slackness, sensitivity analysis, finite basis the orems, etc. are all explained using projection or inverse projection. Indeed, a unique feature of this book is that these fundamental results are developed and explained before the simplex and interior point algorithms are presented.

First-order and Stochastic Optimization Methods for Machine Learning
First-order and Stochastic Optimization Methods for Machine Learning

Author: Guanghui Lan

Publisher: Springer Nature

Published: 2020-05-15

Total Pages: 591

ISBN-13: 3030395685

DOWNLOAD EBOOK

This book covers not only foundational materials but also the most recent progresses made during the past few years on the area of machine learning algorithms. In spite of the intensive research and development in this area, there does not exist a systematic treatment to introduce the fundamental concepts and recent progresses on machine learning algorithms, especially on those based on stochastic optimization methods, randomized algorithms, nonconvex optimization, distributed and online learning, and projection free methods. This book will benefit the broad audience in the area of machine learning, artificial intelligence and mathematical programming community by presenting these recent developments in a tutorial style, starting from the basic building blocks to the most carefully designed and complicated algorithms for machine learning.

Big Data Optimization: Recent Developments and Challenges
Big Data Optimization: Recent Developments and Challenges

Author: Ali Emrouznejad

Publisher: Springer

Published: 2016-05-26

Total Pages: 492

ISBN-13: 3319302655

DOWNLOAD EBOOK

The main objective of this book is to provide the necessary background to work with big data by introducing some novel optimization algorithms and codes capable of working in the big data setting as well as introducing some applications in big data optimization for both academics and practitioners interested, and to benefit society, industry, academia, and government. Presenting applications in a variety of industries, this book will be useful for the researchers aiming to analyses large scale data. Several optimization algorithms for big data including convergent parallel algorithms, limited memory bundle algorithm, diagonal bundle method, convergent parallel algorithms, network analytics, and many more have been explored in this book.

Stochastic Optimization for Large-scale Machine Learning
Stochastic Optimization for Large-scale Machine Learning

Author: Vinod Kumar Chauhan

Publisher: CRC Press

Published: 2021-11-18

Total Pages: 189

ISBN-13: 1000505618

DOWNLOAD EBOOK

Advancements in the technology and availability of data sources have led to the `Big Data' era. Working with large data offers the potential to uncover more fine-grained patterns and take timely and accurate decisions, but it also creates a lot of challenges such as slow training and scalability of machine learning models. One of the major challenges in machine learning is to develop efficient and scalable learning algorithms, i.e., optimization techniques to solve large scale learning problems. Stochastic Optimization for Large-scale Machine Learning identifies different areas of improvement and recent research directions to tackle the challenge. Developed optimisation techniques are also explored to improve machine learning algorithms based on data access and on first and second order optimisation methods. Key Features: Bridges machine learning and Optimisation. Bridges theory and practice in machine learning. Identifies key research areas and recent research directions to solve large-scale machine learning problems. Develops optimisation techniques to improve machine learning algorithms for big data problems. The book will be a valuable reference to practitioners and researchers as well as students in the field of machine learning.

Large-scale Graph Analysis: System, Algorithm and Optimization
Large-scale Graph Analysis: System, Algorithm and Optimization

Author: Yingxia Shao

Publisher: Springer

Published: 2020-08-15

Total Pages: 146

ISBN-13: 9789811539275

DOWNLOAD EBOOK

This book introduces readers to a workload-aware methodology for large-scale graph algorithm optimization in graph-computing systems, and proposes several optimization techniques that can enable these systems to handle advanced graph algorithms efficiently. More concretely, it proposes a workload-aware cost model to guide the development of high-performance algorithms. On the basis of the cost model, the book subsequently presents a system-level optimization resulting in a partition-aware graph-computing engine, PAGE. In addition, it presents three efficient and scalable advanced graph algorithms – the subgraph enumeration, cohesive subgraph detection, and graph extraction algorithms. This book offers a valuable reference guide for junior researchers, covering the latest advances in large-scale graph analysis; and for senior researchers, sharing state-of-the-art solutions based on advanced graph algorithms. In addition, all readers will find a workload-aware methodology for designing efficient large-scale graph algorithms.

Distributed Optimization: Advances in Theories, Methods, and Applications
Distributed Optimization: Advances in Theories, Methods, and Applications

Author: Huaqing Li

Publisher: Springer Nature

Published: 2020-08-04

Total Pages: 243

ISBN-13: 9811561095

DOWNLOAD EBOOK

This book offers a valuable reference guide for researchers in distributed optimization and for senior undergraduate and graduate students alike. Focusing on the natures and functions of agents, communication networks and algorithms in the context of distributed optimization for networked control systems, this book introduces readers to the background of distributed optimization; recent developments in distributed algorithms for various types of underlying communication networks; the implementation of computation-efficient and communication-efficient strategies in the execution of distributed algorithms; and the frameworks of convergence analysis and performance evaluation. On this basis, the book then thoroughly studies 1) distributed constrained optimization and the random sleep scheme, from an agent perspective; 2) asynchronous broadcast-based algorithms, event-triggered communication, quantized communication, unbalanced directed networks, and time-varying networks, from a communication network perspective; and 3) accelerated algorithms and stochastic gradient algorithms, from an algorithm perspective. Finally, the applications of distributed optimization in large-scale statistical learning, wireless sensor networks, and for optimal energy management in smart grids are discussed.