Data-driven Dynamic Optimization with Auxiliary Covariates

Data-driven Dynamic Optimization with Auxiliary Covariates

Author: Christopher George McCord

Publisher:

Published: 2019

Total Pages: 190

ISBN-13:

DOWNLOAD EBOOK

Optimization under uncertainty forms the foundation for many of the fundamental problems the operations research community seeks to solve. In this thesis, we develop and analyze algorithms that incorporate ideas from machine learning to optimize uncertain objectives directly from data. In the first chapter, we consider problems in which the decision affects the observed outcome, such as in personalized medicine and pricing. We present a framework for using observational data to learn to optimize an uncertain objective over a continuous and multi-dimensional decision space. Our approach accounts for the uncertainty in predictions, and we provide theoretical results that show this adds value. In addition, we test our approach on a Warfarin dosing example, and it outperforms the leading alternative methods. In the second chapter, we develop an approach for solving dynamic optimization problems with covariates that uses machine learning to approximate the unknown stochastic process of the uncertainty. We provide theoretical guarantees on the effectiveness of our method and validate the guarantees with computational experiments. In the third chapter, we introduce a distributionally robust approach for incorporating covariates in large-scale, data-driven dynamic optimization. We prove that it is asymptotically optimal and provide a tractable general-purpose approximation scheme that scales to problems with many temporal stages. Across examples in shipment planning, inventory management, and finance, our method achieves improvements of up to 15% over alternatives. In the final chapter, we apply the techniques developed in previous chapters to the problem of optimizing the operating room schedule at a major US hospital. Our partner institution faces significant census variability throughout the week, which limits the amount of patients it can accept due to resource constraints at peak times. We introduce a data-driven approach for this problem that combines machine learning with mixed integer optimization and demonstrate that it can reliably reduce the maximal weekly census.


Data-Driven Evolutionary Optimization

Data-Driven Evolutionary Optimization

Author: Yaochu Jin

Publisher: Springer Nature

Published: 2021-06-28

Total Pages: 393

ISBN-13: 3030746402

DOWNLOAD EBOOK

Intended for researchers and practitioners alike, this book covers carefully selected yet broad topics in optimization, machine learning, and metaheuristics. Written by world-leading academic researchers who are extremely experienced in industrial applications, this self-contained book is the first of its kind that provides comprehensive background knowledge, particularly practical guidelines, and state-of-the-art techniques. New algorithms are carefully explained, further elaborated with pseudocode or flowcharts, and full working source code is made freely available. This is followed by a presentation of a variety of data-driven single- and multi-objective optimization algorithms that seamlessly integrate modern machine learning such as deep learning and transfer learning with evolutionary and swarm optimization algorithms. Applications of data-driven optimization ranging from aerodynamic design, optimization of industrial processes, to deep neural architecture search are included.


Dynamic Optimization in the Age of Big Data

Dynamic Optimization in the Age of Big Data

Author: Bradley Eli Sturt

Publisher:

Published: 2020

Total Pages: 249

ISBN-13:

DOWNLOAD EBOOK

This thesis revisits a fundamental class of dynamic optimization problems introduced by Dantzig (1955). These decision problems remain widely studied in many applications domains (e.g., inventory management, finance, energy planning) but require access to probability distributions that are rarely known in practice. First, we propose a new data-driven approach for addressing multi-stage stochastic linear optimization problems with unknown probability distributions. The approach consists of solving a robust optimization problem that is constructed from sample paths of the underlying stochastic process. As more sample paths are obtained, we prove that the optimal cost of the robust problem converges to that of the underlying stochastic problem. To the best of our knowledge, this is the first data-driven approach for multi-stage stochastic linear optimization problems which is asymptotically optimal when uncertainty is arbitrarily correlated across time. Next, we develop approximation algorithms for the proposed data-driven approach by extending techniques from the field of robust optimization. In particular, we present a simple approximation algorithm, based on overlapping linear decision rules, which can be reformulated as a tractable linear optimization problem with size that scales linearly in the number of data points. For two-stage problems, we show the approximation algorithm is also asymptotically optimal, meaning that the optimal cost of the approximation algorithm converges to that of the underlying stochastic problem as the number of data points tends to infinity. Finally, we extend the proposed data-driven approach to address multi-stage stochastic linear optimization problems with side information. The approach combines predictive machine learning methods (such as K-nearest neighbors, kernel regression, and random forests) with the proposed robust optimization framework. We prove that this machine learning-based approach is asymptotically optimal, and demonstrate the value of the proposed methodology in numerical experiments in the context of inventory management, scheduling, and finance.


Targeted Learning in Data Science

Targeted Learning in Data Science

Author: Mark J. van der Laan

Publisher: Springer

Published: 2018-03-28

Total Pages: 655

ISBN-13: 3319653040

DOWNLOAD EBOOK

This textbook for graduate students in statistics, data science, and public health deals with the practical challenges that come with big, complex, and dynamic data. It presents a scientific roadmap to translate real-world data science applications into formal statistical estimation problems by using the general template of targeted maximum likelihood estimators. These targeted machine learning algorithms estimate quantities of interest while still providing valid inference. Targeted learning methods within data science area critical component for solving scientific problems in the modern age. The techniques can answer complex questions including optimal rules for assigning treatment based on longitudinal data with time-dependent confounding, as well as other estimands in dependent data structures, such as networks. Included in Targeted Learning in Data Science are demonstrations with soft ware packages and real data sets that present a case that targeted learning is crucial for the next generation of statisticians and data scientists. Th is book is a sequel to the first textbook on machine learning for causal inference, Targeted Learning, published in 2011. Mark van der Laan, PhD, is Jiann-Ping Hsu/Karl E. Peace Professor of Biostatistics and Statistics at UC Berkeley. His research interests include statistical methods in genomics, survival analysis, censored data, machine learning, semiparametric models, causal inference, and targeted learning. Dr. van der Laan received the 2004 Mortimer Spiegelman Award, the 2005 Van Dantzig Award, the 2005 COPSS Snedecor Award, the 2005 COPSS Presidential Award, and has graduated over 40 PhD students in biostatistics and statistics. Sherri Rose, PhD, is Associate Professor of Health Care Policy (Biostatistics) at Harvard Medical School. Her work is centered on developing and integrating innovative statistical approaches to advance human health. Dr. Rose’s methodological research focuses on nonparametric machine learning for causal inference and prediction. She co-leads the Health Policy Data Science Lab and currently serves as an associate editor for the Journal of the American Statistical Association and Biostatistics.


Dynamic Models for Knowledge-Driven Organizations

Dynamic Models for Knowledge-Driven Organizations

Author: Jennex, Murray E.

Publisher: IGI Global

Published: 2012-11-30

Total Pages: 443

ISBN-13: 1466624868

DOWNLOAD EBOOK

Since knowledge systems and knowledge management programs are put in place to monitor workers in the performance of their jobs; knowledge is, therefore, an essential component in the achievement of goals and production of economic benefit of an organization. Dynamic Models for Knowledge-Driven Organizations presents a widespread collection of research on the understanding of the managerial, technical and human issues associated with the use of knowledge in organizations while bearing in mind the design, development, and maintenance of useful knowledge management systems. This reference is essential for the tools and information needed to effectively implement knowledge management systems and would benefit researchers and practitioners alike.


Computational Science and Its Applications - ICCSA 2008

Computational Science and Its Applications - ICCSA 2008

Author: Osvaldo Gervasi

Publisher: Springer Science & Business Media

Published: 2008-06-24

Total Pages: 1283

ISBN-13: 3540698388

DOWNLOAD EBOOK

The two-volume set LNCS 5072 and 5073 constitutes the refereed proceedings of the International Conference on Computational Science and Its Applications, ICCSA 2008, held in Perugia, Italy, in June/July, 2008. The two volumes contain papers presenting a wealth of original research results in the field of computational science, from foundational issues in computer science and mathematics to advanced applications in virtually all sciences making use of computational techniques. The topics of the fully refereed papers are structured according to the five major conference themes: computational methods, algorithms and scientific applications, high performance technical computing and networks, advanced and emerging applications, geometric modelling, graphics and visualization, as well as information systems and information technologies. Moreover, submissions from more than 20 workshops and technical sessions in the areas, such as embedded systems, geographical analysis, computational geometry, computational geomatics, computer graphics, virtual reality, computer modeling, computer algebra, mobile communications, wireless networks, computational forensics, data storage, information security, web learning, software engineering, computational intelligence, digital security, biometrics, molecular structures, material design, ubiquitous computing, symbolic computations, web systems and intelligence, and e-education contribute to this publication.


Dynamic Linear Models with R

Dynamic Linear Models with R

Author: Giovanni Petris

Publisher: Springer Science & Business Media

Published: 2009-06-12

Total Pages: 258

ISBN-13: 0387772383

DOWNLOAD EBOOK

State space models have gained tremendous popularity in recent years in as disparate fields as engineering, economics, genetics and ecology. After a detailed introduction to general state space models, this book focuses on dynamic linear models, emphasizing their Bayesian analysis. Whenever possible it is shown how to compute estimates and forecasts in closed form; for more complex models, simulation techniques are used. A final chapter covers modern sequential Monte Carlo algorithms. The book illustrates all the fundamental steps needed to use dynamic linear models in practice, using R. Many detailed examples based on real data sets are provided to show how to set up a specific model, estimate its parameters, and use it for forecasting. All the code used in the book is available online. No prior knowledge of Bayesian statistics or time series analysis is required, although familiarity with basic statistics and R is assumed.


Safety and Reliability: Methodology and Applications

Safety and Reliability: Methodology and Applications

Author: Tomasz Nowakowski

Publisher: CRC Press

Published: 2014-09-01

Total Pages: 408

ISBN-13: 1315736977

DOWNLOAD EBOOK

Within the last fifty years the performance requirements for technical objects and systems were supplemented with: customer expectations (quality), abilities to prevent the loss of the object properties in operation time (reliability and maintainability), protection against the effects of undesirable events (safety and security) and the ability to


Artificial Intelligence

Artificial Intelligence

Author:

Publisher: BoD – Books on Demand

Published: 2019-07-31

Total Pages: 142

ISBN-13: 1789840171

DOWNLOAD EBOOK

Artificial intelligence (AI) is taking on an increasingly important role in our society today. In the early days, machines fulfilled only manual activities. Nowadays, these machines extend their capabilities to cognitive tasks as well. And now AI is poised to make a huge contribution to medical and biological applications. From medical equipment to diagnosing and predicting disease to image and video processing, among others, AI has proven to be an area with great potential. The ability of AI to make informed decisions, learn and perceive the environment, and predict certain behavior, among its many other skills, makes this application of paramount importance in today's world. This book discusses and examines AI applications in medicine and biology as well as challenges and opportunities in this fascinating area.