Enhancing Surrogate-Based Optimization Through Parallelization

Enhancing Surrogate-Based Optimization Through Parallelization

Author: Frederik Rehbach

Publisher: Springer Nature

Published: 2023-05-29

Total Pages: 123

ISBN-13: 3031306090

DOWNLOAD EBOOK

This book presents a solution to the challenging issue of optimizing expensive-to-evaluate industrial problems such as the hyperparameter tuning of machine learning models. The approach combines two well-established concepts, Surrogate-Based Optimization (SBO) and parallelization, to efficiently search for optimal parameter setups with as few function evaluations as possible. Through in-depth analysis, the need for parallel SBO solvers is emphasized, and it is demonstrated that they outperform model-free algorithms in scenarios with a low evaluation budget. The SBO approach helps practitioners save significant amounts of time and resources in hyperparameter tuning as well as other optimization projects. As a highlight, a novel framework for objectively comparing the efficiency of parallel SBO algorithms is introduced, enabling practitioners to evaluate and select the most effective approach for their specific use case. Based on practical examples, decision support is delivered, detailing which parts of industrial optimization projects can be parallelized and how to prioritize which parts to parallelize first. By following the framework, practitioners can make informed decisions about how to allocate resources and optimize their models efficiently.


Parallel Problem Solving from Nature – PPSN XVI

Parallel Problem Solving from Nature – PPSN XVI

Author: Thomas Bäck

Publisher: Springer Nature

Published: 2020-09-02

Total Pages: 753

ISBN-13: 3030581128

DOWNLOAD EBOOK

This two-volume set LNCS 12269 and LNCS 12270 constitutes the refereed proceedings of the 16th International Conference on Parallel Problem Solving from Nature, PPSN 2020, held in Leiden, The Netherlands, in September 2020. The 99 revised full papers were carefully reviewed and selected from 268 submissions. The topics cover classical subjects such as automated algorithm selection and configuration; Bayesian- and surrogate-assisted optimization; benchmarking and performance measures; combinatorial optimization; connection between nature-inspired optimization and artificial intelligence; genetic and evolutionary algorithms; genetic programming; landscape analysis; multiobjective optimization; real-world applications; reinforcement learning; and theoretical aspects of nature-inspired optimization.


KI 2017: Advances in Artificial Intelligence

KI 2017: Advances in Artificial Intelligence

Author: Gabriele Kern-Isberner

Publisher: Springer

Published: 2017-09-18

Total Pages: 411

ISBN-13: 3319671901

DOWNLOAD EBOOK

This book constitutes the refereed proceedings of the 40th Annual German Conference on Artificial Intelligence, KI 2017 held in Dortmund, Germany in September 2017. The 20 revised full technical papers presented together with 16 short technical communications were carefully reviewed and selected from 73 submissions. The conference cover a range of topics from, e. g., agents, robotics, cognitive sciences, machine learning, planning, knowledge representation, reasoning, and ontologies, with numerous applications in areas like social media, psychology, transportation systems and reflecting the richness and diversity of their field.


Online Engineering & Internet of Things

Online Engineering & Internet of Things

Author: Michael E. Auer

Publisher: Springer

Published: 2017-09-14

Total Pages: 1066

ISBN-13: 3319643525

DOWNLOAD EBOOK

This book discusses online engineering and virtual instrumentation, typical working areas for today’s engineers and inseparably connected with areas such as Internet of Things, cyber-physical systems, collaborative networks and grids, cyber cloud technologies, and service architectures, to name just a few. It presents the outcomes of the 14th International Conference on Remote Engineering and Virtual Instrumentation (REV2017), held at Columbia University in New York from 15 to 17 March 2017. The conference addressed fundamentals, applications and experiences in the field of online engineering and virtual instrumentation in the light of growing interest in and need for teleworking, remote services and collaborative working environments as a result of the globalization of education. The book also discusses guidelines for education in university-level courses for these topics.


Deep Learning Applications with Practical Measured Results in Electronics Industries

Deep Learning Applications with Practical Measured Results in Electronics Industries

Author: Mong-Fong Horng

Publisher: MDPI

Published: 2020-05-22

Total Pages: 272

ISBN-13: 3039288636

DOWNLOAD EBOOK

This book collects 14 articles from the Special Issue entitled “Deep Learning Applications with Practical Measured Results in Electronics Industries” of Electronics. Topics covered in this Issue include four main parts: (1) environmental information analyses and predictions, (2) unmanned aerial vehicle (UAV) and object tracking applications, (3) measurement and denoising techniques, and (4) recommendation systems and education systems. These authors used and improved deep learning techniques (e.g., ResNet (deep residual network), Faster-RCNN (faster regions with convolutional neural network), LSTM (long short term memory), ConvLSTM (convolutional LSTM), GAN (generative adversarial network), etc.) to analyze and denoise measured data in a variety of applications and services (e.g., wind speed prediction, air quality prediction, underground mine applications, neural audio caption, etc.). Several practical experiments were conducted, and the results indicate that the performance of the presented deep learning methods is improved compared with the performance of conventional machine learning methods.


Computational Intelligence in Intelligent Data Analysis

Computational Intelligence in Intelligent Data Analysis

Author: Christian Moewes

Publisher: Springer

Published: 2012-08-23

Total Pages: 298

ISBN-13: 3642323782

DOWNLOAD EBOOK

Complex systems and their phenomena are ubiquitous as they can be found in biology, finance, the humanities, management sciences, medicine, physics and similar fields. For many problems in these fields, there are no conventional ways to mathematically or analytically solve them completely at low cost. On the other hand, nature already solved many optimization problems efficiently. Computational intelligence attempts to mimic nature-inspired problem-solving strategies and methods. These strategies can be used to study, model and analyze complex systems such that it becomes feasible to handle them. Key areas of computational intelligence are artificial neural networks, evolutionary computation and fuzzy systems. As only a few researchers in that field, Rudolf Kruse has contributed in many important ways to the understanding, modeling and application of computational intelligence methods. On occasion of his 60th birthday, a collection of original papers of leading researchers in the field of computational intelligence has been collected in this volume.


Recommender Systems Handbook

Recommender Systems Handbook

Author: Francesco Ricci

Publisher: Springer

Published: 2015-11-17

Total Pages: 1008

ISBN-13: 148997637X

DOWNLOAD EBOOK

This second edition of a well-received text, with 20 new chapters, presents a coherent and unified repository of recommender systems’ major concepts, theories, methodologies, trends, and challenges. A variety of real-world applications and detailed case studies are included. In addition to wholesale revision of the existing chapters, this edition includes new topics including: decision making and recommender systems, reciprocal recommender systems, recommender systems in social networks, mobile recommender systems, explanations for recommender systems, music recommender systems, cross-domain recommendations, privacy in recommender systems, and semantic-based recommender systems. This multi-disciplinary handbook involves world-wide experts from diverse fields such as artificial intelligence, human-computer interaction, information retrieval, data mining, mathematics, statistics, adaptive user interfaces, decision support systems, psychology, marketing, and consumer behavior. Theoreticians and practitioners from these fields will find this reference to be an invaluable source of ideas, methods and techniques for developing more efficient, cost-effective and accurate recommender systems.


Machine Learning and Data Mining

Machine Learning and Data Mining

Author: Ryszad S. Michalski

Publisher: Wiley

Published: 1998-04-22

Total Pages: 472

ISBN-13: 9780471971993

DOWNLOAD EBOOK

Master the new computational tools to get the most out of your information system. This practical guide, the first to clearly outline the situation for the benefit of engineers and scientists, provides a straightforward introduction to basic machine learning and data mining methods, covering the analysis of numerical, text, and sound data.