Recently, increasing interest has been shown in applying the concept of Pareto-optimality to machine learning, particularly inspired by the successful developments in evolutionary multi-objective optimization. It has been shown that the multi-objective approach to machine learning is particularly successful to improve the performance of the traditional single objective machine learning methods, to generate highly diverse multiple Pareto-optimal models for constructing ensembles models and, and to achieve a desired trade-off between accuracy and interpretability of neural networks or fuzzy systems. This monograph presents a selected collection of research work on multi-objective approach to machine learning, including multi-objective feature selection, multi-objective model selection in training multi-layer perceptrons, radial-basis-function networks, support vector machines, decision trees, and intelligent systems.
This book focuses on the most well-regarded and recent nature-inspired algorithms capable of solving optimization problems with multiple objectives. Firstly, it provides preliminaries and essential definitions in multi-objective problems and different paradigms to solve them. It then presents an in-depth explanations of the theory, literature review, and applications of several widely-used algorithms, such as Multi-objective Particle Swarm Optimizer, Multi-Objective Genetic Algorithm and Multi-objective GreyWolf Optimizer Due to the simplicity of the techniques and flexibility, readers from any field of study can employ them for solving multi-objective optimization problem. The book provides the source codes for all the proposed algorithms on a dedicated webpage.
This book constitutes the refereed proceedings of the 21th Australasian Joint Conference on Artificial Intelligence, AI 2008, held in Auckland, New Zealand, in December 2008. The 42 revised full papers and 21 revised short papers presented together with 1 invited lecture were carefully reviewed and selected from 143 submissions. The papers are organized in topical sections on knowledge representation, constraints, planning, grammar and language processing, statistical learning, machine learning, data mining, knowledge discovery, soft computing, vision and image processing, and AI applications.
Multi-objective optimization (MO) is a fast-developing field in computational intelligence research. Giving decision makers more options to choose from using some post-analysis preference information, there are a number of competitive MO techniques with an increasingly large number of MO real-world applications. Multi-Objective Optimization in Computational Intelligence: Theory and Practice explores the theoretical, as well as empirical, performance of MOs on a wide range of optimization issues including combinatorial, real-valued, dynamic, and noisy problems. This book provides scholars, academics, and practitioners with a fundamental, comprehensive collection of research on multi-objective optimization techniques, applications, and practices.
- Detailed MOEA applications discussed by international experts - State-of-the-art practical insights in tackling statistical optimization with MOEAs - A unique monograph covering a wide spectrum of real-world applications - Step-by-step discussion of MOEA applications in a variety of domains
Many kinds of practical problems such as engineering design, industrial m- agement and ?nancial investment have multiple objectives con?icting with eachother. Thoseproblemscanbeformulatedasmultiobjectiveoptimization. In multiobjective optimization, there does not necessarily a unique solution which minimizes (or maximizes) all objective functions. We usually face to the situation in which if we want to improve some of objectives, we have to give up other objectives. Finally, we pay much attention on how much to improve some of objectives and instead how much to give up others. This is called “trade-o?. ” Note that making trade-o? is a problem of value ju- ment of decision makers. One of main themes of multiobjective optimization is how to incorporate value judgment of decision makers into decision s- port systems. There are two major issues in value judgment (1) multiplicity of value judgment and (2) dynamics of value judgment. The multiplicity of value judgment is treated as trade-o? analysis in multiobjective optimi- tion. On the other hand, dynamics of value judgment is di?cult to treat. However, it is natural that decision makers change their value judgment even in decision making process, because they obtain new information during the process. Therefore, decision support systems are to be robust against the change of value judgment of decision makers. To this aim, interactive p- grammingmethodswhichsearchasolutionwhileelicitingpartialinformation on value judgment of decision makers have been developed. Those methods are required to perform ?exibly for decision makers’ attitude.
Machine learning techniques provide cost-effective alternatives to traditional methods for extracting underlying relationships between information and data and for predicting future events by processing existing information to train models. Efficient Learning Machines explores the major topics of machine learning, including knowledge discovery, classifications, genetic algorithms, neural networking, kernel methods, and biologically-inspired techniques. Mariette Awad and Rahul Khanna’s synthetic approach weaves together the theoretical exposition, design principles, and practical applications of efficient machine learning. Their experiential emphasis, expressed in their close analysis of sample algorithms throughout the book, aims to equip engineers, students of engineering, and system designers to design and create new and more efficient machine learning systems. Readers of Efficient Learning Machines will learn how to recognize and analyze the problems that machine learning technology can solve for them, how to implement and deploy standard solutions to sample problems, and how to design new systems and solutions. Advances in computing performance, storage, memory, unstructured information retrieval, and cloud computing have coevolved with a new generation of machine learning paradigms and big data analytics, which the authors present in the conceptual context of their traditional precursors. Awad and Khanna explore current developments in the deep learning techniques of deep neural networks, hierarchical temporal memory, and cortical algorithms. Nature suggests sophisticated learning techniques that deploy simple rules to generate highly intelligent and organized behaviors with adaptive, evolutionary, and distributed properties. The authors examine the most popular biologically-inspired algorithms, together with a sample application to distributed datacenter management. They also discuss machine learning techniques for addressing problems of multi-objective optimization in which solutions in real-world systems are constrained and evaluated based on how well they perform with respect to multiple objectives in aggregate. Two chapters on support vector machines and their extensions focus on recent improvements to the classification and regression techniques at the core of machine learning.
Multi-Objective Optimization in Theory and Practice is a traditional two-part approach to solving multi-objective optimization (MOO) problems namely the use of classical methods and evolutionary algorithms. This first book is devoted to classical methods including the extended simplex method by Zeleny and preference-based techniques. This part covers three main topics through nine chapters. The first topic focuses on the design of such MOO problems, their complexities including nonlinearities and uncertainties, and optimality theory. The second topic introduces the founding solving methods including the extended simplex method to linear MOO problems and weighting objective methods. The third topic deals with particular structures of MOO problems, such as mixed-integer programming, hierarchical programming, fuzzy logic programming, and bimatrix games. Multi-Objective Optimization in Theory and Practice is a user-friendly book with detailed, illustrated calculations, examples, test functions, and small-size applications in Mathematica® (among other mathematical packages) and from scholarly literature. It is an essential handbook for students and teachers involved in advanced optimization courses in engineering, information science, and mathematics degree programs.
Problems with multiple objectives and criteria are generally known as multiple criteria optimization or multiple criteria decision-making (MCDM) problems. So far, these types of problems have typically been modelled and solved by means of linear programming. However, many real-life phenomena are of a nonlinear nature, which is why we need tools for nonlinear programming capable of handling several conflicting or incommensurable objectives. In this case, methods of traditional single objective optimization and linear programming are not enough; we need new ways of thinking, new concepts, and new methods - nonlinear multiobjective optimization. Nonlinear Multiobjective Optimization provides an extensive, up-to-date, self-contained and consistent survey, review of the literature and of the state of the art on nonlinear (deterministic) multiobjective optimization, its methods, its theory and its background. The amount of literature on multiobjective optimization is immense. The treatment in this book is based on approximately 1500 publications in English printed mainly after the year 1980. Problems related to real-life applications often contain irregularities and nonsmoothnesses. The treatment of nondifferentiable multiobjective optimization in the literature is rather rare. For this reason, this book contains material about the possibilities, background, theory and methods of nondifferentiable multiobjective optimization as well. This book is intended for both researchers and students in the areas of (applied) mathematics, engineering, economics, operations research and management science; it is meant for both professionals and practitioners in many different fields of application. The intention has been to provide a consistent summary that may help in selecting an appropriate method for the problem to be solved. It is hoped the extensive bibliography will be of value to researchers.
Multiobjective optimization deals with solving problems having not only one, but multiple, often conflicting, criteria. Such problems can arise in practically every field of science, engineering and business, and the need for efficient and reliable solution methods is increasing. The task is challenging due to the fact that, instead of a single optimal solution, multiobjective optimization results in a number of solutions with different trade-offs among criteria, also known as Pareto optimal or efficient solutions. Hence, a decision maker is needed to provide additional preference information and to identify the most satisfactory solution. Depending on the paradigm used, such information may be introduced before, during, or after the optimization process. Clearly, research and application in multiobjective optimization involve expertise in optimization as well as in decision support. This state-of-the-art survey originates from the International Seminar on Practical Approaches to Multiobjective Optimization, held in Dagstuhl Castle, Germany, in December 2006, which brought together leading experts from various contemporary multiobjective optimization fields, including evolutionary multiobjective optimization (EMO), multiple criteria decision making (MCDM) and multiple criteria decision aiding (MCDA). This book gives a unique and detailed account of the current status of research and applications in the field of multiobjective optimization. It contains 16 chapters grouped in the following 5 thematic sections: Basics on Multiobjective Optimization; Recent Interactive and Preference-Based Approaches; Visualization of Solutions; Modelling, Implementation and Applications; and Quality Assessment, Learning, and Future Challenges.
