Large-Scale Nonlinear Optimization

Large-Scale Nonlinear Optimization

Author: Gianni Pillo

Publisher: Springer Science & Business Media

Published: 2006-06-03

Total Pages: 297

ISBN-13: 0387300651

DOWNLOAD EBOOK

This book reviews and discusses recent advances in the development of methods and algorithms for nonlinear optimization and its applications, focusing on the large-dimensional case, the current forefront of much research. Individual chapters, contributed by eminent authorities, provide an up-to-date overview of the field from different and complementary standpoints, including theoretical analysis, algorithmic development, implementation issues and applications.


Large-Scale PDE-Constrained Optimization

Large-Scale PDE-Constrained Optimization

Author: Lorenz T. Biegler

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 347

ISBN-13: 364255508X

DOWNLOAD EBOOK

Optimal design, optimal control, and parameter estimation of systems governed by partial differential equations (PDEs) give rise to a class of problems known as PDE-constrained optimization. The size and complexity of the discretized PDEs often pose significant challenges for contemporary optimization methods. With the maturing of technology for PDE simulation, interest has now increased in PDE-based optimization. The chapters in this volume collectively assess the state of the art in PDE-constrained optimization, identify challenges to optimization presented by modern highly parallel PDE simulation codes, and discuss promising algorithmic and software approaches for addressing them. These contributions represent current research of two strong scientific computing communities, in optimization and PDE simulation. This volume merges perspectives in these two different areas and identifies interesting open questions for further research.


Large-Scale Optimization with Applications

Large-Scale Optimization with Applications

Author: Lorenz T. Biegler

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 339

ISBN-13: 1461219604

DOWNLOAD EBOOK

With contributions by specialists in optimization and practitioners in the fields of aerospace engineering, chemical engineering, and fluid and solid mechanics, the major themes include an assessment of the state of the art in optimization algorithms as well as challenging applications in design and control, in the areas of process engineering and systems with partial differential equation models.


Computational Optimization

Computational Optimization

Author: Jong-Shi Pang

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 266

ISBN-13: 1461551978

DOWNLOAD EBOOK

Computational Optimization: A Tribute to Olvi Mangasarian serves as an excellent reference, providing insight into some of the most challenging research issues in the field. This collection of papers covers a wide spectrum of computational optimization topics, representing a blend of familiar nonlinear programming topics and such novel paradigms as semidefinite programming and complementarity-constrained nonlinear programs. Many new results are presented in these papers which are bound to inspire further research and generate new avenues for applications. An informal categorization of the papers includes: Algorithmic advances for special classes of constrained optimization problems Analysis of linear and nonlinear programs Algorithmic advances B- stationary points of mathematical programs with equilibrium constraints Applications of optimization Some mathematical topics Systems of nonlinear equations.


Practical Optimization

Practical Optimization

Author: Philip E. Gill

Publisher: SIAM

Published: 2019-12-16

Total Pages: 422

ISBN-13: 1611975603

DOWNLOAD EBOOK

In the intervening years since this book was published in 1981, the field of optimization has been exceptionally lively. This fertility has involved not only progress in theory, but also faster numerical algorithms and extensions into unexpected or previously unknown areas such as semidefinite programming. Despite these changes, many of the important principles and much of the intuition can be found in this Classics version of Practical Optimization. This book provides model algorithms and pseudocode, useful tools for users who prefer to write their own code as well as for those who want to understand externally provided code. It presents algorithms in a step-by-step format, revealing the overall structure of the underlying procedures and thereby allowing a high-level perspective on the fundamental differences. And it contains a wealth of techniques and strategies that are well suited for optimization in the twenty-first century, and particularly in the now-flourishing fields of data science, “big data,” and machine learning. Practical Optimization is appropriate for advanced undergraduates, graduate students, and researchers interested in methods for solving optimization problems.


Applications of Linear and Nonlinear Models

Applications of Linear and Nonlinear Models

Author: Erik W. Grafarend

Publisher: Springer Nature

Published: 2022-10-01

Total Pages: 1127

ISBN-13: 3030945987

DOWNLOAD EBOOK

This book provides numerous examples of linear and nonlinear model applications. Here, we present a nearly complete treatment of the Grand Universe of linear and weakly nonlinear regression models within the first 8 chapters. Our point of view is both an algebraic view and a stochastic one. For example, there is an equivalent lemma between a best, linear uniformly unbiased estimation (BLUUE) in a Gauss–Markov model and a least squares solution (LESS) in a system of linear equations. While BLUUE is a stochastic regression model, LESS is an algebraic solution. In the first six chapters, we concentrate on underdetermined and overdetermined linear systems as well as systems with a datum defect. We review estimators/algebraic solutions of type MINOLESS, BLIMBE, BLUMBE, BLUUE, BIQUE, BLE, BIQUE, and total least squares. The highlight is the simultaneous determination of the first moment and the second central moment of a probability distribution in an inhomogeneous multilinear estimation by the so-called E-D correspondence as well as its Bayes design. In addition, we discuss continuous networks versus discrete networks, use of Grassmann–Plucker coordinates, criterion matrices of type Taylor–Karman as well as FUZZY sets. Chapter seven is a speciality in the treatment of an overjet. This second edition adds three new chapters: (1) Chapter on integer least squares that covers (i) model for positioning as a mixed integer linear model which includes integer parameters. (ii) The general integer least squares problem is formulated, and the optimality of the least squares solution is shown. (iii) The relation to the closest vector problem is considered, and the notion of reduced lattice basis is introduced. (iv) The famous LLL algorithm for generating a Lovasz reduced basis is explained. (2) Bayes methods that covers (i) general principle of Bayesian modeling. Explain the notion of prior distribution and posterior distribution. Choose the pragmatic approach for exploring the advantages of iterative Bayesian calculations and hierarchical modeling. (ii) Present the Bayes methods for linear models with normal distributed errors, including noninformative priors, conjugate priors, normal gamma distributions and (iii) short outview to modern application of Bayesian modeling. Useful in case of nonlinear models or linear models with no normal distribution: Monte Carlo (MC), Markov chain Monte Carlo (MCMC), approximative Bayesian computation (ABC) methods. (3) Error-in-variables models, which cover: (i) Introduce the error-in-variables (EIV) model, discuss the difference to least squares estimators (LSE), (ii) calculate the total least squares (TLS) estimator. Summarize the properties of TLS, (iii) explain the idea of simulation extrapolation (SIMEX) estimators, (iv) introduce the symmetrized SIMEX (SYMEX) estimator and its relation to TLS, and (v) short outview to nonlinear EIV models. The chapter on algebraic solution of nonlinear system of equations has also been updated in line with the new emerging field of hybrid numeric-symbolic solutions to systems of nonlinear equations, ermined system of nonlinear equations on curved manifolds. The von Mises–Fisher distribution is characteristic for circular or (hyper) spherical data. Our last chapter is devoted to probabilistic regression, the special Gauss–Markov model with random effects leading to estimators of type BLIP and VIP including Bayesian estimation. A great part of the work is presented in four appendices. Appendix A is a treatment, of tensor algebra, namely linear algebra, matrix algebra, and multilinear algebra. Appendix B is devoted to sampling distributions and their use in terms of confidence intervals and confidence regions. Appendix C reviews the elementary notions of statistics, namely random events and stochastic processes. Appendix D introduces the basics of Groebner basis algebra, its careful definition, the Buchberger algorithm, especially the C. F. Gauss combinatorial algorithm.


Separable Optimization

Separable Optimization

Author: Stefan M. Stefanov

Publisher: Springer Nature

Published: 2022-01-01

Total Pages: 360

ISBN-13: 3030784010

DOWNLOAD EBOOK

In this book, the theory, methods and applications of separable optimization are considered. Some general results are presented, techniques of approximating the separable problem by linear programming problem, and dynamic programming are also studied. Convex separable programs subject to inequality/ equality constraint(s) and bounds on variables are also studied and convergent iterative algorithms of polynomial complexity are proposed. As an application, these algorithms are used in the implementation of stochastic quasigradient methods to some separable stochastic programs. The problems of numerical approximation of tabulated functions and numerical solution of overdetermined systems of linear algebraic equations and some systems of nonlinear equations are solved by separable convex unconstrained minimization problems. Some properties of the Knapsack polytope are also studied. This second edition includes a substantial amount of new and revised content. Three new chapters, 15-17, are included. Chapters 15-16 are devoted to the further analysis of the Knapsack problem. Chapter 17 is focused on the analysis of a nonlinear transportation problem. Three new Appendices (E-G) are also added to this edition and present technical details that help round out the coverage. Optimization problems and methods for solving the problems considered are interesting not only from the viewpoint of optimization theory, optimization methods and their applications, but also from the viewpoint of other fields of science, especially the artificial intelligence and machine learning fields within computer science. This book is intended for the researcher, practitioner, or engineer who is interested in the detailed treatment of separable programming and wants to take advantage of the latest theoretical and algorithmic results. It may also be used as a textbook for a special topics course or as a supplementary textbook for graduate courses on nonlinear and convex optimization.


Computational Methods for Large Sparse Power Systems Analysis

Computational Methods for Large Sparse Power Systems Analysis

Author: S.A. Soman

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 349

ISBN-13: 1461508231

DOWNLOAD EBOOK

Computational methods in Power Systems require significant inputs from diverse disciplines, such as data base structures, numerical analysis etc. Strategic decisions in sparsity exploitation and algorithm design influence large-scale simulation and high-speed computations. Selection of programming paradigm shapes the design, its modularity and reusability. This has a far reaching effect on software maintenance. Computational Methods for Large Sparse Power Systems Analysis: An Object Oriented Approach provides a unified object oriented (OO) treatment for power system analysis. Sparsity exploitation techniques in OO paradigm are emphasized to facilitate large scale and fast computing. Specific applications like large-scale load flow, short circuit analysis, state estimation and optimal power flow are discussed within this framework. A chapter on modeling and computational issues in power system dynamics is also included. Motivational examples and illustrations are included throughout the book. A library of C++ classes provided along with this book has classes for transmission lines, transformers, substation etc. A CD-ROM with C++ programs is also included. It contains load flow, short circuit analysis and network topology processor applications. Power system data is provided and systems up to 150 buses can be studied. Other Special Features: This book is the first of its kind, covering power system applications designed with an OO perspective. Chapters on object orientation for modeling of power system computations, data structure, large sparse linear system solver, sparse QR decomposition in an OO framework are special features of this book.