Optimal Design of Experiments offers a rare blend of linear algebra, convex analysis, and statistics. The optimal design for statistical experiments is first formulated as a concave matrix optimization problem. Using tools from convex analysis, the problem is solved generally for a wide class of optimality criteria such as D-, A-, or E-optimality. The book then offers a complementary approach that calls for the study of the symmetry properties of the design problem, exploiting such notions as matrix majorization and the Kiefer matrix ordering. The results are illustrated with optimal designs for polynomial fit models, Bayes designs, balanced incomplete block designs, exchangeable designs on the cube, rotatable designs on the sphere, and many other examples.
Wim van der Linden was just given a lifetime achievement award by the National Council on Measurement in Education. There is no one more prominent in the area of educational testing. There are hundreds of computer-based credentialing exams in areas such as accounting, real estate, nursing, and securities, as well as the well-known admissions exams for college, graduate school, medical school, and law school - there is great need on the theory of testing. This book presents the statistical theory and practice behind constructing good tests e.g., how is the first test item selected, how are the next items selected, and when do you have enough items.
1. The generalized moment problem. 1.1. Formulations. 1.2. Duality theory. 1.3. Computational complexity. 1.4. Summary. 1.5. Exercises. 1.6. Notes and sources -- 2. Positive polynomials. 2.1. Sum of squares representations and semi-definite optimization. 2.2. Nonnegative versus s.o.s. polynomials. 2.3. Representation theorems : univariate case. 2.4. Representation theorems : mutivariate case. 2.5. Polynomials positive on a compact basic semi-algebraic set. 2.6. Polynomials nonnegative on real varieties. 2.7. Representations with sparsity properties. 2.8. Representation of convex polynomials. 2.9. Summary. 2.10. Exercises. 2.11. Notes and sources -- 3. Moments. 3.1. The one-dimensional moment problem. 3.2. The multi-dimensional moment problem. 3.3. The K-moment problem. 3.4. Moment conditions for bounded density. 3.5. Summary. 3.6. Exercises. 3.7. Notes and sources -- 4. Algorithms for moment problems. 4.1. The overall approach. 4.2. Semidefinite relaxations. 4.3. Extraction of solutions. 4.4. Linear relaxations. 4.5. Extensions. 4.6. Exploiting sparsity. 4.7. Summary. 4.8. Exercises. 4.9. Notes and sources. 4.10. Proofs -- 5. Global optimization over polynomials. 5.1. The primal and dual perspectives. 5.2. Unconstrained polynomial optimization. 5.3. Constrained polynomial optimization : semidefinite relaxations. 5.4. Linear programming relaxations. 5.5. Global optimality conditions. 5.6. Convex polynomial programs. 5.7. Discrete optimization. 5.8. Global minimization of a rational function. 5.9. Exploiting symmetry. 5.10. Summary. 5.11. Exercises. 5.12. Notes and sources -- 6. Systems of polynomial equations. 6.1. Introduction. 6.2. Finding a real solution to systems of polynomial equations. 6.3. Finding all complex and/or all real solutions : a unified treatment. 6.4. Summary. 6.5. Exercises. 6.6. Notes and sources -- 7. Applications in probability. 7.1. Upper bounds on measures with moment conditions. 7.2. Measuring basic semi-algebraic sets. 7.3. Measures with given marginals. 7.4. Summary. 7.5. Exercises. 7.6. Notes and sources -- 8. Markov chains applications. 8.1. Bounds on invariant measures. 8.2. Evaluation of ergodic criteria. 8.3. Summary. 8.4. Exercises. 8.5. Notes and sources -- 9. Application in mathematical finance. 9.1. Option pricing with moment information. 9.2. Option pricing with a dynamic model. 9.3. Summary. 9.4. Notes and sources -- 10. Application in control. 10.1. Introduction. 10.2. Weak formulation of optimal control problems. 10.3. Semidefinite relaxations for the OCP. 10.4. Summary. 10.5. Notes and sources -- 11. Convex envelope and representation of convex sets. 11.1. The convex envelope of a rational function. 11.2. Semidefinite representation of convex sets. 11.3. Algebraic certificates of convexity. 11.4. Summary. 11.5. Exercises. 11.6. Notes and sources -- 12. Multivariate integration 12.1. Integration of a rational function. 12.2. Integration of exponentials of polynomials. 12.3. Maximum entropy estimation. 12.4. Summary. 12.5. Exercises. 12.6. Notes and sources -- 13. Min-max problems and Nash equilibria. 13.1. Robust polynomial optimization. 13.2. Minimizing the sup of finitely many rational cunctions. 13.3. Application to Nash equilibria. 13.4. Exercises. 13.5. Notes and sources -- 14. Bounds on linear PDE. 14.1. Linear partial differential equations. 14.2. Notes and sources
The book dwells mainly on the optimality aspects of mixture designs. As mixture models are a special case of regression models, a general discussion on regression designs has been presented, which includes topics like continuous designs, de la Garza phenomenon, Loewner order domination, Equivalence theorems for different optimality criteria and standard optimality results for single variable polynomial regression and multivariate linear and quadratic regression models. This is followed by a review of the available literature on estimation of parameters in mixture models. Based on recent research findings, the volume also introduces optimal mixture designs for estimation of optimum mixing proportions in different mixture models, which include Scheffé’s quadratic model, Darroch-Waller model, log- contrast model, mixture-amount models, random coefficient models and multi-response model. Robust mixture designs and mixture designs in blocks have been also reviewed. Moreover, some applications of mixture designs in areas like agriculture, pharmaceutics and food and beverages have been presented. Familiarity with the basic concepts of design and analysis of experiments, along with the concept of optimality criteria are desirable prerequisites for a clear understanding of the book. It is likely to be helpful to both theoreticians and practitioners working in the area of mixture experiments.
Optimal Design for Nonlinear Response Models discusses the theory and applications of model-based experimental design with a strong emphasis on biopharmaceutical studies. The book draws on the authors' many years of experience in academia and the pharmaceutical industry. While the focus is on nonlinear models, the book begins with an explanation of
"This is an engaging and informative book on the modern practice of experimental design. The authors' writing style is entertaining, the consulting dialogs are extremely enjoyable, and the technical material is presented brilliantly but not overwhelmingly. The book is a joy to read. Everyone who practices or teaches DOE should read this book." - Douglas C. Montgomery, Regents Professor, Department of Industrial Engineering, Arizona State University "It's been said: 'Design for the experiment, don't experiment for the design.' This book ably demonstrates this notion by showing how tailor-made, optimal designs can be effectively employed to meet a client's actual needs. It should be required reading for anyone interested in using the design of experiments in industrial settings." —Christopher J. Nachtsheim, Frank A Donaldson Chair in Operations Management, Carlson School of Management, University of Minnesota This book demonstrates the utility of the computer-aided optimal design approach using real industrial examples. These examples address questions such as the following: How can I do screening inexpensively if I have dozens of factors to investigate? What can I do if I have day-to-day variability and I can only perform 3 runs a day? How can I do RSM cost effectively if I have categorical factors? How can I design and analyze experiments when there is a factor that can only be changed a few times over the study? How can I include both ingredients in a mixture and processing factors in the same study? How can I design an experiment if there are many factor combinations that are impossible to run? How can I make sure that a time trend due to warming up of equipment does not affect the conclusions from a study? How can I take into account batch information in when designing experiments involving multiple batches? How can I add runs to a botched experiment to resolve ambiguities? While answering these questions the book also shows how to evaluate and compare designs. This allows researchers to make sensible trade-offs between the cost of experimentation and the amount of information they obtain.
The increasing cost of research means that scientists are in more urgent need of optimal design theory to increase the efficiency of parameter estimators and the statistical power of their tests. The objectives of a good design are to provide interpretable and accurate inference at minimal costs. Optimal design theory can help to identify a design with maximum power and maximum information for a statistical model and, at the same time, enable researchers to check on the model assumptions. This Book: Introduces optimal experimental design in an accessible format. Provides guidelines for practitioners to increase the efficiency of their designs, and demonstrates how optimal designs can reduce a study’s costs. Discusses the merits of optimal designs and compares them with commonly used designs. Takes the reader from simple linear regression models to advanced designs for multiple linear regression and nonlinear models in a systematic manner. Illustrates design techniques with practical examples from social and biomedical research to enhance the reader’s understanding. Researchers and students studying social, behavioural and biomedical sciences will find this book useful for understanding design issues and in putting optimal design ideas to practice.
On the occasion of the 65th birthday of Professor Madan L. Puri, the authors of this Festschrift pay their tribute to his scientific achievements in statistics. This volume reflects a selective survey of leading contemprary scientific trends and developments that are significantly related to ideas expressed and pursued in Madan L. Puri's work in statistics and related fields. The wide spectrum of scientific interest which characterizes Professor Puri's scientific activity is thus illuminated. The choice of papers offered combines fundamental principles with interesting applications, selected for their originality and insight, and for their influence on the modern approach to statistics, probability and related fields.
Praise for the First Edition "The obvious enthusiasm of Myers, Montgomery, and Vining and their reliance on their many examples as a major focus of their pedagogy make Generalized Linear Models a joy to read. Every statistician working in any area of applied science should buy it and experience the excitement of these new approaches to familiar activities." —Technometrics Generalized Linear Models: With Applications in Engineering and the Sciences, Second Edition continues to provide a clear introduction to the theoretical foundations and key applications of generalized linear models (GLMs). Maintaining the same nontechnical approach as its predecessor, this update has been thoroughly extended to include the latest developments, relevant computational approaches, and modern examples from the fields of engineering and physical sciences. This new edition maintains its accessible approach to the topic by reviewing the various types of problems that support the use of GLMs and providing an overview of the basic, related concepts such as multiple linear regression, nonlinear regression, least squares, and the maximum likelihood estimation procedure. Incorporating the latest developments, new features of this Second Edition include: A new chapter on random effects and designs for GLMs A thoroughly revised chapter on logistic and Poisson regression, now with additional results on goodness of fit testing, nominal and ordinal responses, and overdispersion A new emphasis on GLM design, with added sections on designs for regression models and optimal designs for nonlinear regression models Expanded discussion of weighted least squares, including examples that illustrate how to estimate the weights Illustrations of R code to perform GLM analysis The authors demonstrate the diverse applications of GLMs through numerous examples, from classical applications in the fields of biology and biopharmaceuticals to more modern examples related to engineering and quality assurance. The Second Edition has been designed to demonstrate the growing computational nature of GLMs, as SAS®, Minitab®, JMP®, and R software packages are used throughout the book to demonstrate fitting and analysis of generalized linear models, perform inference, and conduct diagnostic checking. Numerous figures and screen shots illustrating computer output are provided, and a related FTP site houses supplementary material, including computer commands and additional data sets. Generalized Linear Models, Second Edition is an excellent book for courses on regression analysis and regression modeling at the upper-undergraduate and graduate level. It also serves as a valuable reference for engineers, scientists, and statisticians who must understand and apply GLMs in their work.
Here, the authors explain the basic ideas so as to generate interest in modern problems of experimental design. The topics discussed include designs for inference based on nonlinear models, designs for models with random parameters and stochastic processes, designs for model discrimination and incorrectly specified (contaminated) models, as well as examples of designs in functional spaces. Since the authors avoid technical details, the book assumes only a moderate background in calculus, matrix algebra, and statistics. However, at many places, hints are given as to how readers may enhance and adopt the basic ideas for advanced problems or applications. This allows the book to be used for courses at different levels, as well as serving as a useful reference for graduate students and researchers in statistics and engineering.
