Generalizability theory offers an extensive conceptual framework and a powerful set of statistical procedures for characterizing and quantifying the fallibility of measurements. Robert Brennan, the author, has written the most comprehensive and up-to-date treatment of generalizability theory. The book provides a synthesis of those parts of the statistical literature that are directly applicable to generalizability theory. The principal intended audience is measurement practitioners and graduate students in the behavioral and social sciences, although a few examples and references are provided from other fields. Readers will benefit from some familiarity with classical test theory and analysis of variance, but the treatment of most topics does not presume specific background.
Accessible to any professional or researcher who has a basic understanding of analysis of variance, Shavelson and Webb offer an intuitive development of generalizability theory, a technique for estimating the relative magnitudes of various components of error variation and for indicating the most efficient strategy for achieving desired measurement precision. Covering a variety of topics such as generalizability studies with nested facets and with fixed facets, measurement error and generalizability coefficients, and decision studies with same and with different designs, the text includes exercises so the reader may practice the application of each chapter's material. By using detailed illustrations and examples, Shavelson and Webb clearly describe the logic underlying major concepts in generalizability theory to enable readers to apply these methods when investigating the consistency of their own measurements.
Intended to help improve measurement and data collection methods in the behavioral, social, and medical sciences, this book demonstrates an expanded and accessible use of Generalizability Theory (G theory). G theory conceptually models the way in which the reliability of measurement is ascertained. Sources of score variation are identified as potential contributors to measurement error and taken into account accordingly. The authors demonstrate the powerful potential of G theory by showing how to improve the quality of any kind of measurement, regardless of the discipline. Readers will appreciate the conversational style used to present a comprehensive review of G theory and its application using the freeware EduG. To maximize understanding the authors illustrate all fundamental principles with concrete examples from different fields and contexts. Annotated applications lead students through the main concepts of G theory, while illustrating both the use of EduG and interpretation of its output. Formulas are avoided wherever possible. Exercises with data sets available on the Psychology Press website allow readers to carry out their own analyses to reinforce understanding. Brief overviews of analysis of variance, estimation, and the statistical error model are provided for review. The procedures involved in carrying out a generalizability study using EduG follow, as well as guidance in the interpretation of results. Real-world applications of G theory to the assessment of depression, managerial ability, attitudes, and writing and mathematical skills are then presented. Next, annotated exercises provide an opportunity for readers to use EduG and interpret its results. The book concludes with a review of the development of G theory and possible new directions of application. Finally, for those with a strong statistical background, the appendixes provide the formulas used by EduG. Ideal as a supplement for courses on measurement theory and/or generalizability theory taught in departments of psychology, education, medicine, and the social sciences, this text will also appeal to researchers from a variety of fields interested in learning how to apply G theory to their studies.
Generalizability theory offers an extensive conceptual framework and a powerful set of statistical procedures for characterizing and quantifying the fallibility of measurements. Robert Brennan, the author, has written the most comprehensive and up-to-date treatment of generalizability theory. The book provides a synthesis of those parts of the statistical literature that are directly applicable to generalizability theory. The principal intended audience is measurement practitioners and graduate students in the behavioral and social sciences, although a few examples and references are provided from other fields. Readers will benefit from some familiarity with classical test theory and analysis of variance, but the treatment of most topics does not presume specific background.
Intended to help improve measurement and data collection methods in the behavioral, social, and medical sciences, this book demonstrates an expanded and accessible use of Generalizability Theory (G theory). G theory conceptually models the way in which the reliability of measurement is ascertained. Sources of score variation are identified as potential contributors to measurement error and taken into account accordingly. The authors demonstrate the powerful potential of G theory by showing how to improve the quality of any kind of measurement, regardless of the discipline. Readers will appreciate the conversational style used to present a comprehensive review of G theory and its application using the freeware EduG. To maximize understanding the authors illustrate all fundamental principles with concrete examples from different fields and contexts. Annotated applications lead students through the main concepts of G theory, while illustrating both the use of EduG and interpretation of its output. Formulas are avoided wherever possible. Exercises with data sets available on the Psychology Press website allow readers to carry out their own analyses to reinforce understanding. Brief overviews of analysis of variance, estimation, and the statistical error model are provided for review. The procedures involved in carrying out a generalizability study using EduG follow, as well as guidance in the interpretation of results. Real-world applications of G theory to the assessment of depression, managerial ability, attitudes, and writing and mathematical skills are then presented. Next, annotated exercises provide an opportunity for readers to use EduG and interpret its results. The book concludes with a review of the development of G theory and possible new directions of application. Finally, for those with a strong statistical background, the appendixes provide the formulas used by EduG. Ideal as a supplement for courses on measurement theory and/or generalizability theory taught in departments of psychology, education, medicine, and the social sciences, this text will also appeal to researchers from a variety of fields interested in learning how to apply G theory to their studies.
This new text provides a state-of the-art introduction to educational and psychological testing and measurement theory that reflects many intellectual developments of the past two decades. The book introduces psychometric theory using a latent variable modeling (LVM) framework and emphasizes interval estimation throughout, so as to better prepare readers for studying more advanced topics later in their careers. Featuring numerous examples, it presents an applied approach to conducting testing and measurement in the behavioral, social, and educational sciences. Readers will find numerous tips on how to use test theory in today’s actual testing situations. To reflect the growing use of statistical software in psychometrics, the authors introduce the use of Mplus after the first few chapters. IBM SPSS, SAS, and R are also featured in several chapters. Software codes and associated outputs are reviewed throughout to enhance comprehension. Essentially all of the data used in the book are available on the website. In addition instructors will find helpful PowerPoint lecture slides and questions and problems for each chapter. The authors rely on LVM when discussing fundamental concepts such as exploratory and confirmatory factor analysis, test theory, generalizability theory, reliability and validity, interval estimation, nonlinear factor analysis, generalized linear modeling, and item response theory. The varied applications make this book a valuable tool for those in the behavioral, social, educational, and biomedical disciplines, as well as in business, economics, and marketing. A brief introduction to R is also provided. Intended as a text for advanced undergraduate and/or graduate courses in psychometrics, testing and measurement, measurement theory, psychological testing, and/or educational and/or psychological measurement taught in departments of psychology, education, human development, epidemiology, business, and marketing, it will also appeal to researchers in these disciplines. Prerequisites include an introduction to statistics with exposure to regression analysis and ANOVA. Familiarity with SPSS, SAS, STATA, or R is also beneficial. As a whole, the book provides an invaluable introduction to measurement and test theory to those with limited or no familiarity with the mathematical and statistical procedures involved in measurement and testing.
Grounded in current knowledge and professional practice, this book provides up-to-date coverage of psychometric theory, methods, and interpretation of results. Essential topics include measurement and statistical concepts, scaling models, test design and development, reliability, validity, factor analysis, item response theory, and generalizability theory. Also addressed are norming and test equating, topics not typically covered in traditional psychometrics texts. Examples drawn from a dataset on intelligence testing are used throughout the book, elucidating the assumptions underlying particular methods and providing SPSS (or alternative) syntax for conducting analyses. The companion website presents datasets for all examples as well as PowerPoint slides of figures and key concepts. Pedagogical features include equation boxes with explanations of statistical notation, and end-of-chapter glossaries. The Appendix offers extensions of the topical chapters with example source code from SAS, SPSS, IRTPRO, BILOG-MG, PARSCALE, TESTFACT, and DIMTEST.
Multivariate statistics and mathematical models provide flexible and powerful tools essential in most disciplines. Nevertheless, many practicing researchers lack an adequate knowledge of these techniques, or did once know the techniques, but have not been able to keep abreast of new developments. The Handbook of Applied Multivariate Statistics and Mathematical Modeling explains the appropriate uses of multivariate procedures and mathematical modeling techniques, and prescribe practices that enable applied researchers to use these procedures effectively without needing to concern themselves with the mathematical basis. The Handbook emphasizes using models and statistics as tools. The objective of the book is to inform readers about which tool to use to accomplish which task. Each chapter begins with a discussion of what kinds of questions a particular technique can and cannot answer. As multivariate statistics and modeling techniques are useful across disciplines, these examples include issues of concern in biological and social sciences as well as the humanities.
