In this book, experts in statistics and psychometrics describe classes of linkages, the history of score linkings, data collection designs, and methods used to achieve sound score linkages. They describe and critically discuss applications to a variety of domains. They define what linking is, to distinguish among the varieties of linking and to describe different procedure for linking. Furthermore, they convey the complexity and diversity of linking by covering different areas of linking and providing diverse perspectives.
This book provides an introduction to test equating, scaling and linking, including those concepts and practical issues that are critical for developers and all other testing professionals. In addition to statistical procedures, successful equating, scaling and linking involves many aspects of testing, including procedures to develop tests, to administer and score tests and to interpret scores earned on tests. Test equating methods are used with many standardized tests in education and psychology to ensure that scores from multiple test forms can be used interchangeably. Test scaling is the process of developing score scales that are used when scores on standardized tests are reported. In test linking, scores from two or more tests are related to one another. Linking has received much recent attention, due largely to investigations of linking similarly named tests from different test publishers or tests constructed for different purposes. In recent years, researchers from the education, psychology and statistics communities have contributed to the rapidly growing statistical and psychometric methodologies used in test equating, scaling and linking. In addition to the literature covered in previous editions, this new edition presents coverage of significant recent research. In order to assist researchers, advanced graduate students and testing professionals, examples are used frequently and conceptual issues are stressed. New material includes model determination in log-linear smoothing, in-depth presentation of chained linear and equipercentile equating, equating criteria, test scoring and a new section on scores for mixed-format tests. In the third edition, each chapter contains a reference list, rather than having a single reference list at the end of the volume The themes of the third edition include: * the purposes of equating, scaling and linking and their practical context * data collection designs * statistical methodology * designing reasonable and useful equating, scaling, and linking studies * importance of test development and quality control processes to equating * equating error, and the underlying statistical assumptions for equating
A must-have resource for researchers, practitioners, and advanced students interested or involved in psychometric testing Over the past hundred years, psychometric testing has proved to be a valuable tool for measuring personality, mental ability, attitudes, and much more. The word ‘psychometrics’ can be translated as ‘mental measurement’; however, the implication that psychometrics as a field is confined to psychology is highly misleading. Scientists and practitioners from virtually every conceivable discipline now use and analyze data collected from questionnaires, scales, and tests developed from psychometric principles, and the field is vibrant with new and useful methods and approaches. This handbook brings together contributions from leading psychometricians in a diverse array of fields around the globe. Each provides accessible and practical information about their specialist area in a three-step format covering historical and standard approaches, innovative issues and techniques, and practical guidance on how to apply the methods discussed. Throughout, real-world examples help to illustrate and clarify key aspects of the topics covered. The aim is to fill a gap for information about psychometric testing that is neither too basic nor too technical and specialized, and will enable researchers, practitioners, and graduate students to expand their knowledge and skills in the area. Provides comprehensive coverage of the field of psychometric testing, from designing a test through writing items to constructing and evaluating scales Takes a practical approach, addressing real issues faced by practitioners and researchers Provides basic and accessible mathematical and statistical foundations of all psychometric techniques discussed Provides example software code to help readers implement the analyses discussed
By providing an introduction to test equating which both discusses the most frequently used equating methodologies and covering many of the practical issues involved, this volume expands upon the coverage of the first edition by providing a new chapter on test scaling and a second on test linking.
Research on how stakeholders interpret language test scores and how they make decisions about language proficiency is critical because score-based decisions can be extremely consequential for test takers, score users, such as educational institutions and employers, and the society overall. This edited volume is intended as a primary resource for language assessment researchers, developers, and policy makers interested in efficiently communicating score information related to language proficiency. Its nine chapters report on complicated, often behind-the-scenes research efforts to enhance the interpretation of English language test scores developed by ETS, by employing diverse methodologies such as vertical linking, score mapping, standard setting, scale anchoring, and score concordance. In a post-pandemic era full of challenges and change in the field of language assessment, this volume highlights the ethical responsibility of test providers to engage in sometimes challenging research and development efforts to better serve score users.
The goal of this book is to emphasize the formal statistical features of the practice of equating, linking, and scaling. The book encourages the view and discusses the quality of the equating results from the statistical perspective (new models, robustness, fit, testing hypotheses, statistical monitoring) as opposed to placing the focus on the policy and the implications, which although very important, represent a different side of the equating practice. The book contributes to establishing “equating” as a theoretical field, a view that has not been offered often before. The tradition in the practice of equating has been to present the knowledge and skills needed as a craft, which implies that only with years of experience under the guidance of a knowledgeable practitioner could one acquire the required skills. This book challenges this view by indicating how a good equating framework, a sound understanding of the assumptions that underlie the psychometric models, and the use of statistical tests and statistical process control tools can help the practitioner navigate the difficult decisions in choosing the final equating function. This book provides a valuable reference for several groups: (a) statisticians and psychometricians interested in the theory behind equating methods, in the use of model-based statistical methods for data smoothing, and in the evaluation of the equating results in applied work; (b) practitioners who need to equate tests, including those with these responsibilities in testing companies, state testing agencies, and school districts; and (c) instructors in psychometric, measurement, and psychology programs.
This book is open access under a CC BY-NC 2.5 license. This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.
The importance of fairness, validity, and accessibility in assessment is greater than ever as testing expands to include more diverse populations, more complex purposes, and more sophisticated technologies. This book offers a detailed account of fairness in assessment, and illustrates the interplay between assessment and broader changes in education. In 16 chapters written by leading experts, this volume explores the philosophical, technical, and practical questions surrounding fair measurement. Fairness in Educational Assessment and Measurement addresses issues pertaining to the construction, administration, and scoring of tests, the comparison of performance across test takers, grade levels and tests, and the uses of educational test scores. Perfect for researchers and professionals in test development, design, and administration, Fairness in Educational Assessment and Measurement presents a diverse array of perspectives on this topic of enduring interest. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.
This book focuses on central issues that are key components of successful planning, development and implementation of LSAs. The book's main distinction is its focus on practice- based, cutting-edge research. This is achieved by having chapters co-authored by world-class researchers in collaboration with measurement practitioners.
Test Development and Validation by Gary Skaggs summarizes the latest test theories, frameworks for test development and validation, and guidance for developing tests in straightforward language in one core text. Students looking for clear, concise explanations of measurement, validity, and test development within a real-world context and with numerous examples will find this book to be an excellent learning resource. Author Gary Skaggs takes years of experience teaching test development to graduate students across social and behavioral sciences and consulting on a wide variety of government and institutional research projects to offer students a thorough, jargon-free, and highly applied book to help propel their own research and careers. Part I of the book, The Big Picture, sets the stage for test development, placing it within the larger context and history of measurement, emphasizing measurement concepts and their evolution over time. Part II, Test Development, covers the technical details of instrument and test development in logical order. Validation, Part III, links the conceptual bases provided in Part I with the technical process provided in Part II to conclude the book. For those students wanting to go further, software suggestions are referenced in the technical chapters, while Further Reading sections offer the original sources for more details. Exercises and Activities at the end of each chapter provide students a variety of ways to apply their knowledge, from conceptual questions to brief project ideas to data analysis problems.
