KE is applied to the four major equating designs and to both Chain Equating and Post-Stratification Equating for the Non-Equivalent groups with Anchor Test Design. It will be an important reference for several groups: (a) Statisticians (b) Practitioners and (c) Instructors in psychometric and measurement programs. The authors assume some familiarity with linear and equipercentile test equating, and with matrix algebra.
KE is applied to the four major equating designs and to both Chain Equating and Post-Stratification Equating for the Non-Equivalent groups with Anchor Test Design. It will be an important reference for several groups: (a) Statisticians (b) Practitioners and (c) Instructors in psychometric and measurement programs. The authors assume some familiarity with linear and equipercentile test equating, and with matrix algebra.
This book describes how to use test equating methods in practice. The non-commercial software R is used throughout the book to illustrate how to perform different equating methods when scores data are collected under different data collection designs, such as equivalent groups design, single group design, counterbalanced design and non equivalent groups with anchor test design. The R packages equate, kequate and SNSequate, among others, are used to practically illustrate the different methods, while simulated and real data sets illustrate how the methods are conducted with the program R. The book covers traditional equating methods including, mean and linear equating, frequency estimation equating and chain equating, as well as modern equating methods such as kernel equating, local equating and combinations of these. It also offers chapters on observed and true score item response theory equating and discusses recent developments within the equating field. More specifically it covers the issue of including covariates within the equating process, the use of different kernels and ways of selecting bandwidths in kernel equating, and the Bayesian nonparametric estimation of equating functions. It also illustrates how to evaluate equating in practice using simulation and different equating specific measures such as the standard error of equating, percent relative error, different that matters and others.
By providing an introduction to test equating which both discusses the most frequently used equating methodologies and covering many of the practical issues involved, this volume expands upon the coverage of the first edition by providing a new chapter on test scaling and a second on test linking.
The goal of this book is to emphasize the formal statistical features of the practice of equating, linking, and scaling. The book encourages the view and discusses the quality of the equating results from the statistical perspective (new models, robustness, fit, testing hypotheses, statistical monitoring) as opposed to placing the focus on the policy and the implications, which although very important, represent a different side of the equating practice. The book contributes to establishing “equating” as a theoretical field, a view that has not been offered often before. The tradition in the practice of equating has been to present the knowledge and skills needed as a craft, which implies that only with years of experience under the guidance of a knowledgeable practitioner could one acquire the required skills. This book challenges this view by indicating how a good equating framework, a sound understanding of the assumptions that underlie the psychometric models, and the use of statistical tests and statistical process control tools can help the practitioner navigate the difficult decisions in choosing the final equating function. This book provides a valuable reference for several groups: (a) statisticians and psychometricians interested in the theory behind equating methods, in the use of model-based statistical methods for data smoothing, and in the evaluation of the equating results in applied work; (b) practitioners who need to equate tests, including those with these responsibilities in testing companies, state testing agencies, and school districts; and (c) instructors in psychometric, measurement, and psychology programs.
A must-have resource for researchers, practitioners, and advanced students interested or involved in psychometric testing Over the past hundred years, psychometric testing has proved to be a valuable tool for measuring personality, mental ability, attitudes, and much more. The word ‘psychometrics’ can be translated as ‘mental measurement’; however, the implication that psychometrics as a field is confined to psychology is highly misleading. Scientists and practitioners from virtually every conceivable discipline now use and analyze data collected from questionnaires, scales, and tests developed from psychometric principles, and the field is vibrant with new and useful methods and approaches. This handbook brings together contributions from leading psychometricians in a diverse array of fields around the globe. Each provides accessible and practical information about their specialist area in a three-step format covering historical and standard approaches, innovative issues and techniques, and practical guidance on how to apply the methods discussed. Throughout, real-world examples help to illustrate and clarify key aspects of the topics covered. The aim is to fill a gap for information about psychometric testing that is neither too basic nor too technical and specialized, and will enable researchers, practitioners, and graduate students to expand their knowledge and skills in the area. Provides comprehensive coverage of the field of psychometric testing, from designing a test through writing items to constructing and evaluating scales Takes a practical approach, addressing real issues faced by practitioners and researchers Provides basic and accessible mathematical and statistical foundations of all psychometric techniques discussed Provides example software code to help readers implement the analyses discussed
This proceedings volume highlights the latest research and developments in psychometrics and statistics. It represents selected and peer reviewed presentations given at the 84th Annual International Meeting of the Psychometric Society (IMPS), organized by Pontificia Universidad Católica de Chile and held in Santiago, Chile during July 15th to 19th, 2019. The IMPS is one of the largest international meetings on quantitative measurement in education, psychology and the social sciences. It draws approximately 500 participants from around the world, featuring paper and poster presentations, symposiums, workshops, keynotes, and invited presentations. Leading experts and promising young researchers have written the included chapters. The chapters address a large variety of topics including but not limited to item response theory, multistage adaptive testing, and cognitive diagnostic models. This volume is the 8th in a series of recent volumes to cover research presented at the IMPS.
This book is open access under a CC BY-NC 2.5 license. This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.
The chapters in this book give a detailed and thorough discussion of test equating from many different points of view. It should be a valuable reference on test equating for a broad audience interested in many aspects of tests and testing -- educational researcher, psychologists, educators, legislators, and others interested in the technical consequences of educational policies.
"Psychological Testing by Theresa J. B. Kline is an accessible, easy-to-read book that effectively communicates the current concepts, trends, and controversies in the field of psychological testing. Readers are provided with an in-depth analysis of psychometrics in a format that will keep their attention and that they will be able to relate to the significance of psychological testing across numerous areas such as schools, businesses, clinical settings, military, or government." -Todd L. Chmielewski, PsycCRITIQUES, December 7, 2005 VOL. 50, NO. 49, ARTICLE 12 Psychological Testing: A Practical Approach to Design and Evaluation offers a fresh and innovative approach to students and faculty in the fields of testing, measurement, psychometrics, research design, and related areas of study. Author Theresa J.B. Kline guides readers through the process of designing and evaluating a test, while ensuring that the test meets the highest professional standards. The author uses simple, clear examples throughout and fully details the required statistical analyses. Topics include—but are not limited to—design of item stems and responses; sampling strategies; classical and modern test theory; IRT program examples; reliability of tests and raters; validation using content, criterion-related, and factor analytic approaches; test and item bias; and professional and ethical issues in testing. With the student in mind, Kline has created features that ease them into more difficult ideas, always stressing the practical use of theoretical concepts. Features include A step-by-step approach to designing a test, including construct identification, construct operationalization, collecting data, item assessment, and reliability and validity techniques Examples of data analyses with printouts and interpretation Up-to-date coverage of psychometric topics, such as difference scores, change scores, translation, computer adaptive testing, reliability and validity generalization, professional and ethical guidelines, and references IRT program outputs (dichotomous and multiple response) Coverage of traditional topics in the context of how they would be used, such as standard errors and confidence intervals Sampling approaches and their strengths and weaknesses, as well as response rates and missing data management Psychological Testing is perfectly suited as a main text for upper-level undergraduate and graduate Testing or Psychometrics courses in departments of Psychology, Education, Sociology, Management, and in the Human Services disciplines. Professional researchers, educators, and consultants will also want to add this to their libraries for up-to-date coverage of test design and evaluation techniques. "Professor Kline′s attempts to de-mystify complex measurement concepts are beautifully simplified and illustrated in her countless illustrations of practical and relevant problems for the mathematically-challenged student. This book is also a must-have for those who simply do not have the desire for the theoretical jargon used in similar textbooks but are interested in the important conceptual and practical aspects of measurement as they apply in their disciplines." —Arturo Olivarez, Jr., Texas Tech University "Kline′s Psychological Testing provides a well-written treatment of the critical issues in designing and evaluating psychometric instruments. This book will be very useful to advanced undergraduate students, graduate students, and researchers." —Richard Block, Montana State University
