This book examines extensions of the Rasch model, one of the most researched and applied models in educational research and social science. This collection contains 22 chapters by some of the most renowned international experts in the field. They cover topics ranging from general model extensions to applications in fields as diverse as cognition, personality, organizational and sports psychology, and health sciences and education.
This open access book presents a large number of innovations in the world of operational testing. It brings together different but related areas and provides insight in their possibilities, their advantages and drawbacks. The book not only addresses improvements in the quality of educational measurement, innovations in (inter)national large scale assessments, but also several advances in psychometrics and improvements in computerized adaptive testing, and it also offers examples on the impact of new technology in assessment. Due to its nature, the book will appeal to a broad audience within the educational measurement community. It contributes to both theoretical knowledge and also pays attention to practical implementation of innovations in testing technology.
Measurement in Sport and Exercise Psychology provides a complete analysis of the tools and methods used in sport and exercise psychology research. Each chapter of this accessible text presents key measurement variables and concepts, including their definitions; an evaluation of the measurement constructs and tools available; and an explanation of any controversies in each topic. The text includes access to an online resource that presents 14 measurement instruments in their entirety. This resource also contains additional web links to many other measurement instruments. Drawing on their experience as leading researchers in the field, editors Tenenbaum, Eklund, and Kamata have selected a team of recognized scholars to bring both breadth and depth to this essential resource. By thoroughly examining each measurement tool, Measurement in Sport and Exercise Psychology assists readers in determining strengths and limitations of each tool and discovering which tools are best suited to their research projects. Readers will also gain critical knowledge to expand the field by recognizing opportunities for new methods of measurement and evaluation. The text begins with a historical review of measurement in sport and exercise psychology followed by a comprehensive description of theories and measurement issues. It provides detailed information regarding ethical and cultural issues inherent in the selection of specific testing protocols as well as issues in interpreting meta-analysis. This is followed by discussion of the commonly used constructs and inventories in three areas: cognition, perception, and motivation measurement; emotion (affect) and coping measurement; and social and behavioral measurement. Recommendations for researchers and practitioners included at the end of each chapter provide starting points for considering ways to incorporate chapter content into research projects and professional practice. Tables located at the end of each chapter summarize key information for quick reference and provide online sources, when available, so that readers can access each measurement tool. Original source information is provided for those tools not available online. Measurement in Sport and Exercise Psychology assists readers in evaluating the effectiveness of specific measurement tools. As the most complete and up-to-date directory of tools and inventories in the field of sport and exercise, this text offers a thorough explanation of considerations, controversies, recommendations, and locations for accessing these measurement tools.
Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers? In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing.
This book addresses problems and challenges that face educational measurement at a time when multipurpose usage of observational data from educational assessments, tests and international surveys has become a growing global trend. While the construction of educational measures and use of educational data offer many opportunities, they also require awareness of the numerous threats to validity and methods of reducing such threats. Written by leading international scholars, the book demonstrates the complexity of educational measurement by addressing three broad and interrelated topics. The first part discusses cognitive abilities, including studies on fluid intelligence, its improvement and its links to aptitude tests for admission to higher education. The second part focuses on the effects of school and teacher-related factors on school outcomes at individual and group levels, and uses international studies to analyze causes. The third part presents analytical techniques and measurement methods to improve reliability, for example factor analysis using Bayesian estimators, bi-factor analysis, model misfit and solutions, and discusses balance issues in reporting test results. The book provides examples of state-of-the-art analytical techniques for pursuing fundamental research problems, and the latest advances in measurement methods, with a focus on validity improvement. Eminent researchers discuss and provide insights into questions such as: Is it possible to train individuals to think at a higher level than normal for their age? What determines prospective preschool teachers’ skill to perceive mathematics-related preschool situations? Can international indicator design and instruments be improved to use trends and national context variables more efficiently? Can indicator data at national, school and class levels be compared easier? Are value-added measures of teacher effectiveness valid when it comes to hiring and promoting teachers? Is money better spent on teacher training than on smaller class-size? How do theory and empirical statistical data intertwine in building structures of understanding? This book is inspired by the career and personal influence of the Swedish scholar Professor Jan-Eric Gustafsson, renowned for his research on individual differences, especially the structure of cognitive abilities, and on the effects of education on knowledge and skills.
Statistical Analysis of Questionnaires: A Unified Approach Based on R and Stata presents special statistical methods for analyzing data collected by questionnaires. The book takes an applied approach to testing and measurement tasks, mirroring the growing use of statistical methods and software in education, psychology, sociology, and other fields.
This handbook provides an overview of major developments around diagnostic classification models (DCMs) with regard to modeling, estimation, model checking, scoring, and applications. It brings together not only the current state of the art, but also the theoretical background and models developed for diagnostic classification. The handbook also offers applications and special topics and practical guidelines how to plan and conduct research studies with the help of DCMs. Commonly used models in educational measurement and psychometrics typically assume a single latent trait or at best a small number of latent variables that are aimed at describing individual differences in observed behavior. While this allows simple rankings of test takers along one or a few dimensions, it does not provide a detailed picture of strengths and weaknesses when assessing complex cognitive skills. DCMs, on the other hand, allow the evaluation of test taker performance relative to a potentially large number of skill domains. Most diagnostic models provide a binary mastery/non-mastery classification for each of the assumed test taker attributes representing these skill domains. Attribute profiles can be used for formative decisions as well as for summative purposes, for example in a multiple cut-off procedure that requires mastery on at least a certain subset of skills. The number of DCMs discussed in the literature and applied to a variety of assessment data has been increasing over the past decades, and their appeal to researchers and practitioners alike continues to grow. These models have been used in English language assessment, international large scale assessments, and for feedback for practice exams in preparation of college admission testing, just to name a few. Nowadays, technology-based assessments provide increasingly rich data on a multitude of skills and allow collection of data with respect to multiple types of behaviors. Diagnostic models can be understood as an ideal match for these types of data collections to provide more in-depth information about test taker skills and behavioral tendencies.
Longitudinal data is essential for understanding how the world around us changes. Most theories in the social sciences and elsewhere have a focus on change, be it of individuals, of countries, of organizations, or of systems, and this is reflected in the myriad of longitudinal data that are being collected using large panel surveys. This type of data collection has been made easier in the age of Big Data and with the rise of social media. Yet our measurements of the world are often imperfect, and longitudinal data is vulnerable to measurement errors which can lead to flawed and misleading conclusions. Measurement Error in Longitudinal Data tackles the important issue of how to investigate change in the context of imperfect data. It compiles the latest advances in estimating change in the presence of measurement error from several fields and covers the entire process, from the best ways of collecting longitudinal data, to statistical models to estimate change under uncertainty, to examples of researchers applying these methods in the real world. This book introduces the essential issues of longitudinal data collection, such as memory effects, panel conditioning (or mere measurement effects), the use of administrative data, and the collection of multi-mode longitudinal data. It also presents some of the most important models used in this area, including quasi-simplex models, latent growth models, latent Markov chains, and equivalence/DIF testing. Finally, the use of vignettes in the context of longitudinal data and estimation methods for multilevel models of change in the presence of measurement error are also discussed.
Statistics in Psychology covers all statistical methods needed in education and research in psychology. This book looks at research questions when planning data sampling, that is to design the intended study and to calculate the sample sizes in advance. In other words, no analysis applies if the minimum size is not determined in order to fulfil certain precision requirements. The book looks at the process of empirical research into the following seven stages: Formulation of the problem Stipulation of the precision requirements Selecting the statistical model for the planning and analysis The (optimal) design of the experiment or survey Performing the experiment or the survey Statistical analysis of the observed results Interpretation of the results.
