Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.
"Prepared by the Joint Committee on Standards for Educatioanl and Psychological Testing of the American Educational Research Association, American Psychological Association and National Council on Measurement in Education"--T.p. verso.
The United States Social Security Administration (SSA) administers two disability programs: Social Security Disability Insurance (SSDI), for disabled individuals, and their dependent family members, who have worked and contributed to the Social Security trust funds, and Supplemental Security Income (SSSI), which is a means-tested program based on income and financial assets for adults aged 65 years or older and disabled adults and children. Both programs require that claimants have a disability and meet specific medical criteria in order to qualify for benefits. SSA establishes the presence of a medically-determined impairment in individuals with mental disorders other than intellectual disability through the use of standard diagnostic criteria, which include symptoms and signs. These impairments are established largely on reports of signs and symptoms of impairment and functional limitation. Psychological Testing in the Service of Disability Determination considers the use of psychological tests in evaluating disability claims submitted to the SSA. This report critically reviews selected psychological tests, including symptom validity tests, that could contribute to SSA disability determinations. The report discusses the possible uses of such tests and their contribution to disability determinations. Psychological Testing in the Service of Disability Determination discusses testing norms, qualifications for administration of tests, administration of tests, and reporting results. The recommendations of this report will help SSA improve the consistency and accuracy of disability determination in certain cases.
This encyclopedia is the first major reference guide for students new to the field, covering traditional areas while pointing the way to future developments.
From early answer sheets filled in with number 2 pencils, to tests administered by mainframe computers, to assessments wholly constructed by computers, it is clear that technology is changing the field of educational and psychological measurement. The numerous and rapid advances have immediate impact on test creators, assessment professionals, and those who implement and analyze assessments. This comprehensive new volume brings together leading experts on the issues posed by technological applications in testing, with chapters on game-based assessment, testing with simulations, video assessment, computerized test development, large-scale test delivery, model choice, validity, and error issues. Including an overview of existing literature and ground-breaking research, each chapter considers the technological, practical, and ethical considerations of this rapidly-changing area. Ideal for researchers and professionals in testing and assessment, Technology and Testing provides a critical and in-depth look at one of the most pressing topics in educational testing today. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.
The Handbook of Psychoeducational Assessment is a practical guide for educational and psychological professionals using norm-referenced tests in the ability, achievement, and behavioral assessment of children. Written by key individuals involved in the construction and evolution of the most widely used tests, this book provides critical information on the nature and scope of commonly used tests, their reliability and validity, administration, scoring and interpretation, and on how the tests may differ and complement each other in their utility with specific populations. Part 1 of the Handbook of Psychoeducational Assessment focuses on ability assessment and the use of full battery intelligence tests as well as brief scales and short forms. Part 2 discusses achievement and the expanded role of psychologists in consultation with educators. Part 3 covers behavior assessment with special attention given to discussion of which tests are most suitable for assessing specific behavioral problems such as ADHD, anxiety, and depression. The final section recognizes the importance of context and person sensitive assessment practices, discussing cross-cultural assessment, neuropsychological assessment, and the usefulness of dynamic assessment for program planning and intervention delivery. Key Features: - Covers the most commonly used and newest assessment instruments - Describes the nature, scope, reliability, and validity of each test - Discusses the administration, scoring, and interpretation of tests - Provides empirical findings on patterns of performance with tested populations - Includes case studies to highlight the utility of specific tests for specific populations - Illustrates new developments in instrumentation and unique features - Covers the most commonly used and newest assessment instruments - Describes the nature, scope, reliability, and validity of each test - Discusses the administration, scoring, and interpretation of tests - Provides empirical findings on patterns of performance with tested populations - Includes case studies to highlight the utility of specific tests for specific populations - Illustrates new developments in instrumentation and unique features
This book combines an overview of validity theory, trends in validation practices and a review of standards and guidelines in several international jurisdictions with research synthesis of the validity evidence in different research areas. An overview of theory is both useful and timely, in view of the increased use of tests and measures for decision-making, ranking and policy purposes in large-scale testing, assessment and social indicators and quality of life research. Research synthesis is needed to help us assemble, critically appraise and integrate the overwhelming volume of research on validity in different contexts. Rather than examining whether any given measure is “valid”, the focus is on a critical appraisal of the kinds of validity evidence reported in the published research literature. The five sources of validity evidence discussed are: content-related, response processes, internal structure, associations with other variables and consequences. The 15 syntheses included here, represent a broad sampling of psychosocial, health, medical and educational research settings, giving us an extensive evidential basis to build upon earlier studies. The book concludes with a meta-synthesis of the 15 syntheses and a discussion of the current thinking of validation practices by leading experts in the field.
This book is open access under a CC BY-NC 2.5 license. This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.
"Standardized testing bears the twin burden of controversy and complexity and is difficult for many to understand either dispassionately or technically. In response to this reality, Richard P. Phelps and a team of well-noted measurement specialists describe the current state of public debate about testing across fields, explain and refute the primary criticisms of testing, acknowledge the limitations and undesirable consequences of testing, provide suggestions for improving testing practices, and present a vigorous defense of testing as well as a practical vision for its promise and future." "Those who are charged with translating the science of testing into public information and policy - including administrators, social scientists, test publishers, professors, and journalists who specialize in education and psychology - will find a wealth of valuable information here with which to balance the debate."--BOOK JACKET.
Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.
