Computerized Adaptive and Multistage Testing with R

Computerized Adaptive and Multistage Testing with R

Author: David Magis

Publisher: Springer

Published: 2017-11-23

Total Pages: 183

ISBN-13: 3319692186

DOWNLOAD EBOOK

The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.


Computerized Multistage Testing

Computerized Multistage Testing

Author: Duanli Yan

Publisher: CRC Press

Published: 2016-04-19

Total Pages: 532

ISBN-13: 146650580X

DOWNLOAD EBOOK

Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.


Computerized Adaptive Testing: Theory and Practice

Computerized Adaptive Testing: Theory and Practice

Author: Wim J. van der Linden

Publisher: Springer Science & Business Media

Published: 2000-07-31

Total Pages: 327

ISBN-13: 0792364252

DOWNLOAD EBOOK

This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.


Elements of Adaptive Testing

Elements of Adaptive Testing

Author: Wim J. van der Linden

Publisher: Springer Science & Business Media

Published: 2010-03-10

Total Pages: 433

ISBN-13: 0387854614

DOWNLOAD EBOOK

The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.


Multidimensional Item Response Theory

Multidimensional Item Response Theory

Author: M.D. Reckase

Publisher: Springer Science & Business Media

Published: 2009-07-07

Total Pages: 355

ISBN-13: 0387899766

DOWNLOAD EBOOK

First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing


Application of Artificial Intelligence to Assessment

Application of Artificial Intelligence to Assessment

Author: Hong Jiao

Publisher: IAP

Published: 2020-03-01

Total Pages: 218

ISBN-13: 1641139536

DOWNLOAD EBOOK

The general theme of this book is to present the applications of artificial intelligence (AI) in test development. In particular, this book includes research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing. By utilizing artificial intelligence, the efficiency of item development, test form construction, test delivery, and scoring could be dramatically increased. Chapters on automated item generation offer different perspectives related to generating a large number of items with controlled psychometric properties including the latest development of using machine learning methods. Automated scoring is illustrated for different types of assessments such as speaking and writing from both methodological aspects and practical considerations. Further, automated test assembly is elaborated for the conventional linear tests from both classical test theory and item response theory perspectives. Item pool design and assembly for the linear-on-the-fly tests elaborates more complications in practice when test security is a big concern. Finally, several chapters focus on computerized adaptive testing (CAT) at either item or module levels. CAT is further illustrated as an effective approach to increasing test-takers’ engagement in testing. In summary, the book includes both theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to automate the process of test development. While some of these automation processes have become common practices such as automated test assembly, automated scoring, and computerized adaptive testing, some others such as automated item generation calls for more research and exploration. When new AI methods are emerging and evolving, it is expected that researchers can expand and improve the methods for automating different steps in test development to enhance the automation features and practitioners can adopt quality automation procedures to improve assessment practices.


Computerized Adaptive Testing

Computerized Adaptive Testing

Author: David J. Weiss

Publisher: Guilford Publications

Published: 2024-06-12

Total Pages: 387

ISBN-13: 1462554512

DOWNLOAD EBOOK

"CAT is the use of artificial intelligence and machine learning to create a test unique to each person in real time. CAT: From Concept to Implementation is designed to take you from your initial decision to implement a CAT through each step in the process of fielding a CAT that will provide its benefits both to your examinees and to your organization. It describes how CATs are developed, and how they are implemented using current advanced psychometric methods"--


Technology and Testing

Technology and Testing

Author: Fritz Drasgow

Publisher: Routledge

Published: 2015-08-20

Total Pages: 376

ISBN-13: 1317975898

DOWNLOAD EBOOK

From early answer sheets filled in with number 2 pencils, to tests administered by mainframe computers, to assessments wholly constructed by computers, it is clear that technology is changing the field of educational and psychological measurement. The numerous and rapid advances have immediate impact on test creators, assessment professionals, and those who implement and analyze assessments. This comprehensive new volume brings together leading experts on the issues posed by technological applications in testing, with chapters on game-based assessment, testing with simulations, video assessment, computerized test development, large-scale test delivery, model choice, validity, and error issues. Including an overview of existing literature and ground-breaking research, each chapter considers the technological, practical, and ethical considerations of this rapidly-changing area. Ideal for researchers and professionals in testing and assessment, Technology and Testing provides a critical and in-depth look at one of the most pressing topics in educational testing today. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.


Handbook of Test Development

Handbook of Test Development

Author: Suzanne Lane

Publisher: Routledge

Published: 2015-10-08

Total Pages: 676

ISBN-13: 1136242570

DOWNLOAD EBOOK

The second edition of the Handbook of Test Development provides graduate students and professionals with an up-to-date, research-oriented guide to the latest developments in the field. Including thirty-two chapters by well-known scholars and practitioners, it is divided into five sections, covering the foundations of test development, content definition, item development, test design and form assembly, and the processes of test administration, documentation, and evaluation. Keenly aware of developments in the field since the publication of the first edition, including changes in technology, the evolution of psychometric theory, and the increased demands for effective tests via educational policy, the editors of this edition include new chapters on assessing noncognitive skills, measuring growth and learning progressions, automated item generation and test assembly, and computerized scoring of constructed responses. The volume also includes expanded coverage of performance testing, validity, fairness, and numerous other topics. Edited by Suzanne Lane, Mark R. Raymond, and Thomas M. Haladyna, The Handbook of Test Development, 2nd edition, is based on the revised Standards for Educational and Psychological Testing, and is appropriate for graduate courses and seminars that deal with test development and usage, professional testing services and credentialing agencies, state and local boards of education, and academic libraries serving these groups.


Integrating Timing Considerations to Improve Testing Practices

Integrating Timing Considerations to Improve Testing Practices

Author: Melissa J. Margolis

Publisher: Routledge

Published: 2020-06-03

Total Pages: 309

ISBN-13: 1351064762

DOWNLOAD EBOOK

Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers? In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing.