Value Added Modeling and Growth Modeling with Particular Application to Teacher and School Effectiveness
Value Added Modeling and Growth Modeling with Particular Application to Teacher and School Effectiveness

Author: Robert W. Lissitz

Publisher: IAP

Published: 2014-12-01

Total Pages: 327

ISBN-13: 1623967767

DOWNLOAD EBOOK

Modeling student growth has been a federal policy requirement under No Child Left Behind (NCLB). In addition to tracking student growth, the latest Race To The Top (RTTP) federal education policy stipulates the evaluation of teacher effectiveness from the perspective of added value that teachers contribute to student learning and growth. Student growth modeling and teacher value-added modeling are complex. The complexity stems, in part, from issues due to non-random assignment of students into classes and schools, measurement error in students’ achievement scores that are utilized to evaluate the added value of teachers, multidimensionality of the measured construct across multiple grades, and the inclusion of covariates. National experts at the Twelfth Annual Maryland Assessment Research Center’s Conference on “Value Added Modeling and Growth Modeling with Particular Application to Teacher and School Effectiveness” present the latest developments and methods to tackle these issues. This book includes chapters based on these conference presentations. Further, the book provides some answers to questions such as what makes a good growth model? What criteria should be used in evaluating growth models? How should outputs from growth models be utilized? How auxiliary teacher information could be utilized to improve value added? How multiple sources of student information could be accumulated to estimate teacher effectiveness? Whether student-level and school-level covariates should be included? And what are the impacts of the potential heterogeneity of teacher effects across students of different aptitudes or other differing characteristics on growth modeling and teacher evaluation? Overall, this book addresses reliability and validity issues in growth modeling and value added modeling and presents the latest development in this area. In addition, some persistent issues have been approached from a new perspective. This edited volume provides a very good source of information related to the current explorations in student growth and teacher effectiveness evaluation.

Getting Value Out of Value-Added
Getting Value Out of Value-Added

Author: National Academy of Education

Publisher: National Academies Press

Published: 2010-01-25

Total Pages: 97

ISBN-13: 030915099X

DOWNLOAD EBOOK

Value-added methods refer to efforts to estimate the relative contributions of specific teachers, schools, or programs to student test performance. In recent years, these methods have attracted considerable attention because of their potential applicability for educational accountability, teacher pay-for-performance systems, school and teacher improvement, program evaluation, and research. Value-added methods involve complex statistical models applied to test data of varying quality. Accordingly, there are many technical challenges to ascertaining the degree to which the output of these models provides the desired estimates. Despite a substantial amount of research over the last decade and a half, overcoming these challenges has proven to be very difficult, and many questions remain unanswered-at a time when there is strong interest in implementing value-added models in a variety of settings. The National Research Council and the National Academy of Education held a workshop, summarized in this volume, to help identify areas of emerging consensus and areas of disagreement regarding appropriate uses of value-added methods, in an effort to provide research-based guidance to policy makers who are facing decisions about whether to proceed in this direction.

The Lost Ethnographies
The Lost Ethnographies

Author: Robin James Smith

Publisher: Emerald Group Publishing

Published: 2019-01-07

Total Pages: 233

ISBN-13: 1787439313

DOWNLOAD EBOOK

This volume explores ethnographic projects that were planned but never happened, and reports on the methodological lessons researchers can learn, as well as how they can gain fresh energy and social science insight from apparent rejection.

Assessing Student Learning Outcomes in Higher Education
Assessing Student Learning Outcomes in Higher Education

Author: Hamish Coates

Publisher: Routledge

Published: 2018-12-07

Total Pages: 152

ISBN-13: 1351260472

DOWNLOAD EBOOK

This book examines important advances and offers a realistic image of the state of the art in student learning outcomes assessment in higher education—a field close to the core of nearly every higher education institution. Producing sound information on what students know and can do is critical to higher education practitioners and future social prosperity. Spanning international, national and institutional developments, the book presents methodological and empirical insights, highlights research challenges, and showcases the enormous progress made in recent years. The book will be of interest to researchers in education assessment and neighbouring fields, and stakeholders like institutional leaders, teachers and graduate employers looking for better insight on returns, governments searching for information to assist with funding and regulation, and members of the public wanting more clarity about outcomes and public investment. This book was originally published as a special issue of Assessment & Evaluation in Higher Education.

Advancing Human Assessment
Advancing Human Assessment

Author: Randy E. Bennett

Publisher: Springer

Published: 2017-10-17

Total Pages: 717

ISBN-13: 3319586890

DOWNLOAD EBOOK

This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Evaluating Value-added Models for Teacher Accountability
Evaluating Value-added Models for Teacher Accountability

Author: Daniel F. McCaffrey

Publisher: Rand Corporation

Published: 2003

Total Pages: 168

ISBN-13:

DOWNLOAD EBOOK

Does value-added modeling (VAM) demonstrate the importance of teachers to student outcomes? The authors clarify the primary questions raised by VAM for measuring teacher effects, review the most important recent applications of VAM, and discuss a variety of statistical and measurement issues that might affect the validity of VAM inferences. The authors identify numerous possible sources of error and bias in teacher effects and recommend a number of steps for future research into these potential errors.

Enhancing Effective Instruction and Learning Using Assessment Data
Enhancing Effective Instruction and Learning Using Assessment Data

Author: Hong Jiao

Publisher: IAP

Published: 2022-01-01

Total Pages: 243

ISBN-13: 1648026281

DOWNLOAD EBOOK

This book introduces theories and practices for using assessment data to enhance learning and instruction. Topics include reshaping the homework review process, iterative learning engineering, learning progressions, learning maps, score report designing, the use of psychosocial data, and the combination of adaptive testing and adaptive learning. In addition, studies proposing new methods and strategies, technical details about the collection and maintenance of process data, and examples illustrating proposed methods and software are included. Chapters 1, 4, 6, 8, and 9 discuss how to make valid interpretations of results and achieve more efficient instructions from various sources of data. Chapters 3 and 7 propose and evaluate new methods to promote students’ learning by using evidence-based iterative learning engineering and supporting the teachers’ use of assessment data, respectively. Chapter 2 provides technical details on the collection, storage, and security protection of process data. Chapter 5 introduces software for automating some aspects of developmental education and the use of predictive modeling. Chapter 10 describes the barriers to using psychosocial data for formative assessment purposes. Chapter 11 describes a conceptual framework for adaptive learning and testing and gives an example of a functional learning and assessment system. In summary, the book includes comprehensive perspectives of the recent development and challenges of using test data for formative assessment purposes. The chapters provide innovative theoretical frameworks, new perspectives on the use of data with technology, and how to build new methods based on existing theories. This book is a useful resource to researchers who are interested in using data and technology to inform decision making, facilitate instructional utility, and achieve better learning outcomes.

Ready for Fall? Near-Term Effects of Voluntary Summer Learning Programs on Low-Income Students' Learning Opportunities and Outcomes
Ready for Fall? Near-Term Effects of Voluntary Summer Learning Programs on Low-Income Students' Learning Opportunities and Outcomes

Author: Jennifer Sloan McCombs

Publisher: Rand Corporation

Published: 2014-12-16

Total Pages: 139

ISBN-13: 0833088203

DOWNLOAD EBOOK

The Wallace Foundation’s National Summer Learning Study, conducted by RAND and launched in 2011, offers the first assessment of district-run voluntary summer programs over the short and long run. This report, the second of five that will result from the study, looks at how summer programs affected student performance on math, reading, and social and emotional assessments in fall 2013.

Language, Literacy, and Learning in the STEM Disciplines
Language, Literacy, and Learning in the STEM Disciplines

Author: Alison L. Bailey

Publisher: Routledge

Published: 2018-02-01

Total Pages: 304

ISBN-13: 1351979590

DOWNLOAD EBOOK

With a focus on what mathematics and science educators need to know about academic language used in the STEM disciplines, this book critically synthesizes the current knowledge base on language challenges inherent to learning mathematics and science, with particular attention to the unique issues for English learners. These key questions are addressed: When and how do students develop mastery of the language registers unique to mathematics and to the sciences? How do teachers use assessment as evidence of student learning for both accountability and instructional purposes? Orienting each chapter with a research review and drawing out important Focus Points, chapter authors examine the obstacles to and latest ideas for improving STEM literacy, and discuss implications for future research and practice.

Machine Learning, Natural Language Processing, and Psychometrics
Machine Learning, Natural Language Processing, and Psychometrics

Author: Hong Jiao

Publisher: IAP

Published: 2024-04-01

Total Pages: 242

ISBN-13:

DOWNLOAD EBOOK

With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better understand the assessment products or accuracy and the process how an item product was attained. The analysis of the conventional and non-conventional assessment data calls for more methodology other than the latent trait modeling. Natural language processing (NLP) methods and machine learning algorithms have been successfully applied in automated scoring. It has been explored in providing diagnostic feedback to test-takers in writing assessment. Recently, machine learning algorithms have been explored for cheating detection and cognitive diagnosis. When the measurement field promote the use of assessment data to provide feedback to improve teaching and learning, it is the right time to explore new methodology and explore the value added from other data sources. This book presents the use cases of machine learning and NLP in improving the assessment theory and practices in high-stakes summative assessment, learning, and instruction. More specifically, experts from the field addressed the topics related to automated item generations, automated scoring, automated feedback in writing, explainability of automated scoring, equating, cheating and alarming response detection, adaptive testing, and applications in science assessment. This book demonstrates the utility of machine learning and NLP in assessment design and psychometric analysis.