This report addresses the more contentious aspects of large-scale learning assessments (LSLAs). Drawing on UNESCO's extensive experience in the area from involvement in the direct implementation of assessments and as a knowledge broker and convener of networks this publication presents the Organization's critical take on such initiatives. It aims to balance the debate on LSLAs by reviewing their benefits while raising awareness on their potential risks and pitfalls. The focus of discussions in this publication is on LSLAs conducted in formal and school-based education. It includes an Annex outlining key international studies. [Executive summary, ed]
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.
The OECD has initiated PISA for Development (PISA-D) in response to the rising need of developing countries to collect data about their education systems and the capacity of their student bodies.
This book provides an overview of current research on a variety of topics related to both large-scale and classroom assessment. First, the purposes, traditions and principles of assessment are considered, with particular attention to those common to all levels of assessment and those more connected with either classroom or large-scale assessment. Assessment design based on sound assessment principles is discussed, differentiating between large-scale and classroom assessment, but also examining how the design principles overlap. The focus then shifts to classroom assessment and provides specific examples of assessment strategies, before examining the impact of large-scale assessment on curriculum, policy, instruction, and classroom assessment. The book concludes by discussing the challenges that teachers currently face, as well as ways to support them. The book offers a common language for researchers in assessment, as well as a primer for those interested in understanding current work in the area of assessment. In summary, it provides the opportunity to discuss large-scale and classroom assessment by addressing the following main themes: ·Purposes, Traditions and Principles of Assessment ·Design of Assessment Tasks ·Classroom Assessment in Action ·Interactions of Large-Scale and Classroom Assessment ·Enhancing Sound Assessment Knowledge and Practices It also suggests areas for future research in assessment in mathematics education.
This book draws together leading student assessment academics from across Europe exploring student monitoring policies and practices in a range of countries across 22 chapters. The chapters in the first part offer a broad overview on student assessment covering history and current status, aims and approaches as well as methodological challenges of international student assessment. The second part presents country specific chapters provide an in depth look examining country specific policy and practices and findings of national and/or international assessments. Findings are critically discussed and recommendations are made for further development of each country's assessment context. The book shows similarities and differences within the educational assessment landscape as well as complexity and similarities in assessment policy documents and strategies, Given the globalized world we live in today, this book fills a need in the higher educational context and is intended for for policy makers in different countries as well.
Everyone invested in the success of American education, from parents to policymakers, are affected by or concerned about educational testing. The education reform movement of the past 15 years has focused on raising academic standards. Some standards advocates attach a testing mechanism to gauge the extent to which high standards are actually accomplished. On the other hand, some critics view the push for standards and testing as precisely what ails American education. They view testing generally as an impediment to reform, an antiquated technology that reflects an antiquated view of teaching, learning, and social organization, and perpetuates inequality. At the same time, the testing profession has produced advances in the format, accuracy, dependability, and utility of tests. Never before has obtaining such an abundance of accurate and useful information about student learning been possible. And, never before has the American public been in such agreement about the value of testing for measuring student performance, monitoring the performance of educational systems, gauging the success of reforms, and accountability. acknowledge the benefits of testing. Many of these measurement specialists also believe that those benefits have been insufficiently articulated in the public discussions of testing. Although much has been written over the past decade on standardized testing policy, little has been published by measurement specialists who support the use of external, high-stakes standardized testing. Most of the published material has been written by those opposed to such testing. The contributing authors of this volume are both accomplished researchers and practitioners who are respected and admired worldwide. They bring to the project an abundance of experience working with standardized tests. standardized testing situation, arguments, and strategies; explain and refute many of the common criticisms of standardized testing; document the public support for, and the realized benefits of, standardized testing; acknowledge the genuine limitations of, and suggest improvements to, testing practices; provide guidance for structuring and administering large-scale testing programs in light of public preferences and the "No Child Left Behind Act" requirements; and present a defense of standardized testing and a practical vision for its promise and future. Defending Standardized Testing minimizes the use of technical jargon so as to appeal to all who have a stake in American educational reform - parents, policy makers, school board members, teachers, administrators, and measurement specialists.
Winner of the 2017 AERA Division D Significant Contribution to Educational Measurement and Research Methodology Award! Technological and statistical advances, along with a strong interest in gathering more information about the state of our educational systems, have made it possible to assess more students, in more countries, more often, and in more subject domains. The Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis brings together recognized scholars in the field of ILSA, behavioral statistics, and policy to develop a detailed guide that goes beyond database user manuals. After highlighting the importance of ILSA data to policy and research, the book reviews methodological aspects and features of the studies based on operational considerations, analytics, and reporting. The book then describes methods of interest to advanced graduate students, researchers, and policy analysts who have a good grounding in quantitative methods, but who are not necessarily quantitative methodologists. In addition, it provides a detailed exposition of the technical details behind these assessments, including the test design, the sampling framework, and estimation methods, with a focus on how these issues impact analysis choices.
State education departments and school districts face an important challenge in implementing a new law that requires disadvantaged students to be held to the same standards as other students. The new requirements come from provisions of the 1994 reauthorization of Title I, the largest federal effort in precollegiate education, which provides aid to "level the field" for disadvantaged students. Testing, Teaching, and Learning is written to help states and school districts comply with the new law, offering guidance for designing and implementing assessment and accountability systems. This book examines standards-based education reform and reviews the research on student assessment, focusing on the needs of disadvantaged students covered by Title I. With examples of states and districts that have track records in new systems, the committee develops a practical "decision framework" for education officials. The book explores how best to design assessment and accountability systems that support high levels of student learning and to work toward continuous improvement. Testing, Teaching, and Learning will be an important tool for all involved in educating disadvantaged studentsâ€"state and local administrators and classroom teachers.
A collaborative series with the University of Cambridge Faculty of Education highlighting leading-edge research across Teacher Education, International Education Reform and Language Education.
