At the request of the Department of Education, the National Research Council formed the Committee on NAEP Reporting Practices to address questions about the desirability, feasibility, and potential impact of implementing these reporting practices. The committee developed study questions designed to address issues surrounding district-level and market-basket reporting.
At the request of the U.S. Department of Education, the National Research Council (NRC) established the Committee on NAEP Reporting Practices to examine the feasibility and potential impact of district-level and market-basket reporting practices. As part of its charge, the committee sponsored a workshop in February 2000 to gather information on issues related to market-basket reporting for the National Assessment of Education Progress (NAEP). Designing a Market Basket for NAEP: Summary of a Workshop explores with various stakeholders their interest in and perceptions regarding the desirability, feasibility, and potential impact of market-basket reporting for the NAEP. The market-basket concept is based on the idea that a relatively limited set of items can represent some larger construct. The general idea of a NAEP market basket is based on an image of a collection of test questions representative of some larger content domain and an easily understood index to summarize performance on the items.
This paper offers recommendations to the National Center for Education Statistics (NCES) on the development of the background questionnaire for the National Assessment of Adult Literacy (NAAL). The recommendations are from the viewpoint of a researcher interested in applying sophisticated statistical models to address important issues in adult literacy. The paper focuses on five issues, each of which is the subject of a section of the paper: sampling; selection bias; measurement; policy modeling; and gauging cohort effects. Each section considers the scope of the issue and then makes recommendations to NCES. These recommendations include providing all appropriate sampling weights in NAAL data; examining contextual effects on the distribution of literacy ability in the population; considering relevant auxiliary variables that would constitute the selection equation; considering the hypothesized number of factors and including at least four variables measuring each factor in the questionnaire; obtaining retrospective data on general and job-specific literacy-related activities; and exploring the possibility of linking NAAL with existing longitudinal surveys. (Contains 21 references.) (YLB)
Since the late 1960s, the National Assessment of Educational Progress (NAEP)â€"the nation's report cardâ€"has been the only continuing measure of student achievement in key subject areas. Increasingly, educators and policymakers have expected NAEP to serve as a lever for education reform and many other purposes beyond its original role. Grading the Nation's Report Card examines ways NAEP can be strengthened to provide more informative portrayals of student achievement and the school and system factors that influence it. The committee offers specific recommendations and strategies for improving NAEP's effectiveness and utility, including: Linking achievement data to other education indicators. Streamlining data collection and other aspects of its design. Including students with disabilities and English-language learners. Revamping the process by which achievement levels are set. The book explores how to improve NAEP framework documentsâ€"which identify knowledge and skills to be assessedâ€"with a clearer eye toward the inferences that will be drawn from the results. What should the nation expect from NAEP? What should NAEP do to meet these expectations? This book provides a blueprint for a new paradigm, important to education policymakers, professors, and students, as well as school administrators and teachers, and education advocates.
This book addresses the important assessment themes, provides a perspective from which to view large-scale assessments, and lays the foundation for plausible interpretations of their results.
