"Contains brief summaries of 240 known completed social experiments. Each summary outlines the cost and time frame of the demonstration, the treatments tested, outcomes of interest, sample sizes and target population, research components, major findings, important methodological limitations and design issues encountered, and other relevant topics. In addition, very brief outlines of 21 experiments and one quasi experiment still in progress [as of April 2003] are also provided"--p. 3.
Social experimentation randomly assigns individuals or groups to coverage by the policy of interest or a control group and then the groups are compared in terms of outcome. Greenberg (economics, U. of Maryland), Linksz (mathematics, science, and engineering, Community College of Baltimore County), and Mandell (policy sciences, U. of Maryland) seek to assess whether the substantial investment in social experimentation in the United States has resulted in significant public policy changes. After explaining the general concepts behind social experimentation, they analyze five case studies and determine that they are not of decisive importance in state policy making, but they often serve useful purposes of policy formation. Annotation (c)2003 Book News, Inc., Portland, OR (booknews.com).
Intended to provide a basic understanding not only of how to design and implement social experiments, but also of how to interpret their results once they are completed, author Larry L. Orr's Social Experiments is written in a friendly, how-to manner. Through the use of illustrative examples, how-to exhibits and cases, and boldface key words, Orr provides readers with a grounding in the experimental method, including the rational and ethical issues of random assignment; designs that best address alternative policy questions; maximizing the precision of the estimates; implementing the experiment in the field; data collection; estimating and interpreting program impacts, costs, and benefits; dealing with potential biases; and the use and misuse of experimental results in the policy process. This book will be useful not only to those who plan to conduct experiments, but also to the much larger group who will, at one time or another, want to understand the results of experimental evaluations.
Policy analysis has grown increasingly reliant on the random assignment experiment—a research method whereby participants are sorted by chance into either a program group that is subject to a government policy or program, or a control group that is not. Because the groups are randomly selected, they do not differ from one another systematically. Therefore any differences between the groups at the end of the study can be attributed solely to the influence of the program or policy. But there are many questions that randomized experiments have not been able to address. What component of a social policy made it successful? Did a given program fail because it was designed poorly or because it suffered from low participation rates? In Learning More from Social Experiments, editor Howard Bloom and a team of innovative social researchers profile advancements in the scientific underpinnings of social policy research that can improve randomized experimental studies. Using evaluations of actual social programs as examples, Learning More from Social Experiments makes the case that many of the limitations of random assignment studies can be overcome by combining data from these studies with statistical methods from other research designs. Carolyn Hill, James Riccio, and Bloom profile a new statistical model that allows researchers to pool data from multiple randomized-experiments in order to determine what characteristics of a program made it successful. Lisa Gennetian, Pamela Morris, Johannes Bos, and Bloom discuss how a statistical estimation procedure can be used with experimental data to single out the effects of a program's intermediate outcomes (e.g., how closely patients in a drug study adhere to the prescribed dosage) on its ultimate outcomes (the health effects of the drug). Sometimes, a social policy has its true effect on communities and not individuals, such as in neighborhood watch programs or public health initiatives. In these cases, researchers must randomly assign treatment to groups or clusters of individuals, but this technique raises different issues than do experiments that randomly assign individuals. Bloom evaluates the properties of cluster randomization, its relevance to different kinds of social programs, and the complications that arise from its use. He pays particular attention to the way in which the movement of individuals into and out of clusters over time complicates the design, execution, and interpretation of a study. Learning More from Social Experiments represents a substantial leap forward in the analysis of social policies. By supplementing theory with applied research examples, this important new book makes the case for enhancing the scope and relevance of social research by combining randomized experiments with non-experimental statistical methods, and it serves as a useful guide for researchers who wish to do so.
The SAGE Handbook of Social Research Methods is a must for every social-science researcher. It charts the new and evolving terrain of social research methodology, covering qualitative, quantitative and mixed methods in one volume. The Handbook includes chapters on each phase of the research process: research design, methods of data collection, and the processes of analyzing and interpreting data. The volume maintains that there is much more to research than learning skills and techniques; methodology involves the fit between theory, research questions research design and analysis. The book also includes several chapters that describe historical and current directions in social research, debating crucial subjects such as qualitative versus quantitative paradigms, how to judge the credibility of types of research, and the increasingly topical issue of research ethics. The Handbook serves as an invaluable resource for approaching research with an open mind. This volume maps the field of social research methods using an approach that will prove valuable for both students and researchers.
The study of public policy and the methods of policy analysis are among the most rapidly developing areas in the social sciences. Policy analysis has emerged to provide a better understanding of the policymaking process and to supply decision makers with reliable policy-relevant knowledge about pressing economic and social problems. Presenting a broad, comprehensive perspective, the Handbook of Public Policy Analysis: Theory, Politics, and Methods covers the historical development of policy analysis, its role in the policy process, and empirical methods. The handbook considers the theory generated by these methods and the normative and ethical issues surrounding their practice. Written by leading experts in the field, this book- Deals with the basic origins and evolution of public policy Examines the stages of the policy-making process Identifies political advocacy and expertise in the policy process Focuses on rationality in policy decision-making and the role of policy networks and learning Details argumentation, rhetoric, and narratives Explores the comparative, cultural, and ethical aspects of public policy Explains primary quantitative-oriented analytical methods employed in policy research Addresses the qualitative sides of policy analysis Discusses tools used to refine policy choices Traces the development of policy analysis in selected national contexts The Handbook of Public Policy Analysis: Theory, Politics, and Methods describes the theoretical debates that have recently defined the field, including the work of postpositivist, interpretivist, and social constructionist scholars. This book also explores the interplay between empirical and normative analysis, a crucial issue running through contemporary debates.
The concepts of cause and effect are critical to the field of program evaluation. Experimentally-designed evaluations—those that randomize to treatment and control groups—offer a convincing means for establishing a causal connection between a program and its effects. Experimental Evaluation Design for Program Improvement considers a range of impact evaluation questions, particularly those questions that focus on the impact of specific aspects of a program. Laura R. Peck shows how a variety of experimental evaluation design options can provide answers to these questions, and she suggests opportunities for experiments to be applied in more varied settings and focused on program improvement efforts.
This readable and comprehensive text is designed to equip students and practitioners with the statistical skills needed to meet government standards regarding public program evaluation. Even those with little statistical training will find the explanations clear, with many illustrative examples, case studies, and applications. Far more than a cookbook of statistical techniques, the book begins with chapters on the overall context for successful program evaluations, and carefully explains statistical methods--and threats to internal and statistical validity--that correspond to each evaluation design. Laura Langbein then presents a variety of methods for program analysis, and advise readers on how to select the mix of methods most appropriate for the issues they deal with-- always balancing methodology with the need for generality, the size of the evaluator's budget, the availability of data, and the need for quick results.
Handbook of Field Experiments, Volume Two explains how to conduct experimental research, presents a catalog of research to date, and describes which areas remain to be explored. The new volume includes sections on field experiments in education in developing countries, how to design social protection programs, a section on how to combat poverty, and updates on data relating to the impact and determinants of health levels in low-income countries. Separating itself from circumscribed debates of specialists, this volume surpasses the many journal articles and narrowly-defined books written by practitioners. This ongoing series will be of particular interest to scholars working with experimental methods. Users will find results from politics, education, and more. - Balances methodological insights with analyses of principal findings and suggestions for further research - Appeals broadly to social scientists seeking to develop an expertise in field experiments - Written in a language that is accessible to graduate students and non-specialist economists
Public policy research has become increasingly comparative over the past several decades, but the methodological issues involved in this research have not been discussed adequately. This Handbook provides a discussion of the fundamental methodological issues in comparative policy research, as well as descriptions and analyses of major techniques used for that research. The techniques discussed are both quantitative and qualitative, and all are embedded in the broader discussion of comparative research design.
