Evaluation researchers are tasked with providing the evidence to guide programme building and to assess its outcomes. As such, they labour under the highest expectations - bringing independence and objectivity to policy making. They face huge challenges, given the complexity of modern interventions and the politicised backdrop to all of their investigations. They have responded with a huge portfolio of research techniques and, through their professional associations, have set up schemes to establish standards for evaluative inquiry and to accredit evaluation practitioners. A big question remains. Has this monumental effort produced a progressive, cumulative and authoritative body of knowledge that we might think of as evaluation science? This is the question addressed by Ray Pawson in this sequel to Realistic Evaluation and Evidence-based Policy. In answer, he provides a detailed blueprint for an evaluation science based on realist principles.
Program Theory-Driven Evaluation Science fills the gap between 21st century literature on evaluation and what is happening in practice. It features detailed examples of how evaluations actually unfold in practice to develop people, programs, and organizations. Commonly accepted strategies for practicing evaluation are outlined, followed by comprehe
Evaluation for the 21st Century features thoughtfully written introductions to each of the main sections that provide a context and synthesis of the various evaluators' chapters. After reading this groundbreaking book, researchers and practitioners will be able to recognize these new developments in evaluation as they encounter them, place them in context, and incorporate them into their own evaluation professions and practices.
Both practical and theoretical in approach, this book is the perfect companion for student researchers and policy makers alike. It provides actionable advice for planning and implementing evaluations, while also instilling an ability to assess the evaluations of others and consider the ways in which evaluation evidence could influence policy and practice. Drawing upon a wide range of examples from policy areas like education, criminal justice, and health and social care, this book showcases how evaluation is an interdisciplinary research practice with a spectrum of applications. Each chapter contains philosophical underpinnings and applied knowledge as well as examples from published evaluations. Specific topics include how to: Choose an approach to evaluation Plan, design, and conduct evaluations Approach evaluations using theories of change Differentiate between process, impact, and economic evaluations Understand the role of quantitative and qualitative methods in data collection Use systematic reviews and other tools to assess and disseminate evaluation findings From getting started in the field to turning evidence into policy, this book will guide you through every step of the evaluation process.
Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods at the upper-undergraduate and graduate levels. it also serves as a reference for government statisticians, survey methodologists, and researchers and practitioners who carry out survey research in the areas of the social and health sciences.
The 'Encyclopedia of Evaluation' recognises the growth of evaluation around the world & highlights all the major contributions to the field. There are over 400 entries organised alphabetically.
Through the use of specific examples to illustrate evaluation research goals and methods, this book provides readers with an overview of the science and politics of evaluation research. The Second Edition includes coverage of meta-analysis, selection models and instrumental variables.
How can evaluation be used most effectively, and what are the strengths and weaknesses of the various methods? Colin Robson provides guidance in a clear and uncluttered way. The issue of collaboration is examined step-by-step; stakeholder models are compared with techniques such as participatory evaluation and practitioner-centred action research; ethical and political considerations are placed in context; and the best ways of communicating findings are discussed. Each chapter is illustrated with helpful exercises to show the practical application of the issues covered, making this an invaluable introduction for anyone new to evaluation.
Providing state-of-the-art perspectives on what evaluation is, its purpose, and how to ensure it is done well, this book brings together major evaluation researchers from a variety of social and behavioral science disciplines. Each chapter identifies a fundamental issue facing the field today; considers its implications for theory, method, practice, or the profession; and explores one or more approaches to dealing with the issue. Among the topics addressed are the nature of expertise in evaluation, how to build a better evidence base for evaluation theory, promoting cultural competence in evaluation, how to synthesize evaluation research findings, ways to involve stakeholders in decision making, and much more.
