Evaluation Design for Complex Global Initiatives

Evaluation Design for Complex Global Initiatives

Author: Institute of Medicine

Publisher:

Published: 2014

Total Pages: 0

ISBN-13: 9780309302586

DOWNLOAD EBOOK

Every year, public and private funders spend many billions of dollars on large-scale, complex, multi-national health initiatives. The only way to know whether these initiatives are achieving their objectives is through evaluations that examine the links between program activities and desired outcomes. Investments in such evaluations, which, like the initiatives being evaluated, are carried out in some of the world's most challenging settings, are a relatively new phenomenon. In the last five years, evaluations have been conducted to determine the effects of some of the world's largest and most complex multi-national health initiatives. Evaluation Design for Complex Global Initiatives is the summary of a workshop convened by the Institute of Medicine in January 2014 to explore these recent evaluation experiences and to consider the lessons learned from how these evaluations were designed, carried out, and used. The workshop brought together more than 100 evaluators, researchers in the field of evaluation science, staff involved in implementing large-scale health programs, local stakeholders in the countries where the initiatives are carried out, policy makers involved in the initiatives, representatives of donor organizations, and others to derive lessons learned from past large-scale evaluations and to discuss how to apply these lessons to future evaluations. This report discusses transferable insights gained across the spectrum of choosing the evaluator, framing the evaluation, designing the evaluation, gathering and analyzing data, synthesizing findings and recommendations, and communicating key messages. The report also explores the relative benefits and limitations of different quantitative and qualitative approaches within the mixed methods designs used for these complex and costly evaluations.


Blue Marble Evaluation

Blue Marble Evaluation

Author: Michael Quinn Patton

Publisher: Guilford Publications

Published: 2019-11

Total Pages: 249

ISBN-13: 146254195X

DOWNLOAD EBOOK

Global thinking principle -- Anthropocene as context principle -- Transformation engagement principle -- Integration principle -- Transboundary engagement principle -- GLOCAL principle -- Cross-silos principle -- Time being of the essence principle -- Yin-yang principle -- Bricolage methods principle -- World savvy principle -- Skin in the game principle -- Theory of transformation principle -- Transformation fidelity principles : evaluating transformation -- Transformational alignment principle : transforming evaluation to evaluate transformation.


Developmental Evaluation

Developmental Evaluation

Author: Michael Quinn Patton

Publisher: Guilford Press

Published: 2010-06-14

Total Pages: 401

ISBN-13: 1606238868

DOWNLOAD EBOOK

Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how DE can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables. Provided is essential guidance for making evaluations useful, practical, and credible in support of social change.


Working with Assumptions in International Development Program Evaluation

Working with Assumptions in International Development Program Evaluation

Author: Apollo M. Nkwake

Publisher: Springer Science & Business Media

Published: 2012-08-30

Total Pages: 191

ISBN-13: 1461447976

DOWNLOAD EBOOK

​ A major reason complex programs are so difficult to evaluate is that the assumptions that inspire them are poorly articulated. Stakeholders of such programs are often unclear about how the change process will unfold. Thus, it is so difficult to reasonably anticipate the early and midterm changes that need to happen in order for a longer-term goalto be reached. The lack of clarity about the “mini-steps” that must be taken to reach a long-term outcome not only makes the task of evaluating a complex initiative challenging, but reduces the likelihood that all of the important factors related to the long term goal will be addressed. Most of the resources that have attempted to address this dilemma have been popularized as theory of change or sometimes program theory approaches. Although these approaches emphasize and elaborate the sequence of changes/mini steps that lead to the long-term goal of interest and the connections between program activities and outcomes that occur at each step of the way, they do not do enough to clarify how program managers or evaluators should deal with assumptions. Assumptions, the glue that holds all the pieces together, remain abstract and far from applicable. In this book the author tackles this important assumptions theme head-on-covering a breadth of ground from the epistemology of development assumptions, to the art of making logical assumptions as well as recognizing, explicit zing and testing assumptions with in an elaborate program theory from program design, implementation, monitoring and evaluation.


Evaluation of PEPFAR's Contribution (2012-2017) to Rwanda's Human Resources for Health Program

Evaluation of PEPFAR's Contribution (2012-2017) to Rwanda's Human Resources for Health Program

Author: National Academies of Sciences, Engineering, and Medicine

Publisher: National Academies Press

Published: 2020-06-22

Total Pages: 299

ISBN-13: 0309672058

DOWNLOAD EBOOK

Since 2004, the U.S. government has supported the global response to HIV/AIDS through the President's Emergency Plan for AIDS Relief (PEPFAR). The Republic of Rwanda, a PEPFAR partner country since the initiative began, has made gains in its HIV response, including increased access to and coverage of antiretroviral therapy and decreased HIV prevalence. However, a persistent shortage in human resources for health (HRH) affects the health of people living with HIV and the entire Rwandan population. Recognizing HRH capabilities as a foundational challenge for the health system and the response to HIV, the Government of Rwanda worked with PEPFAR and other partners to develop a program to strengthen institutional capacity in health professional education and thereby increase the production of high-quality health workers. The Program was fully managed by the Government of Rwanda and was designed to run from 2011 through 2019. PEPFAR initiated funding in 2012. In 2015, PEPFAR adopted a new strategy focused on high-burden geographic areas and key populations, resulting in a reconfiguration of its HIV portfolio in Rwanda and a decision to cease funding the Program, which was determined no longer core to its programming strategy. The last disbursement for the Program from PEPFAR was in 2017. Evaluation of PEPFAR's Contribution (2012-2017) to Rwanda's Human Resources for Health Program describes PEPFAR-supported HRH activities in Rwanda in relation to programmatic priorities, outputs, and outcomes and examines, to the extent feasible, the impact on HRH and HIV-related outcomes. The HRH Program more than tripled the country's physician specialist workforce and produced major increases in the numbers and qualifications of nurses and midwives. Partnerships between U.S. institutions and the University of Rwanda introduced new programs, upgraded curricula, and improved the quality of teaching and training for health professionals. Growing the number, skills, and competencies of health workers contributed to direct and indirect improvements in the quality of HIV care. Based on the successes and challenges of the HRH program, the report recommends that future investments in health professional education be designed within a more comprehensive approach to human resources for health and institutional capacity building, which would strengthen the health system to meet both HIV-specific and more general health needs. The recommendations offer an aspirational framework to reimagine how partnerships are formed, how investments are made, and how the effects of those investments are documented.


Purposeful Program Theory

Purposeful Program Theory

Author: Sue C. Funnell

Publisher: John Wiley & Sons

Published: 2011-02-09

Total Pages: 576

ISBN-13: 0470939893

DOWNLOAD EBOOK

Between good intentions and great results lies a program theory not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. Purposeful Program Theory shows how to develop, represent, and use program theory thoughtfully and strategically to suit your particular situation, drawing on the fifty-year history of program theory and the authors' experiences over more than twenty-five years. "From needs assessment to intervention design, from implementation to outcomes evaluation, from policy formulation to policy execution and evaluation, program theory is paramount. But until now no book has examined these multiple uses of program theory in a comprehensive, understandable, and integrated way. This promises to be a breakthrough book, valuable to practitioners, program designers, evaluators, policy analysts, funders, and scholars who care about understanding why an intervention works or doesn't work." Michael Quinn Patton, author, Utilization-Focused Evaluation "Finally, the definitive guide to evaluation using program theory! Far from the narrow 'one true way' approaches to program theory, this book provides numerous practical options for applying program theory to fulfill different purposes and constraints, and guides the reader through the sound critical thinking required to select from among the options. The tour de force of the history and use of program theory is a truly global view, with examples from around the world and across the full range of content domains. A must-have for any serious evaluator." E. Jane Davidson, PhD, Real Evaluation Ltd. Companion Web site: josseybass.com/go/funnellrogers


RealWorld Evaluation

RealWorld Evaluation

Author: Michael Bamberger

Publisher: SAGE Publications

Published: 2019-07-31

Total Pages: 747

ISBN-13: 1544318766

DOWNLOAD EBOOK

RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints addresses the challenges of conducting program evaluations in real-world contexts where evaluators and their clients face budget and time constraints. The book is organized around the authors’ seven-step model that has been tested in workshops and practice environments to help the evaluation implementers and managers make the best choices when faced with real world constraints. The Third Edition includes a new chapter on gender equality and women’s empowerment and discussion of digital technology and data science.


Impact Evaluation in Practice, Second Edition

Impact Evaluation in Practice, Second Edition

Author: Paul J. Gertler

Publisher: World Bank Publications

Published: 2016-09-12

Total Pages: 444

ISBN-13: 1464807809

DOWNLOAD EBOOK

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.


Ten Steps to a Results-based Monitoring and Evaluation System

Ten Steps to a Results-based Monitoring and Evaluation System

Author: Jody Zall Kusek

Publisher: World Bank Publications

Published: 2004-06-15

Total Pages: 270

ISBN-13: 0821382896

DOWNLOAD EBOOK

An effective state is essential to achieving socio-economic and sustainable development. With the advent of globalization, there are growing pressures on governments and organizations around the world to be more responsive to the demands of internal and external stakeholders for good governance, accountability and transparency, greater development effectiveness, and delivery of tangible results. Governments, parliaments, citizens, the private sector, NGOs, civil society, international organizations and donors are among the stakeholders interested in better performance. As demands for greater accountability and real results have increased, there is an attendant need for enhanced results-based monitoring and evaluation of policies, programs, and projects. This Handbook provides a comprehensive ten-step model that will help guide development practitioners through the process of designing and building a results-based monitoring and evaluation system. These steps begin with a OC Readiness AssessmentOCO and take the practitioner through the design, management, and importantly, the sustainability of such systems. The Handbook describes each step in detail, the tasks needed to complete each one, and the tools available to help along the way."


Evaluation matters

Evaluation matters

Author: Katrin Dziekan

Publisher: Waxmann Verlag

Published: 2013

Total Pages: 177

ISBN-13: 3830978812

DOWNLOAD EBOOK

Based on the authors' rich experiences, this book demonstrates that evaluation of measures aimed at more sustainable mobility is a useful task which can be learned by everybody. By integrating theory and practice it offers richly-illustrated case examples and cartoons to provide hands on advice. It offers a framework for thinking about evaluation of mobility-related measures and outlines the necessary steps for good evaluation practice. Key Features •Richly illustrated by comics and on real measure examples. •A step-by-step hands on guide for practitioners.