What Counts as Credible Evidence in Applied Research and Evaluation Practice?

What Counts as Credible Evidence in Applied Research and Evaluation Practice?

Author: Stewart I. Donaldson

Publisher: SAGE

Published: 2009

Total Pages: 289

ISBN-13: 1412957079

DOWNLOAD EBOOK

"What Counts as Credible Evidence in Applied Research and Evaluation Practice? is the first book of its kind to define and place into greater perspective the meaning of evidence for evaluation professionals and applied researchers. Editors Stewart I. Donaldson, Christina A. Christie, and Melvin M. Mark provide observations about the diversity and changing nature of credible evidence, include lessons from their own applied research and evaluation practice, and suggest ways in which practitioners might address the key issues and challenges of collecting credible evidence." "This book is appropriate for a wide range of courses, including Introduction to Evaluation Research, Research Methods, Evaluation Practice, Program Evaluation, Program Development and Evaluation, and evaluation courses in Social Work, Education, Public Health, and Public Policy."--BOOK JACKET.


Credible and Actionable Evidence

Credible and Actionable Evidence

Author: Stewart I. Donaldson

Publisher: SAGE Publications

Published: 2014-09-10

Total Pages: 377

ISBN-13: 1483325075

DOWNLOAD EBOOK

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable “who’s who” in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.


Advancing Validity in Outcome Evaluation: Theory and Practice

Advancing Validity in Outcome Evaluation: Theory and Practice

Author: Huey T. Chen

Publisher: John Wiley & Sons

Published: 2011-07-12

Total Pages: 157

ISBN-13: 1118159195

DOWNLOAD EBOOK

Exploring the influence and application of Campbellian validity typology in the theory and practice of outcome evaluation, this volume addresses the strengths and weaknesses of this often controversial evaluation method and presents new perspectives for its use. Editors Huey T. Chen, Stewart I. Donaldson and Melvin M. Mark provide a historical overview of the Campbellian typology adoption, contributions and criticism. Contributing authors propose strategies in developing a new perspective of validity typology for advancing validity in program evaluation including Enhance External Validity Enhance Precision by Reclassifying the Campbellian Typology Expand the Scope of the Typology The volume concludes with William R. Shadish's spirited rebuttal to earlier chapters. A collaborator with Don Campbell, Shadish provides a balance to the perspective of the issue with a clarification and defense of Campbell's work. This is the 129th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.


Credible and Actionable Evidence

Credible and Actionable Evidence

Author: Stewart I. Donaldson

Publisher: SAGE Publications

Published: 2014-09-10

Total Pages: 296

ISBN-13: 148335508X

DOWNLOAD EBOOK

Addressing one of the most important and contentious issues challenging applied research and evaluation practice today—what constitutes credible and actionable evidence?—this volume offers a balanced and current context in which to analyze the long-debated quantitative-qualitative paradigms. In the Second Edition, the contributors, a veritable "who’s who" in evaluation, discuss the diversity and changing nature of credible and actionable evidence; offer authoritative guidance about using credible and actionable evidence; explain how to use it to provide rigorous and influential evaluations; and include lessons from their own applied research and evaluation to suggest ways to address the key issues and challenges. Reflecting the latest developments in the field and covering both experimental and non-experimental methods, the new edition includes revised and updated chapters, summaries of strengths and weaknesses across varied approaches, and contains diverse definitions of evidence. Also included are two new chapters on assessing credibility and synthesizing evidence for policy makers. This is a valuable resource for students and others interested in how to best study and evaluate programs, policies, organizations, and other initiatives designed to improve aspects of the human condition and societal well-being.


The SAGE International Handbook of Educational Evaluation

The SAGE International Handbook of Educational Evaluation

Author: Katherine Ryan

Publisher: SAGE Publications

Published: 2009-07-15

Total Pages: 872

ISBN-13: 1483343456

DOWNLOAD EBOOK

Bringing together the expertise of top evaluation leaders from around the world, The SAGE International Handbook of Educational Evaluation addresses methods and applications in the field, particularly as they relate to policy- and decision-making in an era of globalization. The comprehensive collection of articles in the Handbook compels readers to consider globalization influences on educational evaluation within distinct genres or families of evaluation approaches. Key Features Discusses substantive issues surrounding globalization, and its implication for educational policy and practice and ultimately evaluation; Includes state-of-the-art theory chapters and method chapters within scientific, accountability-oriented, learning-oriented, and political genres of evaluation approaches; Provides real-world case exemplar chapters to illustrate core concepts within genres; Extends dialogue on controversial topics and contemporary educational evaluation tensions in the context of globalization; Summarizes, by means of an integration chapter, the issues, tensions and dilemmas confronting educational evaluators in an era of globalization. Serving as a state-of-the-art resource on educational evaluation, this volume is designed for graduate students, evaluation scholars and researchers and professional evaluation practitioners with an interest in educational program and policy evaluation.


Applied Research Design

Applied Research Design

Author: Terry Elizabeth Hedrick

Publisher: SAGE Publications

Published: 1993-01-11

Total Pages: 193

ISBN-13: 1506319440

DOWNLOAD EBOOK

"The Terry E. Hedrick, Leonard Bickman, and Debra J. Rog text provides a framework for designing research that is adaptable to almost any applied setting and constantly reiterates the need for establishing and maintaining credibility with the client at each level of the research process. Although the applied research book is a practical guide, suitable to accompany any thorough applied design textbook, it does a comprehensive job of presenting the distinction between basic and applied research. It introduces many topics found in the general methodology textbooks. This overlap will help students to feel comfortable in using the general skills in a more specific and complex manner." --Contemporary Psychology "For researchers needing to know how to plan and design applied research projects, Applied Research Design will be a most welcome publication. . . . The writing is clear and concise, graphics are utilized helpfully, and this book will be much appreciated by beginning social scientists who are serious but uncertain about the methodologies possible for doing applied research." --Academic Library Book Review Aimed at helping researchers and students make the transition from the classroom and the laboratory to the "real" world, the authors reveal pitfalls to avoid and strategies to undertake in order to overcome obstacles in the design and planning of applied research. Applied Research Design focuses on refining research questions when actual events force deviations from the original analysis. To accomplish this, the authors discuss how to study and monitor program implementation, statistical power analysis, and how to assess the human and material resources needed to conduct an applied research design to facilitate the management of data collection, analysis, and interpretation. Appropriate for professionals and researchers who have had some previous exposure to research methods, this book will enable the development of research strategies that are credible, useful, and--more important--feasible.


Handbook of Ethics in Quantitative Methodology

Handbook of Ethics in Quantitative Methodology

Author: A. T. Panter

Publisher: Routledge

Published: 2011-03-01

Total Pages: 508

ISBN-13: 1136888721

DOWNLOAD EBOOK

This comprehensive Handbook is the first to provide a practical, interdisciplinary review of ethical issues as they relate to quantitative methodology including how to present evidence for reliability and validity, what comprises an adequate tested population, and what constitutes scientific knowledge for eliminating biases. The book uses an ethical framework that emphasizes the human cost of quantitative decision making to help researchers understand the specific implications of their choices. The order of the Handbook chapters parallels the chronology of the research process: determining the research design and data collection; data analysis; and communicating findings. Each chapter: Explores the ethics of a particular topic Identifies prevailing methodological issues Reviews strategies and approaches for handling such issues and their ethical implications Provides one or more case examples Outlines plausible approaches to the issue including best-practice solutions. Part 1 presents ethical frameworks that cross-cut design, analysis, and modeling in the behavioral sciences. Part 2 focuses on ideas for disseminating ethical training in statistics courses. Part 3 considers the ethical aspects of selecting measurement instruments and sample size planning and explores issues related to high stakes testing, the defensibility of experimental vs. quasi-experimental research designs, and ethics in program evaluation. Decision points that shape a researchers’ approach to data analysis are examined in Part 4 – when and why analysts need to account for how the sample was selected, how to evaluate tradeoffs of hypothesis-testing vs. estimation, and how to handle missing data. Ethical issues that arise when using techniques such as factor analysis or multilevel modeling and when making causal inferences are also explored. The book concludes with ethical aspects of reporting meta-analyses, of cross-disciplinary statistical reform, and of the publication process. This Handbook appeals to researchers and practitioners in psychology, human development, family studies, health, education, sociology, social work, political science, and business/marketing. This book is also a valuable supplement for quantitative methods courses required of all graduate students in these fields.


Mixed Methods and Credibility of Evidence in Evaluation

Mixed Methods and Credibility of Evidence in Evaluation

Author: Donna M. Mertens

Publisher: John Wiley & Sons

Published: 2013-06-11

Total Pages: 154

ISBN-13: 1118720458

DOWNLOAD EBOOK

Mixed methods in evaluation have the potential to enhance the credibility of evaluation and the outcomes of evaluation. This issue explores advances in understanding mixed methods in philosophical, theoretical, and methodological terms and presents specific illustrations of the application of these concepts in evaluation practice. Leading thinkers in the mixed methods evaluation community provide frameworks and strategies that are associated with improving the probability of reaching the goals of enhanced credibility for evaluations, the evidence they produce, and the actions taken as a result of the evaluation findings. This is the 138th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.


Dealing With Complexity in Development Evaluation

Dealing With Complexity in Development Evaluation

Author: Michael Bamberger

Publisher: SAGE Publications

Published: 2015-10-16

Total Pages: 481

ISBN-13: 1483344231

DOWNLOAD EBOOK

Recognizing that complexity calls for innovative, conceptual, and methodological solutions, Dealing with Complexity in Development Evaluation by Michael Bamberger, Jos Vaessen, and Estelle Raimondo offers practical guidance to policymakers, managers, and evaluation practitioners on how to design and implement complexity-responsive evaluations that can be undertaken in the real world of time, budget, data, and political constraints. Introductory chapters present comprehensive, non-technical overviews of the most common evaluation tools and methodologies, and additional content addresses more cutting-edge material. The book also includes six case study chapters to illustrate examples of various evaluation contexts from around the world.