Explores how to define problems, recognize research design issues, and how to interpret data from surveys. Designed to serve the information needs of researchers, analysts, and administrators needing statistical tools for educational research, the presentation is oriented to research for school improvement. Problems with answers included.
A thorough and comprehensive guide to the theoretical, practical, and methodological approaches used in survey experiments across disciplines such as political science, health sciences, sociology, economics, psychology, and marketing This book explores and explains the broad range of experimental designs embedded in surveys that use both probability and non-probability samples. It approaches the usage of survey-based experiments with a Total Survey Error (TSE) perspective, which provides insight on the strengths and weaknesses of the techniques used. Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment addresses experiments on within-unit coverage, reducing nonresponse, question and questionnaire design, minimizing interview measurement bias, using adaptive design, trend data, vignettes, the analysis of data from survey experiments, and other topics, across social, behavioral, and marketing science domains. Each chapter begins with a description of the experimental method or application and its importance, followed by reference to relevant literature. At least one detailed original experimental case study then follows to illustrate the experimental method’s deployment, implementation, and analysis from a TSE perspective. The chapters conclude with theoretical and practical implications on the usage of the experimental method addressed. In summary, this book: Fills a gap in the current literature by successfully combining the subjects of survey methodology and experimental methodology in an effort to maximize both internal validity and external validity Offers a wide range of types of experimentation in survey research with in-depth attention to their various methodologies and applications Is edited by internationally recognized experts in the field of survey research/methodology and in the usage of survey-based experimentation —featuring contributions from across a variety of disciplines in the social and behavioral sciences Presents advances in the field of survey experiments, as well as relevant references in each chapter for further study Includes more than 20 types of original experiments carried out within probability sample surveys Addresses myriad practical and operational aspects for designing, implementing, and analyzing survey-based experiments by using a Total Survey Error perspective to address the strengths and weaknesses of each experimental technique and method Experimental Methods in Survey Research: Techniques that Combine Random Sampling with Random Assignment is an ideal reference for survey researchers and practitioners in areas such political science, health sciences, sociology, economics, psychology, public policy, data collection, data science, and marketing. It is also a very useful textbook for graduate-level courses on survey experiments and survey methodology.
Researchers, historians, and philosophers of science have debated the nature of scientific research in education for more than 100 years. Recent enthusiasm for "evidence-based" policy and practice in educationâ€"now codified in the federal law that authorizes the bulk of elementary and secondary education programsâ€"have brought a new sense of urgency to understanding the ways in which the basic tenets of science manifest in the study of teaching, learning, and schooling. Scientific Research in Education describes the similarities and differences between scientific inquiry in education and scientific inquiry in other fields and disciplines and provides a number of examples to illustrate these ideas. Its main argument is that all scientific endeavors share a common set of principles, and that each fieldâ€"including education researchâ€"develops a specialization that accounts for the particulars of what is being studied. The book also provides suggestions for how the federal government can best support high-quality scientific research in education.
Filling a gap in the literature of the field, Factorial Survey Experiments provides researchers with a practical guide to using the factorial survey method to assess respondents’ beliefs about the world, judgment principles, or decision rules through multi-dimensional stimuli (“vignettes”) that resemble real-life decision-making situations. Using insightful examples to illustrate their arguments, authors Katrin Auspurg and Thomas Hinz guide researchers through all relevant steps, including how to set up the factorial experimental design (drawing samples of vignettes and respondents), how to handle the practical challenges that must be mastered when an experimental plan with many different treatments is embedded in a survey format, and how to deal with questions of data analysis. In addition to providing the “how-tos” of designing factorial survey experiments, the authors cover recent developments of similar methods, such as conjoint analyses, choice experiments, and more advanced statistical tools.
Population-based survey experiments have become an invaluable tool for social scientists struggling to generalize laboratory-based results, and for survey researchers besieged by uncertainties about causality. Thanks to technological advances in recent years, experiments can now be administered to random samples of the population to which a theory applies. Yet until now, there was no self-contained resource for social scientists seeking a concise and accessible overview of this methodology, its strengths and weaknesses, and the unique challenges it poses for implementation and analysis. Drawing on examples from across the social sciences, this book covers everything you need to know to plan, implement, and analyze the results of population-based survey experiments. But it is more than just a "how to" manual. This lively book challenges conventional wisdom about internal and external validity, showing why strong causal claims need not come at the expense of external validity, and how it is now possible to execute experiments remotely using large-scale population samples. Designed for social scientists across the disciplines, Population-Based Survey Experiments provides the first complete introduction to this methodology. Offers the most comprehensive treatment of the subjectFeatures a wealth of examples and practical adviceReexamines issues of internal and external validityCan be used in conjunction with downloadable data from ExperimentCentral.org for design and analysis exercises in the classroom
Communication research is evolving and changing in a world of online journals, open-access, and new ways of obtaining data and conducting experiments via the Internet. Although there are generic encyclopedias describing basic social science research methodologies in general, until now there has been no comprehensive A-to-Z reference work exploring methods specific to communication and media studies. Our entries, authored by key figures in the field, focus on special considerations when applied specifically to communication research, accompanied by engaging examples from the literature of communication, journalism, and media studies. Entries cover every step of the research process, from the creative development of research topics and questions to literature reviews, selection of best methods (whether quantitative, qualitative, or mixed) for analyzing research results and publishing research findings, whether in traditional media or via new media outlets. In addition to expected entries covering the basics of theories and methods traditionally used in communication research, other entries discuss important trends influencing the future of that research, including contemporary practical issues students will face in communication professions, the influences of globalization on research, use of new recording technologies in fieldwork, and the challenges and opportunities related to studying online multi-media environments. Email, texting, cellphone video, and blogging are shown not only as topics of research but also as means of collecting and analyzing data. Still other entries delve into considerations of accountability, copyright, confidentiality, data ownership and security, privacy, and other aspects of conducting an ethical research program. Features: 652 signed entries are contained in an authoritative work spanning four volumes available in choice of electronic or print formats. Although organized A-to-Z, front matter includes a Reader’s Guide grouping entries thematically to help students interested in a specific aspect of communication research to more easily locate directly related entries. Back matter includes a Chronology of the development of the field of communication research; a Resource Guide to classic books, journals, and associations; a Glossary introducing the terminology of the field; and a detailed Index. Entries conclude with References/Further Readings and Cross-References to related entries to guide students further in their research journeys. The Index, Reader’s Guide themes, and Cross-References combine to provide robust search-and-browse in the e-version.
This book addresses the needs of researchers who want to conduct surveys online. Issues discussed include sampling from online populations, developing online and mobile questionnaires, and administering electronic surveys, are unique to digital surveys. Others, like creating reliable and valid survey questions, data analysis strategies, and writing the survey report, are common to all survey environments. This single resource captures the particulars of conducting digital surveys from start to finish
This book is designed to introduce doctoral and graduate students to the process of conducting scientific research in the social sciences, business, education, public health, and related disciplines. It is a one-stop, comprehensive, and compact source for foundational concepts in behavioral research, and can serve as a stand-alone text or as a supplement to research readings in any doctoral seminar or research methods class. This book is currently used as a research text at universities on six continents and will shortly be available in nine different languages.
We shall examine the validity of 16 experimental designs against 12 common threats to valid inference. By experiment we refer to that portion of research in which variables are manipulated and their effects upon other variables observed. It is well to distinguish the particular role of this chapter. It is not a chapter on experimental design in the Fisher (1925, 1935) tradition, in which an experimenter having complete mastery can schedule treatments and measurements for optimal statistical efficiency, with complexity of design emerging only from that goal of efficiency. Insofar as the designs discussed in the present chapter become complex, it is because of the intransigency of the environment: because, that is, of the experimenter’s lack of complete control.
Language learning research aims to describe and fully explain how and why language learning takes place, but can fall short of its stated purpose. Systematic, rigorous research is needed if the growing field of language learning is to progress methodically. This book demonstrates and fully explains such a methodology. Given that research in language acquisition yields practical pedagogical implications, it is crucial that it is rigorous and accurate. This book offers a quantitative research methodology that relies on statistical analysis in order to make inferences and conclusions about language learning. Experimental research aims to understand differences between or within groups of learners under manipulated environments. It requires strict control of conditions, enabling interpretations with a low factor of error. Aek Phakiti provides step-by-step guidelines and underlying principles, epistemology and methodology, in a book that is essential for advanced students of language acquisition and language and education.
