This volume highlights the importance of replicating previous economic experiments for understanding the robustness and generalizability of behavior. Readers will gain a better understanding of the role that replication plays in scientific discovery as well as valuable insights into the robustness of previously reported findings.
One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.
This volume offers a comprehensive review of experimental methods in economics. Its 21 chapters cover theoretical and practical issues such as incentives, theory and policy development, data analysis, recruitment, software and laboratory organization. The Handbook includes separate parts on procedures, field experiments and neuroeconomics, and provides the first methodological overview of replication studies and a novel set-valued equilibrium concept. As a whole, the combination of basic methods and current developments will aid both beginners and advanced experimental economists.
Recently, social science has had numerous episodes of influential research that was found invalid when placed under rigorous scrutiny. The growing sense that many published results are potentially erroneous has made those conducting social science research more determined to ensure the underlying research is sound. Transparent and Reproducible Social Science Research is the first book to summarize and synthesize new approaches to combat false positives and non-reproducible findings in social science research, document the underlying problems in research practices, and teach a new generation of students and scholars how to overcome them. Understanding that social science research has real consequences for individuals when used by professionals in public policy, health, law enforcement, and other fields, the book crystallizes new insights, practices, and methods that help ensure greater research transparency, openness, and reproducibility. Readers are guided through well-known problems and are encouraged to work through new solutions and practices to improve the openness of their research. Created with both experienced and novice researchers in mind, Transparent and Reproducible Social Science Research serves as an indispensable resource for the production of high quality social science research.
This book, which comprises eight chapters, presents a comprehensive critical survey of the results and methods of laboratory experiments in economics. The first chapter provides an introduction to experimental economics as a whole, with the remaining chapters providing surveys by leading practitioners in areas of economics that have seen a concentration of experiments: public goods, coordination problems, bargaining, industrial organization, asset markets, auctions, and individual decision making. The work aims both to help specialists set an agenda for future research and to provide nonspecialists with a critical review of work completed to date. Its focus is on elucidating the role of experimental studies as a progressive research tool so that wherever possible, emphasis is on series of experiments that build on one another. The contributors to the volume--Colin Camerer, Charles A. Holt, John H. Kagel, John O. Ledyard, Jack Ochs, Alvin E. Roth, and Shyam Sunder--adopt a particular methodological point of view: the way to learn how to design and conduct experiments is to consider how good experiments grow organically out of the issues and hypotheses they are designed to investigate.
A wide-ranging discussion of factors that impede the cumulation of knowledge in the social sciences, including problems of transparency, replication, and reliability. Rather than focusing on individual studies or methods, this book examines how collective institutions and practices have (often unintended) impacts on the production of knowledge.
Over the past two decades, experimental economics has moved from a fringe activity to become a standard tool for empirical research. With experimental economics now regarded as part of the basic tool-kit for applied economics, this book demonstrates how controlled experiments can be a useful in providing evidence relevant to economic research. Professors Jacquemet and L'Haridon take the standard model in applied econometrics as a basis to the methodology of controlled experiments. Methodological discussions are illustrated with standard experimental results. This book provides future experimental practitioners with the means to construct experiments that fit their research question, and new comers with an understanding of the strengths and weaknesses of controlled experiments. Graduate students and academic researchers working in the field of experimental economics will be able to learn how to undertake, understand and criticise empirical research based on lab experiments, and refer to specific experiments, results or designs completed with case study applications.
The experimental approach in economics is a driving force behind some of the most exciting developments in the field. The 'experimental revolution' was based on a series of bold philosophical premises which have remained until now mostly unexplored. This book provides the first comprehensive analysis and critical discussion of the methodology of experimental economics, written by a philosopher of science with expertise in the field. It outlines the fundamental principles of experimental inference in order to investigate their power, scope and limitations. The author demonstrates that experimental economists have a lot to gain by discussing openly the philosophical principles that guide their work, and that philosophers of science have a lot to learn from their ingenious techniques devised by experimenters in order to tackle difficult scientific problems.
