Reproducibility and Replicability in Science

Reproducibility and Replicability in Science

Author: National Academies of Sciences, Engineering, and Medicine

Publisher: National Academies Press

Published: 2019-10-20

Total Pages: 257

ISBN-13: 0309486165

DOWNLOAD EBOOK

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.


Managing Scientific Information and Research Data

Managing Scientific Information and Research Data

Author: Svetla Baykoucheva

Publisher: Chandos Publishing

Published: 2015-07-14

Total Pages: 163

ISBN-13: 0081002378

DOWNLOAD EBOOK

Innovative technologies are changing the way research is performed, preserved, and communicated. Managing Scientific Information and Research Data explores how these technologies are used and provides detailed analysis of the approaches and tools developed to manage scientific information and data. Following an introduction, the book is then divided into 15 chapters discussing the changes in scientific communication; new models of publishing and peer review; ethics in scientific communication; preservation of data; discovery tools; discipline-specific practices of researchers for gathering and using scientific information; academic social networks; bibliographic management tools; information literacy and the information needs of students and researchers; the involvement of academic libraries in eScience and the new opportunities it presents to librarians; and interviews with experts in scientific information and publishing. - Promotes innovative technologies for creating, sharing and managing scientific content - Presents new models of scientific publishing, peer review, and dissemination of information - Serves as a practical guide for researchers, students, and librarians on how to discover, filter, and manage scientific information - Advocates for the adoption of unique author identifiers such as ORCID and ResearcherID - Looks into new tools that make scientific information easy to discover and manage - Shows what eScience is and why it is becoming a priority for academic libraries - Demonstrates how Electronic Laboratory Notebooks can be used to record, store, share, and manage research data - Shows how social media and the new area of Altmetrics increase researchers' visibility and measure attention to their research - Directs to sources for datasets - Provides directions on choosing and using bibliographic management tools - Critically examines the metrics used to evaluate research impact - Aids strategic thinking and informs decision making


Returning Individual Research Results to Participants

Returning Individual Research Results to Participants

Author: National Academies of Sciences, Engineering, and Medicine

Publisher: National Academies Press

Published: 2018-08-23

Total Pages: 399

ISBN-13: 0309475201

DOWNLOAD EBOOK

When is it appropriate to return individual research results to participants? The immense interest in this question has been fostered by the growing movement toward greater transparency and participant engagement in the research enterprise. Yet, the risks of returning individual research resultsâ€"such as results with unknown validityâ€"and the associated burdens on the research enterprise are competing considerations. Returning Individual Research Results to Participants reviews the current evidence on the benefits, harms, and costs of returning individual research results, while also considering the ethical, social, operational, and regulatory aspects of the practice. This report includes 12 recommendations directed to various stakeholdersâ€"investigators, sponsors, research institutions, institutional review boards (IRBs), regulators, and participantsâ€"and are designed to help (1) support decision making regarding the return of results on a study-by-study basis, (2) promote high-quality individual research results, (3) foster participant understanding of individual research results, and (4) revise and harmonize current regulations.


Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results

Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results

Author: National Academies of Sciences, Engineering, and Medicine

Publisher: National Academies Press

Published: 2016-03-29

Total Pages: 133

ISBN-13: 0309392020

DOWNLOAD EBOOK

Questions about the reproducibility of scientific research have been raised in numerous settings and have gained visibility through several high-profile journal and popular press articles. Quantitative issues contributing to reproducibility challenges have been considered (including improper data measurement and analysis, inadequate statistical expertise, and incomplete data, among others), but there is no clear consensus on how best to approach or to minimize these problems. A lack of reproducibility of scientific results has created some distrust in scientific findings among the general public, scientists, funding agencies, and industries. While studies fail for a variety of reasons, many factors contribute to the lack of perfect reproducibility, including insufficient training in experimental design, misaligned incentives for publication and the implications for university tenure, intentional manipulation, poor data management and analysis, and inadequate instances of statistical inference. The workshop summarized in this report was designed not to address the social and experimental challenges but instead to focus on the latter issues of improper data management and analysis, inadequate statistical expertise, incomplete data, and difficulties applying sound statistic inference to the available data. Many efforts have emerged over recent years to draw attention to and improve reproducibility of scientific work. This report uniquely focuses on the statistical perspective of three issues: the extent of reproducibility, the causes of reproducibility failures, and the potential remedies for these failures.


Strengthening Forensic Science in the United States

Strengthening Forensic Science in the United States

Author: National Research Council

Publisher: National Academies Press

Published: 2009-07-29

Total Pages: 348

ISBN-13: 0309142393

DOWNLOAD EBOOK

Scores of talented and dedicated people serve the forensic science community, performing vitally important work. However, they are often constrained by lack of adequate resources, sound policies, and national support. It is clear that change and advancements, both systematic and scientific, are needed in a number of forensic science disciplines to ensure the reliability of work, establish enforceable standards, and promote best practices with consistent application. Strengthening Forensic Science in the United States: A Path Forward provides a detailed plan for addressing these needs and suggests the creation of a new government entity, the National Institute of Forensic Science, to establish and enforce standards within the forensic science community. The benefits of improving and regulating the forensic science disciplines are clear: assisting law enforcement officials, enhancing homeland security, and reducing the risk of wrongful conviction and exoneration. Strengthening Forensic Science in the United States gives a full account of what is needed to advance the forensic science disciplines, including upgrading of systems and organizational structures, better training, widespread adoption of uniform and enforceable best practices, and mandatory certification and accreditation programs. While this book provides an essential call-to-action for congress and policy makers, it also serves as a vital tool for law enforcement agencies, criminal prosecutors and attorneys, and forensic science educators.


Technology Commercialization

Technology Commercialization

Author: Committee on Utilization of Technologies Developed at Russian Research and Educational Institutions

Publisher: National Academies Press

Published: 1998-12-23

Total Pages: 149

ISBN-13: 0309592348

DOWNLOAD EBOOK

This collection of papers—by American and Russian specialists—addresses a variety of legal, regulatory, institutional, and financial issues that can promote or hinder technology commercialization. The book is the result of a series of workshops organized by the National Research Council with the Russian Academy of Sciences on commercialization of technologies, particularly those developed at research and educational institutions. Technology Commercialization concludes with a list of actions, programs, and policies which warrant further consideration as Russia tries to improve the success of technology commercialization. This book will be of interest to those concerned with small-business development in post-communist states, university technology management, and comparative technology commercialization.


Social Science Research

Social Science Research

Author: Anol Bhattacherjee

Publisher: CreateSpace

Published: 2012-04-01

Total Pages: 156

ISBN-13: 9781475146127

DOWNLOAD EBOOK

This book is designed to introduce doctoral and graduate students to the process of conducting scientific research in the social sciences, business, education, public health, and related disciplines. It is a one-stop, comprehensive, and compact source for foundational concepts in behavioral research, and can serve as a stand-alone text or as a supplement to research readings in any doctoral seminar or research methods class. This book is currently used as a research text at universities on six continents and will shortly be available in nine different languages.


Fostering Integrity in Research

Fostering Integrity in Research

Author: National Academies of Sciences, Engineering, and Medicine

Publisher: National Academies Press

Published: 2018-01-13

Total Pages: 327

ISBN-13: 0309391253

DOWNLOAD EBOOK

The integrity of knowledge that emerges from research is based on individual and collective adherence to core values of objectivity, honesty, openness, fairness, accountability, and stewardship. Integrity in science means that the organizations in which research is conducted encourage those involved to exemplify these values in every step of the research process. Understanding the dynamics that support â€" or distort â€" practices that uphold the integrity of research by all participants ensures that the research enterprise advances knowledge. The 1992 report Responsible Science: Ensuring the Integrity of the Research Process evaluated issues related to scientific responsibility and the conduct of research. It provided a valuable service in describing and analyzing a very complicated set of issues, and has served as a crucial basis for thinking about research integrity for more than two decades. However, as experience has accumulated with various forms of research misconduct, detrimental research practices, and other forms of misconduct, as subsequent empirical research has revealed more about the nature of scientific misconduct, and because technological and social changes have altered the environment in which science is conducted, it is clear that the framework established more than two decades ago needs to be updated. Responsible Science served as a valuable benchmark to set the context for this most recent analysis and to help guide the committee's thought process. Fostering Integrity in Research identifies best practices in research and recommends practical options for discouraging and addressing research misconduct and detrimental research practices.


Statistics and Analysis of Scientific Data

Statistics and Analysis of Scientific Data

Author: Massimiliano Bonamente

Publisher: Springer

Published: 2016-11-08

Total Pages: 323

ISBN-13: 1493965727

DOWNLOAD EBOOK

The revised second edition of this textbook provides the reader with a solid foundation in probability theory and statistics as applied to the physical sciences, engineering and related fields. It covers a broad range of numerical and analytical methods that are essential for the correct analysis of scientific data, including probability theory, distribution functions of statistics, fits to two-dimensional data and parameter estimation, Monte Carlo methods and Markov chains. Features new to this edition include: • a discussion of statistical techniques employed in business science, such as multiple regression analysis of multivariate datasets. • a new chapter on the various measures of the mean including logarithmic averages. • new chapters on systematic errors and intrinsic scatter, and on the fitting of data with bivariate errors. • a new case study and additional worked examples. • mathematical derivations and theoretical background material have been appropriately marked, to improve the readability of the text. • end-of-chapter summary boxes, for easy reference. As in the first edition, the main pedagogical method is a theory-then-application approach, where emphasis is placed first on a sound understanding of the underlying theory of a topic, which becomes the basis for an efficient and practical application of the material. The level is appropriate for undergraduates and beginning graduate students, and as a reference for the experienced researcher. Basic calculus is used in some of the derivations, and no previous background in probability and statistics is required. The book includes many numerical tables of data, as well as exercises and examples to aid the readers' understanding of the topic.