You are here:
Raising the Bar for Reproducible Science at the US Environmental Protection Agency Office of Research and Development
Citation:
George, BJ, J. Sobus, L. Phelps, B. Rashleigh, J. Simmons, AND R. Hines. Raising the Bar for Reproducible Science at the US Environmental Protection Agency Office of Research and Development. TOXICOLOGICAL SCIENCES. Society of Toxicology, RESTON, VA, 145(1):16-22, (2015).
Impact/Purpose:
Value-added tools have been developed to improve statistical consideration during study design and its review/approval. These tools will serve to raise standards and expectations and further enhance the reproducibility of ORD science.
Description:
Considerable concern has been raised regarding research reproducibility both within and outside the scientific community. Several factors possibly contribute to a lack of reproducibility, including a failure to adequately employ statistical considerations during study design, bias in sample selection or subject recruitment, errors in developing data inclusion/exclusion criteria, and flawed statistical analysis. To address some of these issues, several publishers have developed checklists that authors must complete. Others have either enhanced statistical expertise on existing editorial boards, or formed distinct statistics editorial boards. Although the U.S. Environmental Protection Agency, Office of Research and Development, already has a strong Quality Assurance Program, an initiative was undertaken to further strengthen statistics consideration and other factors in study design and also to ensure these same factors are evaluated during the review and approval of study protocols. To raise awareness of the importance of statistical issues and provide a forum for robust discussion, a Community of Practice for Statistics was formed in January 2014. In addition, three working groups were established to develop a series of questions or criteria that should be considered when designing or reviewing experimental, observational, or modeling focused research. This article describes the process used to develop these study design guidance documents, their contents, how they are being employed by the Agency’s research enterprise, and expected benefits to Agency science. The process and guidance documents presented here may be of utility for any research enterprise interested in enhancing the reproducibility of its science.
URLs/Downloads:
http://toxsci.oxfordjournals.org/content/145/1/16.full.pdf+html?sid=71ed8808-d678-4d37-8660-f86505bb2b7e