US EPA

In response to a Congressional directive contained in HR 106-379 regarding EPA's appropriations for FY2000, EPA has undertaken an evaluation of the characterization of data variability and uncertainty in its Integrated Risk Information System (IRIS) health effects information database. Through consultation with EPA's Science Advisory Board, EPA developed and implemented a systematic plan to select a representative sample of chemical assessments in IRIS to be evaluated in-depth by an independent panel of experts for the extent to which EPA has documented uncertainty and variability. EPA conducted a screening evaluation on 10% percent of the IRIS summaries of chemical assessments completed during the period of 1988-1994 (52 of 522 pre-Pilot assessments) and all 15 Pilot/post-Pilot IRIS summaries and Toxicological Reviews (completed after 1995) for overall documentation of data variability and uncertainty. An EPA contractor then selected 16 assessments (IRIS summaries and support documents) for in-depth examination from the screening sample (8 of 52 pre-Pilot and 8 of 15 Pilot/post-Pilot). The contractor selected six independent experts (outside EPA) in the field of human health risk assessment, who performed this in-depth review. In general, the outside experts concluded that the characterization of data variability and uncertainty varied across the assessments they reviewed. While the documentation of data variability and uncertainty has generally improved since the IRIS Pilot's introduction of Toxicological Reviews to substantiate IRIS summaries, the reviewers found that the quality of the characterization of data variability and uncertainty varied among the Pilot/post-Pilot assessments. The reviewers also suggested ways to describe uncertainty and variability, and a number of scientific improvements, especially the need to update older assessments with more recent scientific data and risk assessment methods. This study supports EPA's goal to make the scientific bases for risk assessment conclusions more transparent. EPA will continue to look into ways to improve the characterization and documentation of data variability and uncertainty in future IRIS assessments.

Hogan, K. Characterization Of Data Variability And Uncertainty: Health Effects Assessments In The Integrated Risk Information System (IRIS). U.S. Environmental Protection Agency, Office of Research and Development, National Center for Environmental Assessment, Washington Office, Washington, DC, EPA/635/R-00/005A, 2000.

This download(s) is distributed solely for the purpose of pre-dissemination peer review under applicable information quality guidelines. It has not been formally disseminated by EPA. It does not represent and should not be construed to represent any Agency determination or policy.

• Versar Report: Characterization of Data Uncertainty and Variability in IRIS Assessments, Pre-Pilot vs. Pilot/post-Pilot (PDF)  (46 pp, 136 KB, about PDF)
• Appendix A: Comments from Reviewers (PDF)  (214 pp, 459 KB, about PDF)
• EPA Screening Evaluation Report: Presentation and Discussion of Uncertainty and Variability in IRIS Assessment (PDF)  (26 pp, 48 KB, about PDF)
• Characterization of Data Variability and Uncertainty: Health Effects Assessments in the Integrated Risk Information System (IRIS), EPA Summary Report (PDF)  (23 pp, 118 KB, about PDF)

If you have a disability and the format of any material on our web pages interferes with your ability to access the information, please reach out to us using the Contact us about IRIS form for assistance. To enable us to respond in a manner most helpful to you, please indicate the nature of the accessibility problem, the web address of the requested material, your preferred format in which you want to receive the material (electronic format (ASCII, etc.), standard print, large print, etc.), and your contact information.

• Characterization of Data Uncertainty and Variability in IRIS Assessments Pre-Pilot Vs Pilot/Post-Pilot