You are here:
THE NEW ENGLAND AIR QUALITY FORECASTING PILOT PROGRAM: DEVELOPMENT OF AN EVALUATION PROTOCOL AND PERFORMANCE BENCHMARK
Citation:
KANG, D., B. K. EDER, A. F. STEIN, G. A. GRELL, S. E. PECKHAM, AND J. MCHENRY. THE NEW ENGLAND AIR QUALITY FORECASTING PILOT PROGRAM: DEVELOPMENT OF AN EVALUATION PROTOCOL AND PERFORMANCE BENCHMARK. JOURNAL OF AIR AND WASTE MANAGEMENT. Air & Waste Management Association, Pittsburgh, PA, 55(12):1782-1796, (2005).
Impact/Purpose:
The objectives of this task include: (1) to continuously evaluate and analyze the forecast results to provide diagnostic information on model performance and inadequacies to guide further evolution and refinements to the CMAQ model, and (2) extending the utility of the daily air quality forecast model data being produced by NOAA's National Weather Service (NWS) as part of a NOAA/EPA collaboration in air quality forecasting, to EPA mission-oriented activities. These objectives include developing and maintaining a long-term database of air quality modeling results (ozone and PM2.5), performing periodic analysis and assessments using the data, and making the air quality database available and accessible to States, Regions, RPO's and others to use as input data for regional/local scale air quality modeling for policy/regulatory purposes.
Description:
The National Oceanic and Atmospheric Administration recently sponsored the New England Forecasting Pilot Program to serve as a "test bed" for chemical forecasting by providing all of the elements of a National Air Quality Forecasting System, including the development and implementation of an evaluation protocol. This Pilot Program enlisted three regional-scale air quality models, serving as prototypes, to forecast ozone (O3) concentrations across the northeastern United States during the summer of 2002. A suite of statistical metrics was identified as part of the protocol that facilitated evaluation of both discrete forecasts (observed versus modeled concentrations) and categorical forecasts (observed versus modeled exceedances/nonexceedances) for both the maximum 1-hr (125 ppb) and 8-hr (85 ppb) forecasts produced by each of the models. Implementation of the evaluation protocol took place during a 25-day period (August 5-29), utilizing hourly O3 concentration data obtained from over 450 monitors from the U.S. Environment Protection Agency's Air Quality System network.