Science Inventory

Hierarchical Metamorphic Relations for Testing Scientific Software - Sweden

Citation:

Lin, X., M. Simon, AND N. Niu. Hierarchical Metamorphic Relations for Testing Scientific Software - Sweden. International Conference on Software Engineering, Gothenburg, SWEDEN, May 27 - June 03, 2018.

Impact/Purpose:

To present testing methodology to computer science public for scientific software integration. Scientist developers have not yet adopted a consistent systematic testing techniques to assure software quality. A key challenge is the oracle problem, a situation in which appropriate mechanisms for checking whether the program under test produces the expected output when executed using a set of test cases (TCs). Metamorphic testing alleviates the oracle problem by specifying the relationship that a source TC and its follow-up TC shall meet. Such relationships are called metamorphic relations (MRs) which are necessary properties of the intended program’s functionality. Existing approaches handle the MRs in a flat manner. This paper introduces a novel way to facilitate a hierarchy of MRs to be developed incrementally. We illustrate our approach by testing U.S. EPA’s Storm Water Management Model (SWMM). The results offer concrete insights into developing effective MRs to systematically test scientific software

Description:

Scientist developers have not yet adopted a consistent systematic testing techniques to assure software quality. A key challenge is the oracle problem, a situation in which appropriate mechanisms for checking whether the program under test produces the expected output when executed using a set of test cases (TCs). Metamorphic testing alleviates the oracle problem by specifying the relationship that a source TC and its follow-up TC shall meet. Such relationships are called metamorphic relations (MRs) which are necessary properties of the intended program’s functionality. Existing approaches handle the MRs in a flat manner. This paper introduces a novel way to facilitate a hierarchy of MRs to be developed incrementally. We illustrate our approach by testing U.S. EPA’s Storm Water Management Model (SWMM). The results offer concrete insights into developing effective MRs to systematically test scientific software.

URLs/Downloads:

WORKSHOP-SLIDES.PDF   (PDF,NA pp, 1671.57 KB,  about PDF)

Record Details:

Record Type: DOCUMENT (PRESENTATION/SLIDE)
Product Published Date: 05/30/2018
Record Last Revised: 09/26/2018
OMB Category: Other
Record ID: 342515

Organization:

U.S. ENVIRONMENTAL PROTECTION AGENCY

OFFICE OF RESEARCH AND DEVELOPMENT

NATIONAL RISK MANAGEMENT RESEARCH LABORATORY

WATER SYSTEMS DIVISION