You are here:
Hierarchical Metamorphic Relations for Testing Scientific Software - Sweden
Citation:
Lin, X., M. Simon, AND N. Niu. Hierarchical Metamorphic Relations for Testing Scientific Software - Sweden. International Conference on Software Engineering, Gothenburg, SWEDEN, May 27 - June 03, 2018.
Impact/Purpose:
To present testing methodology to computer science public for scientific software integration. Scientist developers have not yet adopted a consistent systematic testing techniques to assure software quality. A key challenge is the oracle problem, a situation in which appropriate mechanisms for checking whether the program under test produces the expected output when executed using a set of test cases (TCs). Metamorphic testing alleviates the oracle problem by specifying the relationship that a source TC and its follow-up TC shall meet. Such relationships are called metamorphic relations (MRs) which are necessary properties of the intended program’s functionality. Existing approaches handle the MRs in a flat manner. This paper introduces a novel way to facilitate a hierarchy of MRs to be developed incrementally. We illustrate our approach by testing U.S. EPA’s Storm Water Management Model (SWMM). The results offer concrete insights into developing effective MRs to systematically test scientific software
Description:
Scientist developers have not yet adopted a consistent systematic testing techniques to assure software quality. A key challenge is the oracle problem, a situation in which appropriate mechanisms for checking whether the program under test produces the expected output when executed using a set of test cases (TCs). Metamorphic testing alleviates the oracle problem by specifying the relationship that a source TC and its follow-up TC shall meet. Such relationships are called metamorphic relations (MRs) which are necessary properties of the intended program’s functionality. Existing approaches handle the MRs in a flat manner. This paper introduces a novel way to facilitate a hierarchy of MRs to be developed incrementally. We illustrate our approach by testing U.S. EPA’s Storm Water Management Model (SWMM). The results offer concrete insights into developing effective MRs to systematically test scientific software.