Finding failures from passed test cases: Improving the pattern classification approach to the testing of mesh simplification programs

W. K. Chan, Jeffrey Chun Fai Ho, T. H. Tse

Research output: Journal article publicationJournal articleAcademic researchpeer-review

14 Citations (Scopus)

Abstract

Mesh simplification programs create three-dimensional polygonal models similar to an original polygonal model, and yet use fewer polygons. They produce different graphics even though they are based on the same original polygonal model. This results in a test oracle problem. To address the problem, our previous work has developed a technique that uses a reference model of the program under test to train a classifier. Using such an approach may mistakenly mark a failure-causing test case as passed. It lowers the testing effectiveness of revealing failures. This paper suggests piping the test cases marked as passed by a statistical pattern classification module to an analytical metamorphic testing (MT) module. We evaluate our approach empirically using three subject programs with over 2700 program mutants. The result shows that, using a resembling reference model to train a classifier, the integrated approach can significantly improve the failure detection effectiveness of the pattern classification approach. We also explain how MT in our design trades specificity for sensitivity.
Original languageEnglish
Pages (from-to)89-120
Number of pages32
JournalSoftware Testing Verification and Reliability
Volume20
Issue number2
DOIs
Publication statusPublished - 1 Jun 2010
Externally publishedYes

Keywords

  • Classification
  • Mesh simplification
  • Metamorphic testing
  • Non-testable software
  • Test oracle problem
  • Testing methodology

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Cite this