Subsumption, correctness and relative correctness: Implications for software testing

Samia AlBlwi, Imen Marsit, Besma Khaireddine, Amani Ayad, Ji Meng Loh, Ali Mili

Research output: Contribution to journalArticlepeer-review

Abstract

Context. Several Research areas emerged and have been proceeding independently when in fact they have much in common. These include: mutant subsumption and mutant set minimization; relative correctness and the semantic definition of faults; differentiator sets and their application to test diversity; generate-and–validate methods of program repair; test suite coverage metrics. Objective. Highlight their analogies, commonalities and overlaps; explore their potential for synergy and shared research goals; unify several disparate concepts around a minimal set of artifacts. Method. Introduce and analyze a minimal set of concepts that enable us to model these disparate research efforts, and explore how these models may enable us to share insights between different research directions, and advance their respective goals. Results. Capturing absolute (total and partial) correctness and relative (total and partial) correctness with a single concept: detector sets. Using the same concept to quantify the effectiveness of test suites, and prove that the proposed measure satisfies appealing monotonicity properties. Using the measure of test suite effectiveness to model mutant set minimization as an optimization problem, characterized by an objective function and a constraint. Generalizing the concept of mutant subsumption using the concept of differentiator sets. Identifying analogies between detector sets and differentiator sets, and inferring relationships between subsumption and relative correctness. Conclusion. This paper does not aim to answer any pressing research question as much as it aims to raise research questions that use the insights gained from one research venue to gain a fresh perspective on a related research issue.

Original languageEnglish (US)
Article number103177
JournalScience of Computer Programming
Volume239
DOIs
StatePublished - Jan 2025
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Modeling and Simulation
  • Computational Theory and Mathematics

Keywords

  • Absolute correctness
  • Detector set
  • Differentiator set
  • Mutant set minimization
  • Mutant subsumption
  • Partial correctness
  • Program fault
  • Program repair
  • Relative correctness
  • Total correctness

Fingerprint

Dive into the research topics of 'Subsumption, correctness and relative correctness: Implications for software testing'. Together they form a unique fingerprint.

Cite this