Effectiveness assessment of an early testing technique using model-level mutants

M. F. Granda, N. Condori-Fernández, T. E.J. Vos, O. Pastor

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

While modern software development technologies enhance the capabilities of model-based/driven development, they introduce challenges for testers such as how to perform early testing at model level to ensure the quality of the model. In this context, we have developed an early testing technique supported by the CoSTest tool to validate requirements at model level. In this paper we describe an empirical evaluation of CoSTest with respect to its effectiveness in terms of its fault detection and test suite adequacy. This evaluation is carried out by model-level mutation testing using first order mutants (created by injection of a single fault) and high order mutants (containing more than one fault) with seven conceptual schemas (of different sizes) that represent the functionality of different software systems in different domains. Our findings show that the tests generated by CoSTest are effective at killing a large number of mutants. However, there are also some fault types (e.g. delete the references to a class attribute or an operation call in a constraint) that our test suites were not able to detect. CoSTest was more effective in terms of detecting fault types using high order mutants that first order mutants. Thus, CoSTest's effectiveness is affected by the mutant type tested.

Original languageEnglish
Title of host publicationProceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, EASE 2017
PublisherAssociation for Computing Machinery
Pages98-107
Number of pages10
ISBN (Electronic)9781450348041
DOIs
Publication statusPublished - 15 Jun 2017
Event21st International Conference on Evaluation and Assessment in Software Engineering, EASE 2017 - Karlskrona, Sweden
Duration: 15 Jun 201716 Jun 2017

Publication series

NameACM International Conference Proceeding Series
VolumePart F128635

Conference

Conference21st International Conference on Evaluation and Assessment in Software Engineering, EASE 2017
Country/TerritorySweden
CityKarlskrona
Period15/06/1716/06/17

Bibliographical note

Publisher Copyright:
© 2017 Association for Computing Machinery.

Keywords

  • Class diagram mutation
  • Conceptual schemas testing
  • Effectiveness assessment
  • Mutation testing
  • Test suite effectiveness

Fingerprint

Dive into the research topics of 'Effectiveness assessment of an early testing technique using model-level mutants'. Together they form a unique fingerprint.

Cite this