A Model-level Mutation Tool to Support the Assessment of the Test Case Quality

Nelly Condori Fernandez, Maria Fernanda Granda, Tanja E.J. Vos, Oscar Pastor

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: 1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). 2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.
Original languageEnglish
Title of host publicationInformation Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings)
EditorsM. Gołuchowski, , C. Pańkowska, H. Linger, C. Schneider
Place of PublicationKatowice, Poland
PublisherUniversity of Economics in Katowice
ISBN (Print) 978-83-7875-307-0
Publication statusPublished - 2016

Fingerprint

Testing

Keywords

  • Mutation
  • conceptual model
  • quality of test cases

Cite this

Condori Fernandez, N., Granda, M. F., Vos, T. E. J., & Pastor, O. (2016). A Model-level Mutation Tool to Support the Assessment of the Test Case Quality. In M. Gołuchowski, , C. Pańkowska, H. Linger, & C. Schneider (Eds.), Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings) Katowice, Poland: University of Economics in Katowice.
Condori Fernandez, Nelly ; Granda, Maria Fernanda ; Vos, Tanja E.J. ; Pastor, Oscar. / A Model-level Mutation Tool to Support the Assessment of the Test Case Quality. Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings). editor / M. Gołuchowski, ; C. Pańkowska ; H. Linger ; C. Schneider. Katowice, Poland : University of Economics in Katowice, 2016.
@inproceedings{e33b53fe033f4c1296338e47ab78bbc1,
title = "A Model-level Mutation Tool to Support the Assessment of the Test Case Quality",
abstract = "Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: 1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1{\%}). 2) Fewer equivalent mutants were generated (7.2{\%}) and 74.3{\%} were reduced by analysing the CS static structure in six subject CSs.",
keywords = "Mutation, conceptual model, quality of test cases",
author = "{Condori Fernandez}, Nelly and Granda, {Maria Fernanda} and Vos, {Tanja E.J.} and Oscar Pastor",
year = "2016",
language = "English",
isbn = "978-83-7875-307-0",
editor = "{Gołuchowski, }, {M. } and Pańkowska, {C. } and Linger, { H. } and Schneider, {C. }",
booktitle = "Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings)",
publisher = "University of Economics in Katowice",

}

Condori Fernandez, N, Granda, MF, Vos, TEJ & Pastor, O 2016, A Model-level Mutation Tool to Support the Assessment of the Test Case Quality. in M Gołuchowski, , C Pańkowska, H Linger & C Schneider (eds), Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings). University of Economics in Katowice, Katowice, Poland.

A Model-level Mutation Tool to Support the Assessment of the Test Case Quality. / Condori Fernandez, Nelly; Granda, Maria Fernanda; Vos, Tanja E.J.; Pastor, Oscar.

Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings). ed. / M. Gołuchowski, ; C. Pańkowska; H. Linger; C. Schneider. Katowice, Poland : University of Economics in Katowice, 2016.

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - A Model-level Mutation Tool to Support the Assessment of the Test Case Quality

AU - Condori Fernandez, Nelly

AU - Granda, Maria Fernanda

AU - Vos, Tanja E.J.

AU - Pastor, Oscar

PY - 2016

Y1 - 2016

N2 - Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: 1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). 2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.

AB - Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: 1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). 2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.

KW - Mutation

KW - conceptual model

KW - quality of test cases

M3 - Conference contribution

SN - 978-83-7875-307-0

BT - Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings)

A2 - Gołuchowski, , M.

A2 - Pańkowska, C.

A2 - Linger, H.

A2 - Schneider, C.

PB - University of Economics in Katowice

CY - Katowice, Poland

ER -

Condori Fernandez N, Granda MF, Vos TEJ, Pastor O. A Model-level Mutation Tool to Support the Assessment of the Test Case Quality. In Gołuchowski, M, Pańkowska C, Linger H, Schneider C, editors, Information Systems Development: Complexity in Information Systems Development (ISD2016 Proceedings). Katowice, Poland: University of Economics in Katowice. 2016