A model-level mutation tool to support the assessment of the test case quality

Maria Fernanda Granda; Nelly Condori-Fernández; Tanja E.J. Vos; Oscar Pastor

doi:10.1007/978-3-319-52593-8_2

A model-level mutation tool to support the assessment of the test case quality

Maria Fernanda Granda^*, Nelly Condori-Fernández, Tanja E.J. Vos, Oscar Pastor

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Chapter › Academic › peer-review

15 Downloads (Pure)

Abstract

Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; (ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: (1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). (2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.

Original language	English
Title of host publication	Complexity in Information Systems Development
Subtitle of host publication	Proceedings of the 25th International Conference on Information Systems Development
Editors	Jerzy Goluchowski, Malgorzata Pankowska, Henry Linger, Chris Barry, Michael Lang, Christoph Schneider
Publisher	Springer Heidelberg
Pages	17-37
Number of pages	21
ISBN (Electronic)	9783319525938
ISBN (Print)	9783319525921
DOIs	https://doi.org/10.1007/978-3-319-52593-8_2
Publication status	Published - 2017

Publication series

Name	Lecture Notes in Information Systems and Organisation
Volume	22
ISSN (Print)	2195-4968
ISSN (Electronic)	2195-4976

Bibliographical note

Funding Information:
This work has been developed with the financial support by SENESCYT of the Republic of Ecuador, SHIP (SMEs and HEIs in Innovation Partnerships, ref: EACEA/A2/UHB/CL 554187), PERTEST (TIN2013-46928-C3-1-R), European Commission (CaaS project) and Generalitat Valenciana (PROMETEOII/2014/039).

Publisher Copyright:
© Springer International Publishing Switzerland 2017.

Keywords

Class diagram mutants
Model-level mutation
Mutation tool
Test cases quality

Access to Document

10.1007/978-3-319-52593-8_2

A Model-Level Mutation Tool to Support the Assessment of the Test Case QualityFinal published version, 418 KBLicence: Article 25fa Dutch Copyright Act

Persistent URL (handle)

Copy link address

Cite this

Granda, M. F., Condori-Fernández, N., Vos, T. E. J., & Pastor, O. (2017). A model-level mutation tool to support the assessment of the test case quality. In J. Goluchowski, M. Pankowska, H. Linger, C. Barry, M. Lang, & C. Schneider (Eds.), Complexity in Information Systems Development: Proceedings of the 25th International Conference on Information Systems Development (pp. 17-37). (Lecture Notes in Information Systems and Organisation; Vol. 22). Springer Heidelberg. https://doi.org/10.1007/978-3-319-52593-8_2

Granda, Maria Fernanda ; Condori-Fernández, Nelly ; Vos, Tanja E.J. et al. / A model-level mutation tool to support the assessment of the test case quality. Complexity in Information Systems Development: Proceedings of the 25th International Conference on Information Systems Development. editor / Jerzy Goluchowski ; Malgorzata Pankowska ; Henry Linger ; Chris Barry ; Michael Lang ; Christoph Schneider. Springer Heidelberg, 2017. pp. 17-37 (Lecture Notes in Information Systems and Organisation).

@inbook{6657f96f95234efc8929cadeb1a18d02,

title = "A model-level mutation tool to support the assessment of the test case quality",

abstract = "Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; (ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: (1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). (2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.",

keywords = "Class diagram mutants, Model-level mutation, Mutation tool, Test cases quality",

author = "Granda, {Maria Fernanda} and Nelly Condori-Fern{\'a}ndez and Vos, {Tanja E.J.} and Oscar Pastor",

note = "Funding Information: This work has been developed with the financial support by SENESCYT of the Republic of Ecuador, SHIP (SMEs and HEIs in Innovation Partnerships, ref: EACEA/A2/UHB/CL 554187), PERTEST (TIN2013-46928-C3-1-R), European Commission (CaaS project) and Generalitat Valenciana (PROMETEOII/2014/039). Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2017.",

year = "2017",

doi = "10.1007/978-3-319-52593-8_2",

language = "English",

isbn = "9783319525921",

series = "Lecture Notes in Information Systems and Organisation",

publisher = "Springer Heidelberg",

pages = "17--37",

editor = "Jerzy Goluchowski and Malgorzata Pankowska and Henry Linger and Chris Barry and Michael Lang and Christoph Schneider",

booktitle = "Complexity in Information Systems Development",

address = "Germany",

}

Granda, MF, Condori-Fernández, N, Vos, TEJ & Pastor, O 2017, A model-level mutation tool to support the assessment of the test case quality. in J Goluchowski, M Pankowska, H Linger, C Barry, M Lang & C Schneider (eds), Complexity in Information Systems Development: Proceedings of the 25th International Conference on Information Systems Development. Lecture Notes in Information Systems and Organisation, vol. 22, Springer Heidelberg, pp. 17-37. https://doi.org/10.1007/978-3-319-52593-8_2

A model-level mutation tool to support the assessment of the test case quality. / Granda, Maria Fernanda; Condori-Fernández, Nelly; Vos, Tanja E.J. et al.
Complexity in Information Systems Development: Proceedings of the 25th International Conference on Information Systems Development. ed. / Jerzy Goluchowski; Malgorzata Pankowska; Henry Linger; Chris Barry; Michael Lang; Christoph Schneider. Springer Heidelberg, 2017. p. 17-37 (Lecture Notes in Information Systems and Organisation; Vol. 22).

Research output: Chapter in Book / Report / Conference proceeding › Chapter › Academic › peer-review

TY - CHAP

T1 - A model-level mutation tool to support the assessment of the test case quality

AU - Granda, Maria Fernanda

AU - Condori-Fernández, Nelly

AU - Vos, Tanja E.J.

AU - Pastor, Oscar

N1 - Funding Information: This work has been developed with the financial support by SENESCYT of the Republic of Ecuador, SHIP (SMEs and HEIs in Innovation Partnerships, ref: EACEA/A2/UHB/CL 554187), PERTEST (TIN2013-46928-C3-1-R), European Commission (CaaS project) and Generalitat Valenciana (PROMETEOII/2014/039). Publisher Copyright: © Springer International Publishing Switzerland 2017.

PY - 2017

Y1 - 2017

N2 - Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; (ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: (1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). (2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.

AB - Although mutation testing is a well-known technique for assessing the quality of tests, there is not a lot of support available for model-level mutation analysis. It is also considered to be expensive due to: (i) the large number of mutants generated; (ii) the time-consuming activity of determining equivalent mutants; and (iii) the mutant execution time. It should also be remembered that real software artefacts of appropriate size including real faults are hard to find and prepare appropriately. In this paper we propose a mutation tool to generate valid First Order Mutants (FOM) for Conceptual Schemas (CS) based on UML Class Diagrams and evaluate its effectiveness and efficiency in generating valid and non-equivalent mutants. Our main findings were: (1) FOM mutation operators can be automated to avoiding non-valid mutants (49.1%). (2) Fewer equivalent mutants were generated (7.2%) and 74.3% were reduced by analysing the CS static structure in six subject CSs.

KW - Class diagram mutants

KW - Model-level mutation

KW - Mutation tool

KW - Test cases quality

UR - http://www.scopus.com/inward/record.url?scp=85018744085&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85018744085&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-52593-8_2

DO - 10.1007/978-3-319-52593-8_2

M3 - Chapter

AN - SCOPUS:85018744085

SN - 9783319525921

T3 - Lecture Notes in Information Systems and Organisation

SP - 17

EP - 37

BT - Complexity in Information Systems Development

A2 - Goluchowski, Jerzy

A2 - Pankowska, Malgorzata

A2 - Linger, Henry

A2 - Barry, Chris

A2 - Lang, Michael

A2 - Schneider, Christoph

PB - Springer Heidelberg

ER -

Granda MF, Condori-Fernández N, Vos TEJ, Pastor O. A model-level mutation tool to support the assessment of the test case quality. In Goluchowski J, Pankowska M, Linger H, Barry C, Lang M, Schneider C, editors, Complexity in Information Systems Development: Proceedings of the 25th International Conference on Information Systems Development. Springer Heidelberg. 2017. p. 17-37. (Lecture Notes in Information Systems and Organisation). Epub 2017 Apr 19. doi: 10.1007/978-3-319-52593-8_2

A model-level mutation tool to support the assessment of the test case quality

Abstract

Publication series

Bibliographical note

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this