Scriptless Testing at the GUI Level in an Industrial Setting

Hatim Chahim; Mehmet Duran; Tanja E.J. Vos; Pekka Aho; Nelly Condori Fernandez

doi:10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting

Hatim Chahim, Mehmet Duran, Tanja E.J. Vos^*, Pekka Aho, Nelly Condori Fernandez

^*Corresponding author for this work

Software and Sustainability (S2)

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

355 Downloads (Pure)

Abstract

TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

Original language	English
Title of host publication	Research Challenges in Information Science
Subtitle of host publication	14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings
Editors	Fabiano Dalpiaz, Jelena Zdravkovic, Pericles Loucopoulos
Publisher	Springer
Pages	267-284
Number of pages	18
ISBN (Electronic)	9783030503161
ISBN (Print)	9783030503154
DOIs	https://doi.org/10.1007/978-3-030-50316-1_16
Publication status	Published - 2020
Event	14th International Conference on Research Challenges in Information Sciences, RCIS 2020 - Limassol, Cyprus Duration: 23 Sept 2020 → 25 Sept 2020

Publication series

Name	Lecture Notes in Business Information Processing
Volume	385 LNBIP
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	14th International Conference on Research Challenges in Information Sciences, RCIS 2020
Country/Territory	Cyprus
City	Limassol
Period	23/09/20 → 25/09/20

Funding

We would like to acknowledge the help of the case study companies They have been supporting our research, answering our questions, and validating our analyses. We would also like to thank the involved universities. This work was partially funded by the ITEA3 TESTOMAT project and the H2020 DECODER project.

Keywords

Compare test approaches
GUI test automation tools
Industrial case study
Railway sector
Technology transfer
TESTAR

Access to Document

10.1007/978-3-030-50316-1_16

Chahim2020_Chapter_ScriptlessTestingAtTheGUILevelInAnIndustrialSettingFinal published version, 773 KBLicence: Article 25fa Dutch Copyright Act

Persistent URL (handle)

Persistent link

Cite this

Chahim, H., Duran, M., Vos, T. E. J., Aho, P., & Condori Fernandez, N. (2020). Scriptless Testing at the GUI Level in an Industrial Setting. In F. Dalpiaz, J. Zdravkovic, & P. Loucopoulos (Eds.), Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings (pp. 267-284). (Lecture Notes in Business Information Processing; Vol. 385 LNBIP). Springer. https://doi.org/10.1007/978-3-030-50316-1_16

Chahim, Hatim ; Duran, Mehmet ; Vos, Tanja E.J. et al. / Scriptless Testing at the GUI Level in an Industrial Setting. Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings. editor / Fabiano Dalpiaz ; Jelena Zdravkovic ; Pericles Loucopoulos. Springer, 2020. pp. 267-284 (Lecture Notes in Business Information Processing).

@inproceedings{339660b419bc489a87b50c7122e92e5b,

title = "Scriptless Testing at the GUI Level in an Industrial Setting",

abstract = "TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.",

keywords = "Compare test approaches, GUI test automation tools, Industrial case study, Railway sector, Technology transfer, TESTAR",

author = "Hatim Chahim and Mehmet Duran and Vos, {Tanja E.J.} and Pekka Aho and {Condori Fernandez}, Nelly",

year = "2020",

doi = "10.1007/978-3-030-50316-1_16",

language = "English",

isbn = "9783030503154",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "267--284",

editor = "Fabiano Dalpiaz and Jelena Zdravkovic and Pericles Loucopoulos",

booktitle = "Research Challenges in Information Science",

note = "14th International Conference on Research Challenges in Information Sciences, RCIS 2020 ; Conference date: 23-09-2020 Through 25-09-2020",

}

Chahim, H, Duran, M, Vos, TEJ, Aho, P & Condori Fernandez, N 2020, Scriptless Testing at the GUI Level in an Industrial Setting. in F Dalpiaz, J Zdravkovic & P Loucopoulos (eds), Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings. Lecture Notes in Business Information Processing, vol. 385 LNBIP, Springer, pp. 267-284, 14th International Conference on Research Challenges in Information Sciences, RCIS 2020, Limassol, Cyprus, 23/09/20. https://doi.org/10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting. / Chahim, Hatim; Duran, Mehmet; Vos, Tanja E.J. et al.
Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings. ed. / Fabiano Dalpiaz; Jelena Zdravkovic; Pericles Loucopoulos. Springer, 2020. p. 267-284 (Lecture Notes in Business Information Processing; Vol. 385 LNBIP).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Scriptless Testing at the GUI Level in an Industrial Setting

AU - Chahim, Hatim

AU - Duran, Mehmet

AU - Vos, Tanja E.J.

AU - Aho, Pekka

AU - Condori Fernandez, Nelly

PY - 2020

Y1 - 2020

N2 - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

AB - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.

KW - Compare test approaches

KW - GUI test automation tools

KW - Industrial case study

KW - Railway sector

KW - Technology transfer

KW - TESTAR

UR - http://www.scopus.com/inward/record.url?scp=85087763650&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85087763650&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-50316-1_16

DO - 10.1007/978-3-030-50316-1_16

M3 - Conference contribution

AN - SCOPUS:85087763650

SN - 9783030503154

T3 - Lecture Notes in Business Information Processing

SP - 267

EP - 284

BT - Research Challenges in Information Science

A2 - Dalpiaz, Fabiano

A2 - Zdravkovic, Jelena

A2 - Loucopoulos, Pericles

PB - Springer

T2 - 14th International Conference on Research Challenges in Information Sciences, RCIS 2020

Y2 - 23 September 2020 through 25 September 2020

ER -

Chahim H, Duran M, Vos TEJ, Aho P, Condori Fernandez N. Scriptless Testing at the GUI Level in an Industrial Setting. In Dalpiaz F, Zdravkovic J, Loucopoulos P, editors, Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings. Springer. 2020. p. 267-284. (Lecture Notes in Business Information Processing). Epub 2020 Jun 25. doi: 10.1007/978-3-030-50316-1_16

Scriptless Testing at the GUI Level in an Industrial Setting

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this