Abstract
TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.
Original language | English |
---|---|
Title of host publication | Research Challenges in Information Science |
Subtitle of host publication | 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings |
Editors | Fabiano Dalpiaz, Jelena Zdravkovic, Pericles Loucopoulos |
Publisher | Springer |
Pages | 267-284 |
Number of pages | 18 |
ISBN (Electronic) | 9783030503161 |
ISBN (Print) | 9783030503154 |
DOIs | |
Publication status | Published - 2020 |
Event | 14th International Conference on Research Challenges in Information Sciences, RCIS 2020 - Limassol, Cyprus Duration: 23 Sept 2020 → 25 Sept 2020 |
Publication series
Name | Lecture Notes in Business Information Processing |
---|---|
Volume | 385 LNBIP |
ISSN (Print) | 1865-1348 |
ISSN (Electronic) | 1865-1356 |
Conference
Conference | 14th International Conference on Research Challenges in Information Sciences, RCIS 2020 |
---|---|
Country/Territory | Cyprus |
City | Limassol |
Period | 23/09/20 → 25/09/20 |
Funding
We would like to acknowledge the help of the case study companies They have been supporting our research, answering our questions, and validating our analyses. We would also like to thank the involved universities. This work was partially funded by the ITEA3 TESTOMAT project and the H2020 DECODER project.
Keywords
- Compare test approaches
- GUI test automation tools
- Industrial case study
- Railway sector
- Technology transfer
- TESTAR