TY - GEN
T1 - Scriptless Testing at the GUI Level in an Industrial Setting
AU - Chahim, Hatim
AU - Duran, Mehmet
AU - Vos, Tanja E.J.
AU - Aho, Pekka
AU - Condori Fernandez, Nelly
PY - 2020
Y1 - 2020
N2 - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.
AB - TESTAR is a traversal-based and scriptless tool for test automation at the Graphical User Interface (GUI) level. It is different from existing test approaches because no test cases need to be defined before testing. Instead, the tests are generated during the execution, on-the-fly. This paper presents an empirical case study in a realistic industrial context where we compare TESTAR to a manual test approach of a web-based application in the rail sector. Both qualitative and quantitative research methods are used to investigate learnability, effectiveness, efficiency, and satisfaction. The results show that TESTAR was able to detect more faults and higher functional test coverage than the used manual test approach. As far as efficiency is concerned, the preparation time of both test approaches is identical, but TESTAR can realize test execution without the use of human resources. Finally, TESTAR turns out to be a learnable test approach. As a result of the study described in this paper, TESTAR technology was successfully transferred and the company will use both test approaches in a complementary way in the future.
KW - Compare test approaches
KW - GUI test automation tools
KW - Industrial case study
KW - Railway sector
KW - Technology transfer
KW - TESTAR
UR - http://www.scopus.com/inward/record.url?scp=85087763650&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85087763650&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-50316-1_16
DO - 10.1007/978-3-030-50316-1_16
M3 - Conference contribution
AN - SCOPUS:85087763650
SN - 9783030503154
T3 - Lecture Notes in Business Information Processing
SP - 267
EP - 284
BT - Research Challenges in Information Science
A2 - Dalpiaz, Fabiano
A2 - Zdravkovic, Jelena
A2 - Loucopoulos, Pericles
PB - Springer
T2 - 14th International Conference on Research Challenges in Information Sciences, RCIS 2020
Y2 - 23 September 2020 through 25 September 2020
ER -