TY - GEN
T1 - Using automatic failure detection for cognitive agents in eclipse (AAMAS 2016 DEMONSTRATION)
AU - Koeman, Vincent J.
AU - Hindriks, Koen V.
AU - Jonker, Catholijn M.
PY - 2016/1/1
Y1 - 2016/1/1
N2 - In order to reduce debugging effort and enable automated failure detection, we proposed an automated testing framework for detecting failures in cognitive agent programs in previous work. This approach is based on a minimal set of temporal operators that enable the specification of test conditions with sufficient expressiveness for detecting all failures in an existing failure taxonomy. We also introduced an according approach for specifying test templates that supports a programmer in writing tests. In this demonstration paper, the automated test framework for the Goal agent programming language that has been created for the Eclipse platform is introduced, with a focus on its practical aspects, i.e., how to use it to detect failures in cognitive agents. As fault localization is an important follow-up to failure detection, the integration of the test framework in the existing source-level debugger for Goal is discussed as well. In addition, an empirical evaluation of the automated testing framework implementation for Goal is presented based on the work of almost 200 novice agent programmers.
AB - In order to reduce debugging effort and enable automated failure detection, we proposed an automated testing framework for detecting failures in cognitive agent programs in previous work. This approach is based on a minimal set of temporal operators that enable the specification of test conditions with sufficient expressiveness for detecting all failures in an existing failure taxonomy. We also introduced an according approach for specifying test templates that supports a programmer in writing tests. In this demonstration paper, the automated test framework for the Goal agent programming language that has been created for the Eclipse platform is introduced, with a focus on its practical aspects, i.e., how to use it to detect failures in cognitive agents. As fault localization is an important follow-up to failure detection, the integration of the test framework in the existing source-level debugger for Goal is discussed as well. In addition, an empirical evaluation of the automated testing framework implementation for Goal is presented based on the work of almost 200 novice agent programmers.
UR - https://www.scopus.com/pages/publications/85009758493
UR - https://www.scopus.com/pages/publications/85009758493#tab=citedBy
U2 - 10.1007/978-3-319-50983-9_4
DO - 10.1007/978-3-319-50983-9_4
M3 - Conference contribution
AN - SCOPUS:85009758493
SN - 9783319509822
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 59
EP - 80
BT - Engineering Multi-Agent Systems - 4th International Workshop, EMAS 2016, Revised, Selected, and Invited Papers
A2 - Muller, Jorg P.
A2 - Nunes, Ingrid
A2 - Baldoni, Matteo
A2 - Zalila-Wenkstern, Rym
PB - Springer/Verlag
T2 - 4th International Workshop on Engineering Multi-Agent Systems, EMAS 2016
Y2 - 9 May 2016 through 10 May 2016
ER -