The “why did you do that?” button: Answering why-questions for end users of robotic systems

Vincent J. Koeman, Louise A. Dennis*, Matt Webster, Michael Fisher, Koen Hindriks

*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

111 Downloads (Pure)


The issue of explainability for autonomous systems is becoming increasingly prominent. Several researchers and organisations have advocated the provision of a “Why did you do that?” button which allows a user to interrogate a robot about its choices and actions. We take previous work on debugging cognitive agent programs and apply it to the question of supplying explanations to end users in the form of answers to why-questions. These previous approaches are based on the generation of a trace of events in the execution of the program and then answering why-questions using the trace. We implemented this framework in the agent infrastructure layer and, in particular, the Gwendolen programming language it supports – extending it in the process to handle the generation of applicable plans and multiple intentions. In order to make the answers to why-questions comprehensible to end users we advocate a two step process in which first a representation of an explanation is created and this is subsequently converted into natural language in a way which abstracts away from some events in the trace and employs application specific predicate dictionaries in order to translate the first-order logic presentation of concepts within the cognitive agent program in natural language. A prototype implementation of these ideas is provided.

Original languageEnglish
Title of host publicationEngineering Multi-Agent System
Subtitle of host publication7th International Workshop, EMAS 2019, Montreal, QC, Canada, May 13–14, 2019, Revised Selected Papers
EditorsLouise A. Dennis, Rafael H. Bordini, Yves Lespérance
Number of pages21
ISBN (Electronic)9783030514174
ISBN (Print)9783030514167
Publication statusPublished - 2020
Event7th International Workshop on Engineering Multi-Agent Systems, EMAS 2019 - Montreal, Canada
Duration: 13 May 201914 May 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12058 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference7th International Workshop on Engineering Multi-Agent Systems, EMAS 2019


Dive into the research topics of 'The “why did you do that?” button: Answering why-questions for end users of robotic systems'. Together they form a unique fingerprint.

Cite this