TY - GEN
T1 - Allocation of moral decision-making in human-agent teams
T2 - 17th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
AU - van der Waa, Jasper
AU - van Diggelen, Jurriaan
AU - Cavalcante Siebert, Luciano
AU - Neerincx, Mark
AU - Jonker, Catholijn
PY - 2020
Y1 - 2020
N2 - Artificially intelligent agents will deal with more morally sensitive situations as the field of AI progresses. Research efforts are made to regulate, design and build Artificial Moral Agents (AMAs) capable of making moral decisions. This research is highly multidisciplinary with each their own jargon and vision, and so far it is unclear whether a fully autonomous AMA can be achieved. To specify currently available solutions and structure an accessible discussion around them, we propose to apply Team Design Patterns (TDPs). The language of TDPs describe (visually, textually and formally) a dynamic allocation of tasks for moral decision making in a human-agent team context. A task decomposition is proposed on moral decision-making and AMA capabilities to help define such TDPs. Four TDPs are given as examples to illustrate the versatility of the approach. Two problem scenarios (surgical robots and drone surveillance) are used to illustrate these patterns. Finally, we discuss in detail the advantages and disadvantages of a TDP approach to moral decision making.
AB - Artificially intelligent agents will deal with more morally sensitive situations as the field of AI progresses. Research efforts are made to regulate, design and build Artificial Moral Agents (AMAs) capable of making moral decisions. This research is highly multidisciplinary with each their own jargon and vision, and so far it is unclear whether a fully autonomous AMA can be achieved. To specify currently available solutions and structure an accessible discussion around them, we propose to apply Team Design Patterns (TDPs). The language of TDPs describe (visually, textually and formally) a dynamic allocation of tasks for moral decision making in a human-agent team context. A task decomposition is proposed on moral decision-making and AMA capabilities to help define such TDPs. Four TDPs are given as examples to illustrate the versatility of the approach. Two problem scenarios (surgical robots and drone surveillance) are used to illustrate these patterns. Finally, we discuss in detail the advantages and disadvantages of a TDP approach to moral decision making.
UR - https://www.scopus.com/pages/publications/85088541120
UR - https://www.scopus.com/inward/citedby.url?scp=85088541120&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-49183-3_16
DO - 10.1007/978-3-030-49183-3_16
M3 - Conference contribution
SN - 9783030491826
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 203
EP - 220
BT - Engineering Psychology and Cognitive Ergonomics. Cognition and Design - 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
A2 - Harris, D.
A2 - Li, W.-C.
PB - Springer
Y2 - 19 July 2020 through 24 July 2020
ER -