Ordered preference elicitation strategies for supporting multi-objective decision making

Luisa M. Zintgraf, Diederik M. Roijers, Sjoerd Linders, Catholijn M. Jonker, Ann Nowé

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining which policy to execute by maximising the user's intrinsic utility function over this (possibly infinite) set, is under-studied. This paper aims to fill this gap. We build on previous work on Gaussian processes and pairwise comparisons for preference modelling, extend it to the multi-objective decision support scenario, and propose new ordered preference elicitation strategies based on ranking and clustering. Our main contribution is an in-depth evaluation of these strategies using computer and human-based experiments. We show that our proposed elicitation strategies outperform the currently used pairwise methods, and found that users prefer ranking most. Our experiments further show that utilising monotonicity information in GPS by using a linear prior mean at the start and virtual comparisons to the nadir and ideal points, increases performance. We demonstrate our decision support framework in a real-world study on traffic regulation, conducted with the city of Amsterdam.

Original languageEnglish
Title of host publication17th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2018
PublisherInternational Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
Pages1477-1485
Number of pages9
Volume2
ISBN (Print)9781510868083, 9781450356497
Publication statusPublished - 2018
Event17th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2018 - Stockholm, Sweden
Duration: 10 Jul 201815 Jul 2018

Publication series

NameAAMAS Electronic Proceedings
PublisherIFAAMAS
Volume2018
ISSN (Electronic)2523-5699

Conference

Conference17th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2018
CountrySweden
CityStockholm
Period10/07/1815/07/18

Bibliographical note

Session 40: Human and Agent Interaction

Keywords

  • Active learning
  • Decision support
  • Gaussian processes
  • Multi-objective decision making
  • Preference elicitation

Fingerprint Dive into the research topics of 'Ordered preference elicitation strategies for supporting multi-objective decision making'. Together they form a unique fingerprint.

  • Cite this

    Zintgraf, L. M., Roijers, D. M., Linders, S., Jonker, C. M., & Nowé, A. (2018). Ordered preference elicitation strategies for supporting multi-objective decision making. In 17th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2018 (Vol. 2, pp. 1477-1485). (AAMAS Electronic Proceedings; Vol. 2018). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).