Skip to main navigation Skip to search Skip to main content

Ethics-in-practice in UX Design: An Empirical Study of an AI-Based Conversational Support Tool

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

While designers routinely face ethical dilemmas related to privacy, accessibility, transparency, and manipulative design, existing UX ethics resources, such as checklists and static guidelines, often fail to provide timely, context-sensitive support within fast, iterative workflows, limiting their effectiveness as instruments of ethical accountability. This paper examines how conversational and static delivery of the same ethics content differ in supporting ethics-in-practice tasks. We developed a retrieval-augmented agent grounded in a curated UX ethics knowledge base and compared it to an equivalently sourced static guideline in a counterbalanced within-subjects study involving five common UX ethics scenarios. Participants evaluated both tools in terms of practicality, clarity, actionability, and decision confidence; results show significant gains for the conversational agent in practicality and actionability, with smaller improvements in clarity and confidence. Qualitative feedback indicates that the agent supports the translation of abstract principles into situated design decisions, while also revealing risks related to response structure, source transparency, and limited multi-stakeholder framing. Automated evaluation of the retrieval-augmented generation pipeline shows high faithfulness and recall but lower answer relevancy, suggesting alignment limitations at the generation stage rather than gaps in the evidence base. We argue that conversational ethics-support tools can improve access to and operationalization of ethics guidance, but should be treated as complements to human deliberation and static resources rather than as shortcuts to ethical correctness.

Original languageEnglish
Title of host publicationFAccT '26: The 2026 ACM Conference on Fairness, Accountability, and Transparency
PublisherAssociation for Computing Machinery, Inc
Pages2562-2585
Number of pages24
ISBN (Electronic)9798400725968
DOIs
Publication statusPublished - 2026
Event9th Annual ACM Conference on Fairness, Accountability, and Transparency, ACM FAccT 2026 - Montreal, Canada
Duration: 25 Jun 202628 Jun 2026

Conference

Conference9th Annual ACM Conference on Fairness, Accountability, and Transparency, ACM FAccT 2026
Country/TerritoryCanada
CityMontreal
Period25/06/2628/06/26

Bibliographical note

Publisher Copyright:
© 2026 Copyright held by the owner/author(s).

Keywords

  • automatic evaluation
  • conversational agent
  • user studies
  • UX ethics

Fingerprint

Dive into the research topics of 'Ethics-in-practice in UX Design: An Empirical Study of an AI-Based Conversational Support Tool'. Together they form a unique fingerprint.

Cite this