Increasing the Coverage of Clarification Responses for a Cooking Assistant

Gina E.M. Stolwijk; Florian A. Kunneman

doi:10.1007/978-3-031-25581-6_11

Increasing the Coverage of Clarification Responses for a Cooking Assistant

Gina E.M. Stolwijk^*, Florian A. Kunneman

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

7 Downloads (Pure)

Abstract

In conversation genres like instruction, clarification questions asked by a user may either relate to the task at hand or to common-sense knowledge about the task domain, whereas most conversational agents focus on only one of these types. To learn more about the best approach and feasibility of integrating both types of questions, we experimented with different approaches for modelling and distinguishing between task-specific and common sense questions in the context of a cooking assistant. We subsequently integrated the best ones in a conversational agent, which we tested in a study with six users cooking a recipe. Even though the three elements functioned well on their own and all participants completed the recipe, question-answering accuracy was relatively low (66%). We conclude with a discussion of the aspects that need to be improved upon to cope with the diverse information need in task-based conversational agents.

Original language	English
Title of host publication	Chatbot Research and Design
Subtitle of host publication	6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers
Editors	Asbjørn Følstad, Theo Araujo, Symeon Papadopoulos, Effie L.-C. Law, Ewa Luger, Morten Goodwin, Petter Bae Brandtzaeg
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	171-189
Number of pages	19
ISBN (Electronic)	9783031255816
ISBN (Print)	9783031255809
DOIs	https://doi.org/10.1007/978-3-031-25581-6_11
Publication status	Published - 2023
Event	6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022 - Amsterdam, Netherlands Duration: 22 Nov 2022 → 23 Nov 2022

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13815 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022
Country/Territory	Netherlands
City	Amsterdam
Period	22/11/22 → 23/11/22

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

Clarification
Cooking assistant
Natural language processing
User study

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1007/978-3-031-25581-6_11

Increasing the Coverage of Clarification Responses for a Cooking AssistantFinal published version, 635 KBLicence: Article 25fa Dutch Copyright Act

Persistent URL (handle)

Copy link address

Cite this

Stolwijk, G. E. M., & Kunneman, F. A. (2023). Increasing the Coverage of Clarification Responses for a Cooking Assistant. In A. Følstad, T. Araujo, S. Papadopoulos, E. L.-C. Law, E. Luger, M. Goodwin, & P. B. Brandtzaeg (Eds.), Chatbot Research and Design: 6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers (pp. 171-189). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-25581-6_11

Stolwijk, Gina E.M. ; Kunneman, Florian A. / Increasing the Coverage of Clarification Responses for a Cooking Assistant. Chatbot Research and Design: 6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers. editor / Asbjørn Følstad ; Theo Araujo ; Symeon Papadopoulos ; Effie L.-C. Law ; Ewa Luger ; Morten Goodwin ; Petter Bae Brandtzaeg. Springer Science and Business Media Deutschland GmbH, 2023. pp. 171-189 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b43ac44a1d2e4a2eb7aa2f30ce9aa413,

title = "Increasing the Coverage of Clarification Responses for a Cooking Assistant",

abstract = "In conversation genres like instruction, clarification questions asked by a user may either relate to the task at hand or to common-sense knowledge about the task domain, whereas most conversational agents focus on only one of these types. To learn more about the best approach and feasibility of integrating both types of questions, we experimented with different approaches for modelling and distinguishing between task-specific and common sense questions in the context of a cooking assistant. We subsequently integrated the best ones in a conversational agent, which we tested in a study with six users cooking a recipe. Even though the three elements functioned well on their own and all participants completed the recipe, question-answering accuracy was relatively low (66%). We conclude with a discussion of the aspects that need to be improved upon to cope with the diverse information need in task-based conversational agents.",

keywords = "Clarification, Cooking assistant, Natural language processing, User study",

author = "Stolwijk, {Gina E.M.} and Kunneman, {Florian A.}",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022 ; Conference date: 22-11-2022 Through 23-11-2022",

year = "2023",

doi = "10.1007/978-3-031-25581-6_11",

language = "English",

isbn = "9783031255809",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "171--189",

editor = "Asbj{\o}rn F{\o}lstad and Theo Araujo and Symeon Papadopoulos and Law, {Effie L.-C.} and Ewa Luger and Morten Goodwin and Brandtzaeg, {Petter Bae}",

booktitle = "Chatbot Research and Design",

address = "Germany",

}

Stolwijk, GEM & Kunneman, FA 2023, Increasing the Coverage of Clarification Responses for a Cooking Assistant. in A Følstad, T Araujo, S Papadopoulos, EL-C Law, E Luger, M Goodwin & PB Brandtzaeg (eds), Chatbot Research and Design: 6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13815 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 171-189, 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022, Amsterdam, Netherlands, 22/11/22. https://doi.org/10.1007/978-3-031-25581-6_11

Increasing the Coverage of Clarification Responses for a Cooking Assistant. / Stolwijk, Gina E.M.; Kunneman, Florian A.
Chatbot Research and Design: 6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers. ed. / Asbjørn Følstad; Theo Araujo; Symeon Papadopoulos; Effie L.-C. Law; Ewa Luger; Morten Goodwin; Petter Bae Brandtzaeg. Springer Science and Business Media Deutschland GmbH, 2023. p. 171-189 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Increasing the Coverage of Clarification Responses for a Cooking Assistant

AU - Stolwijk, Gina E.M.

AU - Kunneman, Florian A.

PY - 2023

Y1 - 2023

N2 - In conversation genres like instruction, clarification questions asked by a user may either relate to the task at hand or to common-sense knowledge about the task domain, whereas most conversational agents focus on only one of these types. To learn more about the best approach and feasibility of integrating both types of questions, we experimented with different approaches for modelling and distinguishing between task-specific and common sense questions in the context of a cooking assistant. We subsequently integrated the best ones in a conversational agent, which we tested in a study with six users cooking a recipe. Even though the three elements functioned well on their own and all participants completed the recipe, question-answering accuracy was relatively low (66%). We conclude with a discussion of the aspects that need to be improved upon to cope with the diverse information need in task-based conversational agents.

AB - In conversation genres like instruction, clarification questions asked by a user may either relate to the task at hand or to common-sense knowledge about the task domain, whereas most conversational agents focus on only one of these types. To learn more about the best approach and feasibility of integrating both types of questions, we experimented with different approaches for modelling and distinguishing between task-specific and common sense questions in the context of a cooking assistant. We subsequently integrated the best ones in a conversational agent, which we tested in a study with six users cooking a recipe. Even though the three elements functioned well on their own and all participants completed the recipe, question-answering accuracy was relatively low (66%). We conclude with a discussion of the aspects that need to be improved upon to cope with the diverse information need in task-based conversational agents.

KW - Clarification

KW - Cooking assistant

KW - Natural language processing

KW - User study

UR - http://www.scopus.com/inward/record.url?scp=85148692632&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85148692632&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-25581-6_11

DO - 10.1007/978-3-031-25581-6_11

M3 - Conference contribution

AN - SCOPUS:85148692632

SN - 9783031255809

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 171

EP - 189

BT - Chatbot Research and Design

A2 - Følstad, Asbjørn

A2 - Araujo, Theo

A2 - Papadopoulos, Symeon

A2 - Law, Effie L.-C.

A2 - Luger, Ewa

A2 - Goodwin, Morten

A2 - Brandtzaeg, Petter Bae

PB - Springer Science and Business Media Deutschland GmbH

T2 - 6th International Workshop on Chatbot Research and Design, CONVERSATIONS 2022

Y2 - 22 November 2022 through 23 November 2022

ER -

Stolwijk GEM, Kunneman FA. Increasing the Coverage of Clarification Responses for a Cooking Assistant. In Følstad A, Araujo T, Papadopoulos S, Law ELC, Luger E, Goodwin M, Brandtzaeg PB, editors, Chatbot Research and Design: 6th International Workshop, CONVERSATIONS 2022, Amsterdam, The Netherlands, November 22–23, 2022, Revised Selected Papers. Springer Science and Business Media Deutschland GmbH. 2023. p. 171-189. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2023 Feb 2. doi: 10.1007/978-3-031-25581-6_11