Measuring semantic coherence of a conversation

Svitlana Vakulenko; Maarten de Rijke; Michael Cochez; Vadim Savenkov; Axel Polleres

doi:10.1007/978-3-030-00671-6_37

Measuring semantic coherence of a conversation

Svitlana Vakulenko, Maarten de Rijke, Michael Cochez, Vadim Savenkov, Axel Polleres^*

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Conversational systems have become increasingly popular as a way for humans to interact with computers. To be able to provide intelligent responses, conversational systems must correctly model the structure and semantics of a conversation. We introduce the task of measuring semantic (in)coherence in a conversation with respect to background knowledge, which relies on the identification of semantic relations between concepts introduced during a conversation. We propose and evaluate graph-based and machine learning-based approaches for measuring semantic coherence using knowledge graphs, their vector space embeddings and word embedding models, as sources of background knowledge. We demonstrate how these approaches are able to uncover different coherence patterns in conversations on the Ubuntu Dialogue Corpus.

Original language	English
Title of host publication	The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings
Editors	Mari Carmen Suárez-Figueroa, Valentina Presutti, Lucie-Aimee Kaffee, Elena Simperl, Marta Sabou, Denny Vrandecic, Irene Celino, Kalina Bontcheva
Publisher	Springer Verlag
Pages	634-651
Number of pages	18
ISBN (Print)	9783030006709
DOIs	https://doi.org/10.1007/978-3-030-00671-6_37
Publication status	Published - 1 Jan 2018
Externally published	Yes
Event	17th International Semantic Web Conference, ISWC 2018 - Monterey, United States Duration: 8 Oct 2018 → 12 Oct 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11136 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th International Semantic Web Conference, ISWC 2018
Country/Territory	United States
City	Monterey
Period	8/10/18 → 12/10/18

Funding

Acknowledgments. This work is supported by the project 855407 “Open Data for Local Communities” (CommuniData) of the Austrian Federal Ministry of Transport, Innovation and Technology (BMVIT) under the program “ICT of the Future.” Svit-lana Vakulenko was supported by the EU H2020 programme under the MSCA-RISE agreement 645751 (RISE BPM). Axel Polleres was supported under the Distinguished Visiting Austrian Chair Professors program hosted by The Europe Center of Stanford University. Maarten de Rijke was supported by Ahold Delhaize, Amsterdam Data Science, the Bloomberg Research Grant program, the China Scholarship Council, the Criteo Faculty Research Award program, Elsevier, the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant agreement nr 312827 (VOX-Pol), the Google Faculty Research Awards program, the Microsoft Research Ph.D. program, the Netherlands Institute for Sound and Vision, the Netherlands Organisation for Scientific Research (NWO) under project nrs CI-14-25, 652.002.001, 612.001.551, 652.001.003, and Yandex. All content represents the opinion of the authors, which is not necessarily shared or endorsed by their respective employers and/or sponsors.

Funders	Funder number
Austrian Federal Ministry of Transport, Innovation and Technology
EU H2020
FP7/2007
Netherlands Institute for Sound and Vision
Stanford University
Microsoft Research
Google
Horizon 2020 Framework Programme
H2020 Marie Skłodowska-Curie Actions
Seventh Framework Programme	645751, 312827
Nederlandse Organisatie voor Wetenschappelijk Onderzoek	612.001.551, 652.002.001, 652.001.003, CI-14-25
China Scholarship Council
Bundesministerium für Verkehr, Innovation und Technologie	855407
Seventh Framework Programme

Access to Document

10.1007/978-3-030-00671-6_37

Persistent URL (handle)

Copy link address

Cite this

Vakulenko, S., de Rijke, M., Cochez, M., Savenkov, V., & Polleres, A. (2018). Measuring semantic coherence of a conversation. In M. C. Suárez-Figueroa, V. Presutti, L.-A. Kaffee, E. Simperl, M. Sabou, D. Vrandecic, I. Celino, & K. Bontcheva (Eds.), The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings (pp. 634-651). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11136 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-00671-6_37

Vakulenko, Svitlana ; de Rijke, Maarten ; Cochez, Michael et al. / Measuring semantic coherence of a conversation. The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings. editor / Mari Carmen Suárez-Figueroa ; Valentina Presutti ; Lucie-Aimee Kaffee ; Elena Simperl ; Marta Sabou ; Denny Vrandecic ; Irene Celino ; Kalina Bontcheva. Springer Verlag, 2018. pp. 634-651 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{852397408386421ca2b8503a4d973c97,

title = "Measuring semantic coherence of a conversation",

abstract = "Conversational systems have become increasingly popular as a way for humans to interact with computers. To be able to provide intelligent responses, conversational systems must correctly model the structure and semantics of a conversation. We introduce the task of measuring semantic (in)coherence in a conversation with respect to background knowledge, which relies on the identification of semantic relations between concepts introduced during a conversation. We propose and evaluate graph-based and machine learning-based approaches for measuring semantic coherence using knowledge graphs, their vector space embeddings and word embedding models, as sources of background knowledge. We demonstrate how these approaches are able to uncover different coherence patterns in conversations on the Ubuntu Dialogue Corpus.",

author = "Svitlana Vakulenko and {de Rijke}, Maarten and Michael Cochez and Vadim Savenkov and Axel Polleres",

year = "2018",

month = jan,

day = "1",

doi = "10.1007/978-3-030-00671-6_37",

language = "English",

isbn = "9783030006709",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "634--651",

editor = "Su{\'a}rez-Figueroa, {Mari Carmen} and Valentina Presutti and Lucie-Aimee Kaffee and Elena Simperl and Marta Sabou and Denny Vrandecic and Irene Celino and Kalina Bontcheva",

booktitle = "The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings",

address = "Germany",

note = "17th International Semantic Web Conference, ISWC 2018 ; Conference date: 08-10-2018 Through 12-10-2018",

}

Vakulenko, S, de Rijke, M, Cochez, M, Savenkov, V & Polleres, A 2018, Measuring semantic coherence of a conversation. in MC Suárez-Figueroa, V Presutti, L-A Kaffee, E Simperl, M Sabou, D Vrandecic, I Celino & K Bontcheva (eds), The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11136 LNCS, Springer Verlag, pp. 634-651, 17th International Semantic Web Conference, ISWC 2018, Monterey, United States, 8/10/18. https://doi.org/10.1007/978-3-030-00671-6_37

Measuring semantic coherence of a conversation. / Vakulenko, Svitlana; de Rijke, Maarten; Cochez, Michael et al.
The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings. ed. / Mari Carmen Suárez-Figueroa; Valentina Presutti; Lucie-Aimee Kaffee; Elena Simperl; Marta Sabou; Denny Vrandecic; Irene Celino; Kalina Bontcheva. Springer Verlag, 2018. p. 634-651 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11136 LNCS).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Measuring semantic coherence of a conversation

AU - Vakulenko, Svitlana

AU - de Rijke, Maarten

AU - Cochez, Michael

AU - Savenkov, Vadim

AU - Polleres, Axel

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Conversational systems have become increasingly popular as a way for humans to interact with computers. To be able to provide intelligent responses, conversational systems must correctly model the structure and semantics of a conversation. We introduce the task of measuring semantic (in)coherence in a conversation with respect to background knowledge, which relies on the identification of semantic relations between concepts introduced during a conversation. We propose and evaluate graph-based and machine learning-based approaches for measuring semantic coherence using knowledge graphs, their vector space embeddings and word embedding models, as sources of background knowledge. We demonstrate how these approaches are able to uncover different coherence patterns in conversations on the Ubuntu Dialogue Corpus.

AB - Conversational systems have become increasingly popular as a way for humans to interact with computers. To be able to provide intelligent responses, conversational systems must correctly model the structure and semantics of a conversation. We introduce the task of measuring semantic (in)coherence in a conversation with respect to background knowledge, which relies on the identification of semantic relations between concepts introduced during a conversation. We propose and evaluate graph-based and machine learning-based approaches for measuring semantic coherence using knowledge graphs, their vector space embeddings and word embedding models, as sources of background knowledge. We demonstrate how these approaches are able to uncover different coherence patterns in conversations on the Ubuntu Dialogue Corpus.

UR - http://www.scopus.com/inward/record.url?scp=85054866205&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054866205&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-00671-6_37

DO - 10.1007/978-3-030-00671-6_37

M3 - Conference contribution

AN - SCOPUS:85054866205

SN - 9783030006709

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 634

EP - 651

BT - The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings

A2 - Suárez-Figueroa, Mari Carmen

A2 - Presutti, Valentina

A2 - Kaffee, Lucie-Aimee

A2 - Simperl, Elena

A2 - Sabou, Marta

A2 - Vrandecic, Denny

A2 - Celino, Irene

A2 - Bontcheva, Kalina

PB - Springer Verlag

T2 - 17th International Semantic Web Conference, ISWC 2018

Y2 - 8 October 2018 through 12 October 2018

ER -

Vakulenko S, de Rijke M, Cochez M, Savenkov V, Polleres A. Measuring semantic coherence of a conversation. In Suárez-Figueroa MC, Presutti V, Kaffee LA, Simperl E, Sabou M, Vrandecic D, Celino I, Bontcheva K, editors, The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, 2018, Proceedings. Springer Verlag. 2018. p. 634-651. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-00671-6_37

Measuring semantic coherence of a conversation

Abstract

Publication series

Conference

Funding

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this