Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools

Norah Karrouche; Arjan van Hessen; Silvia Calamai; Henk van den Heuvel; Stefania Scagliola; Jeannine  Beeken; Louise Corti; Christoph Draxler

doi:10.1145/3382507.3420054

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools

Norah Karrouche , Arjan van Hessen, Silvia Calamai, Henk van den Heuvel, Stefania Scagliola, Jeannine Beeken, Louise Corti, Christoph Draxler

Art and Culture, History, Antiquity

Research output: Chapter in Book / Report / Conference proceeding › Chapter › Academic › peer-review

92 Downloads (Pure)

Abstract

Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

Original language	English
Title of host publication	ICMI 2020
Subtitle of host publication	Proceedings of the 2020 International Conference on Multimodal Interaction
Publisher	ACM
Pages	886-887
Number of pages	2
ISBN (Electronic)	9781450375818
DOIs	https://doi.org/10.1145/3382507.3420054
Publication status	Published - Oct 2020

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3382507.3420054

Speech, Voice, Text, and MeaningFinal published version, 1.09 MBLicence: Article 25fa Dutch Copyright Act

Persistent URL (handle)

Persistent link

Cite this

Karrouche , N., van Hessen, A., Calamai, S., van den Heuvel, H., Scagliola, S., Beeken, J., Corti, L., & Draxler, C. (2020). Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools. In ICMI 2020: Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 886-887). ACM. https://doi.org/10.1145/3382507.3420054

@inbook{fab690894d1b42ae9fd22111d37d6b2c,

title = "Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools",

abstract = "Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.",

author = "Norah Karrouche and {van Hessen}, Arjan and Silvia Calamai and {van den Heuvel}, Henk and Stefania Scagliola and Jeannine Beeken and Louise Corti and Christoph Draxler",

year = "2020",

month = oct,

doi = "10.1145/3382507.3420054",

language = "English",

pages = "886--887",

booktitle = "ICMI 2020",

publisher = "ACM",

}

Karrouche , N, van Hessen, A, Calamai, S, van den Heuvel, H, Scagliola, S, Beeken, J, Corti, L & Draxler, C 2020, Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools. in ICMI 2020: Proceedings of the 2020 International Conference on Multimodal Interaction. ACM, pp. 886-887. https://doi.org/10.1145/3382507.3420054

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools. / Karrouche , Norah; van Hessen, Arjan; Calamai, Silvia et al.
ICMI 2020: Proceedings of the 2020 International Conference on Multimodal Interaction. ACM, 2020. p. 886-887.

Research output: Chapter in Book / Report / Conference proceeding › Chapter › Academic › peer-review

TY - CHAP

T1 - Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools

AU - Karrouche , Norah

AU - van Hessen, Arjan

AU - Calamai, Silvia

AU - van den Heuvel, Henk

AU - Scagliola, Stefania

AU - Beeken, Jeannine

AU - Corti, Louise

AU - Draxler, Christoph

PY - 2020/10

Y1 - 2020/10

N2 - Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

AB - Interview data is multimodal data: it consists of speech sound, facial expression and gestures, captured in a particular situation, and containing textual information and emotion. This workshop shows how a multidisciplinary approach may exploit the full potential of interview data. The workshop first gives a systematic overview of the research fields working with interview data. It then presents the speech technology currently available to support transcribing and annotating interview data, such as automatic speech recognition, speaker diarization, and emotion detection. Finally, scholars who work with interview data and tools may present their work and discover how to make use of existing technology.

U2 - 10.1145/3382507.3420054

DO - 10.1145/3382507.3420054

M3 - Chapter

SP - 886

EP - 887

BT - ICMI 2020

PB - ACM

ER -

Speech, Voice, Text, and Meaning: A Multidisciplinary Approach to Interview Data through the Use of Digital Tools

Abstract

UN SDGs

Access to Document

Persistent URL (handle)

Fingerprint

Cite this