Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry

Marjolein C. Nanninga, Yanxia Zhang, Nale Lehmann-Willenbrock, Zoltán Szlávik, Hayley Hung

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

In this paper we propose a novel method of estimating verbal expressions of task and social cohesion by quantifying the dynamic alignment of nonverbal behaviors in speech. As team cohesion has been linked to team effectiveness and productivity, automatically estimating team cohesion can be a useful tool for assessing meeting quality and broader team functioning. In total, more than 20 hours of business meetings (3-8 people) were recorded and annotated for behavioral indicators of group cohesion, distinguishing between social and task cohesion. We hypothesized that behaviors commonly referred to as mimicry can be indicative of verbal expressions of social and task cohesion. Where most prior work targets mimicry of dyads, we investigated the effectiveness of quantifying group-level phenomena. A dynamic approach was adopted in which both the cohesion expressions and the paralinguistic mimicry were quantified on small time windows. By extracting features solely related to the alignment of paralinguistic speech behavior, we found that 2-minute high and low social cohesive regions could be classified with a 0.71 Area under the ROC curve, performing on par with the state-of-The-Art where turn-Taking features were used. Estimating task cohesion was more challenging, obtaining an accuracy of 0.64 AUC, outperforming the state-of-The-Art. Our results suggest that our proposed methodology is successful in quantifying group-level paralinguistic mimicry. As both the state-of-The-Art turn-Taking features and mimicry features performed worse on estimating task cohesion, we conclude that social cohesion is more openly expressed by nonverbal vocal behavior than task cohesion.

Original languageEnglish
Title of host publicationICMI 2017 - Proceedings of the 19th ACM International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery, Inc
Pages206-215
Number of pages10
Volume2017-January
ISBN (Electronic)9781450355438
DOIs
Publication statusPublished - 3 Nov 2017
Event19th ACM International Conference on Multimodal Interaction, ICMI 2017 - Glasgow, United Kingdom
Duration: 13 Nov 201717 Nov 2017

Conference

Conference19th ACM International Conference on Multimodal Interaction, ICMI 2017
CountryUnited Kingdom
CityGlasgow
Period13/11/1717/11/17

Keywords

  • Cohesion
  • Group conversation analysis
  • Mimicry
  • Small group meetings
  • Social signal processing

Fingerprint Dive into the research topics of 'Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry'. Together they form a unique fingerprint.

Cite this