Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches

Judith M. Varkevisser*, Ralph Simon, Ezequiel Mendoza, Martin How, Idse van Hijlkema, Rozanda Jin, Qiaoyi Liang, Constance Scharff, Wouter H. Halfwerk, Katharina Riebel

*Corresponding author for this work

    Research output: Contribution to JournalArticleAcademicpeer-review

    Abstract

    Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches (Taeniopygia guttata). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested.

    Original languageEnglish
    Pages (from-to)249-274
    Number of pages26
    JournalAnimal Cognition
    Volume25
    Issue number2
    Early online date17 Aug 2021
    DOIs
    Publication statusPublished - Apr 2022

    Bibliographical note

    Funding Information:
    Funding for this research was provided by a Human Frontier Science Program Grant (No RGP0046/2016). We would like to thank Jing Wei, Quanxiao Liu and Zhiyuan Ning for the visual comparison of the spectrograms. We want to thank Cynthia Tedore for very helpful advice on video color adjustments and screen calibration and Carel ten Cate, an anonymous reviewer and the editor for comments on earlier versions of this manuscript.

    Publisher Copyright:
    © 2021, The Author(s).

    Keywords

    • Bird song
    • Multimodal communication
    • Video tutors
    • Vocal development

    Fingerprint

    Dive into the research topics of 'Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches'. Together they form a unique fingerprint.

    Cite this