Time-based tags for fiction movies: comparing experts to novices using a video labeling game

Liliana Melgar Estrada, Michiel Hildebrand, Victor de Boer, Jacco van Ossenbruggen

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

The cultural heritage sector has embraced social tagging as a way to increase both access to online content and to engage users with their digital collections. In this article, we build on two current lines of research. (a) We use Waisda?, an existing labeling game, to add time-based annotations to content. (b) In this context, we investigate the role of experts in human-based computation (nichesourcing). We report on a small-scale experiment in which we applied Waisda? to content from film archives. We study the differences in the type of time-based tags between experts and novices for film clips in a crowdsourcing setting. The findings show high similarity in the number and type of tags (mostly factual). In the less frequent tags, however, experts used more domain-specific terms. We conclude that competitive games are not suited to elicit real expert-level descriptions. We also confirm that providing guidelines, based on conceptual frameworks that are more suited to moving images in a time-based fashion, could result in increasing the quality of the tags, thus allowing for creating more tag-based innovative services for online audiovisual heritage.

Original languageEnglish
Pages (from-to)348-364
Number of pages17
JournalJournal of the Association for Information Science and Technology
Volume68
Issue number2
DOIs
Publication statusPublished - 1 Feb 2017

Fingerprint Dive into the research topics of 'Time-based tags for fiction movies: comparing experts to novices using a video labeling game'. Together they form a unique fingerprint.

Cite this