A Multidisciplinary Approach to Unlocking Television Broadcast Archives

L. Hollink, B. Huurnink, M. van Liempt, J. Oomen, A. de Jong, M. de Rijke, A.Th. Schreiber, A. Smeulders

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Audiovisual material is a vital component of the world's heritage but it remains diffi cult to access. With the Netherlands Institute for Sound and Vision as one of its partners, the MuNCH project aims to investigate new methods for improving access to a wide range of audiovisual documents. MuNCH brings together three research fi elds: multimedia analysis, language technology and semantic technologies. Within the MuNCH project, we have investigated several combinations of these fi elds. We have compared text matching, ontology querying, and semantic visual querying as methods to translate a multimedia query to the vocabulary of the retrieval system. In addition, we have investigated how users make such a translation, and have used this as a benchmark to create automatic methods. We have used multimedia technology to automatically detect objects and scenes as they occur in video, and made use of language technology to exploit automatic transcriptions of speech. We have enriched the Sound and Vision thesaurus that is used to annotate the TV programmes in order to provide a user with a wider range of search results. In order to verify the results of the project against real user needs, MuNCH has participated in the creation of a logging system which monitors the usage of the Sound and Vision catalogue system. Insights in the needs of real users will be used as input for all three of MuNCH's research strands. © Institute of Materials, Minerals and Mining 2009.
Original languageEnglish
Pages (from-to)257-271
Number of pages15
JournalInterdisciplinary Science Reviews
Volume34
Issue number2
DOIs
Publication statusPublished - 2009

Fingerprint

television broadcast
multimedia
semantics
language analysis
thesaurus
ritual
ontology
vocabulary
Netherlands
video
language
Multimedia
Sound
Language

Cite this

Hollink, L., Huurnink, B., van Liempt, M., Oomen, J., de Jong, A., de Rijke, M., ... Smeulders, A. (2009). A Multidisciplinary Approach to Unlocking Television Broadcast Archives. Interdisciplinary Science Reviews, 34(2), 257-271. https://doi.org/10.1179/174327909X441144
Hollink, L. ; Huurnink, B. ; van Liempt, M. ; Oomen, J. ; de Jong, A. ; de Rijke, M. ; Schreiber, A.Th. ; Smeulders, A. / A Multidisciplinary Approach to Unlocking Television Broadcast Archives. In: Interdisciplinary Science Reviews. 2009 ; Vol. 34, No. 2. pp. 257-271.
@article{302cd8141fa442df94715c38c529131f,
title = "A Multidisciplinary Approach to Unlocking Television Broadcast Archives",
abstract = "Audiovisual material is a vital component of the world's heritage but it remains diffi cult to access. With the Netherlands Institute for Sound and Vision as one of its partners, the MuNCH project aims to investigate new methods for improving access to a wide range of audiovisual documents. MuNCH brings together three research fi elds: multimedia analysis, language technology and semantic technologies. Within the MuNCH project, we have investigated several combinations of these fi elds. We have compared text matching, ontology querying, and semantic visual querying as methods to translate a multimedia query to the vocabulary of the retrieval system. In addition, we have investigated how users make such a translation, and have used this as a benchmark to create automatic methods. We have used multimedia technology to automatically detect objects and scenes as they occur in video, and made use of language technology to exploit automatic transcriptions of speech. We have enriched the Sound and Vision thesaurus that is used to annotate the TV programmes in order to provide a user with a wider range of search results. In order to verify the results of the project against real user needs, MuNCH has participated in the creation of a logging system which monitors the usage of the Sound and Vision catalogue system. Insights in the needs of real users will be used as input for all three of MuNCH's research strands. {\circledC} Institute of Materials, Minerals and Mining 2009.",
author = "L. Hollink and B. Huurnink and {van Liempt}, M. and J. Oomen and {de Jong}, A. and {de Rijke}, M. and A.Th. Schreiber and A. Smeulders",
year = "2009",
doi = "10.1179/174327909X441144",
language = "English",
volume = "34",
pages = "257--271",
journal = "Interdisciplinary Science Reviews",
issn = "0308-0188",
publisher = "Maney Publishing",
number = "2",

}

Hollink, L, Huurnink, B, van Liempt, M, Oomen, J, de Jong, A, de Rijke, M, Schreiber, AT & Smeulders, A 2009, 'A Multidisciplinary Approach to Unlocking Television Broadcast Archives' Interdisciplinary Science Reviews, vol. 34, no. 2, pp. 257-271. https://doi.org/10.1179/174327909X441144

A Multidisciplinary Approach to Unlocking Television Broadcast Archives. / Hollink, L.; Huurnink, B.; van Liempt, M.; Oomen, J.; de Jong, A.; de Rijke, M.; Schreiber, A.Th.; Smeulders, A.

In: Interdisciplinary Science Reviews, Vol. 34, No. 2, 2009, p. 257-271.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - A Multidisciplinary Approach to Unlocking Television Broadcast Archives

AU - Hollink, L.

AU - Huurnink, B.

AU - van Liempt, M.

AU - Oomen, J.

AU - de Jong, A.

AU - de Rijke, M.

AU - Schreiber, A.Th.

AU - Smeulders, A.

PY - 2009

Y1 - 2009

N2 - Audiovisual material is a vital component of the world's heritage but it remains diffi cult to access. With the Netherlands Institute for Sound and Vision as one of its partners, the MuNCH project aims to investigate new methods for improving access to a wide range of audiovisual documents. MuNCH brings together three research fi elds: multimedia analysis, language technology and semantic technologies. Within the MuNCH project, we have investigated several combinations of these fi elds. We have compared text matching, ontology querying, and semantic visual querying as methods to translate a multimedia query to the vocabulary of the retrieval system. In addition, we have investigated how users make such a translation, and have used this as a benchmark to create automatic methods. We have used multimedia technology to automatically detect objects and scenes as they occur in video, and made use of language technology to exploit automatic transcriptions of speech. We have enriched the Sound and Vision thesaurus that is used to annotate the TV programmes in order to provide a user with a wider range of search results. In order to verify the results of the project against real user needs, MuNCH has participated in the creation of a logging system which monitors the usage of the Sound and Vision catalogue system. Insights in the needs of real users will be used as input for all three of MuNCH's research strands. © Institute of Materials, Minerals and Mining 2009.

AB - Audiovisual material is a vital component of the world's heritage but it remains diffi cult to access. With the Netherlands Institute for Sound and Vision as one of its partners, the MuNCH project aims to investigate new methods for improving access to a wide range of audiovisual documents. MuNCH brings together three research fi elds: multimedia analysis, language technology and semantic technologies. Within the MuNCH project, we have investigated several combinations of these fi elds. We have compared text matching, ontology querying, and semantic visual querying as methods to translate a multimedia query to the vocabulary of the retrieval system. In addition, we have investigated how users make such a translation, and have used this as a benchmark to create automatic methods. We have used multimedia technology to automatically detect objects and scenes as they occur in video, and made use of language technology to exploit automatic transcriptions of speech. We have enriched the Sound and Vision thesaurus that is used to annotate the TV programmes in order to provide a user with a wider range of search results. In order to verify the results of the project against real user needs, MuNCH has participated in the creation of a logging system which monitors the usage of the Sound and Vision catalogue system. Insights in the needs of real users will be used as input for all three of MuNCH's research strands. © Institute of Materials, Minerals and Mining 2009.

U2 - 10.1179/174327909X441144

DO - 10.1179/174327909X441144

M3 - Article

VL - 34

SP - 257

EP - 271

JO - Interdisciplinary Science Reviews

JF - Interdisciplinary Science Reviews

SN - 0308-0188

IS - 2

ER -

Hollink L, Huurnink B, van Liempt M, Oomen J, de Jong A, de Rijke M et al. A Multidisciplinary Approach to Unlocking Television Broadcast Archives. Interdisciplinary Science Reviews. 2009;34(2):257-271. https://doi.org/10.1179/174327909X441144