VideoGraph – Towards Using Knowledge Graphs for Interactive Video Retrieval

L. Rossetto, M. Baumgartner, N. Ashena, F. Ruosch, R. Pernisch, L. Heitz, A. Bernstein

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

© 2021, Springer Nature Switzerland AG.Video is a very expressive medium, able to capture a wide variety of information in different ways. While there have been many advances in the recent past, which enable the annotation of semantic concepts as well as individual objects within video, their larger context has so far not extensively been used for the purpose of retrieval. In this paper, we introduce the first iteration of VideoGraph, a knowledge graph-based video retrieval system. VideoGraph combines information extracted from multiple video modalities with external knowledge bases to produce a semantically enriched representation of the content in a video collection, which can then be retrieved using graph traversal. For the 2021 Video Browser Showdown, we show the first proof-of-concept of such a graph-based video retrieval approach.
Original languageEnglish
Title of host publicationMultiMedia Modeling - 27th International Conference, MMM 2021, Proceedings
EditorsJ. Lokoc, T. Skopal, K. Schoeffmann, V. Mezaris, X. Li, S. Vrochidis, I. Patras
PublisherSpringer Science and Business Media Deutschland GmbH
Pages417-422
ISBN (Print)9783030678340
DOIs
Publication statusPublished - 2021
Externally publishedYes
Event27th International Conference on MultiMedia Modeling, MMM 2021 - Prague, Czech Republic
Duration: 22 Jun 202124 Jun 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference27th International Conference on MultiMedia Modeling, MMM 2021
Country/TerritoryCzech Republic
CityPrague
Period22/06/2124/06/21

Funding

This work was partially funded by the University of Zurich, the Digital Society Initiative, the Swiss Re Institute, and the Swiss National Science Foundation under contract number 200020 184994.

FundersFunder number
Swiss Re Institute
Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung200020 184994
Universität Zürich

    Fingerprint

    Dive into the research topics of 'VideoGraph – Towards Using Knowledge Graphs for Interactive Video Retrieval'. Together they form a unique fingerprint.

    Cite this