An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

In the task of tagging narrative images, traditional event or story models are not suitable for temporal-spatial information modeling. These models are too coarse-grained to represent plots and actions information sufficiently in the particular field of culture heritage. In this paper, we design a narrative image annotation ontology (NIAO) model and a tool (NIA) to address these issues, by using ontology design patterns and other relevant models for reusability. The annotation model, combining the OAC (Open Annotation Collaboration) framework and regarding the Plot as a core element, makes a mapping between annotated image regions and high-level image semantics. It has been embedded in NIA, which we successfully use in the task of annotating narrative paintings. This tool can record annotation region pixels and related property values according to NIAO, and these annotation data can be stored as various formats such as csv, json, and rdf. We have built a SPARQL endpoint, in which end users can make semantic queries based on these annotation data, and visualize the results with pictures rather than tables.

LanguageEnglish
Title of host publicationWorkshop on Humanities in the Semantic Web
Subtitle of host publicationProceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017)
EditorsAlessandro Adamou, Enrico Daga, Leif Isaksen
PublisherCEUR
Pages117-122
Number of pages6
Publication statusPublished - 2017
Event2nd Workshop on Humanities in the Semantic Web, WHiSe 2017 - Vienna, Austria
Duration: 22 Oct 2017 → …

Publication series

NameCEUR Workshop Proceedings
Volume2104
ISSN (Print)1613-0073

Conference

Conference2nd Workshop on Humanities in the Semantic Web, WHiSe 2017
CountryAustria
CityVienna
Period22/10/17 → …

Fingerprint

Ontology
Semantics
Reusability
Painting
Pixels

Keywords

  • Image annotation
  • Narrative image
  • Plot ontology

Cite this

Xu, L., Meroño-Peñuela, A., Huang, Z., & van Harmelen, F. (2017). An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage. In A. Adamou, E. Daga, & L. Isaksen (Eds.), Workshop on Humanities in the Semantic Web: Proceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017) (pp. 117-122). (CEUR Workshop Proceedings; Vol. 2104). CEUR.
Xu, L. ; Meroño-Peñuela, Albert ; Huang, Zhisheng ; van Harmelen, Frank. / An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage. Workshop on Humanities in the Semantic Web: Proceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017). editor / Alessandro Adamou ; Enrico Daga ; Leif Isaksen. CEUR, 2017. pp. 117-122 (CEUR Workshop Proceedings).
@inproceedings{a82df7f956794d6d9e6102396a6288ca,
title = "An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage",
abstract = "In the task of tagging narrative images, traditional event or story models are not suitable for temporal-spatial information modeling. These models are too coarse-grained to represent plots and actions information sufficiently in the particular field of culture heritage. In this paper, we design a narrative image annotation ontology (NIAO) model and a tool (NIA) to address these issues, by using ontology design patterns and other relevant models for reusability. The annotation model, combining the OAC (Open Annotation Collaboration) framework and regarding the Plot as a core element, makes a mapping between annotated image regions and high-level image semantics. It has been embedded in NIA, which we successfully use in the task of annotating narrative paintings. This tool can record annotation region pixels and related property values according to NIAO, and these annotation data can be stored as various formats such as csv, json, and rdf. We have built a SPARQL endpoint, in which end users can make semantic queries based on these annotation data, and visualize the results with pictures rather than tables.",
keywords = "Image annotation, Narrative image, Plot ontology",
author = "L. Xu and Albert Mero{\~n}o-Pe{\~n}uela and Zhisheng Huang and {van Harmelen}, Frank",
year = "2017",
language = "English",
series = "CEUR Workshop Proceedings",
publisher = "CEUR",
pages = "117--122",
editor = "Alessandro Adamou and Enrico Daga and Leif Isaksen",
booktitle = "Workshop on Humanities in the Semantic Web",

}

Xu, L, Meroño-Peñuela, A, Huang, Z & van Harmelen, F 2017, An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage. in A Adamou, E Daga & L Isaksen (eds), Workshop on Humanities in the Semantic Web: Proceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017). CEUR Workshop Proceedings, vol. 2104, CEUR, pp. 117-122, 2nd Workshop on Humanities in the Semantic Web, WHiSe 2017, Vienna, Austria, 22/10/17.

An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage. / Xu, L.; Meroño-Peñuela, Albert; Huang, Zhisheng; van Harmelen, Frank.

Workshop on Humanities in the Semantic Web: Proceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017). ed. / Alessandro Adamou; Enrico Daga; Leif Isaksen. CEUR, 2017. p. 117-122 (CEUR Workshop Proceedings; Vol. 2104).

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage

AU - Xu, L.

AU - Meroño-Peñuela, Albert

AU - Huang, Zhisheng

AU - van Harmelen, Frank

PY - 2017

Y1 - 2017

N2 - In the task of tagging narrative images, traditional event or story models are not suitable for temporal-spatial information modeling. These models are too coarse-grained to represent plots and actions information sufficiently in the particular field of culture heritage. In this paper, we design a narrative image annotation ontology (NIAO) model and a tool (NIA) to address these issues, by using ontology design patterns and other relevant models for reusability. The annotation model, combining the OAC (Open Annotation Collaboration) framework and regarding the Plot as a core element, makes a mapping between annotated image regions and high-level image semantics. It has been embedded in NIA, which we successfully use in the task of annotating narrative paintings. This tool can record annotation region pixels and related property values according to NIAO, and these annotation data can be stored as various formats such as csv, json, and rdf. We have built a SPARQL endpoint, in which end users can make semantic queries based on these annotation data, and visualize the results with pictures rather than tables.

AB - In the task of tagging narrative images, traditional event or story models are not suitable for temporal-spatial information modeling. These models are too coarse-grained to represent plots and actions information sufficiently in the particular field of culture heritage. In this paper, we design a narrative image annotation ontology (NIAO) model and a tool (NIA) to address these issues, by using ontology design patterns and other relevant models for reusability. The annotation model, combining the OAC (Open Annotation Collaboration) framework and regarding the Plot as a core element, makes a mapping between annotated image regions and high-level image semantics. It has been embedded in NIA, which we successfully use in the task of annotating narrative paintings. This tool can record annotation region pixels and related property values according to NIAO, and these annotation data can be stored as various formats such as csv, json, and rdf. We have built a SPARQL endpoint, in which end users can make semantic queries based on these annotation data, and visualize the results with pictures rather than tables.

KW - Image annotation

KW - Narrative image

KW - Plot ontology

UR - http://www.scopus.com/inward/record.url?scp=85039054576&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039054576&partnerID=8YFLogxK

M3 - Conference contribution

T3 - CEUR Workshop Proceedings

SP - 117

EP - 122

BT - Workshop on Humanities in the Semantic Web

A2 - Adamou, Alessandro

A2 - Daga, Enrico

A2 - Isaksen, Leif

PB - CEUR

ER -

Xu L, Meroño-Peñuela A, Huang Z, van Harmelen F. An Ontology Model for Narrative Image Annotation in the Field of Cultural Heritage. In Adamou A, Daga E, Isaksen L, editors, Workshop on Humanities in the Semantic Web: Proceedings of the 2nd Workshop on Humanities in the SEmantic web (WHiSe 2017) : co-located with 16th International Semantic Web Conference (ISWC 2017). CEUR. 2017. p. 117-122. (CEUR Workshop Proceedings).