Classification of User Image Descriptions

L. Hollink, A.T. Schreiber, B.J. Wielinga, M. Worring

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In order to resolve the mismatch between user needs and current image retrieval techniques, we conducted a study to get more information about what users look for in images. First, we developed a framework for the classification of image descriptions by users, based on various classification methods from the literature. The classification framework distinguishes three related viewpoints on images, namely nonvisual metadata, perceptual descriptions and conceptual descriptions. For every viewpoint a set of descriptive classes and relations is specified. We used the framework in an empirical study, in which image descriptions were formulated by 30 participants. The resulting descriptions were split into fragments and categorized in the framework. The results suggest that users prefer general descriptions as opposed to specific or abstract descriptions. Frequently used categories were objects, events and relations between objects in the image. © 2004 Elsevier Ltd. All rights reserved.
Original languageEnglish
Pages (from-to)601-626
Number of pages26
JournalInternational Journal of Human-computer Studies
Volume61
Issue number5
DOIs
Publication statusPublished - 2004

Bibliographical note

Hollink04a

Fingerprint

Dive into the research topics of 'Classification of User Image Descriptions'. Together they form a unique fingerprint.

Cite this