List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists

Albert Meroño-Peñuela; Enrico Daga

doi:10.1007/978-3-030-30796-7_16

List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists

Albert Meroño-Peñuela^*
, Enrico Daga

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

160 Downloads (Pure)

Abstract

Linked lists represent a countable number of ordered values, and are among the most important abstract data types in computer science. With the advent of RDF as a highly expressive knowledge representation language for the Web, various implementations for RDF lists have been proposed. Yet, there is no benchmark so far dedicated to evaluate the performance of triple stores and SPARQL query engines on dealing with ordered linked data. Moreover, essential tasks for evaluating RDF lists, like generating datasets containing RDF lists of various sizes, or generating the same RDF list using different modelling choices, are cumbersome and unprincipled. In this paper, we propose List.MID, a systematic benchmark for evaluating systems serving RDF lists. List.MID consists of a dataset generator, which creates RDF list data in various models and of different sizes; and a set of SPARQL queries. The RDF list data is coherently generated from a large, community-curated base collection of Web MIDI files, rich in lists of musical events of arbitrary length. We describe the List.MID benchmark, and discuss its impact and adoption, reusability, design, and availability.

Original language	English
Title of host publication	The Semantic Web – ISWC 2019
Subtitle of host publication	18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II
Editors	Chiara Ghidini, Olaf Hartig, Maria Maleshkova, Vojtech Svátek, Isabel Cruz, Aidan Hogan, Jie Song, Maxime Lefrançois, Fabien Gandon
Publisher	Springer
Pages	246-260
Number of pages	15
Volume	2
ISBN (Electronic)	9783030307967
ISBN (Print)	9783030307950
DOIs	https://doi.org/10.1007/978-3-030-30796-7_16
Publication status	Published - 2019
Event	18th International Semantic Web Conference, ISWC 2019 - Auckland, New Zealand Duration: 26 Oct 2019 → 30 Oct 2019

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11779 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th International Semantic Web Conference, ISWC 2019
Country/Territory	New Zealand
City	Auckland
Period	26/10/19 → 30/10/19

Funding

Acknowledgements. This work was partially funded by the CLARIAH project of the Dutch Science Foundation (NWO). We are grateful to all participants of the online survey.

Keywords

Benchmarks
Linked lists
RDF

Access to Document

10.1007/978-3-030-30796-7_16

List.MID A MIDI-Based Benchmark for Evaluating RDF ListsFinal published version, 1.71 MBLicence: Article 25fa Dutch Copyright Act

Persistent URL (handle)

Persistent link

Cite this

Meroño-Peñuela, A., & Daga, E. (2019). List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists. In C. Ghidini, O. Hartig, M. Maleshkova, V. Svátek, I. Cruz, A. Hogan, J. Song, M. Lefrançois, & F. Gandon (Eds.), The Semantic Web – ISWC 2019: 18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II (Vol. 2, pp. 246-260). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11779 LNCS). Springer. https://doi.org/10.1007/978-3-030-30796-7_16

Meroño-Peñuela, Albert ; Daga, Enrico. / List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists. The Semantic Web – ISWC 2019: 18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II. editor / Chiara Ghidini ; Olaf Hartig ; Maria Maleshkova ; Vojtech Svátek ; Isabel Cruz ; Aidan Hogan ; Jie Song ; Maxime Lefrançois ; Fabien Gandon. Vol. 2 Springer, 2019. pp. 246-260 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{51df7ba8caf54aa9ac3fd74be3b9756b,

title = "List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists",

abstract = "Linked lists represent a countable number of ordered values, and are among the most important abstract data types in computer science. With the advent of RDF as a highly expressive knowledge representation language for the Web, various implementations for RDF lists have been proposed. Yet, there is no benchmark so far dedicated to evaluate the performance of triple stores and SPARQL query engines on dealing with ordered linked data. Moreover, essential tasks for evaluating RDF lists, like generating datasets containing RDF lists of various sizes, or generating the same RDF list using different modelling choices, are cumbersome and unprincipled. In this paper, we propose List.MID, a systematic benchmark for evaluating systems serving RDF lists. List.MID consists of a dataset generator, which creates RDF list data in various models and of different sizes; and a set of SPARQL queries. The RDF list data is coherently generated from a large, community-curated base collection of Web MIDI files, rich in lists of musical events of arbitrary length. We describe the List.MID benchmark, and discuss its impact and adoption, reusability, design, and availability.",

keywords = "Benchmarks, Linked lists, RDF",

author = "Albert Mero{\~n}o-Pe{\~n}uela and Enrico Daga",

year = "2019",

doi = "10.1007/978-3-030-30796-7\_16",

language = "English",

isbn = "9783030307950",

volume = "2",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "246--260",

editor = "Chiara Ghidini and Olaf Hartig and Maria Maleshkova and Vojtech Sv{\'a}tek and Isabel Cruz and Aidan Hogan and Jie Song and Maxime Lefran{\c c}ois and Fabien Gandon",

booktitle = "The Semantic Web – ISWC 2019",

note = "18th International Semantic Web Conference, ISWC 2019 ; Conference date: 26-10-2019 Through 30-10-2019",

}

Meroño-Peñuela, A & Daga, E 2019, List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists. in C Ghidini, O Hartig, M Maleshkova, V Svátek, I Cruz, A Hogan, J Song, M Lefrançois & F Gandon (eds), The Semantic Web – ISWC 2019: 18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II. vol. 2, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11779 LNCS, Springer, pp. 246-260, 18th International Semantic Web Conference, ISWC 2019, Auckland, New Zealand, 26/10/19. https://doi.org/10.1007/978-3-030-30796-7_16

List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists. / Meroño-Peñuela, Albert; Daga, Enrico.
The Semantic Web – ISWC 2019: 18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II. ed. / Chiara Ghidini; Olaf Hartig; Maria Maleshkova; Vojtech Svátek; Isabel Cruz; Aidan Hogan; Jie Song; Maxime Lefrançois; Fabien Gandon. Vol. 2 Springer, 2019. p. 246-260 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11779 LNCS).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists

AU - Meroño-Peñuela, Albert

AU - Daga, Enrico

PY - 2019

Y1 - 2019

N2 - Linked lists represent a countable number of ordered values, and are among the most important abstract data types in computer science. With the advent of RDF as a highly expressive knowledge representation language for the Web, various implementations for RDF lists have been proposed. Yet, there is no benchmark so far dedicated to evaluate the performance of triple stores and SPARQL query engines on dealing with ordered linked data. Moreover, essential tasks for evaluating RDF lists, like generating datasets containing RDF lists of various sizes, or generating the same RDF list using different modelling choices, are cumbersome and unprincipled. In this paper, we propose List.MID, a systematic benchmark for evaluating systems serving RDF lists. List.MID consists of a dataset generator, which creates RDF list data in various models and of different sizes; and a set of SPARQL queries. The RDF list data is coherently generated from a large, community-curated base collection of Web MIDI files, rich in lists of musical events of arbitrary length. We describe the List.MID benchmark, and discuss its impact and adoption, reusability, design, and availability.

AB - Linked lists represent a countable number of ordered values, and are among the most important abstract data types in computer science. With the advent of RDF as a highly expressive knowledge representation language for the Web, various implementations for RDF lists have been proposed. Yet, there is no benchmark so far dedicated to evaluate the performance of triple stores and SPARQL query engines on dealing with ordered linked data. Moreover, essential tasks for evaluating RDF lists, like generating datasets containing RDF lists of various sizes, or generating the same RDF list using different modelling choices, are cumbersome and unprincipled. In this paper, we propose List.MID, a systematic benchmark for evaluating systems serving RDF lists. List.MID consists of a dataset generator, which creates RDF list data in various models and of different sizes; and a set of SPARQL queries. The RDF list data is coherently generated from a large, community-curated base collection of Web MIDI files, rich in lists of musical events of arbitrary length. We describe the List.MID benchmark, and discuss its impact and adoption, reusability, design, and availability.

KW - Benchmarks

KW - Linked lists

KW - RDF

UR - https://www.scopus.com/pages/publications/85081079901

UR - https://www.scopus.com/pages/publications/85081079901#tab=citedBy

U2 - 10.1007/978-3-030-30796-7_16

DO - 10.1007/978-3-030-30796-7_16

M3 - Conference contribution

AN - SCOPUS:85081079901

SN - 9783030307950

VL - 2

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 246

EP - 260

BT - The Semantic Web – ISWC 2019

A2 - Ghidini, Chiara

A2 - Hartig, Olaf

A2 - Maleshkova, Maria

A2 - Svátek, Vojtech

A2 - Cruz, Isabel

A2 - Hogan, Aidan

A2 - Song, Jie

A2 - Lefrançois, Maxime

A2 - Gandon, Fabien

PB - Springer

T2 - 18th International Semantic Web Conference, ISWC 2019

Y2 - 26 October 2019 through 30 October 2019

ER -

Meroño-Peñuela A, Daga E. List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists. In Ghidini C, Hartig O, Maleshkova M, Svátek V, Cruz I, Hogan A, Song J, Lefrançois M, Gandon F, editors, The Semantic Web – ISWC 2019: 18th International Semantic Web Conference, , Auckland, New Zealand, October 26–30, 2019, Proceedings, Part II. Vol. 2. Springer. 2019. p. 246-260. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2019 Oct 17. doi: 10.1007/978-3-030-30796-7_16

List.MID: A MIDI-Based Benchmark for Evaluating RDF Lists

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this