Balanced large scale knowledge matching using LSH forest

Michael Cochez; Vagan Terziyan; Vadim Ermolayev

doi:10.1007/978-3-319-27932-9_4

Balanced large scale knowledge matching using LSH forest

Michael Cochez^*, Vagan Terziyan, Vadim Ermolayev

^*Corresponding author for this work

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Evolving Knowledge Ecosystems were proposed recently to approach the Big Data challenge, following the hypothesis that knowledge evolves in a way similar to biological systems. Therefore, the inner working of the knowledge ecosystem can be spotted from natural evolution. An evolving knowledge ecosystem consists of Knowledge Organisms, which form a representation of the knowledge, and the environment in which they reside. The environment consists of contexts, which are composed of so-called knowledge tokens. These tokens are ontological fragments extracted from information tokens, in turn, which originate from the streams of information flowing into the ecosystem. In this article we investigate the use of LSH Forest (a self-tuning indexing schema based on locality-sensitive hashing) for solving the problem of placing new knowledge tokens in the right contexts of the environment. We argue and show experimentally that LSH Forest possesses required properties and could be used for large distributed set-ups.

Original language	English
Title of host publication	Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers
Editors	Yannis Velegrakis, Jorge Cardoso, Jorge Cardoso, Alexandre Miguel Pinto, Francesco Guerra, Geert-Jan Houben
Publisher	Springer Verlag
Pages	36-50
Number of pages	15
ISBN (Print)	9783319279312
DOIs	https://doi.org/10.1007/978-3-319-27932-9_4
Publication status	Published - 1 Jan 2015
Externally published	Yes
Event	1st COST Action IC1302 International KEYSTONE Conference on Semantic Keyword-Based Search on Structured Data Sources, IKC 2015 - Coimbra, Portugal Duration: 8 Sept 2015 → 9 Sept 2015

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9398
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	1st COST Action IC1302 International KEYSTONE Conference on Semantic Keyword-Based Search on Structured Data Sources, IKC 2015
Country/Territory	Portugal
City	Coimbra
Period	8/09/15 → 9/09/15

Funding

The authors would like to thank the department of Mathematical Information Technology of the University of Jyv?skyl? for financially supporting this research. This research is also in part financed by the N4S SHOK organized by Digile Oy and financially supported by TEKES. The authors would further like to thank Steeri Oy for supporting the research and the members of the Industrial Ontologies Group (IOG) of the University of Jyv?skyl? for their support in the research. Further, it has to be mentioned that the implementation of the software was greatly simplified by the Guava library by Google, the Apache Commons MathTM library, and the Rabin hash library by Bill Dwyer and Ian Brandt.

Keywords

Big data
Evolving knowledge ecosystems
Locality-sensitive hashing
LSH forest

Access to Document

10.1007/978-3-319-27932-9_4

Persistent URL (handle)

Persistent link

Cite this

Cochez, M., Terziyan, V., & Ermolayev, V. (2015). Balanced large scale knowledge matching using LSH forest. In Y. Velegrakis, J. Cardoso, J. Cardoso, A. M. Pinto, F. Guerra, & G.-J. Houben (Eds.), Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers (pp. 36-50). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9398). Springer Verlag. https://doi.org/10.1007/978-3-319-27932-9_4

Cochez, Michael ; Terziyan, Vagan ; Ermolayev, Vadim. / Balanced large scale knowledge matching using LSH forest. Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers. editor / Yannis Velegrakis ; Jorge Cardoso ; Jorge Cardoso ; Alexandre Miguel Pinto ; Francesco Guerra ; Geert-Jan Houben. Springer Verlag, 2015. pp. 36-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{734d129f2b65437ab53ebf295dcb30a9,

title = "Balanced large scale knowledge matching using LSH forest",

abstract = "Evolving Knowledge Ecosystems were proposed recently to approach the Big Data challenge, following the hypothesis that knowledge evolves in a way similar to biological systems. Therefore, the inner working of the knowledge ecosystem can be spotted from natural evolution. An evolving knowledge ecosystem consists of Knowledge Organisms, which form a representation of the knowledge, and the environment in which they reside. The environment consists of contexts, which are composed of so-called knowledge tokens. These tokens are ontological fragments extracted from information tokens, in turn, which originate from the streams of information flowing into the ecosystem. In this article we investigate the use of LSH Forest (a self-tuning indexing schema based on locality-sensitive hashing) for solving the problem of placing new knowledge tokens in the right contexts of the environment. We argue and show experimentally that LSH Forest possesses required properties and could be used for large distributed set-ups.",

keywords = "Big data, Evolving knowledge ecosystems, Locality-sensitive hashing, LSH forest",

author = "Michael Cochez and Vagan Terziyan and Vadim Ermolayev",

year = "2015",

month = jan,

day = "1",

doi = "10.1007/978-3-319-27932-9\_4",

language = "English",

isbn = "9783319279312",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "36--50",

editor = "Yannis Velegrakis and Jorge Cardoso and Jorge Cardoso and Pinto, \{Alexandre Miguel\} and Francesco Guerra and Geert-Jan Houben",

booktitle = "Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers",

address = "Germany",

note = "1st COST Action IC1302 International KEYSTONE Conference on Semantic Keyword-Based Search on Structured Data Sources, IKC 2015 ; Conference date: 08-09-2015 Through 09-09-2015",

}

Cochez, M, Terziyan, V & Ermolayev, V 2015, Balanced large scale knowledge matching using LSH forest. in Y Velegrakis, J Cardoso, J Cardoso, AM Pinto, F Guerra & G-J Houben (eds), Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9398, Springer Verlag, pp. 36-50, 1st COST Action IC1302 International KEYSTONE Conference on Semantic Keyword-Based Search on Structured Data Sources, IKC 2015, Coimbra, Portugal, 8/09/15. https://doi.org/10.1007/978-3-319-27932-9_4

Balanced large scale knowledge matching using LSH forest. / Cochez, Michael; Terziyan, Vagan; Ermolayev, Vadim.
Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers. ed. / Yannis Velegrakis; Jorge Cardoso; Jorge Cardoso; Alexandre Miguel Pinto; Francesco Guerra; Geert-Jan Houben. Springer Verlag, 2015. p. 36-50 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9398).

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Balanced large scale knowledge matching using LSH forest

AU - Cochez, Michael

AU - Terziyan, Vagan

AU - Ermolayev, Vadim

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Evolving Knowledge Ecosystems were proposed recently to approach the Big Data challenge, following the hypothesis that knowledge evolves in a way similar to biological systems. Therefore, the inner working of the knowledge ecosystem can be spotted from natural evolution. An evolving knowledge ecosystem consists of Knowledge Organisms, which form a representation of the knowledge, and the environment in which they reside. The environment consists of contexts, which are composed of so-called knowledge tokens. These tokens are ontological fragments extracted from information tokens, in turn, which originate from the streams of information flowing into the ecosystem. In this article we investigate the use of LSH Forest (a self-tuning indexing schema based on locality-sensitive hashing) for solving the problem of placing new knowledge tokens in the right contexts of the environment. We argue and show experimentally that LSH Forest possesses required properties and could be used for large distributed set-ups.

AB - Evolving Knowledge Ecosystems were proposed recently to approach the Big Data challenge, following the hypothesis that knowledge evolves in a way similar to biological systems. Therefore, the inner working of the knowledge ecosystem can be spotted from natural evolution. An evolving knowledge ecosystem consists of Knowledge Organisms, which form a representation of the knowledge, and the environment in which they reside. The environment consists of contexts, which are composed of so-called knowledge tokens. These tokens are ontological fragments extracted from information tokens, in turn, which originate from the streams of information flowing into the ecosystem. In this article we investigate the use of LSH Forest (a self-tuning indexing schema based on locality-sensitive hashing) for solving the problem of placing new knowledge tokens in the right contexts of the environment. We argue and show experimentally that LSH Forest possesses required properties and could be used for large distributed set-ups.

KW - Big data

KW - Evolving knowledge ecosystems

KW - Locality-sensitive hashing

KW - LSH forest

UR - https://www.scopus.com/pages/publications/84955309131

UR - https://www.scopus.com/inward/citedby.url?scp=84955309131&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-27932-9_4

DO - 10.1007/978-3-319-27932-9_4

M3 - Conference contribution

AN - SCOPUS:84955309131

SN - 9783319279312

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 36

EP - 50

BT - Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers

A2 - Velegrakis, Yannis

A2 - Cardoso, Jorge

A2 - Pinto, Alexandre Miguel

A2 - Guerra, Francesco

A2 - Houben, Geert-Jan

PB - Springer Verlag

T2 - 1st COST Action IC1302 International KEYSTONE Conference on Semantic Keyword-Based Search on Structured Data Sources, IKC 2015

Y2 - 8 September 2015 through 9 September 2015

ER -

Cochez M, Terziyan V, Ermolayev V. Balanced large scale knowledge matching using LSH forest. In Velegrakis Y, Cardoso J, Cardoso J, Pinto AM, Guerra F, Houben GJ, editors, Semantic Keyword-Based Search on Structured Data Sources First COST Action IC1302 – International KEYSTONE Conference, IKC 2015, Revised Selected Papers. Springer Verlag. 2015. p. 36-50. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-27932-9_4

Balanced large scale knowledge matching using LSH forest

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this