TY - GEN
T1 - The BigDataEurope Platform - Supporting the Variety Dimension of Big Data
AU - Auer, Sören
AU - Scerri, Simon
AU - Versteden, Aad
AU - Pauwels, Erika
AU - Charalambidis, Angelos
AU - Konstantopoulos, Stasinos
AU - Lehmann, Jens
AU - Jabeen, Hajira
AU - Ermilov, Ivan
AU - Sejdiu, Gezim
AU - Ikonomopoulos, Andreas
AU - Andronopoulos, Spyros
AU - Vlachogiannis, Mandy
AU - Pappas, Charalambos
AU - Davettas, Athanasios
AU - Klampanos, Iraklis A.
AU - Grigoropoulos, Efstathios
AU - Karkaletsis, Vangelis
AU - Boer, Victor de
AU - Siebes, Ronald
AU - Mami, Mohamed Nadjib
AU - Albani, Sergio
AU - Lazzarini, Michele
AU - Nunes, Paulo
AU - Angiuli, Emanuele
AU - Pittaras, Nikiforos
AU - Giannakopoulos, George
AU - Argyriou, Giorgos
AU - Stamoulis, George
AU - Papadakis, George
AU - Koubarakis, Manolis
AU - Karampiperis, Pythagoras
AU - Ngomo, Axel-Cyrille Ngonga
AU - Vidal, Maria-Esther
PY - 2017
Y1 - 2017
N2 - The management and analysis of large-scale datasets - described with the term Big Data - involves the three classic dimensions volume, velocity and variety. While the former two are well supported by a plethora of software components, the variety dimension is still rather neglected. We present the BDE platform - an easy-to-deploy, easy-to-use and adaptable (cluster-based and standalone) platform for the execution of big data components and tools like Hadoop, Spark, Flink, Flume and Cassandra. The BDE platform was designed based upon the requirements gathered from seven of the societal challenges put forward by the European Commission in the Horizon 2020 programme and targeted by the BigDataEurope pilots. As a result, the BDE platform allows to perform a variety of Big Data flow tasks like message passing, storage, analysis or publishing. To facilitate the processing of heterogeneous data, a particular innovation of the platform is the Semantic Layer, which allows to directly process RDF data and to map and transform arbitrary data into RDF. The advantages of the BDE platform are demonstrated through seven pilots, each focusing on a major societal challenge.
AB - The management and analysis of large-scale datasets - described with the term Big Data - involves the three classic dimensions volume, velocity and variety. While the former two are well supported by a plethora of software components, the variety dimension is still rather neglected. We present the BDE platform - an easy-to-deploy, easy-to-use and adaptable (cluster-based and standalone) platform for the execution of big data components and tools like Hadoop, Spark, Flink, Flume and Cassandra. The BDE platform was designed based upon the requirements gathered from seven of the societal challenges put forward by the European Commission in the Horizon 2020 programme and targeted by the BigDataEurope pilots. As a result, the BDE platform allows to perform a variety of Big Data flow tasks like message passing, storage, analysis or publishing. To facilitate the processing of heterogeneous data, a particular innovation of the platform is the Semantic Layer, which allows to directly process RDF data and to map and transform arbitrary data into RDF. The advantages of the BDE platform are demonstrated through seven pilots, each focusing on a major societal challenge.
UR - http://www.scopus.com/inward/record.url?scp=85020541049&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85020541049&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-60131-1_3
DO - 10.1007/978-3-319-60131-1_3
M3 - Conference contribution
SP - 41
EP - 59
BT - Web Engineering - 17th International Conference, ICWE 2017, Rome, Italy, June 5-8, 2017, Proceedings
ER -
