Skip to main navigation Skip to search Skip to main content

Parallel continuous preference queries over out-of-order and bursty data streams

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Techniques to handle traffic bursts and out-of-order arrivals are of paramount importance to provide real-time sensor data analytics in domains like traffic surveillance, transportation management, healthcare and security applications. In these systems the amount of raw data coming from sensors must be analyzed by continuous queries that extract value-added information used to make informed decisions in real-time. To perform this task with timing constraints, parallelism must be exploited in the query execution in order to enable the real-time processing on parallel architectures. In this paper we focus on continuous preference queries, a representative class of continuous queries for decision making, and we propose a parallel query model targeting the efficient processing over out-of-order and bursty data streams. We study how to integrate punctuation mechanisms in order to enable out-of-order processing. Then, we present advanced scheduling strategies targeting scenarios with different burstiness levels, parameterized using the index of dispersion quantity. Extensive experiments have been performed using synthetic datasets and real-world data streams obtained from an existing real-time locating system. The experimental evaluation demonstrates the efficiency of our parallel solution and its effectiveness in handling the out-of-orderness degrees and burstiness levels of real-world applications.
Original languageEnglish
Article number7873332
Pages (from-to)2608-2624
JournalIEEE Transactions on Parallel and Distributed Systems
Volume28
Issue number9
DOIs
Publication statusPublished - 1 Sept 2017
Externally publishedYes

Funding

We would like to thank Dr. Yuanzhen Ji, PhD (SAP, TU Dresden) for her valuable help in providing us the real datasets used for the final evaluation of our work. This work has been partially supported by EU H2020-ICT-2014-1 project RePhrase (No. 644235).

FundersFunder number
European Commission
Horizon 2020 Framework Programme644235

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 16 - Peace, Justice and Strong Institutions
      SDG 16 Peace, Justice and Strong Institutions

    Fingerprint

    Dive into the research topics of 'Parallel continuous preference queries over out-of-order and bursty data streams'. Together they form a unique fingerprint.

    Cite this