TY - GEN
T1 - Designing flink pipelines in IoT mashup tools
AU - Mahapatra, Tanmaya
AU - Gerostathopoulos, Ilias
AU - Fernández Moreno, Federico Alonso
AU - Prehofer, Christian
PY - 2018/1/1
Y1 - 2018/1/1
N2 - Internet of Things (IoT) applications are generating increasingly large amounts of data because of continuous activity and periodical sensing capabilities. Processing the data generated by IoT applications is necessary to derive important insights-for example, processing data from CO emissions can help municipal authorities apply traffic restrictions in order to improve a city's air quality. State-of-the-art stream-processing platforms, such as Apache Flink, can be used to process large amounts of data streams from different IoT devices. However, it is difficult to both set-up and write applications for these platforms; this is also manifested in the increasing need for data analysts and engineers. A promising solution is to enable domain experts, who are not necessarily programmers, to develop the necessary stream pipelines by providing them with domain-specific graphical tools. We present our proposal for a state-of-the-art mashup tool, originally developed for wiring IoT applications together, to graphically design streaming data pipelines and deploy them as a Flink application. Our prototype and experimental evaluation show that our proposal is feasible and potentially impactful.
AB - Internet of Things (IoT) applications are generating increasingly large amounts of data because of continuous activity and periodical sensing capabilities. Processing the data generated by IoT applications is necessary to derive important insights-for example, processing data from CO emissions can help municipal authorities apply traffic restrictions in order to improve a city's air quality. State-of-the-art stream-processing platforms, such as Apache Flink, can be used to process large amounts of data streams from different IoT devices. However, it is difficult to both set-up and write applications for these platforms; this is also manifested in the increasing need for data analysts and engineers. A promising solution is to enable domain experts, who are not necessarily programmers, to develop the necessary stream pipelines by providing them with domain-specific graphical tools. We present our proposal for a state-of-the-art mashup tool, originally developed for wiring IoT applications together, to graphically design streaming data pipelines and deploy them as a Flink application. Our prototype and experimental evaluation show that our proposal is feasible and potentially impactful.
KW - Flink pipelines
KW - Graphical tool
KW - IoT mashup tools
KW - Stream analytics
UR - http://www.scopus.com/inward/record.url?scp=85061292923&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85061292923&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85061292923
VL - 2316
T3 - CEUR Workshop Proceedings
SP - 41
EP - 53
BT - 4th Norwegian Big Data Symposium, NOBIDS 2018
T2 - 4th Norwegian Big Data Symposium, NOBIDS 2018
Y2 - 14 November 2018
ER -