On the Use of In-memory Analytics Workflows to Compute eScience Indicators from Large Climate Datasets

Alessandro DAnca, Cosimo Palazzo, Donatello Elia, Sandro Fiore, Ioannis Bistinas, Kristin Bottcher, Victoria Bennett, Giovanni Aloisio

Research output: Chapter in Book / Report / Conference proceedingChapterAcademicpeer-review

Abstract

The need to apply complex algorithms on large volumes of data is boosting the development of technological solutions able to satisfy big data analytics needs in Cloud and HPC environments. In this context Ophidia represents a big data analytics framework for eScience offering a cross-domain solution for managing scientific, multi-dimensional data. It also exploits an in-memory-based distributed data storage and provides support for the submission of complex workflows by means of various interfaces compliant to well-known standards. This paper presents some applications of Ophidia for the computation of climate indicators defined in the CLIPC project, the WPS interface used for the submission and the workflow based approach employed.
Original languageEnglish
Title of host publicationProceedings - 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID 2017
PublisherInstitute of Electrical and Electronics Engineers, Inc.
Pages1035-1043
Number of pages9
ISBN (Electronic)9781509066100
ISBN (Print)9781509066100
DOIs
Publication statusPublished - 10 Jul 2017

Publication series

NameProceedings - 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGRID 2017

Keywords

  • Big data analytics
  • Climate impact indicator
  • Performance evaluation
  • Scientific workflows

Fingerprint Dive into the research topics of 'On the Use of In-memory Analytics Workflows to Compute eScience Indicators from Large Climate Datasets'. Together they form a unique fingerprint.

Cite this