On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure

J. Maassen, Ben van Werkhoven, Maarten van Meersbergen, Henri E. Bal, Michael Kliphuis, Sandra E. Brunnabend, Henk A. Dijkstra, Gerben van Malenstein, Migiel de Vos, Sylvia Kuijpers, Sander Boele, Jules Wolfrat, Nick Hill, David Wallom, Christian Grimm, Dieter Kranzlmüller, Dinesh Ganpathi, Shantenu Jha, Shantenu Jha, Frank O. Bryan & 2 others Benjamin Kirtman, Frank J. Seinstra

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In Autumn 2013, we—an international team of climate scientists, computer scientists, eScience researchers, and e-Infrastructure specialists—participated in the enlighten your research global competition, organized to showcase advanced lightpath technologies in support of state-of-the-art research questions. As one of the winning entries, our enlighten your research global team embarked on a very ambitious project to run an extremely high resolution climate model on a collection of supercomputers distributed over two continents and connected using an advanced 10 G lightpath networking infrastructure. Although good progress was made, we were not able to perform all desired experiments due to a varying combination of technical problems, configuration issues, policy limitations and lack of (budget for) human resources to solve these issues. In this paper, we describe our goals, the technical and non-technical barriers, we encountered and provide recommendations on how these barriers can be removed so future project of this kind may succeed.
LanguageEnglish
Article numbere3853
JournalConcurrency and Computation: Practice and Experience
Volume29
Issue number2
DOIs
Publication statusPublished - 25 Jan 2017

Fingerprint

Infrastructure
E-Science
Climate Models
Human Resources
Supercomputer
Networking
Climate
Climate models
Recommendations
High Resolution
Supercomputers
Configuration
Personnel
Experiment
Experiments
Policy

Keywords

  • Distributed cyberinfrastructure
  • Lightpaths
  • Global climate modeling

Cite this

Maassen, J. ; van Werkhoven, Ben ; van Meersbergen, Maarten ; Bal, Henri E. ; Kliphuis, Michael ; Brunnabend, Sandra E. ; Dijkstra, Henk A. ; van Malenstein, Gerben ; de Vos, Migiel ; Kuijpers, Sylvia ; Boele, Sander ; Wolfrat, Jules ; Hill, Nick ; Wallom, David ; Grimm, Christian ; Kranzlmüller, Dieter ; Ganpathi, Dinesh ; Jha, Shantenu ; Jha, Shantenu ; Bryan, Frank O. ; Kirtman, Benjamin ; Seinstra, Frank J. / On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure. In: Concurrency and Computation: Practice and Experience. 2017 ; Vol. 29, No. 2.
@article{9d23fbf9557f47a8998a3436fc4826bd,
title = "On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure",
abstract = "In Autumn 2013, we—an international team of climate scientists, computer scientists, eScience researchers, and e-Infrastructure specialists—participated in the enlighten your research global competition, organized to showcase advanced lightpath technologies in support of state-of-the-art research questions. As one of the winning entries, our enlighten your research global team embarked on a very ambitious project to run an extremely high resolution climate model on a collection of supercomputers distributed over two continents and connected using an advanced 10 G lightpath networking infrastructure. Although good progress was made, we were not able to perform all desired experiments due to a varying combination of technical problems, configuration issues, policy limitations and lack of (budget for) human resources to solve these issues. In this paper, we describe our goals, the technical and non-technical barriers, we encountered and provide recommendations on how these barriers can be removed so future project of this kind may succeed.",
keywords = "Distributed cyberinfrastructure, Lightpaths, Global climate modeling",
author = "J. Maassen and {van Werkhoven}, Ben and {van Meersbergen}, Maarten and Bal, {Henri E.} and Michael Kliphuis and Brunnabend, {Sandra E.} and Dijkstra, {Henk A.} and {van Malenstein}, Gerben and {de Vos}, Migiel and Sylvia Kuijpers and Sander Boele and Jules Wolfrat and Nick Hill and David Wallom and Christian Grimm and Dieter Kranzlm{\"u}ller and Dinesh Ganpathi and Shantenu Jha and Shantenu Jha and Bryan, {Frank O.} and Benjamin Kirtman and Seinstra, {Frank J.}",
year = "2017",
month = "1",
day = "25",
doi = "10.1002/cpe.3853",
language = "English",
volume = "29",
journal = "Concurrency and Computation: Practice and Experience",
issn = "1532-0626",
publisher = "John Wiley and Sons Ltd.",
number = "2",

}

Maassen, J, van Werkhoven, B, van Meersbergen, M, Bal, HE, Kliphuis, M, Brunnabend, SE, Dijkstra, HA, van Malenstein, G, de Vos, M, Kuijpers, S, Boele, S, Wolfrat, J, Hill, N, Wallom, D, Grimm, C, Kranzlmüller, D, Ganpathi, D, Jha, S, Jha, S, Bryan, FO, Kirtman, B & Seinstra, FJ 2017, 'On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure', Concurrency and Computation: Practice and Experience, vol. 29, no. 2, e3853. https://doi.org/10.1002/cpe.3853

On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure. / Maassen, J.; van Werkhoven, Ben; van Meersbergen, Maarten; Bal, Henri E.; Kliphuis, Michael; Brunnabend, Sandra E.; Dijkstra, Henk A.; van Malenstein, Gerben; de Vos, Migiel; Kuijpers, Sylvia; Boele, Sander; Wolfrat, Jules; Hill, Nick; Wallom, David; Grimm, Christian; Kranzlmüller, Dieter; Ganpathi, Dinesh; Jha, Shantenu; Jha, Shantenu; Bryan, Frank O.; Kirtman, Benjamin; Seinstra, Frank J.

In: Concurrency and Computation: Practice and Experience, Vol. 29, No. 2, e3853, 25.01.2017.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - On the complexities of utilizing large-scale lightpath-connected distributed cyberinfrastructure

AU - Maassen, J.

AU - van Werkhoven, Ben

AU - van Meersbergen, Maarten

AU - Bal, Henri E.

AU - Kliphuis, Michael

AU - Brunnabend, Sandra E.

AU - Dijkstra, Henk A.

AU - van Malenstein, Gerben

AU - de Vos, Migiel

AU - Kuijpers, Sylvia

AU - Boele, Sander

AU - Wolfrat, Jules

AU - Hill, Nick

AU - Wallom, David

AU - Grimm, Christian

AU - Kranzlmüller, Dieter

AU - Ganpathi, Dinesh

AU - Jha, Shantenu

AU - Jha, Shantenu

AU - Bryan, Frank O.

AU - Kirtman, Benjamin

AU - Seinstra, Frank J.

PY - 2017/1/25

Y1 - 2017/1/25

N2 - In Autumn 2013, we—an international team of climate scientists, computer scientists, eScience researchers, and e-Infrastructure specialists—participated in the enlighten your research global competition, organized to showcase advanced lightpath technologies in support of state-of-the-art research questions. As one of the winning entries, our enlighten your research global team embarked on a very ambitious project to run an extremely high resolution climate model on a collection of supercomputers distributed over two continents and connected using an advanced 10 G lightpath networking infrastructure. Although good progress was made, we were not able to perform all desired experiments due to a varying combination of technical problems, configuration issues, policy limitations and lack of (budget for) human resources to solve these issues. In this paper, we describe our goals, the technical and non-technical barriers, we encountered and provide recommendations on how these barriers can be removed so future project of this kind may succeed.

AB - In Autumn 2013, we—an international team of climate scientists, computer scientists, eScience researchers, and e-Infrastructure specialists—participated in the enlighten your research global competition, organized to showcase advanced lightpath technologies in support of state-of-the-art research questions. As one of the winning entries, our enlighten your research global team embarked on a very ambitious project to run an extremely high resolution climate model on a collection of supercomputers distributed over two continents and connected using an advanced 10 G lightpath networking infrastructure. Although good progress was made, we were not able to perform all desired experiments due to a varying combination of technical problems, configuration issues, policy limitations and lack of (budget for) human resources to solve these issues. In this paper, we describe our goals, the technical and non-technical barriers, we encountered and provide recommendations on how these barriers can be removed so future project of this kind may succeed.

KW - Distributed cyberinfrastructure

KW - Lightpaths

KW - Global climate modeling

UR - http://www.scopus.com/inward/record.url?scp=84971469216&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84971469216&partnerID=8YFLogxK

U2 - 10.1002/cpe.3853

DO - 10.1002/cpe.3853

M3 - Article

VL - 29

JO - Concurrency and Computation: Practice and Experience

T2 - Concurrency and Computation: Practice and Experience

JF - Concurrency and Computation: Practice and Experience

SN - 1532-0626

IS - 2

M1 - e3853

ER -