Skip to main navigation Skip to search Skip to main content

Methods Included: Standardizing Computational Reuse and Portability with the Common Workflow Language

  • Michael R. Crusoe
  • , Sanne Abeln
  • , Alexandru Iosup
  • , Peter Amstutz
  • , John Chilton
  • , Nebojša Tijanić
  • , Hervé Ménager
  • , Stian Soiland-Reyes
  • , Carole Goble

Research output: Working paper / PreprintPreprintAcademic

250 Downloads (Pure)

Abstract

Computational Workflows are widely used in data analysis, enabling innovation and decision-making. In many domains (bioinformatics, image analysis, & radio astronomy) the analysis components are numerous and written in multiple different computer languages by third parties. However, many competing workflow systems exist, severely limiting portability of such workflows, thereby hindering the transfer of workflows between different systems, between different projects and different settings, leading to vendor lock-ins and limiting their generic re-usability. Here we present the Common Workflow Language (CWL) project which produces free and open standards for describing command-line tool based workflows. The CWL standards provide a common but reduced set of abstractions that are both used in practice and implemented in many popular workflow systems. The CWL language is declarative, which allows expressing computational workflows constructed from diverse software tools, executed each through their command-line interface. Being explicit about the runtime environment and any use of software containers enables portability and reuse. Workflows written according to the CWL standards are a reusable description of that analysis that are runnable on a diverse set of computing environments. These descriptions contain enough information for advanced optimization without additional input from workflow authors. The CWL standards support polylingual workflows, enabling portability and reuse of such workflows, easing for example scholarly publication, fulfilling regulatory requirements, collaboration in/between academic research and industry, while reducing implementation costs. CWL has been taken up by a wide variety of domains, and industries and support has been implemented in many major workflow systems.
Original languageEnglish
PublisherarXiv.org
Pages1-11
Number of pages11
Publication statusPublished - 4 Aug 2022

Bibliographical note

For the LaTex source code of this paper, see https://github.com/mr-c/cwl_methods_included.

Funding

European Commission grants BioExcel-2 (SSR) H2020-INFRAEDI-02-2018 823830

FundersFunder number
Horizon 2020 Framework Programme676559, 823830, 739563, 653477, 730976, 675728, 824087
Society for the Study of ReproductionH2020-INFRAEDI-02-2018 823830
European CommissionBioExcel-2

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 17 - Partnerships for the Goals
      SDG 17 Partnerships for the Goals

    Keywords

    • cs.DC

    Fingerprint

    Dive into the research topics of 'Methods Included: Standardizing Computational Reuse and Portability with the Common Workflow Language'. Together they form a unique fingerprint.

    Cite this