Cost-Aware Stage-Based Experimentation: Challenges and Emerging Results

Ilias Gerostathopoulos, Christian Prehofer, Lubomír Bulej, Tomáš Bureš, Vojtěch Horký, Petr Tůma

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Experimentation at post-deployment phases (in production environments) can be a powerful tool for both learning how a deployed system operates and how it is being used. Though this knowledge is invaluable for optimization of the system, collecting it may require long time and experiments may even worsen the system with negative effects on users and business. This calls for methods for performing experimentation in production environments that balance the profit of experimentation with its cost. In this paper, we describe related challenges and our emerging results towards cost-aware stage-based experimentation. In particular, we aim for performing experiments that optimize towards their profit while making sure that the overall experimentation cost (e.g. total experimentation time) stays within given bounds. First, we illustrate the challenges and needs of such experimentation in two use cases from different domains. Second, we describe the main concepts behind our method in a semi-formal notation. Third, we exemplify the method by applying it in the two use cases and we report interesting first results.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE 15th International Conference on Software Architecture Companion, ICSA-C 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages72-75
Number of pages4
ISBN (Print)9781538665855
DOIs
Publication statusPublished - 9 Aug 2018
Externally publishedYes
Event15th IEEE International Conference on Software Architecture Companion, ICSA-C 2018 - Seattle, United States
Duration: 30 Apr 20184 May 2018

Publication series

NameProceedings - 2018 IEEE 15th International Conference on Software Architecture Companion, ICSA-C 2018

Conference

Conference15th IEEE International Conference on Software Architecture Companion, ICSA-C 2018
CountryUnited States
CitySeattle
Period30/04/184/05/18

Keywords

  • cost-aware
  • experimentation
  • optimization

Fingerprint

Dive into the research topics of 'Cost-Aware Stage-Based Experimentation: Challenges and Emerging Results'. Together they form a unique fingerprint.

Cite this