A Periodic Portfolio Scheduler for Scientific Computing in the Data Center

Kefeng Deng, Ruben Verboon, Kaijun Ren, Alexandru Iosup

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

The popularity of data centers in scientific computing has led to new architectures, new workload structures, and growing customer-bases. As a consequence, the selection of efficient scheduling algorithms for the data center is an increasingly costlier and more difficult challenge. To address this challenge, and contrasting previous work on scheduling for scientific workloads, we focus in this work on portfolio scheduling-here, the dynamic selection and use of a scheduling policy, depending on the current system and workload conditions, from a portfolio of multiple policies. We design a periodic portfolio scheduler for the workload of the entire data center, and equip it with a portfolio of resource provisioning and allocation policies. Through simulation based on real and synthetic workload traces, we show evidence that portfolio scheduling can automatically select the scheduling policy to match both user and data center objectives, and that portfolio scheduling can perform well in the data center, relative to its constituent policies. © 2014 Springer-Verlag.
Original languageEnglish
Title of host publicationJob Scheduling Strategies for Parallel Processing - 17th International Workshop, JSSPP 2013, Boston, MA, USA, May 24, 2013 Revised Selected Papers
PublisherSpringer/Verlag
Pages156-176
Number of pages21
Volume8429 LNCS
ISBN (Print)9783662437780
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event17th International Workshop on Job Scheduling Strategies for Parallel Processing, JSSPP 2013 - Boston, United States
Duration: 24 May 201424 May 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8429 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Workshop

Workshop17th International Workshop on Job Scheduling Strategies for Parallel Processing, JSSPP 2013
CountryUnited States
CityBoston
Period24/05/1424/05/14

Keywords

  • Data center
  • Portfolio scheduling
  • Provisioning and allocation
  • Scheduling policies
  • Scientific workloads

Fingerprint Dive into the research topics of 'A Periodic Portfolio Scheduler for Scientific Computing in the Data Center'. Together they form a unique fingerprint.

Cite this