Approximate Dynamic Programming techniques for the control of time-varying queueing systems applied to call centers with abandonments and retrials

D. Roubos, S. Bhulai

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In this article we develop techniques for applying Approximate Dynamic Programming (ADP) to the control of time-varying queuing systems. First, we show that the classical state space representation in queuing systems leads to approximations that can be significantly improved by increasing the dimensionality of the state space by state disaggregation. Second, we deal with time-varying parameters by adding them to the state space with an ADP parameterization. We demonstrate these techniques for the optimal admission control in a retrial queue with abandonments and time-varying parameters. The numerical experiments show that our techniques have near to optimal performance. © 2009 Cambridge University Press.
Original languageEnglish
Pages (from-to)27-45
JournalProbability in the Engineering and Informational Sciences
Volume24
DOIs
Publication statusPublished - 2010

Fingerprint Dive into the research topics of 'Approximate Dynamic Programming techniques for the control of time-varying queueing systems applied to call centers with abandonments and retrials'. Together they form a unique fingerprint.

  • Cite this