On the control of queueing systems with aging state information

M. Onderwater, S. Bhulai, R.D. van der Mei

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.
Original languageEnglish
Pages (from-to)588-617
JournalStochastic Models
Volume31
Issue number4
DOIs
Publication statusPublished - 2015

Bibliographical note

PT: J; NR: 18; TC: 0; J9: STOCH MODELS; PG: 30; GA: CT3RJ; UT: WOS:000362724200003

Fingerprint

Dive into the research topics of 'On the control of queueing systems with aging state information'. Together they form a unique fingerprint.

Cite this