On the control of queueing systems with aging state information

M. Onderwater; S. Bhulai; R.D. van der Mei

doi:10.1080/15326349.2015.1058716

On the control of queueing systems with aging state information

M. Onderwater, S. Bhulai, R.D. van der Mei

Research output: Contribution to Journal › Article › Academic › peer-review

Abstract

We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.

Original language	English
Pages (from-to)	588-617
Journal	Stochastic Models
Volume	31
Issue number	4
DOIs	https://doi.org/10.1080/15326349.2015.1058716
Publication status	Published - 2015

Bibliographical note

PT: J; NR: 18; TC: 0; J9: STOCH MODELS; PG: 30; GA: CT3RJ; UT: WOS:000362724200003

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1080/15326349.2015.1058716

Persistent URL (handle)

Copy link address

Cite this

@article{863324cb35954ebdabd2fcc696f3da7a,

title = "On the control of queueing systems with aging state information",

abstract = "We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.",

author = "M. Onderwater and S. Bhulai and {van der Mei}, R.D.",

note = "PT: J; NR: 18; TC: 0; J9: STOCH MODELS; PG: 30; GA: CT3RJ; UT: WOS:000362724200003",

year = "2015",

doi = "10.1080/15326349.2015.1058716",

language = "English",

volume = "31",

pages = "588--617",

journal = "Stochastic Models",

issn = "1532-6349",

publisher = "Taylor and Francis Ltd.",

number = "4",

}

TY - JOUR

T1 - On the control of queueing systems with aging state information

AU - Onderwater, M.

AU - Bhulai, S.

AU - van der Mei, R.D.

N1 - PT: J; NR: 18; TC: 0; J9: STOCH MODELS; PG: 30; GA: CT3RJ; UT: WOS:000362724200003

PY - 2015

Y1 - 2015

N2 - We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.

AB - We investigate control of a queueing system in which a component of the state space is subject to aging. The controller can choose to forward incoming queries to the system (where it needs time for processing), or respond with a previously generated response (incurring a penalty for not providing a fresh value). Hence, the controller faces a tradeoff between data freshness and response times. We model the system as a complex Markov decision process, simplify it, and construct a control policy. This policy shows near-optimal performance and achieves lower costs than both a myopic policy and a threshold policy.

U2 - 10.1080/15326349.2015.1058716

DO - 10.1080/15326349.2015.1058716

M3 - Article

SN - 1532-6349

VL - 31

SP - 588

EP - 617

JO - Stochastic Models

JF - Stochastic Models

IS - 4

ER -

On the control of queueing systems with aging state information

Abstract

Bibliographical note

UN SDGs

Access to Document

Persistent URL (handle)

Fingerprint

Cite this