TY - JOUR

T1 - Linear PDEs and eigenvalue problems corresponding to ergodic stochastic optimization problems on compact manifolds

AU - Bierkens, Joris

AU - Chernyak, Vladimir Y.

AU - Chertkov, Michael

AU - Kappen, Hilbert J.

PY - 2016/1/29

Y1 - 2016/1/29

N2 - Long term average or 'ergodic' optimal control problems on a compact manifold are considered. The problems exhibit a special structure which is typical of control problems related to large deviations theory: Control is exerted in all directions and the control costs are proportional to the square of the norm of the control field with respect to the metric induced by the noise. The long term stochastic dynamics on the manifold will be completely characterized by the long term density ρ and the long term current density J. As such, control problems may be reformulated as variational problems over ρ and J. The density ρ is paired in the cost functional with a state dependent cost function V, and the current density J is paired with a vector potential or gauge field A. We discuss several optimization problems: the problem in which both ρ and J are varied freely, the problem in which ρ is fixed and the one in which J is fixed. These problems lead to different kinds of operator problems: linear PDEs in the first two cases and a nonlinear PDE in the latter case. These results are obtained through a variational principle using infinite dimensional Lagrange multipliers. In the case where the initial dynamics are reversible the optimally controlled diffusion is also reversible. The particular case of constraining the dynamics to be reversible of the optimally controlled process leads to a linear eigenvalue problem for the square root of the density process.

AB - Long term average or 'ergodic' optimal control problems on a compact manifold are considered. The problems exhibit a special structure which is typical of control problems related to large deviations theory: Control is exerted in all directions and the control costs are proportional to the square of the norm of the control field with respect to the metric induced by the noise. The long term stochastic dynamics on the manifold will be completely characterized by the long term density ρ and the long term current density J. As such, control problems may be reformulated as variational problems over ρ and J. The density ρ is paired in the cost functional with a state dependent cost function V, and the current density J is paired with a vector potential or gauge field A. We discuss several optimization problems: the problem in which both ρ and J are varied freely, the problem in which ρ is fixed and the one in which J is fixed. These problems lead to different kinds of operator problems: linear PDEs in the first two cases and a nonlinear PDE in the latter case. These results are obtained through a variational principle using infinite dimensional Lagrange multipliers. In the case where the initial dynamics are reversible the optimally controlled diffusion is also reversible. The particular case of constraining the dynamics to be reversible of the optimally controlled process leads to a linear eigenvalue problem for the square root of the density process.

KW - current fluctuations

KW - diffusion

KW - stationary states

UR - http://www.scopus.com/inward/record.url?scp=85000538608&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85000538608&partnerID=8YFLogxK

U2 - 10.1088/1742-5468/2016/01/013206

DO - 10.1088/1742-5468/2016/01/013206

M3 - Article

AN - SCOPUS:85000538608

VL - 2016

JO - Journal of Statistical Mechanics: Theory and Experiment

JF - Journal of Statistical Mechanics: Theory and Experiment

SN - 1742-5468

IS - 1

M1 - 013206

ER -