The zig-zag process and super-efficient sampling for Bayesian analysis of big data 1

J. Bierkens, P. Fearnhead, G. Roberts

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Standard MCMC methods can scale poorly to big data settings due to the need to evaluate the likelihood at each iteration. There have been a number of approximate MCMC algorithms that use sub-sampling ideas to reduce this computational burden, but with the drawback that these algorithms no longer target the true posterior distribution. We introduce a new family of Monte Carlo methods based upon a multidimensional version of the Zig-Zag process of [Ann. Appl. Probab. 27 (2017) 846–882], a continuous-time piecewise deterministic Markov process. While traditional MCMC methods are reversible by construction (a property which is known to inhibit rapid convergence) the Zig-Zag process offers a flexible nonreversible alternative which we observe to often have favourable convergence properties. We show how the Zig-Zag process can be simulated without discretisation error, and give conditions for the process to be ergodic. Most importantly, we introduce a sub-sampling version of the Zig-Zag process that is an example of an exact approximate scheme, that is, the resulting approximate process still has the posterior as its stationary distribution. Furthermore, if we use a control-variate idea to reduce the variance of our unbiased estimator, then the Zig-Zag process can be super-efficient: after an initial preprocessing step, essentially independent samples from the posterior distribution are obtained at a computational cost which does not depend on the size of the data.

Original languageEnglish
Pages (from-to)1288-1320
Number of pages33
JournalAnnals of Statistics
Volume47
Issue number3
DOIs
Publication statusPublished - 1 Jun 2019
Externally publishedYes

Keywords

  • Exact sampling
  • MCMC
  • Nonreversible Markov process
  • Piecewise deterministic Markov process
  • Stochastic gradient Langevin dynamics
  • Sub-sampling

Fingerprint Dive into the research topics of 'The zig-zag process and super-efficient sampling for Bayesian analysis of big data <sup>1</sup>'. Together they form a unique fingerprint.

Cite this