Needles and straw in a haystack: Robust confidence for possibly sparse sequences

Eduard Belitser, Nurzhan Nurushev

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In the general signal+noise (allowing non-normal, non-independent observations) model, we construct an empirical Bayes posterior which we then use for uncertainty quantification for the unknown, possibly sparse, signal. We introduce a novel excessive bias restriction (EBR) condition, which gives rise to a new slicing of the entire space that is suitable for uncertainty quantification. Under EBR and some mild exchangeable exponential moment condition on the noise, we establish the local (oracle) optimality of the proposed confidence ball. Without EBR, we propose another confidence ball of full coverage, but its radius contains an additional σn1/4-term. In passing, we also get the local optimal results for estimation, posterior contraction problems, and the problem of weak recovery of sparsity structure. Adaptive minimax results (also for the estimation and posterior contraction problems) over various sparsity classes follow from our local results.

Original languageEnglish
Pages (from-to)191-225
Number of pages35
JournalBernoulli
Volume26
Issue number1
Early online date26 Nov 2019
DOIs
Publication statusPublished - Jan 2020

Keywords

  • Confidence set
  • Empirical Bayes posterior
  • Local radial rate

Fingerprint Dive into the research topics of 'Needles and straw in a haystack: Robust confidence for possibly sparse sequences'. Together they form a unique fingerprint.

Cite this