Skip to main navigation Skip to search Skip to main content

The minimum regularized covariance determinant estimator

  • Kris Boudt*
  • , Peter J. Rousseeuw
  • , Steven Vanduffel
  • , Tim Verdonck
  • *Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

841 Downloads (Pure)

Abstract

The minimum covariance determinant (MCD) approach estimates the location and scatter matrix using the subset of given size with lowest sample covariance determinant. Its main drawback is that it cannot be applied when the dimension exceeds the subset size. We propose the minimum regularized covariance determinant (MRCD) approach, which differs from the MCD in that the scatter matrix is a convex combination of a target matrix and the sample covariance matrix of the subset. A data-driven procedure sets the weight of the target matrix, so that the regularization is only used when needed. The MRCD estimator is defined in any dimension, is well-conditioned by construction and preserves the good robustness properties of the MCD. We prove that so-called concentration steps can be performed to reduce the MRCD objective function, and we exploit this fact to construct a fast algorithm. We verify the accuracy and robustness of the MRCD estimator in a simulation study and illustrate its practical use for outlier detection and regression analysis on real-life high-dimensional data sets in chemistry and criminology.

Original languageEnglish
Pages (from-to)113-128
Number of pages16
JournalStatistics and Computing
Volume30
Issue number1
Early online date2 Apr 2019
DOIs
Publication statusPublished - Feb 2020

Funding

FundersFunder number
UK Research and Innovation84929

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 12 - Responsible Consumption and Production
      SDG 12 Responsible Consumption and Production

    Keywords

    • Breakdown value
    • High-dimensional data
    • Regularization
    • Robust covariance estimation

    Fingerprint

    Dive into the research topics of 'The minimum regularized covariance determinant estimator'. Together they form a unique fingerprint.

    Cite this