Selecting the number of factors in principal component analysis by permutation testing—Numerical and practical aspects

Raffaele Vitale*, Johan A. Westerhuis, Tormod Næs, Age K. Smilde, Onno E. de Noord, Alberto Ferrer

*Corresponding author for this work

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Selecting the correct number of factors in principal component analysis (PCA) is a critical step to achieve a reasonable data modelling, where the optimal strategy strictly depends on the objective PCA is applied for. In the last decades, much work has been devoted to methods like Kaiser's eigenvalue greater than 1 rule, Velicer's minimum average partial rule, Cattell's scree test, Bartlett's chi-square test, Horn's parallel analysis, and cross-validation. However, limited attention has been paid to the possibility of assessing the significance of the calculated components via permutation testing. That may represent a feasible approach in case the focus of the study is discriminating relevant from nonsystematic sources of variation and/or the aforementioned methodologies cannot be resorted to (eg, when the analysed matrices do not fulfill specific properties or statistical assumptions). The main aim of this article is to provide practical insights for an improved understanding of permutation testing, highlighting its pros and cons, mathematically formalising the numerical procedure to be abided by when applying it for PCA factor selection by the description of a novel algorithm developed to this end, and proposing ad hoc solutions for optimising computational time and efficiency.

Original languageEnglish
Article numbere2937
JournalJournal of Chemometrics
Volume31
Issue number12
DOIs
Publication statusPublished - 1 Dec 2017
Externally publishedYes

Keywords

  • deflation
  • eigenvalues
  • permutation testing
  • principal component analysis (PCA)
  • projection

Fingerprint Dive into the research topics of 'Selecting the number of factors in principal component analysis by permutation testing—Numerical and practical aspects'. Together they form a unique fingerprint.

  • Cite this