Acceleration of the alternating least squares algorithm for principal components analysis

Masahiro Kuroda, Yuichi Mori, Masaya Iizuka, Michio Sakakihara

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

Principal components analysis (PCA) is a popular descriptive multivariate method for handling quantitative data and it can be extended to deal with qualitative data and mixed measurement level data. The existing algorithms for extended PCA are PRINCIPALS of Young et al. (1978) and PRINCALS of Gifi (1989) in which the alternating least squares algorithm is utilized. These algorithms based on the least squares estimation may require many iterations in their application to very large data sets and variable selection problems and may take a long time to converge. In this paper, we derive a new iterative algorithm for accelerating the convergence of PRINCIPALS and PRINCALS by using the vector ε algorithm of Wynn (1962). The proposed acceleration algorithm speeds up the convergence of the sequence of the parameter estimates obtained from PRINCIPALS or PRINCALS. Numerical experiments illustrate the potential of the proposed acceleration algorithm.

Original languageEnglish
Pages (from-to)143-153
Number of pages11
JournalComputational Statistics and Data Analysis
Volume55
Issue number1
DOIs
Publication statusPublished - Jan 1 2011

Keywords

  • Acceleration of convergence
  • Alternating least squares algorithm
  • PRINCALS
  • PRINCIPALS
  • Vector ε algorithm

ASJC Scopus subject areas

  • Statistics and Probability
  • Computational Mathematics
  • Computational Theory and Mathematics
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Acceleration of the alternating least squares algorithm for principal components analysis'. Together they form a unique fingerprint.

  • Cite this