Acceleration of the alternating least squares algorithm for principal components analysis

Masahiro Kuroda, Yuichi Mori, Masaya Iizuka, Michio Sakakihara

    Research output: Contribution to journalArticlepeer-review

    27 Citations (Scopus)

    Abstract

    Principal components analysis (PCA) is a popular descriptive multivariate method for handling quantitative data and it can be extended to deal with qualitative data and mixed measurement level data. The existing algorithms for extended PCA are PRINCIPALS of Young et al. (1978) and PRINCALS of Gifi (1989) in which the alternating least squares algorithm is utilized. These algorithms based on the least squares estimation may require many iterations in their application to very large data sets and variable selection problems and may take a long time to converge. In this paper, we derive a new iterative algorithm for accelerating the convergence of PRINCIPALS and PRINCALS by using the vector ε algorithm of Wynn (1962). The proposed acceleration algorithm speeds up the convergence of the sequence of the parameter estimates obtained from PRINCIPALS or PRINCALS. Numerical experiments illustrate the potential of the proposed acceleration algorithm.

    Original languageEnglish
    Pages (from-to)143-153
    Number of pages11
    JournalComputational Statistics and Data Analysis
    Volume55
    Issue number1
    DOIs
    Publication statusPublished - Jan 1 2011

    Keywords

    • Acceleration of convergence
    • Alternating least squares algorithm
    • PRINCALS
    • PRINCIPALS
    • Vector ε algorithm

    ASJC Scopus subject areas

    • Statistics and Probability
    • Computational Mathematics
    • Computational Theory and Mathematics
    • Applied Mathematics

    Fingerprint

    Dive into the research topics of 'Acceleration of the alternating least squares algorithm for principal components analysis'. Together they form a unique fingerprint.

    Cite this