Estimation of an oblique structure via penalized likelihood factor analysis

Kei Hirose, Michio Yamamoto

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

The problem of sparse estimation via a lasso-type penalized likelihood procedure in a factor analysis model is considered. Typically, model estimation assumes that the common factors are orthogonal (i.e., uncorrelated). However, if the common factors are correlated, the lasso-type penalization method based on the orthogonal model frequently estimates an erroneous model. To overcome this problem, factor correlations are incorporated into the model. Together with parameters in the orthogonal model, these correlations are estimated by a maximum penalized likelihood procedure. Entire solutions are computed by the EM algorithm with a coordinate descent, enabling the application of a wide variety of convex and nonconvex penalties. The proposed method is applicable even when the number of variables exceeds that of observations. The effectiveness of the proposed strategy is evaluated by Monte Carlo simulations, and its utility is demonstrated through real data analysis.

Original languageEnglish
Pages (from-to)120-132
Number of pages13
JournalComputational Statistics and Data Analysis
Volume79
DOIs
Publication statusPublished - 2014
Externally publishedYes

    Fingerprint

Keywords

  • Nonconvex penalty
  • Oblique structure
  • Penalized likelihood factor analysis
  • Rotation technique

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computational Mathematics
  • Statistics and Probability
  • Applied Mathematics

Cite this