Exploring Estimation Procedures for Reducing Dimensionality in Psychological Network Modeling

• Published in: Multivariate behavioral research Vol. 60; no. 2; pp. 184 - 210
• Main Authors: Shi, Dingjing, Christensen, Alexander P., Day, Eric Anthony, Golino, Hudson F., Garrido, Luis Eduardo
• Format: Journal Article
• Language: English
• Published: United States Routledge 04.03.2025; Taylor & Francis Ltd
• Subjects: Accuracy; Algorithms; Bayes Theorem; Bayesian analysis; Bayesian estimation; community detection algorithm; Computer Simulation; dimensionality assessment; Errors; Estimation; estimation procedures; Humans; Hypothesis testing; Modelling; Models, Psychological; Models, Statistical; Monte Carlo Method; Monte Carlo simulation; Network psychometrics; Psychometrics; Psychometrics - methods; Regularization; Sampling methods; estimation procedures; dimensionality assessment; community detection algorithm; Bayesian estimation; Network psychometrics
• ISSN: 0027-3171; 1532-7906; 1532-7906
• DOI: 10.1080/00273171.2024.2395941

To understand psychological data, it is crucial to examine the structure and dimensions of variables. In this study, we examined alternative estimation algorithms to the conventional GLASSO-based exploratory graph analysis (EGA) in network psychometric models to assess the dimensionality structure of the data. The study applied Bayesian conjugate or Jeffreys' priors to estimate the graphical structure and then used the Louvain community detection algorithm to partition and identify groups of nodes, which allowed the detection of the multi- and unidimensional factor structures. Monte Carlo simulations suggested that the two alternative Bayesian estimation algorithms had comparable or better performance when compared with the GLASSO-based EGA and conventional parallel analysis (PA). When estimating the multidimensional factor structure, the analytically based method (i.e., EGA.analytical) showed the best balance between accuracy and mean biased/absolute errors, with the highest accuracy tied with EGA but with the smallest errors. The sampling-based approach (EGA.sampling) yielded higher accuracy and smaller errors than PA; lower accuracy but also lower errors than EGA. Techniques from the two algorithms had more stable performance than EGA and PA across different data conditions. When estimating the unidimensional structure, the PA technique performed the best, followed closely by EGA, and then EGA.analytical and EGA.sampling. Furthermore, the study explored four full Bayesian techniques to assess dimensionality in network psychometrics. The results demonstrated superior performance when using Bayesian hypothesis testing or deriving posterior samples of graph structures under small sample sizes. The study recommends using the EGA.analytical technique as an alternative tool for assessing dimensionality and advocates for the usefulness of the EGA.sampling method as a valuable alternate technique. The findings also indicated encouraging results for extending the regularization-based network modeling EGA method to the Bayesian framework and discussed future directions in this line of work. The study illustrated the practical application of the techniques to two empirical examples in R.