Model‐based clustering of high‐dimensional longitudinal data via regularization

• Published in: Biometrics Vol. 79; no. 2; pp. 761 - 774
• Main Authors: Yang, Luoying, Wu, Tong Tong
• Format: Journal Article
• Language: English
• Published: United States Blackwell Publishing Ltd 01.06.2023
• Subjects: adolescence; Adolescent; Adolescents; Adult; adulthood; Algorithms; Bayes Theorem; Bayesian analysis; Bayesian theory; Cluster Analysis; Clustering; exponentially growing number of variables; Female; Humans; linear mixed‐effects models; Linear Models; Longitudinal studies; Mathematical models; Multivariate analysis; nonconcave penalty functions; Normal Distribution; Optimization; Parameter estimation; Penalty function; Physical activity; Regularization; sample size; simultaneous effects selection; nonconcave penalty functions; simultaneous effects selection; linear mixed-effects models; exponentially growing number of variables
• ISSN: 0006-341X; 1541-0420; 1541-0420
• DOI: 10.1111/biom.13672

We propose a model‐based clustering method for high‐dimensional longitudinal data via regularization in this paper. This study was motivated by the Trial of Activity in Adolescent Girls (TAAG), which aimed to examine multilevel factors related to the change of physical activity by following up a cohort of 783 girls over 10 years from adolescence to early adulthood. Our goal is to identify the intrinsic grouping of subjects with similar patterns of physical activity trajectories and the most relevant predictors within each group. The previous analyses conducted clustering and variable selection in two steps, while our new method can perform the tasks simultaneously. Within each cluster, a linear mixed‐effects model (LMM) is fitted with a doubly penalized likelihood to induce sparsity for parameter estimation and effect selection. The large‐sample joint properties are established, allowing the dimensions of both fixed and random effects to increase at an exponential rate of the sample size, with a general class of penalty functions. Assuming subjects are drawn from a Gaussian mixture distribution, model effects and cluster labels are estimated via a coordinate descent algorithm nested inside the Expectation‐Maximization (EM) algorithm. Bayesian Information Criterion (BIC) is used to determine the optimal number of clusters and the values of tuning parameters. Our numerical studies show that the new method has satisfactory performance and is able to accommodate complex data with multilevel and/or longitudinal effects.