Maximum Likelihood Estimation of Hierarchical Linear Models from Incomplete Data: Random Coefficients, Statistical Interactions, and Measurement Error

• Published in: Journal of computational and graphical statistics Vol. 33; no. 1; pp. 112 - 125
• Main Authors: Shin, Yongyun, Raudenbush, Stephen W.
• Format: Journal Article
• Language: English
• Published: Alexandria Taylor & Francis 02.01.2024; Taylor & Francis Ltd
• Subjects: Adaptive Gauss Hermite quadrature; Bayesian analysis; Compatibility; Error analysis; Hermite polynomials; Mathematical models; Maximum likelihood estimation; Missing at random; Normal distribution; Provisionally known random effects; Quadratures; Random variables; Samplers; Statistical analysis; The EM algorithm
• ISSN: 1061-8600; 1537-2715
• DOI: 10.1080/10618600.2023.2234414

We consider two-level models where a continuous response R and continuous covariates C are assumed missing at random. Inferences based on maximum likelihood or Bayes are routinely made by estimating their joint normal distribution from observed data R obs and C obs . However, if the model for R given C includes random coefficients, interactions, or polynomial terms, their joint distribution will be nonstandard. We propose a family of unique factorizations involving selected "provisionally known random effects" u such that h ( R obs , C obs | u ) is normally distributed and u is a low-dimensional normal random vector; we approximate h ( R obs , C obs ) = ∫ h ( R obs , C obs | u ) g ( u ) du via adaptive Gauss-Hermite quadrature. For polynomial models, the approximation is exact but, in any case, can be made as accurate as required given sufficient computation time. The model incorporates random effects as explanatory variables, reducing bias due to measurement error. By construction, our factorizations solve problems of compatibility among fully conditional distributions that have arisen in Bayesian imputation based on the Gibbs Sampler. We spell out general rules for selecting u, and show that our factorizations can support fully compatible Bayesian methods of imputation using the Gibbs Sampler. Supplementary materials for this article are available online.