Nonparametric bootstrap methods for interval estimation of the area under the ROC curve with correlated diagnostic test data: application to whole-virus ELISA testing in swine

• Published in: Frontiers in veterinary science Vol. 10; p. 1274786
• Main Authors: Pang, Jinji, Ju, Wangqian, Welch, Michael, Gauger, Phillip, Liu, Peng, Zhang, Qijing, Wang, Chong
• Format: Journal Article
• Language: English
• Published: Switzerland Frontiers Media S.A 05.12.2023
• Subjects: area under the curve (AUC); cluster bootstrapping; correlated data analysis; diagnostic test; hierarchical bootstrapping; receiver operating characteristic (ROC) curve; Veterinary Science; area under the curve (AUC); cluster bootstrapping; hierarchical bootstrapping; correlated data analysis; diagnostic test; receiver operating characteristic (ROC) curve
• ISSN: 2297-1769; 2297-1769
• DOI: 10.3389/fvets.2023.1274786

Developing and evaluating novel diagnostic assays are crucial components of contemporary diagnostic research. The receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC) are frequently used to evaluate diagnostic assays’ performance. The variation in AUC estimation can be quantified nonparametrically using resampling methods, such as bootstrapping, and then used to construct interval estimation for the AUC. When multiple observations are observed from the same subject, which is very common in veterinary diagnostic tests evaluation experiments, a traditional bootstrap-based method can fail to provide valid interval estimations of AUC. In particular, the traditional method does not account for the correlation among data observations and could result in interval estimation that fails to cover the true AUC adequately at the desired confidence level. In this paper, we proposed two novel methods to calculate the confidence interval of the AUC for correlated diagnostic test data based on cluster bootstrapping and hierarchical bootstrapping, respectively. Our simulation studies showed that both proposed methods had adequate coverage probabilities which were higher than the existing traditional method when there were intra-subject correlations. We also discussed applying the proposed methods to evaluate a novel whole-virus ELISA (wv-ELISA) diagnostic assay in detecting porcine parainfluenza virus type-1 antibodies in swine serum.