Machine learning assessment of myocardial ischemia using angiography: Development and retrospective validation

• Published in: PLoS medicine Vol. 15; no. 11; p. e1002693
• Main Authors: Hae, Hyeonyong, Kang, Soo-Jin, Kim, Won-Jang, Choi, So-Yeon, Lee, June-Goo, Bae, Youngoh, Cho, Hyungjoo, Yang, Dong Hyun, Kang, Joon-Won, Lim, Tae-Hwan, Lee, Cheol Hyun, Kang, Do-Yoon, Lee, Pil Hyung, Ahn, Jung-Min, Park, Duk-Woo, Lee, Seung-Whan, Kim, Young-Hak, Lee, Cheol Whan, Park, Seong-Wook, Park, Seung-Jung
• Format: Journal Article
• Language: English
• Published: United States Public Library of Science 13.11.2018; Public Library of Science (PLoS)
• Subjects: Accuracy; Algorithms; Angina; Angina pectoris; Angiography; Artificial intelligence; Biology and Life Sciences; Calibration; Cardiology; Cardiovascular disease; CAT scans; Computed tomography; Computer and Information Sciences; Coronary artery; Coronary vessels; Diagnosis; Diagnostic imaging; Educational assessment; Flow velocity; Health care facilities; Ischemia; Learning algorithms; Lesions; Machine learning; Medical imaging; Medical instruments; Medical research; Medicine; Medicine and Health Sciences; Minority & ethnic groups; Myocardial ischemia; Patients; Physical Sciences; Prediction models; Research and Analysis Methods; Risk factors; Segmentation; Software; Stenosis; Stents; Territory; Tomography; Ultrasonic imaging
• ISSN: 1549-1676; 1549-1277; 1549-1676
• DOI: 10.1371/journal.pmed.1002693

Invasive fractional flow reserve (FFR) is a standard tool for identifying ischemia-producing coronary stenosis. However, in clinical practice, over 70% of treatment decisions still rely on visual estimation of angiographic stenosis, which has limited accuracy (about 60%-65%) for the prediction of FFR < 0.80. One of the reasons for the visual-functional mismatch is that myocardial ischemia can be affected by the supplied myocardial size, which is not always evident by coronary angiography. The aims of this study were to develop an angiography-based machine learning (ML) algorithm for predicting the supplied myocardial volume for a stenosis, as measured using coronary computed tomography angiography (CCTA), and then to build an angiography-based classifier for the lesions with an FFR < 0.80 versus ≥ 0.80. A retrospective study was conducted using data from 1,132 stable and unstable angina patients with 1,132 intermediate lesions who underwent invasive coronary angiography, FFR, and CCTA at the Asan Medical Center, Seoul, Korea, between 1 May 2012 and 30 November 2015. The mean age was 63 ± 10 years, 76% were men, and 72% of the patients presented with stable angina. Of these, 932 patients (assessed before 31 January 2015) constituted the training set for the algorithm, and 200 patients (assessed after 1 February 2015) served as a test cohort to validate its diagnostic performance. Additionally, external validation with 79 patients from two centers (CHA University, Seongnam, Korea, and Ajou University, Suwon, Korea) was conducted. After automatic contour calibration using the caliber of guiding catheter, quantitative coronary angiography was performed using the edge-detection algorithms (CAAS-5, Pie-Medical). Clinical information was provided by the Asan BiomedicaL Research Environment (ABLE) system. The CCTA-based myocardial segmentation (CAMS)-derived myocardial volume supplied by each vessel (right coronary artery [RCA], left anterior descending [LAD], left circumflex [LCX]) and the myocardial volume subtended to a stenotic segment (CAMS-%Vsub) were measured for labeling. The ML for (1) predicting vessel territories (CAMS-%LAD, CAMS-%LCX, and CAMS-%RCA) and CAMS-%Vsub and (2) identifying the lesions with an FFR < 0.80 was constructed. Angiography-based ML, employing a light gradient boosting machine (GBM), showed mean absolute errors (MAEs) of 5.42%, 8.57%, and 4.54% for predicting CAMS-%LAD, CAMS-%LCX, and CAMS-%RCA, respectively. The percent myocardial volumes predicted by ML were used to predict the CAMS-%Vsub. With 5-fold cross validation, the MAEs between ML-predicted percent myocardial volume subtended to a stenotic segment (ML-%Vsub) and CAMS-%Vsub were minimized by the elastic net (6.26% ± 0.55% for LAD, 5.79% ± 0.68% for LCX, and 2.95% ± 0.14% for RCA lesions). Using all attributes (age, sex, involved vessel segment, and angiographic features affecting the myocardial territory and stenosis degree), the ML classifiers (L2 penalized logistic regression, support vector machine, and random forest) predicted an FFR < 0.80 with an accuracy of approximately 80% (area under the curve [AUC] = 0.84-0.87, 95% confidence intervals 0.71-0.94) in the test set, which was greater than that of diameter stenosis (DS) > 53% (66%, AUC = 0.71, 95% confidence intervals 0.65-0.78). The external validation showed 84% accuracy (AUC = 0.89, 95% confidence intervals 0.83-0.95). The retrospective design, single ethnicity, and the lack of clinical outcomes may limit this prediction model's generalized application. We found that angiography-based ML is useful to predict subtended myocardial territories and ischemia-producing lesions by mitigating the visual-functional mismatch between angiographic and FFR. Assessment of clinical utility requires further validation in a large, prospective cohort study.