Development and validation of multivariable machine learning algorithms to predict risk of cancer in symptomatic patients referred urgently from primary care: a diagnostic accuracy study

• Published in: BMJ open Vol. 12; no. 4; p. e053590
• Main Authors: Savage, Richard, Messenger, Mike, Neal, Richard D, Ferguson, Rosie, Johnston, Colin, Lloyd, Katherine L, Neal, Matthew D, Sansom, Nigel, Selby, Peter, Sharma, Nisha, Shinkins, Bethany, Skinner, Jim R, Tully, Giles, Duffy, Sean, Hall, Geoff
• Format: Journal Article
• Language: English
• Published: England British Medical Journal Publishing Group 01.04.2022; BMJ Publishing Group LTD; BMJ Publishing Group
• Series: Original research
• Subjects: Adult; Algorithms; Biochemistry; Cancer; Coronaviruses; COVID-19; Datasets; health informatics; Humans; Laboratories; Machine Learning; Medical diagnosis; Middle Aged; Neoplasms - diagnosis; Neoplasms - epidemiology; Oncology; Pathology; Patients; Primary care; Primary Health Care; Referral and Consultation; Retrospective Studies; statistics & research methods; United Kingdom > UK; England; statistics & research methods; health informatics; oncology
• ISSN: 2044-6055; 2044-6055
• DOI: 10.1136/bmjopen-2021-053590

ObjectivesTo develop and validate tests to assess the risk of any cancer for patients referred to the NHS Urgent Suspected Cancer (2-week wait, 2WW) clinical pathways.SettingPrimary and secondary care, one participating regional centre.ParticipantsRetrospective analysis of data from 371 799 consecutive 2WW referrals in the Leeds region from 2011 to 2019. The development cohort was composed of 224 669 consecutive patients with an urgent suspected cancer referral in Leeds between January 2011 and December 2016. The diagnostic algorithms developed were then externally validated on a similar consecutive sample of 147 130 patients (between January 2017 and December 2019). All such patients over the age of 18 with a minimum set of blood counts and biochemistry measurements available were included in the cohort.Primary and secondary outcome measuressensitivity, specificity, negative predictive value, positive predictive value, Receiver Operating Characteristic (ROC) curve Area Under Curve (AUC), calibration curvesResultsWe present results for two clinical use-cases. In use-case 1, the algorithms identify 20% of patients who do not have cancer and may not need an urgent 2WW referral. In use-case 2, they identify 90% of cancer cases with a high probability of cancer that could be prioritised for review.ConclusionsCombining a panel of widely available blood markers produces effective blood tests for cancer for NHS 2WW patients. The tests are affordable, and can be deployed rapidly to any NHS pathology laboratory with no additional hardware requirements.