Power Calculations to Select Instruments for Clinical Trial Secondary Endpoints. A Case Study of Instrument Selection for Post-Traumatic Stress Symptoms in Subjects with Acute Respiratory Distress Syndrome

• Published in: Annals of the American Thoracic Society Vol. 14; no. 1; pp. 110 - 117
• Main Authors: Sjoding, Michael W., Schoenfeld, David A., Brown, Samuel M., Hough, Catherine L., Yealy, Donald M., Moss, Marc, Angus, Derek C., Iwashyna, Theodore J.
• Format: Journal Article
• Language: English
• Published: United States American Thoracic Society 01.01.2017
• Subjects: Atracurium - analogs & derivatives; Atracurium - therapeutic use; Critical Care; Humans; Neuromuscular Blockade - psychology; Neuromuscular Blockade - statistics & numerical data; Neuromuscular Blocking Agents - therapeutic use; Original Research; Outcome Assessment, Health Care; Randomized Controlled Trials as Topic; Respiration, Artificial - methods; Respiratory Distress Syndrome, Adult - psychology; Respiratory Distress Syndrome, Adult - therapy; Sample Size; Sensitivity and Specificity; Stress Disorders, Post-Traumatic - diagnosis; Stress Disorders, Post-Traumatic - epidemiology; Stress Disorders, Post-Traumatic - psychology; specificity; critical care outcomes; clinical trials; sensitivity; bias
• ISSN: 2329-6933; 2325-6621; 2325-6621
• DOI: 10.1513/AnnalsATS.201608-585OC

After the sample size of a randomized clinical trial (RCT) is set by the power requirement of its primary endpoint, investigators select secondary endpoints while unable to further adjust sample size. How the sensitivity and specificity of an instrument used to measure these outcomes, together with their expected underlying event rates, affect an RCT's power to measure significant differences in these outcomes is poorly understood. Motivated by the design of an RCT of neuromuscular blockade in acute respiratory distress syndrome, we examined how power to detect a difference in secondary endpoints varies with the sensitivity and specificity of the instrument used to measure such outcomes. We derived a general formula and Stata code for calculating an RCT's power to detect differences in binary outcomes when such outcomes are measured with imperfect sensitivity and specificity. The formula informed the choice of instrument for measuring post-traumatic stress-like symptoms in the Reevaluation of Systemic Early Neuromuscular Blockade RCT ( www.clinicaltrials.gov identifier NCT02509078). On the basis of published sensitivities and specificities, the Impact of Events Scale-Revised was predicted to measure a 36% symptom rate, whereas the Post-Traumatic Stress Symptoms instrument was predicted to measure a 23% rate, if the true underlying rate of post-traumatic stress symptoms were 25%. Despite its lower sensitivity, the briefer Post-Traumatic Stress Symptoms instrument provided superior power to detect a difference in rates between trial arms, owing to its higher specificity. Examining instruments' power to detect differences in outcomes may guide their selection when multiple instruments exist, each with different sensitivities and specificities.