Only half of the authors of overviews of exercise-related interventions use some strategy to manage overlapping primary studies—a metaresearch study

• Published in: Journal of clinical epidemiology Vol. 170; p. 111328
• Main Authors: Gutierrez-Arias, Ruvistay, Pieper, Dawid, Lunny, Carole, Torres-Castro, Rodrigo, Aguilera-Eguía, Raúl, Oliveros, Maria-Jose, Seron, Pamela
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.06.2024; Elsevier Limited
• Subjects: Algorithms; Bibliometrics; Exercise; Exercise Therapy - methods; Exercise Therapy - statistics & numerical data; Humans; Intervention; Meta-analysis; Overlap; Overviews of systematic reviews; Physical fitness; Rehabilitation; Research Design; Review methods; Systematic review; Systematic Reviews as Topic - methods; Umbrella review; Exercise; Overlap; Rehabilitation; Review methods; Umbrella review; Overviews of systematic reviews
• ISSN: 0895-4356; 1878-5921; 1878-5921
• DOI: 10.1016/j.jclinepi.2024.111328

The conduct of systematic reviews (SRs) and overviews share several similarities. However, because the unit of analysis for overviews is the SRs, there are some unique challenges. One of the most critical issues to manage when conducting an overview is the overlap of data across the primary studies included in the SRs. This metaresearch study aimed to describe the frequency of strategies to manage the overlap in overviews of exercise-related interventions. A systematic search in MEDLINE (Ovid), Embase (Ovid), Cochrane Library, Epistemonikos, and other sources was conducted from inception to June 2022. We included overviews of SRs that considered primary studies and evaluated the effectiveness of exercise-related interventions for any health condition. The overviews were screened by two authors independently, and the extraction was performed by one author and checked by a second. We found 353 overviews published between 2005 and 2022 that met the inclusion criteria. One hundred and sixty-four overviews (46%) used at least one strategy to visualize, quantify, or resolve overlap, with a matrix (32/164; 20%), absolute frequency (34/164; 21%), and authors' algorithms (24/164; 15%) being the most used methods, respectively. From 2016 onwards, there has been a trend toward increasing the use of some strategies to manage overlap. Of the 108 overviews that used some strategy to resolve the overlap, ie, avoiding double or multiple counting of primary study data, 79 (73%) succeeded. In overviews where no strategies to manage overlap were reported (n = 189/353; 54%), 16 overview authors (8%) recognized this as a study limitation. Although there is a trend toward increasing its use, only half of the authors of the overviews of exercise-related interventions used a strategy to visualize, quantify, or resolve overlap in the primary studies’ data. In the future, authors should report such strategies to communicate more valid results. [Display omitted]