Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis
- PMID: 28529187
- DOI: 10.1016/j.jclinepi.2017.05.007
Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis
Abstract
Objective: To identify variations in outcomes and results across reports of randomized clinical trials (RCTs).
Study design and setting: Eligible RCTs examined gabapentin for neuropathic pain and quetiapine for bipolar depression, reported in public (e.g., journal articles) and nonpublic (e.g., clinical study reports) sources by 2015. We prespecified outcome domains. From each source, we collected "outcomes" (i.e., domain, measure, metric, method of aggregation, and time point); "treatment effect" (i.e., outcome plus the methods of analysis [e.g., how missing data were handled]); and results (i.e., numerical contrasts of treatment and comparison groups). We assessed whether results included sufficient information for meta-analysis.
Results: We found 21 gabapentin (68 public, 6 nonpublic reports) and seven quetiapine RCTs (46 public, 4 nonpublic reports). For four (gabapentin) and seven (quetiapine) prespecified outcome domains, RCTs reported 214 and 81 outcomes by varying four elements. RCTs assessed 605 and 188 treatment effects by varying the analysis of those outcomes. RCTs reported 1,230 and 661 meta-analyzable results, 305 (25%) and 109 (16%) in public reports.
Conclusion: RCTs included hundreds of outcomes and results; a small proportion were in public reports. Trialists and meta-analysts may cherry-pick what they report from multiple sources of RCT information.
Keywords: Clinical trials; Meta-analysis; Outcomes; Selective outcome reporting; Systematic reviews.
Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.
Similar articles
-
The Benefits and Challenges of Using Multiple Sources of Information about Clinical Trials [Internet].Washington (DC): Patient-Centered Outcomes Research Institute (PCORI); 2018 Mar. Washington (DC): Patient-Centered Outcomes Research Institute (PCORI); 2018 Mar. PMID: 37043591 Free Books & Documents. Review.
-
Harms are assessed inconsistently and reported inadequately part 1: systematic adverse events.J Clin Epidemiol. 2019 Sep;113:20-27. doi: 10.1016/j.jclinepi.2019.04.022. Epub 2019 May 2. J Clin Epidemiol. 2019. PMID: 31055175
-
Practical guidance for using multiple data sources in systematic reviews and meta-analyses (with examples from the MUDS study).Res Synth Methods. 2018 Mar;9(1):2-12. doi: 10.1002/jrsm.1277. Epub 2017 Dec 15. Res Synth Methods. 2018. PMID: 29057573 Free PMC article.
-
Cherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy.J Clin Epidemiol. 2017 Nov;91:95-110. doi: 10.1016/j.jclinepi.2017.07.014. Epub 2017 Aug 24. J Clin Epidemiol. 2017. PMID: 28842290 Review.
-
Integrating multiple data sources (MUDS) for meta-analysis to improve patient-centered outcomes research: a protocol.Syst Rev. 2015 Nov 2;4:143. doi: 10.1186/s13643-015-0134-z. Syst Rev. 2015. PMID: 26525044 Free PMC article.
Cited by
-
The methodological quality of systematic reviews regarding the Core Outcome Set (COS) development.BMC Med Res Methodol. 2024 Mar 11;24(1):65. doi: 10.1186/s12874-024-02182-w. BMC Med Res Methodol. 2024. PMID: 38468223 Free PMC article.
-
Primary outcome reporting in clinical trials for older adults with depression.BJPsych Open. 2024 Mar 7;10(2):e60. doi: 10.1192/bjo.2023.650. BJPsych Open. 2024. PMID: 38450491 Free PMC article. Review.
-
Efficacy and safety of Panax notoginseng saponins (Xuesaitong) for patients with acute ischemic stroke: a systematic review and meta-analysis of randomized controlled trials.Front Pharmacol. 2023 Oct 16;14:1280559. doi: 10.3389/fphar.2023.1280559. eCollection 2023. Front Pharmacol. 2023. PMID: 37908976 Free PMC article.
-
Artificial intelligence models in prediction of response to cardiac resynchronization therapy: a systematic review.Heart Fail Rev. 2024 Jan;29(1):133-150. doi: 10.1007/s10741-023-10357-8. Epub 2023 Oct 20. Heart Fail Rev. 2024. PMID: 37861853 Free PMC article. Review.
-
Effectiveness and safety of virtual reality rehabilitation after stroke: an overview of systematic reviews.EClinicalMedicine. 2023 Sep 14;64:102220. doi: 10.1016/j.eclinm.2023.102220. eCollection 2023 Oct. EClinicalMedicine. 2023. PMID: 37745019 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical