TY - JOUR
T1 - The overestimation of the effect sizes of psychotherapies for depression in waitlist controlled trials
T2 - a meta-analytic comparison with usual care controlled trials
AU - Cuijpers, Pim
AU - Miguel, Clara
AU - Harrer, Mathias
AU - Ciharova, Marketa
AU - Karyotaki, Eirini
N1 - Publisher Copyright:
© The Author(s), 2024.
PY - 2024
Y1 - 2024
N2 - Aims. There is considerable evidence that waiting list (WL) control groups overestimate the effect sizes of psychotherapies for depression. It is not clear, however, what are the exact causes for this overestimation. We decided to conduct a meta-analytic study to compare trials on psychotherapy for depression with a WL control group against trials with a care-as-usual (CAU) control group. Methods. We used an existing meta-analytic database of randomized trials comparing psychological treatments of adult depression with control groups and selected trials using a WL or a CAU control group. We used subgroup and meta-regression analyses to examine differences in effect sizes between WL and CAU controlled trials. Results. We included 333 randomized controlled trials (472 comparisons; total number participants: 41,480), 141 with a WL and 195 with a CAU control group (3 included both). We found several significant differences between WL and CAU controlled trials (in type of therapy examined, treatment format, recency, target group, recruitment strategy, number of treatment arms and number of depression outcome measures). The overall effect size indicating the difference between treatment and control at post-test for all comparisons was g = 0.77 (95% confidence interval [CI]: 0.71; 0.84) with high heterogeneity (I2 = 84; 95% CI: 82; 85). A highly significant difference was observed between studies with a CAU control group (g = 0.63; 95% CI: 0.55; 0.71; I2 = 85; 95% CI: 83; 86) and studies with a WL (g = 0.95; 95% CI: 0.85; 1.04; I2 = 80; 95% CI: 78; 82; p for difference < 0.001). This difference remained significant in all sensitivity analyses, including a meta-regression analysis in which we adjusted for all differences in characteristics of studies with a WL versus CAU control group. We also found that pre-post effect sizes in WL control conditions (g = 0.37; 95% CI: 0.28; 0.46) were significantly smaller than change within CAU conditions (g = 0.64; 95% CI: 0.50; 0.78). We found few indications that pre-post effect sizes within therapy conditions differed between WL and CAU controlled trials. Conclusions. WL control conditions considerably overestimate the effect sizes of psychological treatments, compared to trials using CAU control conditions. This overestimation is probably caused by a smaller improvement within the WL condition compared to the improvement in the CAU condition. WL control conditions should be avoided in randomized trials examining psychological treatments of adult depression.
AB - Aims. There is considerable evidence that waiting list (WL) control groups overestimate the effect sizes of psychotherapies for depression. It is not clear, however, what are the exact causes for this overestimation. We decided to conduct a meta-analytic study to compare trials on psychotherapy for depression with a WL control group against trials with a care-as-usual (CAU) control group. Methods. We used an existing meta-analytic database of randomized trials comparing psychological treatments of adult depression with control groups and selected trials using a WL or a CAU control group. We used subgroup and meta-regression analyses to examine differences in effect sizes between WL and CAU controlled trials. Results. We included 333 randomized controlled trials (472 comparisons; total number participants: 41,480), 141 with a WL and 195 with a CAU control group (3 included both). We found several significant differences between WL and CAU controlled trials (in type of therapy examined, treatment format, recency, target group, recruitment strategy, number of treatment arms and number of depression outcome measures). The overall effect size indicating the difference between treatment and control at post-test for all comparisons was g = 0.77 (95% confidence interval [CI]: 0.71; 0.84) with high heterogeneity (I2 = 84; 95% CI: 82; 85). A highly significant difference was observed between studies with a CAU control group (g = 0.63; 95% CI: 0.55; 0.71; I2 = 85; 95% CI: 83; 86) and studies with a WL (g = 0.95; 95% CI: 0.85; 1.04; I2 = 80; 95% CI: 78; 82; p for difference < 0.001). This difference remained significant in all sensitivity analyses, including a meta-regression analysis in which we adjusted for all differences in characteristics of studies with a WL versus CAU control group. We also found that pre-post effect sizes in WL control conditions (g = 0.37; 95% CI: 0.28; 0.46) were significantly smaller than change within CAU conditions (g = 0.64; 95% CI: 0.50; 0.78). We found few indications that pre-post effect sizes within therapy conditions differed between WL and CAU controlled trials. Conclusions. WL control conditions considerably overestimate the effect sizes of psychological treatments, compared to trials using CAU control conditions. This overestimation is probably caused by a smaller improvement within the WL condition compared to the improvement in the CAU condition. WL control conditions should be avoided in randomized trials examining psychological treatments of adult depression.
KW - cognitive therapy
KW - depression
KW - randomized controlled trials
KW - systematic reviews
UR - http://www.scopus.com/inward/record.url?scp=85208602541&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85208602541&partnerID=8YFLogxK
U2 - 10.1017/S2045796024000611
DO - 10.1017/S2045796024000611
M3 - Article
C2 - 39501660
AN - SCOPUS:85208602541
SN - 2045-7960
VL - 33
SP - 1
EP - 10
JO - Epidemiology and Psychiatric Sciences
JF - Epidemiology and Psychiatric Sciences
M1 - e56
ER -