Comparing single-level and multilevel regression analysis for risk adjustment of treatment outcomes in common mental health disorders

Lisanne Warmerdam, Edwin de Beurs, Marko Barendregt, Jos Twisk

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Aim: The aim of this paper is to compare single-level and multilevel regression analysis to obtain risk-adjusted outcomes from mental health care providers. Subject and methods: The study population consisted of adult patients receiving treatment for common mental health disorders. The outcome was self-reported symptom level at post-test. Risk adjustment models were developed using single- and multilevel regression analysis. In the multilevel approach, a random intercept for each provider was included. The intraclass correlation coefficient was used to estimate the proportion of variability in treatment outcome between providers. Spearman correlation coefficient of ranks was used to compare results between the two approaches. Results: The effects of most casemix variables on outcomes were similar for the two models. The ranking of providers in both methods was also quite similar (ρ =.99). The multilevel model estimated that 5.4% of total variability in adjusted post-test scores was explained by the provider factor. Conclusions: The findings of risk adjustment of mental health outcomes are quite robust for the use of single-level or multilevel regression analysis in the current study. However, given the small but significant amount of variation in outcomes that is attributable to providers, the multilevel approach is recommended for dealing with outcomes when patients are clustered within providers.

Original languageEnglish
Pages (from-to)29-35
Number of pages7
JournalJournal of Public Health (Germany)
Volume27
Issue number1
Early online date24 Apr 2018
DOIs
Publication statusPublished - 6 Feb 2019

Fingerprint

Risk Adjustment
Multilevel Analysis
Mental Disorders
Mental Health
Regression Analysis
Nonparametric Statistics
Health Personnel
Population
Therapeutics

Keywords

  • Mental health care
  • Multilevel analysis
  • Outcomes
  • Risk adjustment

Cite this

Warmerdam, Lisanne ; de Beurs, Edwin ; Barendregt, Marko ; Twisk, Jos. / Comparing single-level and multilevel regression analysis for risk adjustment of treatment outcomes in common mental health disorders. In: Journal of Public Health (Germany). 2019 ; Vol. 27, No. 1. pp. 29-35.
@article{3887cf4ffe754d4e952e0de3b56f281e,
title = "Comparing single-level and multilevel regression analysis for risk adjustment of treatment outcomes in common mental health disorders",
abstract = "Aim: The aim of this paper is to compare single-level and multilevel regression analysis to obtain risk-adjusted outcomes from mental health care providers. Subject and methods: The study population consisted of adult patients receiving treatment for common mental health disorders. The outcome was self-reported symptom level at post-test. Risk adjustment models were developed using single- and multilevel regression analysis. In the multilevel approach, a random intercept for each provider was included. The intraclass correlation coefficient was used to estimate the proportion of variability in treatment outcome between providers. Spearman correlation coefficient of ranks was used to compare results between the two approaches. Results: The effects of most casemix variables on outcomes were similar for the two models. The ranking of providers in both methods was also quite similar (ρ =.99). The multilevel model estimated that 5.4{\%} of total variability in adjusted post-test scores was explained by the provider factor. Conclusions: The findings of risk adjustment of mental health outcomes are quite robust for the use of single-level or multilevel regression analysis in the current study. However, given the small but significant amount of variation in outcomes that is attributable to providers, the multilevel approach is recommended for dealing with outcomes when patients are clustered within providers.",
keywords = "Mental health care, Multilevel analysis, Outcomes, Risk adjustment",
author = "Lisanne Warmerdam and {de Beurs}, Edwin and Marko Barendregt and Jos Twisk",
year = "2019",
month = "2",
day = "6",
doi = "10.1007/s10389-018-0921-9",
language = "English",
volume = "27",
pages = "29--35",
journal = "Journal of Public Health (Germany)",
issn = "0943-1853",
publisher = "Springer",
number = "1",

}

Comparing single-level and multilevel regression analysis for risk adjustment of treatment outcomes in common mental health disorders. / Warmerdam, Lisanne; de Beurs, Edwin; Barendregt, Marko; Twisk, Jos.

In: Journal of Public Health (Germany), Vol. 27, No. 1, 06.02.2019, p. 29-35.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - Comparing single-level and multilevel regression analysis for risk adjustment of treatment outcomes in common mental health disorders

AU - Warmerdam, Lisanne

AU - de Beurs, Edwin

AU - Barendregt, Marko

AU - Twisk, Jos

PY - 2019/2/6

Y1 - 2019/2/6

N2 - Aim: The aim of this paper is to compare single-level and multilevel regression analysis to obtain risk-adjusted outcomes from mental health care providers. Subject and methods: The study population consisted of adult patients receiving treatment for common mental health disorders. The outcome was self-reported symptom level at post-test. Risk adjustment models were developed using single- and multilevel regression analysis. In the multilevel approach, a random intercept for each provider was included. The intraclass correlation coefficient was used to estimate the proportion of variability in treatment outcome between providers. Spearman correlation coefficient of ranks was used to compare results between the two approaches. Results: The effects of most casemix variables on outcomes were similar for the two models. The ranking of providers in both methods was also quite similar (ρ =.99). The multilevel model estimated that 5.4% of total variability in adjusted post-test scores was explained by the provider factor. Conclusions: The findings of risk adjustment of mental health outcomes are quite robust for the use of single-level or multilevel regression analysis in the current study. However, given the small but significant amount of variation in outcomes that is attributable to providers, the multilevel approach is recommended for dealing with outcomes when patients are clustered within providers.

AB - Aim: The aim of this paper is to compare single-level and multilevel regression analysis to obtain risk-adjusted outcomes from mental health care providers. Subject and methods: The study population consisted of adult patients receiving treatment for common mental health disorders. The outcome was self-reported symptom level at post-test. Risk adjustment models were developed using single- and multilevel regression analysis. In the multilevel approach, a random intercept for each provider was included. The intraclass correlation coefficient was used to estimate the proportion of variability in treatment outcome between providers. Spearman correlation coefficient of ranks was used to compare results between the two approaches. Results: The effects of most casemix variables on outcomes were similar for the two models. The ranking of providers in both methods was also quite similar (ρ =.99). The multilevel model estimated that 5.4% of total variability in adjusted post-test scores was explained by the provider factor. Conclusions: The findings of risk adjustment of mental health outcomes are quite robust for the use of single-level or multilevel regression analysis in the current study. However, given the small but significant amount of variation in outcomes that is attributable to providers, the multilevel approach is recommended for dealing with outcomes when patients are clustered within providers.

KW - Mental health care

KW - Multilevel analysis

KW - Outcomes

KW - Risk adjustment

UR - http://www.scopus.com/inward/record.url?scp=85061049598&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85061049598&partnerID=8YFLogxK

U2 - 10.1007/s10389-018-0921-9

DO - 10.1007/s10389-018-0921-9

M3 - Article

VL - 27

SP - 29

EP - 35

JO - Journal of Public Health (Germany)

JF - Journal of Public Health (Germany)

SN - 0943-1853

IS - 1

ER -