TY - JOUR
T1 - Impact of Survey Administration Mode on the Results of a Health-Related Discrete Choice Experiment
T2 - Online and Paper Comparison
AU - Determann, D.
AU - Lambooij, M.S.
AU - Steyerberg, E.W.
AU - de Bekker-Grob, E.W.
AU - de Wit, G.A.
PY - 2017/7/1
Y1 - 2017/7/1
N2 - © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR)Background Electronic data collection is increasingly being used for discrete choice experiments (DCEs). Objectives To study whether paper or electronic administration results in measurement effects. Methods Respondents were drawn from the same sample frame (an Internet panel) and completed a nearly identical DCE survey either online or on paper during the same period. A DCE on preferences for basic health insurance served as a case study. We used panel mixed logit models for the analysis. Results In total, 898 respondents completed the survey: 533 respondents completed the survey online, whereas 365 respondents returned the paper survey. There were no significant differences with respect to sociodemographic characteristics between the respondents in both samples. The median response time was shorter for the online sample than for the paper sample, and a smaller proportion of respondents from the online sample were satisfied with the number of choice sets. Although some willingness- to-pay estimates were higher for the online sample, the elicited preferences for basic health insurance characteristics were similar between both modes of administration. Conclusions We find no indication that online surveys yield inferior results compared with paper-based surveys, whereas the price per respondent is lower for online surveys. Researchers might want to include fewer choice sets per respondent when collecting DCE data online. Because our findings are based on a nonrandomized DCE that covers one health domain only, research in other domains is needed to support our findings.
AB - © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR)Background Electronic data collection is increasingly being used for discrete choice experiments (DCEs). Objectives To study whether paper or electronic administration results in measurement effects. Methods Respondents were drawn from the same sample frame (an Internet panel) and completed a nearly identical DCE survey either online or on paper during the same period. A DCE on preferences for basic health insurance served as a case study. We used panel mixed logit models for the analysis. Results In total, 898 respondents completed the survey: 533 respondents completed the survey online, whereas 365 respondents returned the paper survey. There were no significant differences with respect to sociodemographic characteristics between the respondents in both samples. The median response time was shorter for the online sample than for the paper sample, and a smaller proportion of respondents from the online sample were satisfied with the number of choice sets. Although some willingness- to-pay estimates were higher for the online sample, the elicited preferences for basic health insurance characteristics were similar between both modes of administration. Conclusions We find no indication that online surveys yield inferior results compared with paper-based surveys, whereas the price per respondent is lower for online surveys. Researchers might want to include fewer choice sets per respondent when collecting DCE data online. Because our findings are based on a nonrandomized DCE that covers one health domain only, research in other domains is needed to support our findings.
U2 - 10.1016/j.jval.2017.02.007
DO - 10.1016/j.jval.2017.02.007
M3 - Article
SN - 1098-3015
VL - 20
SP - 953
EP - 960
JO - Value in Health
JF - Value in Health
IS - 7
ER -