Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials

Erika Obikane; Natsu Sasaki; Kotaro Imamura; Kyosuke Nozawa; Rajesh Vedanthan; Pim Cuijpers; Taichi Shimazu; Masamitsu Kamada; Norito Kawakami; Daisuke Nishi

doi:10.3390/ijerph192315792

Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials

Erika Obikane, Natsu Sasaki, Kotaro Imamura, Kyosuke Nozawa, Rajesh Vedanthan, Pim Cuijpers, Taichi Shimazu, Masamitsu Kamada, Norito Kawakami, Daisuke Nishi^*

^*Corresponding author for this work

Research output: Contribution to Journal › Article › Academic › peer-review

Abstract

Objectives: Measuring implementation outcomes for digital mental health interventions is essential for examining the effective delivery of these interventions. The “Implementation Outcome Scale of Digital Mental Health” (iOSDMH) has been validated and used in several trials. This study aimed to compare the iOSDMH for participants in six randomized controlled trials (RCTs) involving web-based interventions and to discuss the implications of the iOSDMH for improving the interventions. Additionally, this study examined the associations between iOSDMH scores and program completion rate (adherence). Methods: Variations in total scores and subscales of the iOSDMH were compared in six RCTs of digital mental health interventions conducted in Japan. The web-based intervention programs were based on cognitive behavioral therapy (2 programs), behavioral activation (1 program), acceptance and commitment (1 program), a combination of mindfulness, behavioral activation, and physical activity (1 program), and government guidelines for suicide prevention (1 program). Participants were full-time employees (2 programs), perinatal women (2 programs), working mothers with children (1 program), and students (1 program). The total score and subscale scores were tested using analysis of variance for between-group differences. Results: Total score and subscale scores of the iOSDMH among six trials showed a significant group difference, reflecting users’ perceptions of how each program was implemented, including aspects such as acceptability, appropriateness, feasibility, overall satisfaction, and harm. Subscale scores showed positive associations with completion rate, especially in terms of acceptability and satisfaction (R-squared = 0.93 and 0.89, respectively). Conclusions: The iOSDMH may be a useful tool for evaluating participants’ perceptions of features implemented in web-based interventions, which could contribute to improvements and further development of the intervention.

Original language	English
Article number	15792
Pages (from-to)	1-17
Number of pages	17
Journal	International Journal of Environmental Research and Public Health
Volume	19
Issue number	23
Early online date	27 Nov 2022
DOIs	https://doi.org/10.3390/ijerph192315792
Publication status	Published - Dec 2022

Bibliographical note

Funding Information:
Natsu Sasaki received personal fees from Medilio Inc. outside the submitted work. Norito Kawakami reports grants from SB AtWork Corp., Fujitsu Ltd., and TAK Ltd., personal fees from the Occupational Health Foundation, SB AtWork Corp., RIKEN, Japan Aerospace Exploration Agency (JAXA), Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center, and the Osaka Chamber of Commerce and Industry, all outside the submitted work. Daisuke Nishi received personal fees from Startia Inc., Enpower, Inc., MD.net, and Mitsubishi Heavy Industries Kobe Shipyard, all outside the submitted work. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication.

Funding Information:
This study was partially supported by the National Center Consortium in Implementation Science for Health Equity (N-EQUITY) funded by the Japan Health Research Promotion Bureau (JH) Research Fund (2019-(1)-4), and JH Project Fund (JHP2022-J-02).

Funding Information:
This work was supported by the Japan Society for the Promotion of Science under a Grant-in-Aid for Scientific Research (A) (19H01073 to DN).

Publisher Copyright:
© 2022 by the authors.

Funding

Natsu Sasaki received personal fees from Medilio Inc. outside the submitted work. Norito Kawakami reports grants from SB AtWork Corp., Fujitsu Ltd., and TAK Ltd., personal fees from the Occupational Health Foundation, SB AtWork Corp., RIKEN, Japan Aerospace Exploration Agency (JAXA), Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center, and the Osaka Chamber of Commerce and Industry, all outside the submitted work. Daisuke Nishi received personal fees from Startia Inc., Enpower, Inc., MD.net, and Mitsubishi Heavy Industries Kobe Shipyard, all outside the submitted work. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication. This study was partially supported by the National Center Consortium in Implementation Science for Health Equity (N-EQUITY) funded by the Japan Health Research Promotion Bureau (JH) Research Fund (2019-(1)-4), and JH Project Fund (JHP2022-J-02). This work was supported by the Japan Society for the Promotion of Science under a Grant-in-Aid for Scientific Research (A) (19H01073 to DN).

Funders	Funder number
Japan Aerospace Exploration Agency
TAK
Japan Dental Association
Osaka Chamber of Commerce and Industry
RIKEN
Fujitsu
Japan Society for the Promotion of Science	22H03463, 19H01073
Japan Health Research Promotion Bureau	JHP2022-J-02

Keywords

acceptability
appropriateness
feasibility
implementation outcomes
satisfaction

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.3390/ijerph192315792

Persistent URL (handle)

Persistent link

Cite this

Obikane, E., Sasaki, N., Imamura, K., Nozawa, K., Vedanthan, R., Cuijpers, P., Shimazu, T., Kamada, M., Kawakami, N., & Nishi, D. (2022). Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials. International Journal of Environmental Research and Public Health, 19(23), 1-17. Article 15792. https://doi.org/10.3390/ijerph192315792

@article{e6535319bf964f9a93b34c61f356e51f,

title = "Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials",

abstract = "Objectives: Measuring implementation outcomes for digital mental health interventions is essential for examining the effective delivery of these interventions. The “Implementation Outcome Scale of Digital Mental Health” (iOSDMH) has been validated and used in several trials. This study aimed to compare the iOSDMH for participants in six randomized controlled trials (RCTs) involving web-based interventions and to discuss the implications of the iOSDMH for improving the interventions. Additionally, this study examined the associations between iOSDMH scores and program completion rate (adherence). Methods: Variations in total scores and subscales of the iOSDMH were compared in six RCTs of digital mental health interventions conducted in Japan. The web-based intervention programs were based on cognitive behavioral therapy (2 programs), behavioral activation (1 program), acceptance and commitment (1 program), a combination of mindfulness, behavioral activation, and physical activity (1 program), and government guidelines for suicide prevention (1 program). Participants were full-time employees (2 programs), perinatal women (2 programs), working mothers with children (1 program), and students (1 program). The total score and subscale scores were tested using analysis of variance for between-group differences. Results: Total score and subscale scores of the iOSDMH among six trials showed a significant group difference, reflecting users{\textquoteright} perceptions of how each program was implemented, including aspects such as acceptability, appropriateness, feasibility, overall satisfaction, and harm. Subscale scores showed positive associations with completion rate, especially in terms of acceptability and satisfaction (R-squared = 0.93 and 0.89, respectively). Conclusions: The iOSDMH may be a useful tool for evaluating participants{\textquoteright} perceptions of features implemented in web-based interventions, which could contribute to improvements and further development of the intervention.",

keywords = "acceptability, appropriateness, feasibility, implementation outcomes, satisfaction",

author = "Erika Obikane and Natsu Sasaki and Kotaro Imamura and Kyosuke Nozawa and Rajesh Vedanthan and Pim Cuijpers and Taichi Shimazu and Masamitsu Kamada and Norito Kawakami and Daisuke Nishi",

note = "Funding Information: Natsu Sasaki received personal fees from Medilio Inc. outside the submitted work. Norito Kawakami reports grants from SB AtWork Corp., Fujitsu Ltd., and TAK Ltd., personal fees from the Occupational Health Foundation, SB AtWork Corp., RIKEN, Japan Aerospace Exploration Agency (JAXA), Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center, and the Osaka Chamber of Commerce and Industry, all outside the submitted work. Daisuke Nishi received personal fees from Startia Inc., Enpower, Inc., MD.net, and Mitsubishi Heavy Industries Kobe Shipyard, all outside the submitted work. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication. Funding Information: This study was partially supported by the National Center Consortium in Implementation Science for Health Equity (N-EQUITY) funded by the Japan Health Research Promotion Bureau (JH) Research Fund (2019-(1)-4), and JH Project Fund (JHP2022-J-02). Funding Information: This work was supported by the Japan Society for the Promotion of Science under a Grant-in-Aid for Scientific Research (A) (19H01073 to DN). Publisher Copyright: {\textcopyright} 2022 by the authors.",

year = "2022",

month = dec,

doi = "10.3390/ijerph192315792",

language = "English",

volume = "19",

pages = "1--17",

journal = "International Journal of Environmental Research and Public Health",

issn = "1661-7827",

publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",

number = "23",

}

Obikane, E, Sasaki, N, Imamura, K, Nozawa, K, Vedanthan, R, Cuijpers, P, Shimazu, T, Kamada, M, Kawakami, N & Nishi, D 2022, 'Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials', International Journal of Environmental Research and Public Health, vol. 19, no. 23, 15792, pp. 1-17. https://doi.org/10.3390/ijerph192315792

Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials. / Obikane, Erika; Sasaki, Natsu; Imamura, Kotaro et al.
In: International Journal of Environmental Research and Public Health, Vol. 19, No. 23, 15792, 12.2022, p. 1-17.

Research output: Contribution to Journal › Article › Academic › peer-review

TY - JOUR

T1 - Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH)

T2 - Experiences from Six Randomized Controlled Trials

AU - Obikane, Erika

AU - Sasaki, Natsu

AU - Imamura, Kotaro

AU - Nozawa, Kyosuke

AU - Vedanthan, Rajesh

AU - Cuijpers, Pim

AU - Shimazu, Taichi

AU - Kamada, Masamitsu

AU - Kawakami, Norito

AU - Nishi, Daisuke

N1 - Funding Information: Natsu Sasaki received personal fees from Medilio Inc. outside the submitted work. Norito Kawakami reports grants from SB AtWork Corp., Fujitsu Ltd., and TAK Ltd., personal fees from the Occupational Health Foundation, SB AtWork Corp., RIKEN, Japan Aerospace Exploration Agency (JAXA), Japan Dental Association, Sekisui Chemicals, Junpukai Health Care Center, and the Osaka Chamber of Commerce and Industry, all outside the submitted work. Daisuke Nishi received personal fees from Startia Inc., Enpower, Inc., MD.net, and Mitsubishi Heavy Industries Kobe Shipyard, all outside the submitted work. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication. Funding Information: This study was partially supported by the National Center Consortium in Implementation Science for Health Equity (N-EQUITY) funded by the Japan Health Research Promotion Bureau (JH) Research Fund (2019-(1)-4), and JH Project Fund (JHP2022-J-02). Funding Information: This work was supported by the Japan Society for the Promotion of Science under a Grant-in-Aid for Scientific Research (A) (19H01073 to DN). Publisher Copyright: © 2022 by the authors.

PY - 2022/12

Y1 - 2022/12

N2 - Objectives: Measuring implementation outcomes for digital mental health interventions is essential for examining the effective delivery of these interventions. The “Implementation Outcome Scale of Digital Mental Health” (iOSDMH) has been validated and used in several trials. This study aimed to compare the iOSDMH for participants in six randomized controlled trials (RCTs) involving web-based interventions and to discuss the implications of the iOSDMH for improving the interventions. Additionally, this study examined the associations between iOSDMH scores and program completion rate (adherence). Methods: Variations in total scores and subscales of the iOSDMH were compared in six RCTs of digital mental health interventions conducted in Japan. The web-based intervention programs were based on cognitive behavioral therapy (2 programs), behavioral activation (1 program), acceptance and commitment (1 program), a combination of mindfulness, behavioral activation, and physical activity (1 program), and government guidelines for suicide prevention (1 program). Participants were full-time employees (2 programs), perinatal women (2 programs), working mothers with children (1 program), and students (1 program). The total score and subscale scores were tested using analysis of variance for between-group differences. Results: Total score and subscale scores of the iOSDMH among six trials showed a significant group difference, reflecting users’ perceptions of how each program was implemented, including aspects such as acceptability, appropriateness, feasibility, overall satisfaction, and harm. Subscale scores showed positive associations with completion rate, especially in terms of acceptability and satisfaction (R-squared = 0.93 and 0.89, respectively). Conclusions: The iOSDMH may be a useful tool for evaluating participants’ perceptions of features implemented in web-based interventions, which could contribute to improvements and further development of the intervention.

AB - Objectives: Measuring implementation outcomes for digital mental health interventions is essential for examining the effective delivery of these interventions. The “Implementation Outcome Scale of Digital Mental Health” (iOSDMH) has been validated and used in several trials. This study aimed to compare the iOSDMH for participants in six randomized controlled trials (RCTs) involving web-based interventions and to discuss the implications of the iOSDMH for improving the interventions. Additionally, this study examined the associations between iOSDMH scores and program completion rate (adherence). Methods: Variations in total scores and subscales of the iOSDMH were compared in six RCTs of digital mental health interventions conducted in Japan. The web-based intervention programs were based on cognitive behavioral therapy (2 programs), behavioral activation (1 program), acceptance and commitment (1 program), a combination of mindfulness, behavioral activation, and physical activity (1 program), and government guidelines for suicide prevention (1 program). Participants were full-time employees (2 programs), perinatal women (2 programs), working mothers with children (1 program), and students (1 program). The total score and subscale scores were tested using analysis of variance for between-group differences. Results: Total score and subscale scores of the iOSDMH among six trials showed a significant group difference, reflecting users’ perceptions of how each program was implemented, including aspects such as acceptability, appropriateness, feasibility, overall satisfaction, and harm. Subscale scores showed positive associations with completion rate, especially in terms of acceptability and satisfaction (R-squared = 0.93 and 0.89, respectively). Conclusions: The iOSDMH may be a useful tool for evaluating participants’ perceptions of features implemented in web-based interventions, which could contribute to improvements and further development of the intervention.

KW - acceptability

KW - appropriateness

KW - feasibility

KW - implementation outcomes

KW - satisfaction

UR - http://www.scopus.com/inward/record.url?scp=85143677809&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85143677809&partnerID=8YFLogxK

U2 - 10.3390/ijerph192315792

DO - 10.3390/ijerph192315792

M3 - Article

C2 - 36497867

AN - SCOPUS:85143677809

SN - 1661-7827

VL - 19

SP - 1

EP - 17

JO - International Journal of Environmental Research and Public Health

JF - International Journal of Environmental Research and Public Health

IS - 23

M1 - 15792

ER -

Usefulness of Implementation Outcome Scales for Digital Mental Health (iOSDMH): Experiences from Six Randomized Controlled Trials

Abstract

Bibliographical note

Funding

Keywords

UN SDGs

Access to Document

Persistent URL (handle)

Other files and links

Fingerprint

Cite this