Assessing competencies of trainee sport psychologists: An examination of the 'Structured Case Presentation' assessment method

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Objectives: There is virtually no literature on how to assess competencies of applied sport psychologists. We assessed casework of applied sport psychology students and compared written case report assessment (WCRA) with structured case presentation assessment (SCPA) on reliability and acceptability (e.g., validity, transparency, feedback function and preference of methods, as perceived by students and assessors). Design: A quantitative, comparative study of two assessment methods. Method: Participants were 11 students, nine supervisors and three exam committee members. A number of 18 cases were evaluated with both WCRA by the supervisor and SCPA by two exam committee members. Ten of these cases were also evaluated with WCRA by exam committee members. Interrater reliability measures were calculated and compared for the different assessment methods. Participants' perception of the validity, transparency, and feedback function of the methods, and the preferences for assessment methods were surveyed with a brief questionnaire. Results: SCPA by the exam committee resulted in higher interrater reliability than WCRA by supervisor and exam committee. The feedback function of SCPA seemed superior to WCRA by either supervisor or exam committee. For assessment by the exam committee, the perceived validity and transparency of SCPA seemed higher than of WCRA. Students and exam committee had the highest preference for SCPA by supervisor and exam committee. Conclusions: Overall it can be concluded that, for assessment by the exam committee, structured case presentations provided a more reliable and acceptable method of assessment than written case reports only.
LanguageEnglish
Pages21-30
JournalPsychology of Sport and Exercise
Volume23
DOIs
Publication statusPublished - 2016

Fingerprint

Sports
Psychology
Committee Membership
Students
Applied Psychology

Cite this

@article{a46ae5fa276948cd9289f62e8eb22538,
title = "Assessing competencies of trainee sport psychologists: An examination of the 'Structured Case Presentation' assessment method",
abstract = "Objectives: There is virtually no literature on how to assess competencies of applied sport psychologists. We assessed casework of applied sport psychology students and compared written case report assessment (WCRA) with structured case presentation assessment (SCPA) on reliability and acceptability (e.g., validity, transparency, feedback function and preference of methods, as perceived by students and assessors). Design: A quantitative, comparative study of two assessment methods. Method: Participants were 11 students, nine supervisors and three exam committee members. A number of 18 cases were evaluated with both WCRA by the supervisor and SCPA by two exam committee members. Ten of these cases were also evaluated with WCRA by exam committee members. Interrater reliability measures were calculated and compared for the different assessment methods. Participants' perception of the validity, transparency, and feedback function of the methods, and the preferences for assessment methods were surveyed with a brief questionnaire. Results: SCPA by the exam committee resulted in higher interrater reliability than WCRA by supervisor and exam committee. The feedback function of SCPA seemed superior to WCRA by either supervisor or exam committee. For assessment by the exam committee, the perceived validity and transparency of SCPA seemed higher than of WCRA. Students and exam committee had the highest preference for SCPA by supervisor and exam committee. Conclusions: Overall it can be concluded that, for assessment by the exam committee, structured case presentations provided a more reliable and acceptable method of assessment than written case reports only.",
author = "R.I. Hutter and J.R. Pijpers and R.R.D. Oudejans",
year = "2016",
doi = "10.1016/j.psychsport.2015.10.006",
language = "English",
volume = "23",
pages = "21--30",
journal = "Psychology of Sport and Exercise",
issn = "1469-0292",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - Assessing competencies of trainee sport psychologists: An examination of the 'Structured Case Presentation' assessment method

AU - Hutter, R.I.

AU - Pijpers, J.R.

AU - Oudejans, R.R.D.

PY - 2016

Y1 - 2016

N2 - Objectives: There is virtually no literature on how to assess competencies of applied sport psychologists. We assessed casework of applied sport psychology students and compared written case report assessment (WCRA) with structured case presentation assessment (SCPA) on reliability and acceptability (e.g., validity, transparency, feedback function and preference of methods, as perceived by students and assessors). Design: A quantitative, comparative study of two assessment methods. Method: Participants were 11 students, nine supervisors and three exam committee members. A number of 18 cases were evaluated with both WCRA by the supervisor and SCPA by two exam committee members. Ten of these cases were also evaluated with WCRA by exam committee members. Interrater reliability measures were calculated and compared for the different assessment methods. Participants' perception of the validity, transparency, and feedback function of the methods, and the preferences for assessment methods were surveyed with a brief questionnaire. Results: SCPA by the exam committee resulted in higher interrater reliability than WCRA by supervisor and exam committee. The feedback function of SCPA seemed superior to WCRA by either supervisor or exam committee. For assessment by the exam committee, the perceived validity and transparency of SCPA seemed higher than of WCRA. Students and exam committee had the highest preference for SCPA by supervisor and exam committee. Conclusions: Overall it can be concluded that, for assessment by the exam committee, structured case presentations provided a more reliable and acceptable method of assessment than written case reports only.

AB - Objectives: There is virtually no literature on how to assess competencies of applied sport psychologists. We assessed casework of applied sport psychology students and compared written case report assessment (WCRA) with structured case presentation assessment (SCPA) on reliability and acceptability (e.g., validity, transparency, feedback function and preference of methods, as perceived by students and assessors). Design: A quantitative, comparative study of two assessment methods. Method: Participants were 11 students, nine supervisors and three exam committee members. A number of 18 cases were evaluated with both WCRA by the supervisor and SCPA by two exam committee members. Ten of these cases were also evaluated with WCRA by exam committee members. Interrater reliability measures were calculated and compared for the different assessment methods. Participants' perception of the validity, transparency, and feedback function of the methods, and the preferences for assessment methods were surveyed with a brief questionnaire. Results: SCPA by the exam committee resulted in higher interrater reliability than WCRA by supervisor and exam committee. The feedback function of SCPA seemed superior to WCRA by either supervisor or exam committee. For assessment by the exam committee, the perceived validity and transparency of SCPA seemed higher than of WCRA. Students and exam committee had the highest preference for SCPA by supervisor and exam committee. Conclusions: Overall it can be concluded that, for assessment by the exam committee, structured case presentations provided a more reliable and acceptable method of assessment than written case reports only.

U2 - 10.1016/j.psychsport.2015.10.006

DO - 10.1016/j.psychsport.2015.10.006

M3 - Article

VL - 23

SP - 21

EP - 30

JO - Psychology of Sport and Exercise

T2 - Psychology of Sport and Exercise

JF - Psychology of Sport and Exercise

SN - 1469-0292

ER -