Using cognitive pretesting to explore causes for ethnic differences on role-plays

J.K. Oostrom, M.P. Born

    Research output: Contribution to JournalArticleAcademicpeer-review

    Abstract

    This study used cognitive pretesting to assess what factors could be causing score differences between ethnic majority and ethnic minority applicants on role-plays. In a laboratory room, equipped with a video camera, cognitive interviews were conducted among 12 ethnic majority and 12 ethnic minority students to examine ethnic differences in the interpretation of the instructional texts of two role-plays. Four trained assessors independently rated the participants' videotaped responses. The assessors were asked to indicate whether the participants had understood the instructional text in general, the intended meaning of specific words or phrases, the problem, the job role, and the context of the situation. Ethnic differences were found for almost all of these aspects of the instructional texts (d-values varied between -0.02 and 0.89), indicating that the texts often did not activate the same concepts in the ethnic minority group as in the ethnic majority group. Ethnic differences in verbal ability explained only part of the ethnic differences in the interpretation of the instruction of the role-plays. Cognitive pretesting seems to be a valuable method to assess differences between ethnic majority and ethnic minority applicants in how they interpret test items and instructional texts. © 2014 Elsevier Ltd.
    Original languageEnglish
    Pages (from-to)138-149
    JournalInternational Journal of Intercultural Relations
    Volume41
    DOIs
    Publication statusPublished - 2014

    Bibliographical note

    PT: J; NR: 51; TC: 0; J9: INT J INTERCULT REL; PG: 12; GA: AN6GH; UT: WOS:000340692500012

    Fingerprint Dive into the research topics of 'Using cognitive pretesting to explore causes for ethnic differences on role-plays'. Together they form a unique fingerprint.

    Cite this