A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items

S. Draaijer; S. Klinkenberg

doi:10.1007/978-3-319-27704-2_6

A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items

S. Draaijer, S. Klinkenberg

Educational Sciences

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

184 Downloads (Pure)

Abstract

A procedure to construct valid and fair fixed-length tests with randomly drawn items from an item bank is described. The procedure provides guidelines for the set-up of a typical achievement test with regard to the number of items in the bank and the number of items for each position in a test. Further, a procedure is proposed to calculate the relative difficulty for individual tests and to correct the obtained score for each student based on the mean difficulty for all students and the particular test of a student. Also, two procedures are proposed for the problem to calculate the reliability of tests with randomly drawn items. The procedures use specific interpretations of regularly used methods to calculate Cronbach’s alpha and KR20 and the Spearman-Brown prediction formula. A simulation with R is presented to illustrate the accuracy of the calculation procedures and the effects on pass-fail decisions.

Original language	English
Title of host publication	Computer assisted assessment: research into e-assessment
Editors	E. Ras, D. Joosten-Ten Brinke
Publisher	Spinger
Pages	47-60
DOIs	https://doi.org/10.1007/978-3-319-27704-2_6
Publication status	Published - 2015
Event	Computer assisted assessment: research into e-assessment - Duration: 1 Jan 2015 → 1 Jan 2015

Conference

Conference	Computer assisted assessment: research into e-assessment
Period	1/01/15 → 1/01/15

Access to Document

10.1007/978-3-319-27704-2_6

Draaijer and Klinkenberg - 2015 - A Practical Procedure for the Construction and RelFinal published version, 294 KB

Persistent URL (handle)

Copy link address

Cite this

@inproceedings{a8fe888c981c4b4d8c52c755f4850251,

title = "A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items",

abstract = "A procedure to construct valid and fair fixed-length tests with randomly drawn items from an item bank is described. The procedure provides guidelines for the set-up of a typical achievement test with regard to the number of items in the bank and the number of items for each position in a test. Further, a procedure is proposed to calculate the relative difficulty for individual tests and to correct the obtained score for each student based on the mean difficulty for all students and the particular test of a student. Also, two procedures are proposed for the problem to calculate the reliability of tests with randomly drawn items. The procedures use specific interpretations of regularly used methods to calculate Cronbach{\textquoteright}s alpha and KR20 and the Spearman-Brown prediction formula. A simulation with R is presented to illustrate the accuracy of the calculation procedures and the effects on pass-fail decisions.",

author = "S. Draaijer and S. Klinkenberg",

year = "2015",

doi = "10.1007/978-3-319-27704-2_6",

language = "English",

pages = "47--60",

editor = "E. Ras and {Joosten-Ten Brinke}, D.",

booktitle = "Computer assisted assessment: research into e-assessment",

publisher = "Spinger",

note = "Computer assisted assessment: research into e-assessment ; Conference date: 01-01-2015 Through 01-01-2015",

}

Draaijer, S & Klinkenberg, S 2015, A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items. in E Ras & D Joosten-Ten Brinke (eds), Computer assisted assessment: research into e-assessment. Spinger, pp. 47-60, Computer assisted assessment: research into e-assessment, 1/01/15. https://doi.org/10.1007/978-3-319-27704-2_6

A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items. / Draaijer, S.; Klinkenberg, S.
Computer assisted assessment: research into e-assessment. ed. / E. Ras; D. Joosten-Ten Brinke. Spinger, 2015. p. 47-60.

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items

AU - Draaijer, S.

AU - Klinkenberg, S.

PY - 2015

Y1 - 2015

N2 - A procedure to construct valid and fair fixed-length tests with randomly drawn items from an item bank is described. The procedure provides guidelines for the set-up of a typical achievement test with regard to the number of items in the bank and the number of items for each position in a test. Further, a procedure is proposed to calculate the relative difficulty for individual tests and to correct the obtained score for each student based on the mean difficulty for all students and the particular test of a student. Also, two procedures are proposed for the problem to calculate the reliability of tests with randomly drawn items. The procedures use specific interpretations of regularly used methods to calculate Cronbach’s alpha and KR20 and the Spearman-Brown prediction formula. A simulation with R is presented to illustrate the accuracy of the calculation procedures and the effects on pass-fail decisions.

AB - A procedure to construct valid and fair fixed-length tests with randomly drawn items from an item bank is described. The procedure provides guidelines for the set-up of a typical achievement test with regard to the number of items in the bank and the number of items for each position in a test. Further, a procedure is proposed to calculate the relative difficulty for individual tests and to correct the obtained score for each student based on the mean difficulty for all students and the particular test of a student. Also, two procedures are proposed for the problem to calculate the reliability of tests with randomly drawn items. The procedures use specific interpretations of regularly used methods to calculate Cronbach’s alpha and KR20 and the Spearman-Brown prediction formula. A simulation with R is presented to illustrate the accuracy of the calculation procedures and the effects on pass-fail decisions.

U2 - 10.1007/978-3-319-27704-2_6

DO - 10.1007/978-3-319-27704-2_6

M3 - Conference contribution

SP - 47

EP - 60

BT - Computer assisted assessment: research into e-assessment

A2 - Ras, E.

A2 - Joosten-Ten Brinke, D.

PB - Spinger

T2 - Computer assisted assessment: research into e-assessment

Y2 - 1 January 2015 through 1 January 2015

ER -

A Practical Procedure for the Construction and Reliability Analysis of Fixed Length Tests with Random Drawn Test Items

Abstract

Conference

Access to Document

Persistent URL (handle)

Fingerprint

Cite this