A cost–benefit analysis for developing item banks in higher education

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

Abstract

Item banks in higher education can be regarded as important assets to increasing the quality of education and assessment. An item bank allows for the flexible administration of computer-based achievement tests for summative purposes, as well as quizzes for formative purposes. Developing item banks, however, can require quite an investment. A well-worked-out business case can help with convincing stakeholders to start an item bank development project. An important part of such a business case should be the increase in item quality and the estimated reduction in costs, particularly for the collaborative development of an item bank. However, a theoretical underpinning of a business case, incorporating considerations based on classical test theory is lacking in the literature. Therefore, a model is described to make estimations of reductions in misclassifications and per-unit costs. Examples are presented of the likelihood of reducing misclassifications and cost per unit based on findings in the literature. Implications for research and practice are discussed.

Original languageEnglish
Title of host publicationTechnology Enhanced Assessment
Subtitle of host publication21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers
EditorsSilvester Draaijer, Eric Ras, Desirée Joosten-ten Brinke
PublisherSpringer Verlag
Pages165-179
Number of pages15
ISBN (Electronic)9783030252649
ISBN (Print)9783030252632
DOIs
Publication statusPublished - 2019
Event21st International Conference on Technology Enhanced Assessment, TEA 2018 - Amsterdam, Netherlands
Duration: 10 Dec 201811 Dec 2018

Publication series

NameCommunications in Computer and Information Science
Volume1014
ISSN (Print)1865-0929

Conference

Conference21st International Conference on Technology Enhanced Assessment, TEA 2018
CountryNetherlands
CityAmsterdam
Period10/12/1811/12/18

Fingerprint

Cost-benefit Analysis
Higher Education
Education
Misclassification
Costs
Industry
Test Theory
Unit
Likelihood
Banks
Business

Keywords

  • Economics
  • Educational measurement
  • Higher education
  • Item banking
  • MCQs
  • Multiple-choice questions
  • Question development
  • Test development

Cite this

Draaijer, S. (2019). A cost–benefit analysis for developing item banks in higher education. In S. Draaijer, E. Ras, & D. Joosten-ten Brinke (Eds.), Technology Enhanced Assessment: 21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers (pp. 165-179). (Communications in Computer and Information Science; Vol. 1014). Springer Verlag. https://doi.org/10.1007/978-3-030-25264-9_11
Draaijer, Silvester. / A cost–benefit analysis for developing item banks in higher education. Technology Enhanced Assessment: 21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers. editor / Silvester Draaijer ; Eric Ras ; Desirée Joosten-ten Brinke. Springer Verlag, 2019. pp. 165-179 (Communications in Computer and Information Science).
@inproceedings{2783af1f7138471c8557ce8bc3ad4a98,
title = "A cost–benefit analysis for developing item banks in higher education",
abstract = "Item banks in higher education can be regarded as important assets to increasing the quality of education and assessment. An item bank allows for the flexible administration of computer-based achievement tests for summative purposes, as well as quizzes for formative purposes. Developing item banks, however, can require quite an investment. A well-worked-out business case can help with convincing stakeholders to start an item bank development project. An important part of such a business case should be the increase in item quality and the estimated reduction in costs, particularly for the collaborative development of an item bank. However, a theoretical underpinning of a business case, incorporating considerations based on classical test theory is lacking in the literature. Therefore, a model is described to make estimations of reductions in misclassifications and per-unit costs. Examples are presented of the likelihood of reducing misclassifications and cost per unit based on findings in the literature. Implications for research and practice are discussed.",
keywords = "Economics, Educational measurement, Higher education, Item banking, MCQs, Multiple-choice questions, Question development, Test development",
author = "Silvester Draaijer",
year = "2019",
doi = "10.1007/978-3-030-25264-9_11",
language = "English",
isbn = "9783030252632",
series = "Communications in Computer and Information Science",
publisher = "Springer Verlag",
pages = "165--179",
editor = "Silvester Draaijer and Eric Ras and {Joosten-ten Brinke}, Desir{\'e}e",
booktitle = "Technology Enhanced Assessment",
address = "Germany",

}

Draaijer, S 2019, A cost–benefit analysis for developing item banks in higher education. in S Draaijer, E Ras & D Joosten-ten Brinke (eds), Technology Enhanced Assessment: 21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers. Communications in Computer and Information Science, vol. 1014, Springer Verlag, pp. 165-179, 21st International Conference on Technology Enhanced Assessment, TEA 2018, Amsterdam, Netherlands, 10/12/18. https://doi.org/10.1007/978-3-030-25264-9_11

A cost–benefit analysis for developing item banks in higher education. / Draaijer, Silvester.

Technology Enhanced Assessment: 21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers. ed. / Silvester Draaijer; Eric Ras; Desirée Joosten-ten Brinke. Springer Verlag, 2019. p. 165-179 (Communications in Computer and Information Science; Vol. 1014).

Research output: Chapter in Book / Report / Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - A cost–benefit analysis for developing item banks in higher education

AU - Draaijer, Silvester

PY - 2019

Y1 - 2019

N2 - Item banks in higher education can be regarded as important assets to increasing the quality of education and assessment. An item bank allows for the flexible administration of computer-based achievement tests for summative purposes, as well as quizzes for formative purposes. Developing item banks, however, can require quite an investment. A well-worked-out business case can help with convincing stakeholders to start an item bank development project. An important part of such a business case should be the increase in item quality and the estimated reduction in costs, particularly for the collaborative development of an item bank. However, a theoretical underpinning of a business case, incorporating considerations based on classical test theory is lacking in the literature. Therefore, a model is described to make estimations of reductions in misclassifications and per-unit costs. Examples are presented of the likelihood of reducing misclassifications and cost per unit based on findings in the literature. Implications for research and practice are discussed.

AB - Item banks in higher education can be regarded as important assets to increasing the quality of education and assessment. An item bank allows for the flexible administration of computer-based achievement tests for summative purposes, as well as quizzes for formative purposes. Developing item banks, however, can require quite an investment. A well-worked-out business case can help with convincing stakeholders to start an item bank development project. An important part of such a business case should be the increase in item quality and the estimated reduction in costs, particularly for the collaborative development of an item bank. However, a theoretical underpinning of a business case, incorporating considerations based on classical test theory is lacking in the literature. Therefore, a model is described to make estimations of reductions in misclassifications and per-unit costs. Examples are presented of the likelihood of reducing misclassifications and cost per unit based on findings in the literature. Implications for research and practice are discussed.

KW - Economics

KW - Educational measurement

KW - Higher education

KW - Item banking

KW - MCQs

KW - Multiple-choice questions

KW - Question development

KW - Test development

UR - http://www.scopus.com/inward/record.url?scp=85069645965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069645965&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-25264-9_11

DO - 10.1007/978-3-030-25264-9_11

M3 - Conference contribution

SN - 9783030252632

T3 - Communications in Computer and Information Science

SP - 165

EP - 179

BT - Technology Enhanced Assessment

A2 - Draaijer, Silvester

A2 - Ras, Eric

A2 - Joosten-ten Brinke, Desirée

PB - Springer Verlag

ER -

Draaijer S. A cost–benefit analysis for developing item banks in higher education. In Draaijer S, Ras E, Joosten-ten Brinke D, editors, Technology Enhanced Assessment: 21st International Conference, TEA 2018, Amsterdam, The Netherlands, December 10–11, 2018, Revised Selected Papers. Springer Verlag. 2019. p. 165-179. (Communications in Computer and Information Science). https://doi.org/10.1007/978-3-030-25264-9_11