Assessing students' ability in performing scientific inquiry: instruments for measuring science skills in primary education

Patricia Kruit, R.J. Oostdam, E. van den Berg, J. Schuitema

Research output: Contribution to journalArticle

Abstract

ABSTRACT
Background: With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to assess students’ science skills.
Purpose: This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition) as well as on different steps of the empirical cycle.
Sample: The study included 128 fifth and sixth grade students from seven primary schools in the Netherlands.
Design and method: Seven measures were used: a paper-and-pencil test (PPT), three performance assessments, two metacognitive selfreport tests, and a test used as an indication of general cognitive ability.
Results: Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the PPT and the three performance assessments show that the different tests measure a common core of similar skills thus providing evidence for convergent validity.
Results also show that students’ ability to perform scientific inquiry is significantly related to general cognitive ability. No relationship was found between the measure of general metacognitive ability and either the PPT or the three performance assessments. By contrast, the metacognitive self-report test constructed to obtain information about the application of metacognitive abilities in performing scientific inquiry, shows significant – although small – correlations
with two of the performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and step level.
Conclusions: The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers with diagnostic information to adapt their instructions and foster the learning process of their students.
LanguageEnglish
Number of pages27
JournalResearch in Science & Technological Education
Early online date8 Jan 2018
DOIs
StatePublished - 8 Jan 2018

Fingerprint

primary education
ability
science
performance assessment
student
cognitive ability
diagnostic
primary school
indication
learning process
Netherlands
school grade
instruction
classroom
teacher

Cite this

@article{323802b9fee641e6bb4ac9c60bfb24e7,
title = "Assessing students' ability in performing scientific inquiry: instruments for measuring science skills in primary education",
abstract = "ABSTRACTBackground: With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to assess students’ science skills.Purpose: This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition) as well as on different steps of the empirical cycle.Sample: The study included 128 fifth and sixth grade students from seven primary schools in the Netherlands.Design and method: Seven measures were used: a paper-and-pencil test (PPT), three performance assessments, two metacognitive selfreport tests, and a test used as an indication of general cognitive ability.Results: Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the PPT and the three performance assessments show that the different tests measure a common core of similar skills thus providing evidence for convergent validity.Results also show that students’ ability to perform scientific inquiry is significantly related to general cognitive ability. No relationship was found between the measure of general metacognitive ability and either the PPT or the three performance assessments. By contrast, the metacognitive self-report test constructed to obtain information about the application of metacognitive abilities in performing scientific inquiry, shows significant – although small – correlationswith two of the performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and step level.Conclusions: The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers with diagnostic information to adapt their instructions and foster the learning process of their students.",
author = "Patricia Kruit and R.J. Oostdam and {van den Berg}, E. and J. Schuitema",
year = "2018",
month = "1",
day = "8",
doi = "10.1080/02635143.2017.1421530",
language = "English",
journal = "Research in Science & Technological Education",
issn = "0263-5143",
publisher = "Taylor & Francis",

}

TY - JOUR

T1 - Assessing students' ability in performing scientific inquiry: instruments for measuring science skills in primary education

AU - Kruit,Patricia

AU - Oostdam,R.J.

AU - van den Berg,E.

AU - Schuitema,J.

PY - 2018/1/8

Y1 - 2018/1/8

N2 - ABSTRACTBackground: With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to assess students’ science skills.Purpose: This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition) as well as on different steps of the empirical cycle.Sample: The study included 128 fifth and sixth grade students from seven primary schools in the Netherlands.Design and method: Seven measures were used: a paper-and-pencil test (PPT), three performance assessments, two metacognitive selfreport tests, and a test used as an indication of general cognitive ability.Results: Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the PPT and the three performance assessments show that the different tests measure a common core of similar skills thus providing evidence for convergent validity.Results also show that students’ ability to perform scientific inquiry is significantly related to general cognitive ability. No relationship was found between the measure of general metacognitive ability and either the PPT or the three performance assessments. By contrast, the metacognitive self-report test constructed to obtain information about the application of metacognitive abilities in performing scientific inquiry, shows significant – although small – correlationswith two of the performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and step level.Conclusions: The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers with diagnostic information to adapt their instructions and foster the learning process of their students.

AB - ABSTRACTBackground: With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to assess students’ science skills.Purpose: This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition) as well as on different steps of the empirical cycle.Sample: The study included 128 fifth and sixth grade students from seven primary schools in the Netherlands.Design and method: Seven measures were used: a paper-and-pencil test (PPT), three performance assessments, two metacognitive selfreport tests, and a test used as an indication of general cognitive ability.Results: Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the PPT and the three performance assessments show that the different tests measure a common core of similar skills thus providing evidence for convergent validity.Results also show that students’ ability to perform scientific inquiry is significantly related to general cognitive ability. No relationship was found between the measure of general metacognitive ability and either the PPT or the three performance assessments. By contrast, the metacognitive self-report test constructed to obtain information about the application of metacognitive abilities in performing scientific inquiry, shows significant – although small – correlationswith two of the performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and step level.Conclusions: The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers with diagnostic information to adapt their instructions and foster the learning process of their students.

U2 - 10.1080/02635143.2017.1421530

DO - 10.1080/02635143.2017.1421530

M3 - Article

JO - Research in Science & Technological Education

T2 - Research in Science & Technological Education

JF - Research in Science & Technological Education

SN - 0263-5143

ER -