Design and first results of a psychometric test for measuring basic programming abilities

Andreas Mühling, Alexander Ruf, Peter Hubwieser

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

39 Scopus citations

Abstract

We present the design of a test for measuring students' abilities concerning the application of control structures. Validated test instruments are a valuable tool for the evaluation of teaching both in a research setting as well as in a classroom setting. Our test is based on item-response-theory, in particular the Rasch model, and comprises a set of items all following the same format and using a simple, artificial programming language. We field-tested and modified the instrument in four iterations using only small samples and special statistical methods instead of the large samples usually required for IRT models. After the fourth iteration, the test has now reached a usable state. Based on the results, we were able to identify two misconceptions that are occurring very frequently in our test population - students of grade 7 to 10 in secondary schools.

Original languageEnglish
Title of host publicationWiPSCE 2015 - Proceedings of the 10th Workshop in Primary and Secondary Computing Education
EditorsJudith Gal-Ezer, Sue Sentence, Jan Vahrenhold
PublisherAssociation for Computing Machinery
Pages2-10
Number of pages9
ISBN (Electronic)9781450337533
DOIs
StatePublished - 9 Nov 2015
Event10th Workshop in Primary and Secondary Computing Education, WiPSCE 2015 - London, United Kingdom
Duration: 9 Nov 201511 Nov 2015

Publication series

NameACM International Conference Proceeding Series
Volume09-11-November-2015

Conference

Conference10th Workshop in Primary and Secondary Computing Education, WiPSCE 2015
Country/TerritoryUnited Kingdom
CityLondon
Period9/11/1511/11/15

Keywords

  • Algorithmic control structures
  • Assessment
  • Computer science education
  • Computing concepts
  • Latent-trait
  • Novice programmer
  • Program flow
  • Psychometric test

Fingerprint

Dive into the research topics of 'Design and first results of a psychometric test for measuring basic programming abilities'. Together they form a unique fingerprint.

Cite this