TY - GEN
T1 - Constructive Alignment in Modern Computing Education
T2 - 23rd International Conference on Computing Education Research, Koli Calling 2023
AU - Linhuber, Matthias
AU - Bernius, Jan Philip
AU - Krusche, Stephan
N1 - Publisher Copyright:
© 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
PY - 2023/11/13
Y1 - 2023/11/13
N2 - Large-scale paper-based examinations (PBEs) in computing education frequently emphasize rote memorization, thereby misaligning instructional objectives with assessment techniques. Such incongruities hinder the preparation of students for real world challenges in both industry and academia by inadequately evaluating higher-order cognitive abilities. Often, educators are deterred from implementing comprehensive skills assessment due to the perceived complexity and resource-intensive grading processes involved. To mitigate these limitations, this paper introduces an exam mode as an integral feature of the open-source learning platform Artemis. Designed for both local and cloud-based deployment, this exam mode incorporates anti-cheating protocols, automates the grading of diverse exercise types, and features double-blind manual grading to ensure assessment integrity. It fosters the evaluation of complex cognitive skills while substantially reducing the administrative load on faculty. This paper substantiates the effectiveness of the Artemis exam mode through widespread institutional adoption, demonstrated by over 50 successful computer-based examinations (CBEs). An in-depth case study involving 1,700 undergraduate software engineering students offers key insights, best practices, and lessons learned. This research not only pioneers the documentation of a secure, scalable, and reliable exam system at an institutional scale but also marks a seminal contribution to modernizing assessment strategies in computing education, with a particular focus on constructive alignment.
AB - Large-scale paper-based examinations (PBEs) in computing education frequently emphasize rote memorization, thereby misaligning instructional objectives with assessment techniques. Such incongruities hinder the preparation of students for real world challenges in both industry and academia by inadequately evaluating higher-order cognitive abilities. Often, educators are deterred from implementing comprehensive skills assessment due to the perceived complexity and resource-intensive grading processes involved. To mitigate these limitations, this paper introduces an exam mode as an integral feature of the open-source learning platform Artemis. Designed for both local and cloud-based deployment, this exam mode incorporates anti-cheating protocols, automates the grading of diverse exercise types, and features double-blind manual grading to ensure assessment integrity. It fosters the evaluation of complex cognitive skills while substantially reducing the administrative load on faculty. This paper substantiates the effectiveness of the Artemis exam mode through widespread institutional adoption, demonstrated by over 50 successful computer-based examinations (CBEs). An in-depth case study involving 1,700 undergraduate software engineering students offers key insights, best practices, and lessons learned. This research not only pioneers the documentation of a secure, scalable, and reliable exam system at an institutional scale but also marks a seminal contribution to modernizing assessment strategies in computing education, with a particular focus on constructive alignment.
KW - Automated Assessment
KW - Automated Grading
KW - Continuous Integration
KW - Exam Mode
KW - Instant Feedback
KW - Online Editor
KW - Open-Source Learning Platform
KW - Plagiarism Checks
KW - Programming Exercises
KW - Scalability
KW - Version Control
UR - http://www.scopus.com/inward/record.url?scp=85185533506&partnerID=8YFLogxK
U2 - 10.1145/3631802.3631818
DO - 10.1145/3631802.3631818
M3 - Conference contribution
AN - SCOPUS:85185533506
T3 - ACM International Conference Proceeding Series
BT - Proceedings of 23rd International Conference on Computing Education Research, Koli Calling 2023
PB - Association for Computing Machinery
Y2 - 13 November 2023 through 19 November 2023
ER -