A Machine Learning Approach for Suggesting Feedback in Textual Exercises in Large Courses

Jan Philip Bernius, Stephan Krusche, Bernd Bruegge

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations

Abstract

Open-ended textual exercises facilitate the comprehension of problem-solving skills. Students can learn from their mistakes when teachers provide individual feedback. However, courses with hundreds of students cause a heavy workload for teachers: providing individual feedback is mostly a manual, repetitive, and time-consuming activity. This paper presents CoFee, a machine learning approach designed to suggest computer-aided feedback in open-ended textual exercises. The approach uses topic modeling to split student answers into text segments and language embeddings to transform these segments. It then applies clustering to group the text segments by similarity so that the same feedback can be applied to all segments within the same cluster. We implemented this approach in a reference implementation called Athene and integrated it into Artemis. We used Athene to review 17 textual exercises in two large courses at the Technical University of Munich with 2,300 registered students and 53 teachers. On average, Athene suggested feedback for 26% of the submissions. Accordingly, 85% of these suggestions were accepted by the teachers, 5% were extended with a comment and then accepted, and 10% were changed.

Original languageEnglish
Title of host publicationL@S 2021 - Proceedings of the 8th ACM Conference on Learning @ Scale
PublisherAssociation for Computing Machinery, Inc
Pages173-182
Number of pages10
ISBN (Electronic)9781450382151
DOIs
StatePublished - 8 Jun 2021
Event8th Annual ACM Conference on Learning at Scale, L@S 2021 - Virtual, Online, Germany
Duration: 22 Jun 202125 Jun 2021

Publication series

NameL@S 2021 - Proceedings of the 8th ACM Conference on Learning @ Scale

Conference

Conference8th Annual ACM Conference on Learning at Scale, L@S 2021
Country/TerritoryGermany
CityVirtual, Online
Period22/06/2125/06/21

Keywords

  • assessment support system
  • automatic assessment
  • education
  • feedback
  • grading
  • interactive learning
  • learning
  • software engineering

Fingerprint

Dive into the research topics of 'A Machine Learning Approach for Suggesting Feedback in Textual Exercises in Large Courses'. Together they form a unique fingerprint.

Cite this