SARA: Smart AI Reading Assistant for Reading Comprehension

Enkeleda Thaqi, Mohamed Omar Mantawy, Enkelejda Kasneci

Publikation: Beitrag in Buch/Bericht/KonferenzbandKonferenzbeitragBegutachtung

Abstract

SARA integrates Eye Tracking and state-of-the-art large language models in a mixed reality framework to enhance the reading experience by providing personalized assistance in real-time. By tracking eye movements, SARA identifies the text segments that attract the user's attention the most and potentially indicate uncertain areas and comprehension issues. The process involves these key steps: text detection and extraction, gaze tracking and alignment, and assessment of detected reading difficulty. The results are customized solutions presented directly within the user's field of view as virtual overlays on identified difficult text areas. This support enables users to overcome challenges like unfamiliar vocabulary and complex sentences by offering additional context, rephrased solutions, and multilingual help. SARA's innovative approach demonstrates it has the potential to transform the reading experience and improve reading proficiency.

OriginalspracheEnglisch
TitelProceedings - ETRA 2024, ACM Symposium on Eye Tracking Research and Applications
Redakteure/-innenStephen N. Spencer
Herausgeber (Verlag)Association for Computing Machinery
ISBN (elektronisch)9798400706073
DOIs
PublikationsstatusVeröffentlicht - 4 Juni 2024
Veranstaltung16th Annual ACM Symposium on Eye Tracking Research and Applications, ETRA 2024 - Hybrid, Glasgow, Großbritannien/Vereinigtes Königreich
Dauer: 4 Juni 20247 Juni 2024

Publikationsreihe

NameEye Tracking Research and Applications Symposium (ETRA)

Konferenz

Konferenz16th Annual ACM Symposium on Eye Tracking Research and Applications, ETRA 2024
Land/GebietGroßbritannien/Vereinigtes Königreich
OrtHybrid, Glasgow
Zeitraum4/06/247/06/24

Fingerprint

Untersuchen Sie die Forschungsthemen von „SARA: Smart AI Reading Assistant for Reading Comprehension“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren