Explaining Neural NLP Models for the Joint Analysis of Open- and Closed-Ended Survey Answers

Edoardo Mosca, Katharina Hermann, Tobias Eder, Georg Groh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

Large-scale surveys are a widely used instrument to collect data from a target audience. Beyond the single individual, an appropriate analysis of the answers can reveal trends and patterns and thus generate new insights and knowledge for researchers. Current analysis practices employ shallow machine learning methods or rely on (biased) human judgment. This work investigates the usage of state-of-the-art NLP models such as BERT to automatically extract information from both open- and closed-ended questions. We also leverage explainability methods at different levels of granularity to further derive knowledge from the analysis model. Experiments on EMS-a survey-based study researching influencing factors affecting a student's career goals-show that the proposed approach can identify such factors both at the input- and higher concept-level.

Original languageEnglish
Title of host publicationTrustNLP 2022 - 2nd Workshop on Trustworthy Natural Language Processing, Proceedings of the Workshop
EditorsApurv Verma, Yada Pruksachatkun, Kai-Wei Chang, Aram Galstyan, Jwala Dhamala, Yang Trista Cao
PublisherAssociation for Computational Linguistics (ACL)
Pages49-63
Number of pages15
ISBN (Electronic)9781955917780
StatePublished - 2022
Event2nd Workshop on Trustworthy Natural Language Processing, TrustNLP 2022 - Seattle, United States
Duration: 14 Jul 2022 → …

Publication series

NameTrustNLP 2022 - 2nd Workshop on Trustworthy Natural Language Processing, Proceedings of the Workshop

Conference

Conference2nd Workshop on Trustworthy Natural Language Processing, TrustNLP 2022
Country/TerritoryUnited States
CitySeattle
Period14/07/22 → …

Fingerprint

Dive into the research topics of 'Explaining Neural NLP Models for the Joint Analysis of Open- and Closed-Ended Survey Answers'. Together they form a unique fingerprint.

Cite this