AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning

Adam Rydelek; Daryna Dementieva; Georg Groh

doi:10.18653/v1/2023.semeval-1.190

AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning

Adam Rydelek, Daryna Dementieva, Georg Groh

Informatics 25 - Chair of Data Science and Engineering

Technical University of Munich

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases with three subtasks. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. We tackled the challenge by utilising ensembles of Transformer models trained on different datasets, which are tested to find the balance between performance and interpretability. This solution ranked us in the top 40% of teams for each of the tracks.

Original language	English
Title of host publication	17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop
Editors	Atul Kr. Ojha, A. Seza Dogruoz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Publisher	Association for Computational Linguistics
Pages	1371-1381
Number of pages	11
ISBN (Electronic)	9781959429999
DOIs	https://doi.org/10.18653/v1/2023.semeval-1.190
State	Published - 2023
Event	17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 - Hybrid, Toronto, Canada Duration: 13 Jul 2023 → 14 Jul 2023

Publication series

Name	17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop

Conference

Conference	17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023
Country/Territory	Canada
City	Hybrid, Toronto
Period	13/07/23 → 14/07/23

Access to Document

10.18653/v1/2023.semeval-1.190

Cite this

Rydelek, A., Dementieva, D., & Groh, G. (2023). AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning. In A. K. Ojha, A. S. Dogruoz, G. Da San Martino, H. T. Madabushi, R. Kumar, & E. Sartori (Eds.), 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop (pp. 1371-1381). (17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.semeval-1.190

Rydelek, Adam ; Dementieva, Daryna ; Groh, Georg. / AdamR at SemEval-2023 Task 10 : Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning. 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop. editor / Atul Kr. Ojha ; A. Seza Dogruoz ; Giovanni Da San Martino ; Harish Tayyar Madabushi ; Ritesh Kumar ; Elisa Sartori. Association for Computational Linguistics, 2023. pp. 1371-1381 (17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop).

@inproceedings{33db2fedb5c5483a8b6b24edcaee809f,

title = "AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning",

abstract = "The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases with three subtasks. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. We tackled the challenge by utilising ensembles of Transformer models trained on different datasets, which are tested to find the balance between performance and interpretability. This solution ranked us in the top 40% of teams for each of the tracks.",

author = "Adam Rydelek and Daryna Dementieva and Georg Groh",

note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023 ; Conference date: 13-07-2023 Through 14-07-2023",

year = "2023",

doi = "10.18653/v1/2023.semeval-1.190",

language = "English",

series = "17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop",

publisher = "Association for Computational Linguistics",

pages = "1371--1381",

editor = "Ojha, {Atul Kr.} and Dogruoz, {A. Seza} and {Da San Martino}, Giovanni and Madabushi, {Harish Tayyar} and Ritesh Kumar and Elisa Sartori",

booktitle = "17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop",

}

Rydelek, A, Dementieva, D & Groh, G 2023, AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning. in AK Ojha, AS Dogruoz, G Da San Martino, HT Madabushi, R Kumar & E Sartori (eds), 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop. 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop, Association for Computational Linguistics, pp. 1371-1381, 17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023, Hybrid, Toronto, Canada, 13/07/23. https://doi.org/10.18653/v1/2023.semeval-1.190

AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning. / Rydelek, Adam; Dementieva, Daryna; Groh, Georg.
17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop. ed. / Atul Kr. Ojha; A. Seza Dogruoz; Giovanni Da San Martino; Harish Tayyar Madabushi; Ritesh Kumar; Elisa Sartori. Association for Computational Linguistics, 2023. p. 1371-1381 (17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - AdamR at SemEval-2023 Task 10

T2 - 17th International Workshop on Semantic Evaluation, SemEval 2023, co-located with the 61st Annual Meeting of the Association for Computational Linguistics, ACL 2023

AU - Rydelek, Adam

AU - Dementieva, Daryna

AU - Groh, Georg

PY - 2023

Y1 - 2023

N2 - The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases with three subtasks. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. We tackled the challenge by utilising ensembles of Transformer models trained on different datasets, which are tested to find the balance between performance and interpretability. This solution ranked us in the top 40% of teams for each of the tracks.

AB - The Explainable Detection of Online Sexism task presents the problem of explainable sexism detection through fine-grained categorisation of sexist cases with three subtasks. Our team experimented with different ways to combat class imbalance throughout the tasks using data augmentation and loss alteration techniques. We tackled the challenge by utilising ensembles of Transformer models trained on different datasets, which are tested to find the balance between performance and interpretability. This solution ranked us in the top 40% of teams for each of the tracks.

UR - http://www.scopus.com/inward/record.url?scp=85175400278&partnerID=8YFLogxK

U2 - 10.18653/v1/2023.semeval-1.190

DO - 10.18653/v1/2023.semeval-1.190

M3 - Conference contribution

AN - SCOPUS:85175400278

T3 - 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop

SP - 1371

EP - 1381

BT - 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop

A2 - Ojha, Atul Kr.

A2 - Dogruoz, A. Seza

A2 - Da San Martino, Giovanni

A2 - Madabushi, Harish Tayyar

A2 - Kumar, Ritesh

A2 - Sartori, Elisa

PB - Association for Computational Linguistics

Y2 - 13 July 2023 through 14 July 2023

ER -

Rydelek A, Dementieva D, Groh G. AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning. In Ojha AK, Dogruoz AS, Da San Martino G, Madabushi HT, Kumar R, Sartori E, editors, 17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop. Association for Computational Linguistics. 2023. p. 1371-1381. (17th International Workshop on Semantic Evaluation, SemEval 2023 - Proceedings of the Workshop). doi: 10.18653/v1/2023.semeval-1.190

AdamR at SemEval-2023 Task 10: Solving the Class Imbalance Problem in Sexism Detection with Ensemble Learning

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this