MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor

Lukas Christ; Shahin Amiriparian; Andreas König; Simone Eulitz; Erik Cambria; Björn W. Schuller

doi:10.1145/3689062.3695939

MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor

Lukas Christ, Shahin Amiriparian, Andreas König, Simone Eulitz, Erik Cambria, Björn W. Schuller

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The 5th Multimodal Sentiment Analysis Challenge (MuSe), a workshop in conjunction with ACM Multimedia’24, is focused on Multimodal Machine Learning in the domain of Affective Computing. Two different sub-challenges are proposed: Social Perception Sub-Challenge (MuSe-Perception) is a regression task on 16 different perceived characteristics including arrogance, sincerity and likability. For this, the novel LMU-ELP dataset is introduced, consisting of short audiovisual recordings of 177 subjects annotated by MTurk workers. Cross-Cultural Humour Detection Sub-Challenge (MuSe-Humour) poses the problem of cross-cultural humor recognition. An extension of the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset featuring football coach press conference recordings is utilized in this task. The training set consists of German data, while the test data comprises English recordings only. In both sub-challenges, audiovisual recordings, transcripts, pre-computed features, and baseline models are made available. In this summary, we detail the challenge’s motives, organization, participation statistics, and results.

Original language	English
Title of host publication	MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop
Subtitle of host publication	Social Perception and Humor, Co-Located with: MM 2024
Publisher	Association for Computing Machinery, Inc
Pages	10-11
Number of pages	2
ISBN (Electronic)	9798400711992
DOIs	https://doi.org/10.1145/3689062.3695939
State	Published - 28 Oct 2024
Externally published	Yes
Event	5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, MuSe 2024, in conjunction with ACM Multimedia 2024 - Melbourne, Australia Duration: 28 Oct 2024 → 1 Nov 2024

Publication series

Name	MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024

Conference

Conference	5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, MuSe 2024, in conjunction with ACM Multimedia 2024
Country/Territory	Australia
City	Melbourne
Period	28/10/24 → 1/11/24

Keywords

Affective Computing
Challenge
Cross-Cultural Humour Detection
Multimodal Fusion
Multimodal Sentiment Analysis
Social Perception
Summary Paper

Access to Document

10.1145/3689062.3695939

Cite this

Christ, L., Amiriparian, S., König, A., Eulitz, S., Cambria, E., & Schuller, B. W. (2024). MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor. In MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024 (pp. 10-11). (MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024). Association for Computing Machinery, Inc. https://doi.org/10.1145/3689062.3695939

Christ, Lukas ; Amiriparian, Shahin ; König, Andreas et al. / MuSe’24 : The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor. MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024. Association for Computing Machinery, Inc, 2024. pp. 10-11 (MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024).

@inproceedings{658643ddcaaf47ef87eddf12737e6b4a,

title = "MuSe{\textquoteright}24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor",

abstract = "The 5th Multimodal Sentiment Analysis Challenge (MuSe), a workshop in conjunction with ACM Multimedia{\textquoteright}24, is focused on Multimodal Machine Learning in the domain of Affective Computing. Two different sub-challenges are proposed: Social Perception Sub-Challenge (MuSe-Perception) is a regression task on 16 different perceived characteristics including arrogance, sincerity and likability. For this, the novel LMU-ELP dataset is introduced, consisting of short audiovisual recordings of 177 subjects annotated by MTurk workers. Cross-Cultural Humour Detection Sub-Challenge (MuSe-Humour) poses the problem of cross-cultural humor recognition. An extension of the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset featuring football coach press conference recordings is utilized in this task. The training set consists of German data, while the test data comprises English recordings only. In both sub-challenges, audiovisual recordings, transcripts, pre-computed features, and baseline models are made available. In this summary, we detail the challenge{\textquoteright}s motives, organization, participation statistics, and results.",

keywords = "Affective Computing, Challenge, Cross-Cultural Humour Detection, Multimodal Fusion, Multimodal Sentiment Analysis, Social Perception, Summary Paper",

author = "Lukas Christ and Shahin Amiriparian and Andreas K{\"o}nig and Simone Eulitz and Erik Cambria and Schuller, {Bj{\"o}rn W.}",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s).; 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, MuSe 2024, in conjunction with ACM Multimedia 2024 ; Conference date: 28-10-2024 Through 01-11-2024",

year = "2024",

month = oct,

day = "28",

doi = "10.1145/3689062.3695939",

language = "English",

series = "MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024",

publisher = "Association for Computing Machinery, Inc",

pages = "10--11",

booktitle = "MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop",

}

Christ, L, Amiriparian, S, König, A, Eulitz, S, Cambria, E & Schuller, BW 2024, MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor. in MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024. MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024, Association for Computing Machinery, Inc, pp. 10-11, 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, MuSe 2024, in conjunction with ACM Multimedia 2024, Melbourne, Australia, 28/10/24. https://doi.org/10.1145/3689062.3695939

MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor. / Christ, Lukas; Amiriparian, Shahin; König, Andreas et al.
MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024. Association for Computing Machinery, Inc, 2024. p. 10-11 (MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - MuSe’24

T2 - 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, MuSe 2024, in conjunction with ACM Multimedia 2024

AU - Christ, Lukas

AU - Amiriparian, Shahin

AU - König, Andreas

AU - Eulitz, Simone

AU - Cambria, Erik

AU - Schuller, Björn W.

PY - 2024/10/28

Y1 - 2024/10/28

N2 - The 5th Multimodal Sentiment Analysis Challenge (MuSe), a workshop in conjunction with ACM Multimedia’24, is focused on Multimodal Machine Learning in the domain of Affective Computing. Two different sub-challenges are proposed: Social Perception Sub-Challenge (MuSe-Perception) is a regression task on 16 different perceived characteristics including arrogance, sincerity and likability. For this, the novel LMU-ELP dataset is introduced, consisting of short audiovisual recordings of 177 subjects annotated by MTurk workers. Cross-Cultural Humour Detection Sub-Challenge (MuSe-Humour) poses the problem of cross-cultural humor recognition. An extension of the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset featuring football coach press conference recordings is utilized in this task. The training set consists of German data, while the test data comprises English recordings only. In both sub-challenges, audiovisual recordings, transcripts, pre-computed features, and baseline models are made available. In this summary, we detail the challenge’s motives, organization, participation statistics, and results.

AB - The 5th Multimodal Sentiment Analysis Challenge (MuSe), a workshop in conjunction with ACM Multimedia’24, is focused on Multimodal Machine Learning in the domain of Affective Computing. Two different sub-challenges are proposed: Social Perception Sub-Challenge (MuSe-Perception) is a regression task on 16 different perceived characteristics including arrogance, sincerity and likability. For this, the novel LMU-ELP dataset is introduced, consisting of short audiovisual recordings of 177 subjects annotated by MTurk workers. Cross-Cultural Humour Detection Sub-Challenge (MuSe-Humour) poses the problem of cross-cultural humor recognition. An extension of the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset featuring football coach press conference recordings is utilized in this task. The training set consists of German data, while the test data comprises English recordings only. In both sub-challenges, audiovisual recordings, transcripts, pre-computed features, and baseline models are made available. In this summary, we detail the challenge’s motives, organization, participation statistics, and results.

KW - Affective Computing

KW - Challenge

KW - Cross-Cultural Humour Detection

KW - Multimodal Fusion

KW - Multimodal Sentiment Analysis

KW - Social Perception

KW - Summary Paper

UR - http://www.scopus.com/inward/record.url?scp=85210852765&partnerID=8YFLogxK

U2 - 10.1145/3689062.3695939

DO - 10.1145/3689062.3695939

M3 - Conference contribution

AN - SCOPUS:85210852765

T3 - MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024

SP - 10

EP - 11

BT - MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop

PB - Association for Computing Machinery, Inc

Y2 - 28 October 2024 through 1 November 2024

ER -

Christ L, Amiriparian S, König A, Eulitz S, Cambria E, Schuller BW. MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor. In MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024. Association for Computing Machinery, Inc. 2024. p. 10-11. (MuSe 2024 - Proceedings of the 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception and Humor, Co-Located with: MM 2024). doi: 10.1145/3689062.3695939

MuSe’24: The 5th Multimodal Sentiment Analysis Challenge and Workshop: Social Perception & Humor

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this