MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress

Shahin Amiriparian; Lukas Christ; Andreas König; Eva Maria Meßner; Alan Cowen; Erik Cambria; Björn W. Schuller

doi:10.1145/3503161.3551792

MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress

Shahin Amiriparian, Lukas Christ, Andreas König, Eva Maria Meßner, Alan Cowen, Erik Cambria, Björn W. Schuller

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

25 Scopus citations

Abstract

The 3rd Multimodal Sentiment Analysis Challenge (MuSe) focuses on multimodal affective computing. The workshop is held in conjunction with ACM Multimedia'22. Three datasets are provided as part of the challenge: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset which contains humour-tagged audio-visual data of German football coaches, (ii) the Hume-Reaction dataset, which contains annotations on how people respond to emotional stimuli in terms of seven different emotional expression intensities, and (iii) the Ulm-Trier Social Stress Test (Ulm-TSST) dataset, which consists of audio-visual recordings labelled with continuous emotion values of individuals in stressful circumstances. Based on these datasets three affective computing challenges are defined: 1) Humor Detection Sub-Challenge (MuSe-Humor), for spontaneous humour recognition, 2) Emotional Reactions Sub-Challenge (MuSe-Reaction), for prediction of seven fine-grained in-the-wild' emotions, and 3) Emotional Stress Sub-Challenge (MuSe-Stress), for continuous prediction of stressed emotion values. In this summary, we describe the motivation behind the challenge, participation and its conditions, as well as the outcomes. The complete MuSe'22 workshop proceedings are available at: https://dl.acm.org/doi/proceedings/10.1145/3551876

Original language	English
Title of host publication	MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia
Publisher	Association for Computing Machinery, Inc
Pages	7389-7391
Number of pages	3
ISBN (Electronic)	9781450392037
DOIs	https://doi.org/10.1145/3503161.3551792
State	Published - 10 Oct 2022
Externally published	Yes
Event	30th ACM International Conference on Multimedia, MM 2022 - Lisboa, Portugal Duration: 10 Oct 2022 → 14 Oct 2022

Publication series

Name	MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia

Conference

Conference	30th ACM International Conference on Multimedia, MM 2022
Country/Territory	Portugal
City	Lisboa
Period	10/10/22 → 14/10/22

Keywords

affective computing
challenge
emotion recognition
humor detection
multimodal fusion
multimodal sentiment analysis
summary paper

Access to Document

10.1145/3503161.3551792

Cite this

Amiriparian, S., Christ, L., König, A., Meßner, E. M., Cowen, A., Cambria, E., & Schuller, B. W. (2022). MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress. In MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia (pp. 7389-7391). (MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia). Association for Computing Machinery, Inc. https://doi.org/10.1145/3503161.3551792

@inproceedings{4f8740bb16804b71a68687b02e913473,

title = "MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress",

abstract = "The 3rd Multimodal Sentiment Analysis Challenge (MuSe) focuses on multimodal affective computing. The workshop is held in conjunction with ACM Multimedia'22. Three datasets are provided as part of the challenge: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset which contains humour-tagged audio-visual data of German football coaches, (ii) the Hume-Reaction dataset, which contains annotations on how people respond to emotional stimuli in terms of seven different emotional expression intensities, and (iii) the Ulm-Trier Social Stress Test (Ulm-TSST) dataset, which consists of audio-visual recordings labelled with continuous emotion values of individuals in stressful circumstances. Based on these datasets three affective computing challenges are defined: 1) Humor Detection Sub-Challenge (MuSe-Humor), for spontaneous humour recognition, 2) Emotional Reactions Sub-Challenge (MuSe-Reaction), for prediction of seven fine-grained in-the-wild' emotions, and 3) Emotional Stress Sub-Challenge (MuSe-Stress), for continuous prediction of stressed emotion values. In this summary, we describe the motivation behind the challenge, participation and its conditions, as well as the outcomes. The complete MuSe'22 workshop proceedings are available at: https://dl.acm.org/doi/proceedings/10.1145/3551876",

keywords = "affective computing, challenge, emotion recognition, humor detection, multimodal fusion, multimodal sentiment analysis, summary paper",

author = "Shahin Amiriparian and Lukas Christ and Andreas K{\"o}nig and Me{\ss}ner, {Eva Maria} and Alan Cowen and Erik Cambria and Schuller, {Bj{\"o}rn W.}",

note = "Publisher Copyright: {\textcopyright} 2022 Owner/Author.; 30th ACM International Conference on Multimedia, MM 2022 ; Conference date: 10-10-2022 Through 14-10-2022",

year = "2022",

month = oct,

day = "10",

doi = "10.1145/3503161.3551792",

language = "English",

series = "MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia",

publisher = "Association for Computing Machinery, Inc",

pages = "7389--7391",

booktitle = "MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia",

}

Amiriparian, S, Christ, L, König, A, Meßner, EM, Cowen, A, Cambria, E & Schuller, BW 2022, MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress. in MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia. MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia, Association for Computing Machinery, Inc, pp. 7389-7391, 30th ACM International Conference on Multimedia, MM 2022, Lisboa, Portugal, 10/10/22. https://doi.org/10.1145/3503161.3551792

MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress. / Amiriparian, Shahin; Christ, Lukas; König, Andreas et al.
MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia. Association for Computing Machinery, Inc, 2022. p. 7389-7391 (MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - MuSe 2022 Challenge

T2 - 30th ACM International Conference on Multimedia, MM 2022

AU - Amiriparian, Shahin

AU - Christ, Lukas

AU - König, Andreas

AU - Meßner, Eva Maria

AU - Cowen, Alan

AU - Cambria, Erik

AU - Schuller, Björn W.

PY - 2022/10/10

Y1 - 2022/10/10

N2 - The 3rd Multimodal Sentiment Analysis Challenge (MuSe) focuses on multimodal affective computing. The workshop is held in conjunction with ACM Multimedia'22. Three datasets are provided as part of the challenge: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset which contains humour-tagged audio-visual data of German football coaches, (ii) the Hume-Reaction dataset, which contains annotations on how people respond to emotional stimuli in terms of seven different emotional expression intensities, and (iii) the Ulm-Trier Social Stress Test (Ulm-TSST) dataset, which consists of audio-visual recordings labelled with continuous emotion values of individuals in stressful circumstances. Based on these datasets three affective computing challenges are defined: 1) Humor Detection Sub-Challenge (MuSe-Humor), for spontaneous humour recognition, 2) Emotional Reactions Sub-Challenge (MuSe-Reaction), for prediction of seven fine-grained in-the-wild' emotions, and 3) Emotional Stress Sub-Challenge (MuSe-Stress), for continuous prediction of stressed emotion values. In this summary, we describe the motivation behind the challenge, participation and its conditions, as well as the outcomes. The complete MuSe'22 workshop proceedings are available at: https://dl.acm.org/doi/proceedings/10.1145/3551876

AB - The 3rd Multimodal Sentiment Analysis Challenge (MuSe) focuses on multimodal affective computing. The workshop is held in conjunction with ACM Multimedia'22. Three datasets are provided as part of the challenge: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset which contains humour-tagged audio-visual data of German football coaches, (ii) the Hume-Reaction dataset, which contains annotations on how people respond to emotional stimuli in terms of seven different emotional expression intensities, and (iii) the Ulm-Trier Social Stress Test (Ulm-TSST) dataset, which consists of audio-visual recordings labelled with continuous emotion values of individuals in stressful circumstances. Based on these datasets three affective computing challenges are defined: 1) Humor Detection Sub-Challenge (MuSe-Humor), for spontaneous humour recognition, 2) Emotional Reactions Sub-Challenge (MuSe-Reaction), for prediction of seven fine-grained in-the-wild' emotions, and 3) Emotional Stress Sub-Challenge (MuSe-Stress), for continuous prediction of stressed emotion values. In this summary, we describe the motivation behind the challenge, participation and its conditions, as well as the outcomes. The complete MuSe'22 workshop proceedings are available at: https://dl.acm.org/doi/proceedings/10.1145/3551876

KW - affective computing

KW - challenge

KW - emotion recognition

KW - humor detection

KW - multimodal fusion

KW - multimodal sentiment analysis

KW - summary paper

UR - http://www.scopus.com/inward/record.url?scp=85140954729&partnerID=8YFLogxK

U2 - 10.1145/3503161.3551792

DO - 10.1145/3503161.3551792

M3 - Conference contribution

AN - SCOPUS:85140954729

T3 - MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia

SP - 7389

EP - 7391

BT - MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia

PB - Association for Computing Machinery, Inc

Y2 - 10 October 2022 through 14 October 2022

ER -

Amiriparian S, Christ L, König A, Meßner EM, Cowen A, Cambria E et al. MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress. In MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia. Association for Computing Machinery, Inc. 2022. p. 7389-7391. (MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia). doi: 10.1145/3503161.3551792

MuSe 2022 Challenge: Multimodal Humour, Emotional Reactions, and Stress

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this