TY - GEN
T1 - MuSe 2020 Challenge and Workshop
T2 - 1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop, MuSe 2020
AU - Stappen, Lukas
AU - Baird, Alice
AU - Rizos, Georgios
AU - Tzirakis, Panagiotis
AU - Xinchen Du, Du
AU - Hafner, Felix
AU - Schumann, Lea
AU - Mallol-Ragolta, Adria
AU - Schuller, Bjöern W.
AU - Lefter, Iulia
AU - Cambria, Erik
AU - Kompatsiaris, Ioannis
N1 - Publisher Copyright:
© 2020 ACM.
PY - 2020/10/16
Y1 - 2020/10/16
N2 - Multimodal Sentiment Analysis in Real-life Media (MuSe) 2020 is a Challenge-based Workshop focusing on the tasks of sentiment recognition, as well as emotion-target engagement and trustworthiness detection by means of more comprehensively integrating the audio-visual and language modalities. The purpose of MuSe 2020 is to bring together communities from different disciplines; mainly, the audio-visual emotion recognition community (signal-based), and the sentiment analysis community (symbol-based). We present three distinct sub-challenges: MuSe-Wild, which focuses on continuous emotion (arousal and valence) prediction; MuSe-Topic, in which participants recognise 10 domain-specific topics as the target of 3-class (low, medium, high) emotions; and MuSe-Trust, in which the novel aspect of trustworthiness is to be predicted. In this paper, we provide detailed information on MuSe-CAR, the first of its kind in-the-wild database, which is utilised for the challenge, as well as the state-of-the-art features and modelling approaches applied. For each sub-challenge, a competitive baseline for participants is set; namely, on test we report for MuSe-Wild a combined (valence and arousal) CCC of .2568, for MuSe-Topic a score (computed as 0.34∗UAR + 0.66∗F1) of 76.78 % on the 10-class topic and 40.64 % on the 3-class emotion prediction, and for MuSe-Trust a CCC of .4359.
AB - Multimodal Sentiment Analysis in Real-life Media (MuSe) 2020 is a Challenge-based Workshop focusing on the tasks of sentiment recognition, as well as emotion-target engagement and trustworthiness detection by means of more comprehensively integrating the audio-visual and language modalities. The purpose of MuSe 2020 is to bring together communities from different disciplines; mainly, the audio-visual emotion recognition community (signal-based), and the sentiment analysis community (symbol-based). We present three distinct sub-challenges: MuSe-Wild, which focuses on continuous emotion (arousal and valence) prediction; MuSe-Topic, in which participants recognise 10 domain-specific topics as the target of 3-class (low, medium, high) emotions; and MuSe-Trust, in which the novel aspect of trustworthiness is to be predicted. In this paper, we provide detailed information on MuSe-CAR, the first of its kind in-the-wild database, which is utilised for the challenge, as well as the state-of-the-art features and modelling approaches applied. For each sub-challenge, a competitive baseline for participants is set; namely, on test we report for MuSe-Wild a combined (valence and arousal) CCC of .2568, for MuSe-Topic a score (computed as 0.34∗UAR + 0.66∗F1) of 76.78 % on the 10-class topic and 40.64 % on the 3-class emotion prediction, and for MuSe-Trust a CCC of .4359.
KW - affective computing
KW - multimodal fusion
KW - multimodal sentiment analysis
KW - user-generated data
UR - http://www.scopus.com/inward/record.url?scp=85096085371&partnerID=8YFLogxK
U2 - 10.1145/3423327.3423673
DO - 10.1145/3423327.3423673
M3 - Conference contribution
AN - SCOPUS:85096085371
T3 - MuSe 2020 - Proceedings of the 1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop
SP - 35
EP - 44
BT - MuSe 2020 - Proceedings of the 1st International Multimodal Sentiment Analysis in Real-Life Media Challenge and Workshop
PB - Association for Computing Machinery, Inc
Y2 - 16 October 2020
ER -