Come and have an emotional workout with sensitive artificial listeners!

Marc Schröder; Sathish Pammi; Hatice Gunes; Maja Pantic; Michel F. Valstar; Roddy Cowie; Gary McKeown; Dirk Heylen; Mark Ter Maat; Florian Eyben; Björn Schuller; Martin Wollmer; Elisabetta Bevacqua; Catherine Pelachaud; Etienne De Sevin

doi:10.1109/FG.2011.5771472

Come and have an emotional workout with sensitive artificial listeners!

Marc Schröder, Sathish Pammi, Hatice Gunes, Maja Pantic, Michel F. Valstar, Roddy Cowie, Gary McKeown, Dirk Heylen, Mark Ter Maat, Florian Eyben, Björn Schuller, Martin Wollmer, Elisabetta Bevacqua, Catherine Pelachaud, Etienne De Sevin

Chair of Health Informatics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

Original language	English
Title of host publication	2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
Pages	646
Number of pages	1
DOIs	https://doi.org/10.1109/FG.2011.5771472
State	Published - 2011
Event	2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011 - Santa Barbara, CA, United States Duration: 21 Mar 2011 → 25 Mar 2011

Publication series

Name	2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Conference

Conference	2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
Country/Territory	United States
City	Santa Barbara, CA
Period	21/03/11 → 25/03/11

Access to Document

10.1109/FG.2011.5771472

Cite this

Schröder, M., Pammi, S., Gunes, H., Pantic, M., Valstar, M. F., Cowie, R., McKeown, G., Heylen, D., Ter Maat, M., Eyben, F., Schuller, B., Wollmer, M., Bevacqua, E., Pelachaud, C., & De Sevin, E. (2011). Come and have an emotional workout with sensitive artificial listeners! In 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011 (pp. 646). Article 5771472 (2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011). https://doi.org/10.1109/FG.2011.5771472

@inproceedings{5baeca38d4b5421896bcb99190241155,

title = "Come and have an emotional workout with sensitive artificial listeners!",

abstract = "This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.",

author = "Marc Schr{\"o}der and Sathish Pammi and Hatice Gunes and Maja Pantic and Valstar, {Michel F.} and Roddy Cowie and Gary McKeown and Dirk Heylen and {Ter Maat}, Mark and Florian Eyben and Bj{\"o}rn Schuller and Martin Wollmer and Elisabetta Bevacqua and Catherine Pelachaud and {De Sevin}, Etienne",

year = "2011",

doi = "10.1109/FG.2011.5771472",

language = "English",

isbn = "9781424491407",

series = "2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011",

pages = "646",

booktitle = "2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011",

note = "2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011 ; Conference date: 21-03-2011 Through 25-03-2011",

}

Schröder, M, Pammi, S, Gunes, H, Pantic, M, Valstar, MF, Cowie, R, McKeown, G, Heylen, D, Ter Maat, M, Eyben, F, Schuller, B, Wollmer, M, Bevacqua, E, Pelachaud, C & De Sevin, E 2011, Come and have an emotional workout with sensitive artificial listeners! in 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011., 5771472, 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011, pp. 646, 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011, Santa Barbara, CA, United States, 21/03/11. https://doi.org/10.1109/FG.2011.5771472

Come and have an emotional workout with sensitive artificial listeners! / Schröder, Marc; Pammi, Sathish; Gunes, Hatice et al.
2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011. 2011. p. 646 5771472 (2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Come and have an emotional workout with sensitive artificial listeners!

AU - Schröder, Marc

AU - Pammi, Sathish

AU - Gunes, Hatice

AU - Pantic, Maja

AU - Valstar, Michel F.

AU - Cowie, Roddy

AU - McKeown, Gary

AU - Heylen, Dirk

AU - Ter Maat, Mark

AU - Eyben, Florian

AU - Schuller, Björn

AU - Wollmer, Martin

AU - Bevacqua, Elisabetta

AU - Pelachaud, Catherine

AU - De Sevin, Etienne

PY - 2011

Y1 - 2011

N2 - This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

AB - This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see http://semaine.opendfki.de/wiki). The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.

UR - http://www.scopus.com/inward/record.url?scp=79958734474&partnerID=8YFLogxK

U2 - 10.1109/FG.2011.5771472

DO - 10.1109/FG.2011.5771472

M3 - Conference contribution

AN - SCOPUS:79958734474

SN - 9781424491407

T3 - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

SP - 646

BT - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

T2 - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011

Y2 - 21 March 2011 through 25 March 2011

ER -

Schröder M, Pammi S, Gunes H, Pantic M, Valstar MF, Cowie R et al. Come and have an emotional workout with sensitive artificial listeners! In 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011. 2011. p. 646. 5771472. (2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011). doi: 10.1109/FG.2011.5771472

Come and have an emotional workout with sensitive artificial listeners!

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this