Ask alice: An artificial retrieval of information agent

Michel Valstar; Alexandru Ghitulescu; Tobias Baur; Blaise Potard; Angelo Cafaro; Johannes Wagner; Elisabeth André; Laurent Durieu; Matthew Aylett; Soumia Dermouche; Catherine Pelachaud; Eduardo Coutinho; Björn Schuller; Yue Zhang; Dirk Heylen; Mariët Theune; Jelte van Waterschoot

doi:10.1145/2993148.2998535

Ask alice: An artificial retrieval of information agent

Michel Valstar, Alexandru Ghitulescu, Tobias Baur, Blaise Potard, Angelo Cafaro, Johannes Wagner, Elisabeth André, Laurent Durieu, Matthew Aylett, Soumia Dermouche, Catherine Pelachaud, Eduardo Coutinho, Björn Schuller, Yue Zhang, Dirk Heylen, Mariët Theune, Jelte van Waterschoot

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

19 Scopus citations

Abstract

We present a demonstration of the ARIA framework, a modular approach for rapid development of virtual humans for information retrieval that have linguistic, emotional, and social skills and a strong personality. We demonstrate the framework's capabilities in a scenario where Alice in Wonderland', a popular English literature book, is embodied by a virtual human representing Alice. The user can engage in an information exchange dialogue, where Alice acts as the expert on the book, and the user as an interested novice. Besides speech recognition, sophisticated audio-visual behaviour analysis is used to inform the core agent dialogue module about the user's state and intentions, so that it can go beyond simple chat-bot dialogue. The behaviour generation module features a unique new capability of being able to deal gracefully with interruptions of the agent.

Original language	English
Title of host publication	ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction
Editors	Yukiko I. Nakano, Elisabeth Andre, Toyoaki Nishida, Louis-Philippe Morency, Carlos Busso, Catherine Pelachaud
Publisher	Association for Computing Machinery, Inc
Pages	419-420
Number of pages	2
ISBN (Electronic)	9781450345569
DOIs	https://doi.org/10.1145/2993148.2998535
State	Published - 31 Oct 2016
Externally published	Yes
Event	18th ACM International Conference on Multimodal Interaction, ICMI 2016 - Tokyo, Japan Duration: 12 Nov 2016 → 16 Nov 2016

Publication series

Name	ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

Conference

Conference	18th ACM International Conference on Multimodal Interaction, ICMI 2016
Country/Territory	Japan
City	Tokyo
Period	12/11/16 → 16/11/16

Keywords

Affective computing
Social signal processing
Technology demonstrator
Virtual humans

Access to Document

10.1145/2993148.2998535

Cite this

Valstar, M., Ghitulescu, A., Baur, T., Potard, B., Cafaro, A., Wagner, J., André, E., Durieu, L., Aylett, M., Dermouche, S., Pelachaud, C., Coutinho, E., Schuller, B., Zhang, Y., Heylen, D., Theune, M., & van Waterschoot, J. (2016). Ask alice: An artificial retrieval of information agent. In Y. I. Nakano, E. Andre, T. Nishida, L.-P. Morency, C. Busso, & C. Pelachaud (Eds.), ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction (pp. 419-420). (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction). Association for Computing Machinery, Inc. https://doi.org/10.1145/2993148.2998535

Valstar, Michel ; Ghitulescu, Alexandru ; Baur, Tobias et al. / Ask alice : An artificial retrieval of information agent. ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. editor / Yukiko I. Nakano ; Elisabeth Andre ; Toyoaki Nishida ; Louis-Philippe Morency ; Carlos Busso ; Catherine Pelachaud. Association for Computing Machinery, Inc, 2016. pp. 419-420 (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction).

@inproceedings{96386791eab84776b5fa18c88105f267,

title = "Ask alice: An artificial retrieval of information agent",

abstract = "We present a demonstration of the ARIA framework, a modular approach for rapid development of virtual humans for information retrieval that have linguistic, emotional, and social skills and a strong personality. We demonstrate the framework's capabilities in a scenario where Alice in Wonderland', a popular English literature book, is embodied by a virtual human representing Alice. The user can engage in an information exchange dialogue, where Alice acts as the expert on the book, and the user as an interested novice. Besides speech recognition, sophisticated audio-visual behaviour analysis is used to inform the core agent dialogue module about the user's state and intentions, so that it can go beyond simple chat-bot dialogue. The behaviour generation module features a unique new capability of being able to deal gracefully with interruptions of the agent.",

keywords = "Affective computing, Social signal processing, Technology demonstrator, Virtual humans",

author = "Michel Valstar and Alexandru Ghitulescu and Tobias Baur and Blaise Potard and Angelo Cafaro and Johannes Wagner and Elisabeth Andr{\'e} and Laurent Durieu and Matthew Aylett and Soumia Dermouche and Catherine Pelachaud and Eduardo Coutinho and Bj{\"o}rn Schuller and Yue Zhang and Dirk Heylen and Mari{\"e}t Theune and {van Waterschoot}, Jelte",

note = "Publisher Copyright: {\textcopyright} 2016 ACM.; 18th ACM International Conference on Multimodal Interaction, ICMI 2016 ; Conference date: 12-11-2016 Through 16-11-2016",

year = "2016",

month = oct,

day = "31",

doi = "10.1145/2993148.2998535",

language = "English",

series = "ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery, Inc",

pages = "419--420",

editor = "Nakano, {Yukiko I.} and Elisabeth Andre and Toyoaki Nishida and Louis-Philippe Morency and Carlos Busso and Catherine Pelachaud",

booktitle = "ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction",

}

Valstar, M, Ghitulescu, A, Baur, T, Potard, B, Cafaro, A, Wagner, J, André, E, Durieu, L, Aylett, M, Dermouche, S, Pelachaud, C, Coutinho, E, Schuller, B, Zhang, Y, Heylen, D, Theune, M & van Waterschoot, J 2016, Ask alice: An artificial retrieval of information agent. in YI Nakano, E Andre, T Nishida, L-P Morency, C Busso & C Pelachaud (eds), ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction, Association for Computing Machinery, Inc, pp. 419-420, 18th ACM International Conference on Multimodal Interaction, ICMI 2016, Tokyo, Japan, 12/11/16. https://doi.org/10.1145/2993148.2998535

Ask alice: An artificial retrieval of information agent. / Valstar, Michel; Ghitulescu, Alexandru; Baur, Tobias et al.
ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. ed. / Yukiko I. Nakano; Elisabeth Andre; Toyoaki Nishida; Louis-Philippe Morency; Carlos Busso; Catherine Pelachaud. Association for Computing Machinery, Inc, 2016. p. 419-420 (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Ask alice

T2 - 18th ACM International Conference on Multimodal Interaction, ICMI 2016

AU - Valstar, Michel

AU - Ghitulescu, Alexandru

AU - Baur, Tobias

AU - Potard, Blaise

AU - Cafaro, Angelo

AU - Wagner, Johannes

AU - André, Elisabeth

AU - Durieu, Laurent

AU - Aylett, Matthew

AU - Dermouche, Soumia

AU - Pelachaud, Catherine

AU - Coutinho, Eduardo

AU - Schuller, Björn

AU - Zhang, Yue

AU - Heylen, Dirk

AU - Theune, Mariët

AU - van Waterschoot, Jelte

PY - 2016/10/31

Y1 - 2016/10/31

N2 - We present a demonstration of the ARIA framework, a modular approach for rapid development of virtual humans for information retrieval that have linguistic, emotional, and social skills and a strong personality. We demonstrate the framework's capabilities in a scenario where Alice in Wonderland', a popular English literature book, is embodied by a virtual human representing Alice. The user can engage in an information exchange dialogue, where Alice acts as the expert on the book, and the user as an interested novice. Besides speech recognition, sophisticated audio-visual behaviour analysis is used to inform the core agent dialogue module about the user's state and intentions, so that it can go beyond simple chat-bot dialogue. The behaviour generation module features a unique new capability of being able to deal gracefully with interruptions of the agent.

AB - We present a demonstration of the ARIA framework, a modular approach for rapid development of virtual humans for information retrieval that have linguistic, emotional, and social skills and a strong personality. We demonstrate the framework's capabilities in a scenario where Alice in Wonderland', a popular English literature book, is embodied by a virtual human representing Alice. The user can engage in an information exchange dialogue, where Alice acts as the expert on the book, and the user as an interested novice. Besides speech recognition, sophisticated audio-visual behaviour analysis is used to inform the core agent dialogue module about the user's state and intentions, so that it can go beyond simple chat-bot dialogue. The behaviour generation module features a unique new capability of being able to deal gracefully with interruptions of the agent.

KW - Affective computing

KW - Social signal processing

KW - Technology demonstrator

KW - Virtual humans

UR - http://www.scopus.com/inward/record.url?scp=85016603715&partnerID=8YFLogxK

U2 - 10.1145/2993148.2998535

DO - 10.1145/2993148.2998535

M3 - Conference contribution

AN - SCOPUS:85016603715

T3 - ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

SP - 419

EP - 420

BT - ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

A2 - Nakano, Yukiko I.

A2 - Andre, Elisabeth

A2 - Nishida, Toyoaki

A2 - Morency, Louis-Philippe

A2 - Busso, Carlos

A2 - Pelachaud, Catherine

PB - Association for Computing Machinery, Inc

Y2 - 12 November 2016 through 16 November 2016

ER -

Valstar M, Ghitulescu A, Baur T, Potard B, Cafaro A, Wagner J et al. Ask alice: An artificial retrieval of information agent. In Nakano YI, Andre E, Nishida T, Morency LP, Busso C, Pelachaud C, editors, ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction. Association for Computing Machinery, Inc. 2016. p. 419-420. (ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction). doi: 10.1145/2993148.2998535

Ask alice: An artificial retrieval of information agent

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this