Designing a multimodal emotional interface in the context of negotiation

Fabian Pelzl, Klaus Diepold, Jan Auernhammer

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

This paper examines whether a virtual assistant with emotional intelligence improves the Human-Machine Interaction (HMI) in the specific use case of price negotiations. We propose a schema for an Emotional Interface, which we derive from the Skills-Rules-Knowledge (SRK)-Model and the Four Branch Model of Emotional Intelligence. According to this schema, a prototype of a virtual assistant with emotional intelligence is constructed. An avatar is used for representing the respective emotions by means of prosody and facial expression. The prototype is compared to a conventional digital assistant in a within-subject design study regarding user experience and trust building. The findings show that emotions animated in the mimic of the avatar cannot be clearly identified and attributed. Nevertheless, the User Experience of the prototype outperforms the conventional digital assistant, which is mainly due to the hedonic quality dimension. The study did not find any difference in trust between the emotional and the conventional digital assistant. This provides several interesting future research directions which are outlined in this paper.

Original languageEnglish
Title of host publicationDesign, User Experience, and Usability. Interaction Design - 9th International Conference, DUXU 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
EditorsAaron Marcus, Elizabeth Rosenzweig
PublisherSpringer
Pages501-520
Number of pages20
ISBN (Print)9783030497125
DOIs
StatePublished - 2020
Event9th International Conference on Design, User Experience, and Usability, DUXU 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: 19 Jul 202024 Jul 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12200 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th International Conference on Design, User Experience, and Usability, DUXU 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
Country/TerritoryDenmark
CityCopenhagen
Period19/07/2024/07/20

Keywords

  • Affective computing
  • Chatbots
  • Embodied conversational agents
  • Emotion recognition
  • Emotional intelligence
  • Intelligent interaction
  • Negotiation
  • Neurocognition design
  • Trust
  • User experience
  • Virtual human

Fingerprint

Dive into the research topics of 'Designing a multimodal emotional interface in the context of negotiation'. Together they form a unique fingerprint.

Cite this