Using audio, visual, and lexical features in a multi-modal virtual meeting director

Marc Al-Hames; Benedikt Hörnler; Christoph Scheuermann; Gerhard Rigoll

doi:10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director

Marc Al-Hames, Benedikt Hörnler, Christoph Scheuermann, Gerhard Rigoll

Chair of Human-Machine Communication

Technical University of Munich

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

Original language	English
Title of host publication	Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers
Pages	63-74
Number of pages	12
DOIs	https://doi.org/10.1007/11965152_6
State	Published - 2006
Event	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 - Bethesda, MD, United States Duration: 1 May 2006 → 4 May 2006

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4299 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006
Country/Territory	United States
City	Bethesda, MD
Period	1/05/06 → 4/05/06

Access to Document

10.1007/11965152_6

Cite this

Al-Hames, M., Hörnler, B., Scheuermann, C., & Rigoll, G. (2006). Using audio, visual, and lexical features in a multi-modal virtual meeting director. In Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers (pp. 63-74). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4299 LNCS). https://doi.org/10.1007/11965152_6

Al-Hames, Marc ; Hörnler, Benedikt ; Scheuermann, Christoph et al. / Using audio, visual, and lexical features in a multi-modal virtual meeting director. Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. pp. 63-74 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{580c7fcd6e6540369511038c9b0bd5a0,

title = "Using audio, visual, and lexical features in a multi-modal virtual meeting director",

abstract = "Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.",

author = "Marc Al-Hames and Benedikt H{\"o}rnler and Christoph Scheuermann and Gerhard Rigoll",

year = "2006",

doi = "10.1007/11965152_6",

language = "English",

isbn = "3540692673",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "63--74",

booktitle = "Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers",

note = "3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 ; Conference date: 01-05-2006 Through 04-05-2006",

}

Al-Hames, M, Hörnler, B, Scheuermann, C & Rigoll, G 2006, Using audio, visual, and lexical features in a multi-modal virtual meeting director. in Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4299 LNCS, pp. 63-74, 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006, Bethesda, MD, United States, 1/05/06. https://doi.org/10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director. / Al-Hames, Marc; Hörnler, Benedikt; Scheuermann, Christoph et al.
Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. p. 63-74 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4299 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Using audio, visual, and lexical features in a multi-modal virtual meeting director

AU - Al-Hames, Marc

AU - Hörnler, Benedikt

AU - Scheuermann, Christoph

AU - Rigoll, Gerhard

PY - 2006

Y1 - 2006

N2 - Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

AB - Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

UR - http://www.scopus.com/inward/record.url?scp=77249169836&partnerID=8YFLogxK

U2 - 10.1007/11965152_6

DO - 10.1007/11965152_6

M3 - Conference contribution

AN - SCOPUS:77249169836

SN - 3540692673

SN - 9783540692676

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 63

EP - 74

BT - Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers

T2 - 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006

Y2 - 1 May 2006 through 4 May 2006

ER -

Al-Hames M, Hörnler B, Scheuermann C, Rigoll G. Using audio, visual, and lexical features in a multi-modal virtual meeting director. In Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. p. 63-74. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this