Using audio, visual, and lexical features in a multi-modal virtual meeting director

Marc Al-Hames; Benedikt Hörnler; Christoph Scheuermann; Gerhard Rigoll

doi:10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director

Marc Al-Hames, Benedikt Hörnler, Christoph Scheuermann, Gerhard Rigoll

Lehrstuhl für Mensch - Maschine - Kommunikation

Technische Universität München

Publikation: Beitrag in Buch/Bericht/Konferenzband › Konferenzbeitrag › Begutachtung

3 Zitate (Scopus)

Abstract

Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

Originalsprache	Englisch
Titel	Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers
Seiten	63-74
Seitenumfang	12
DOIs	https://doi.org/10.1007/11965152_6
Publikationsstatus	Veröffentlicht - 2006
Veranstaltung	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 - Bethesda, MD, USA/Vereinigte Staaten Dauer: 1 Mai 2006 → 4 Mai 2006

Publikationsreihe

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band	4299 LNCS
ISSN (Print)	0302-9743
ISSN (elektronisch)	1611-3349

Konferenz

Konferenz	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006
Land/Gebiet	USA/Vereinigte Staaten
Ort	Bethesda, MD
Zeitraum	1/05/06 → 4/05/06

Zugriff auf Dokument

10.1007/11965152_6

Andere Dateien und Links

Verknüpfung zur Publikation in Scopus

Dieses zitieren

Al-Hames, M., Hörnler, B., Scheuermann, C., & Rigoll, G. (2006). Using audio, visual, and lexical features in a multi-modal virtual meeting director. in Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers (S. 63-74). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 4299 LNCS). https://doi.org/10.1007/11965152_6

Al-Hames, Marc ; Hörnler, Benedikt ; Scheuermann, Christoph et al. / Using audio, visual, and lexical features in a multi-modal virtual meeting director. Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. S. 63-74 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{580c7fcd6e6540369511038c9b0bd5a0,

title = "Using audio, visual, and lexical features in a multi-modal virtual meeting director",

abstract = "Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.",

author = "Marc Al-Hames and Benedikt H{\"o}rnler and Christoph Scheuermann and Gerhard Rigoll",

year = "2006",

doi = "10.1007/11965152_6",

language = "English",

isbn = "3540692673",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "63--74",

booktitle = "Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers",

note = "3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 ; Conference date: 01-05-2006 Through 04-05-2006",

}

Al-Hames, M, Hörnler, B, Scheuermann, C & Rigoll, G 2006, Using audio, visual, and lexical features in a multi-modal virtual meeting director. in Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 4299 LNCS, S. 63-74, 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006, Bethesda, MD, USA/Vereinigte Staaten, 1/05/06. https://doi.org/10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director. / Al-Hames, Marc; Hörnler, Benedikt; Scheuermann, Christoph et al.
Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. S. 63-74 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 4299 LNCS).

Publikation: Beitrag in Buch/Bericht/Konferenzband › Konferenzbeitrag › Begutachtung

TY - GEN

T1 - Using audio, visual, and lexical features in a multi-modal virtual meeting director

AU - Al-Hames, Marc

AU - Hörnler, Benedikt

AU - Scheuermann, Christoph

AU - Rigoll, Gerhard

PY - 2006

Y1 - 2006

N2 - Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

AB - Multi-modal recordings of meetings provide the basis for meeting browsing and for remote meetings. However it is often not useful to store or transmit all visual channels. In this work we show how a virtual meeting director selects one of seven possible video modes. We then present several audio, visual, and lexical features for a virtual director. In an experimental section we evaluate the features, their influence on the camera selection, and the properties of the generated video stream. The chosen features all allow a real- or near real-time processing and can therefore not only be applied to offline browsing, but also for a remote meeting assistant.

UR - http://www.scopus.com/inward/record.url?scp=77249169836&partnerID=8YFLogxK

U2 - 10.1007/11965152_6

DO - 10.1007/11965152_6

M3 - Conference contribution

AN - SCOPUS:77249169836

SN - 3540692673

SN - 9783540692676

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 63

EP - 74

BT - Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers

T2 - 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006

Y2 - 1 May 2006 through 4 May 2006

ER -

Al-Hames M, Hörnler B, Scheuermann C, Rigoll G. Using audio, visual, and lexical features in a multi-modal virtual meeting director. in Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. S. 63-74. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11965152_6

Using audio, visual, and lexical features in a multi-modal virtual meeting director

Abstract

Publikationsreihe

Konferenz

Zugriff auf Dokument

Andere Dateien und Links

Fingerprint

Dieses zitieren