Audio-visual processing in meetings: Seven questions and current AMI answers

Marc Al-Hames; Thomas Hain; Jan Cernocky; Sascha Schreiber; Mannes Poel; Ronald Müller; Sebastien Marcel; David Van Leeuwen; Jean Marc Odobez; Sileye Ba; Herve Bourlard; Fabien Cardinaux; Daniel Gatica-Perez; Adam Janin; Petr Motlicek; Stephan Reiter; Steve Renals; Jeroen Van Rest; Rutger Rienks; Gerhard Rigoll; Kevin Smith; Andrew Thean; Pavel Zemcik

doi:10.1007/11965152_3

Audio-visual processing in meetings: Seven questions and current AMI answers

Marc Al-Hames, Thomas Hain, Jan Cernocky, Sascha Schreiber, Mannes Poel, Ronald Müller, Sebastien Marcel, David Van Leeuwen, Jean Marc Odobez, Sileye Ba, Herve Bourlard, Fabien Cardinaux, Daniel Gatica-Perez, Adam Janin, Petr Motlicek, Stephan Reiter, Steve Renals, Jeroen Van Rest, Rutger Rienks, Gerhard RigollKevin Smith, Andrew Thean, Pavel Zemcik

Chair of Human-Machine Communication

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

The project Augmented Multi-party Interaction (AMI) is concerned with the development of meeting browsers and remote meeting assistants for instrumented meeting rooms - and the required component technologies R&D themes: group dynamics, audio, visual, and multimodal processing, content abstraction, and human-computer interaction. The audio-visual processing workpackage within AMI addresses the automatic recognition from audio, video, and combined audio-video streams, that have been recorded during meetings. In this article we describe the progress that has been made in the first two years of the project. We show how the large problem of audio-visual processing in meetings can be split into seven questions, like "Who is acting during the meeting?". We then show which algorithms and methods have been developed and evaluated for the automatic answering of these questions.

Original language	English
Title of host publication	Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers
Pages	24-35
Number of pages	12
DOIs	https://doi.org/10.1007/11965152_3
State	Published - 2006
Event	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 - Bethesda, MD, United States Duration: 1 May 2006 → 4 May 2006

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4299 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006
Country/Territory	United States
City	Bethesda, MD
Period	1/05/06 → 4/05/06

Access to Document

10.1007/11965152_3

Cite this

Al-Hames, M., Hain, T., Cernocky, J., Schreiber, S., Poel, M., Müller, R., Marcel, S., Van Leeuwen, D., Odobez, J. M., Ba, S., Bourlard, H., Cardinaux, F., Gatica-Perez, D., Janin, A., Motlicek, P., Reiter, S., Renals, S., Van Rest, J., Rienks, R., ... Zemcik, P. (2006). Audio-visual processing in meetings: Seven questions and current AMI answers. In Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers (pp. 24-35). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4299 LNCS). https://doi.org/10.1007/11965152_3

Al-Hames, Marc ; Hain, Thomas ; Cernocky, Jan et al. / Audio-visual processing in meetings : Seven questions and current AMI answers. Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. pp. 24-35 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{0842cae1770349b28453c8a3eea66d8d,

title = "Audio-visual processing in meetings: Seven questions and current AMI answers",

abstract = "The project Augmented Multi-party Interaction (AMI) is concerned with the development of meeting browsers and remote meeting assistants for instrumented meeting rooms - and the required component technologies R&D themes: group dynamics, audio, visual, and multimodal processing, content abstraction, and human-computer interaction. The audio-visual processing workpackage within AMI addresses the automatic recognition from audio, video, and combined audio-video streams, that have been recorded during meetings. In this article we describe the progress that has been made in the first two years of the project. We show how the large problem of audio-visual processing in meetings can be split into seven questions, like {"}Who is acting during the meeting?{"}. We then show which algorithms and methods have been developed and evaluated for the automatic answering of these questions.",

author = "Marc Al-Hames and Thomas Hain and Jan Cernocky and Sascha Schreiber and Mannes Poel and Ronald M{\"u}ller and Sebastien Marcel and {Van Leeuwen}, David and Odobez, {Jean Marc} and Sileye Ba and Herve Bourlard and Fabien Cardinaux and Daniel Gatica-Perez and Adam Janin and Petr Motlicek and Stephan Reiter and Steve Renals and {Van Rest}, Jeroen and Rutger Rienks and Gerhard Rigoll and Kevin Smith and Andrew Thean and Pavel Zemcik",

year = "2006",

doi = "10.1007/11965152_3",

language = "English",

isbn = "3540692673",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "24--35",

booktitle = "Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers",

note = "3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006 ; Conference date: 01-05-2006 Through 04-05-2006",

}

Al-Hames, M, Hain, T, Cernocky, J, Schreiber, S, Poel, M, Müller, R, Marcel, S, Van Leeuwen, D, Odobez, JM, Ba, S, Bourlard, H, Cardinaux, F, Gatica-Perez, D, Janin, A, Motlicek, P, Reiter, S, Renals, S, Van Rest, J, Rienks, R, Rigoll, G, Smith, K, Thean, A & Zemcik, P 2006, Audio-visual processing in meetings: Seven questions and current AMI answers. in Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4299 LNCS, pp. 24-35, 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006, Bethesda, MD, United States, 1/05/06. https://doi.org/10.1007/11965152_3

Audio-visual processing in meetings: Seven questions and current AMI answers. / Al-Hames, Marc; Hain, Thomas; Cernocky, Jan et al.
Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. p. 24-35 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4299 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Audio-visual processing in meetings

T2 - 3rd International Workshop on Machine Learning for Multimodal Interaction, MLMI 2006

AU - Al-Hames, Marc

AU - Hain, Thomas

AU - Cernocky, Jan

AU - Schreiber, Sascha

AU - Poel, Mannes

AU - Müller, Ronald

AU - Marcel, Sebastien

AU - Van Leeuwen, David

AU - Odobez, Jean Marc

AU - Ba, Sileye

AU - Bourlard, Herve

AU - Cardinaux, Fabien

AU - Gatica-Perez, Daniel

AU - Janin, Adam

AU - Motlicek, Petr

AU - Reiter, Stephan

AU - Renals, Steve

AU - Van Rest, Jeroen

AU - Rienks, Rutger

AU - Rigoll, Gerhard

AU - Smith, Kevin

AU - Thean, Andrew

AU - Zemcik, Pavel

PY - 2006

Y1 - 2006

N2 - The project Augmented Multi-party Interaction (AMI) is concerned with the development of meeting browsers and remote meeting assistants for instrumented meeting rooms - and the required component technologies R&D themes: group dynamics, audio, visual, and multimodal processing, content abstraction, and human-computer interaction. The audio-visual processing workpackage within AMI addresses the automatic recognition from audio, video, and combined audio-video streams, that have been recorded during meetings. In this article we describe the progress that has been made in the first two years of the project. We show how the large problem of audio-visual processing in meetings can be split into seven questions, like "Who is acting during the meeting?". We then show which algorithms and methods have been developed and evaluated for the automatic answering of these questions.

AB - The project Augmented Multi-party Interaction (AMI) is concerned with the development of meeting browsers and remote meeting assistants for instrumented meeting rooms - and the required component technologies R&D themes: group dynamics, audio, visual, and multimodal processing, content abstraction, and human-computer interaction. The audio-visual processing workpackage within AMI addresses the automatic recognition from audio, video, and combined audio-video streams, that have been recorded during meetings. In this article we describe the progress that has been made in the first two years of the project. We show how the large problem of audio-visual processing in meetings can be split into seven questions, like "Who is acting during the meeting?". We then show which algorithms and methods have been developed and evaluated for the automatic answering of these questions.

UR - http://www.scopus.com/inward/record.url?scp=77249087752&partnerID=8YFLogxK

U2 - 10.1007/11965152_3

DO - 10.1007/11965152_3

M3 - Conference contribution

AN - SCOPUS:77249087752

SN - 3540692673

SN - 9783540692676

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 24

EP - 35

BT - Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers

Y2 - 1 May 2006 through 4 May 2006

ER -

Al-Hames M, Hain T, Cernocky J, Schreiber S, Poel M, Müller R et al. Audio-visual processing in meetings: Seven questions and current AMI answers. In Machine Learning for Multimodal Interaction - Third International Workshop, MLMI 2006, Revised Selected Papers. 2006. p. 24-35. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11965152_3

Audio-visual processing in meetings: Seven questions and current AMI answers

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this