TY - GEN
T1 - Audiovisual behavior modeling by combined feature spaces
AU - Schuller, Björn
AU - Arsic, Dejan
AU - Rigoll, Gerhard
AU - Wimmer, Matthias
AU - Radig, Bernd
PY - 2007
Y1 - 2007
N2 - Great interest is recently shown in behavior modeling, especially in public surveillance tasks. In general it is agreed upon the benefits of use of several input cues as audio and video. Yet, synchronization and fusion of these information sources remains the main challenge. We therefore show results for a feature space combination, which allows for overall feature space optimization. Audio and video features are thereby firstly derived as Low-Level-Descriptors. Synchronization and feature combination is achieved by multivariate time-series analysis. Test-runs on a database of aggressive, cheerful, intoxicated, nervous, neutral, and tired behavior in an airplane situation show a significant improvement over each single modality.
AB - Great interest is recently shown in behavior modeling, especially in public surveillance tasks. In general it is agreed upon the benefits of use of several input cues as audio and video. Yet, synchronization and fusion of these information sources remains the main challenge. We therefore show results for a feature space combination, which allows for overall feature space optimization. Audio and video features are thereby firstly derived as Low-Level-Descriptors. Synchronization and feature combination is achieved by multivariate time-series analysis. Test-runs on a database of aggressive, cheerful, intoxicated, nervous, neutral, and tired behavior in an airplane situation show a significant improvement over each single modality.
KW - Affective computing
KW - Audiovisual emotion recognition
KW - Feature fusion
KW - Synergistic multimodality
UR - http://www.scopus.com/inward/record.url?scp=34547514189&partnerID=8YFLogxK
U2 - 10.1109/ICASSP.2007.366340
DO - 10.1109/ICASSP.2007.366340
M3 - Conference contribution
AN - SCOPUS:34547514189
SN - 1424407281
SN - 9781424407286
T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
SP - 733
EP - 736
BT - 2007 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '07
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2007 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '07
Y2 - 15 April 2007 through 20 April 2007
ER -