Improving keyword spotting with a tandem BLSTM-DBN architecture

Martin Wöllmer, Florian Eyben, Alex Graves, Björn Schuller, Gerhard Rigoll

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

We propose a novel architecture for keyword spotting which is composed of a Dynamic Bayesian Network (DBN) and a bidirectional Long Short-Term Memory (BLSTM) recurrent neural net. The DBN uses a hidden garbage variable as well as the concept of switching parents to discriminate between keywords and arbitrary speech. Contextual information is incorporated by a BLSTM network, providing a discrete phoneme prediction feature for the DBN. Together with continuous acoustic features, the discrete BLSTM output is processed by the DBN which detects keywords. Due to the flexible design of our Tandem BLSTM-DBN recognizer, new keywords can be added to the vocabulary without having to re-train the model. Further, our concept does not require the training of an explicit garbage model. Experiments on the TIMIT corpus show that incorporating a BLSTM network into the DBN architecture can increase true positive rates by up to 10%.

Original languageEnglish
Title of host publicationAdvances in Nonlinear Speech Processing - International Conference on Nonlinear Speech Processing, NOLISP 2009, Revised Selected Papers
Pages68-75
Number of pages8
DOIs
StatePublished - 2010
EventInternational Conference on Nonlinear Speech Processing, NOLISP 2009 - Vic, Spain
Duration: 25 Jun 200927 Jun 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5933 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Conference on Nonlinear Speech Processing, NOLISP 2009
Country/TerritorySpain
CityVic
Period25/06/0927/06/09

Keywords

  • Dynamic Bayesian Networks
  • Keyword spotting
  • Long Short-Term Memory

Fingerprint

Dive into the research topics of 'Improving keyword spotting with a tandem BLSTM-DBN architecture'. Together they form a unique fingerprint.

Cite this