TY - JOUR
T1 - Deep learning for environmentally robust speech recognition
T2 - An overview of recent developments
AU - Zhang, Zixing
AU - Geiger, Jürgen
AU - Pohjalainen, Jouni
AU - Mousa, Amr El Desoky
AU - Jin, Wenyu
AU - Schuller, Björn
N1 - Publisher Copyright:
© 2018 ACM.
PY - 2018/4
Y1 - 2018/4
N2 - Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition but still remains an important challenge. Data-driven supervised approaches, especially the ones based on deep neural networks, have recently emerged as potential alternatives to traditional unsupervised approaches and with sufficient training, can alleviate the shortcomings of the unsupervised methods in various real-life acoustic environments. In this light, we review recently developed, representative deep learning approaches for tackling non-stationary additive and convolutional degradation of speech with the aim of providing guidelines for those involved in the development of environmentally robust speech recognition systems. We separately discuss single- and multi-channel techniques developed for the front-end and back-end of speech recognition systems, as well as joint front-end and back-end training frameworks. In the meanwhile, we discuss the pros and cons of these approaches and provide their experimental results on benchmark databases. We expect that this overview can facilitate the development of the robustness of speech recognition systems in acoustic noisy environments.
AB - Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition but still remains an important challenge. Data-driven supervised approaches, especially the ones based on deep neural networks, have recently emerged as potential alternatives to traditional unsupervised approaches and with sufficient training, can alleviate the shortcomings of the unsupervised methods in various real-life acoustic environments. In this light, we review recently developed, representative deep learning approaches for tackling non-stationary additive and convolutional degradation of speech with the aim of providing guidelines for those involved in the development of environmentally robust speech recognition systems. We separately discuss single- and multi-channel techniques developed for the front-end and back-end of speech recognition systems, as well as joint front-end and back-end training frameworks. In the meanwhile, we discuss the pros and cons of these approaches and provide their experimental results on benchmark databases. We expect that this overview can facilitate the development of the robustness of speech recognition systems in acoustic noisy environments.
KW - Deep learning
KW - Multi-channel speech recognition
KW - Neural networks
KW - Nonstationary noise
KW - Robust speech recognition
UR - http://www.scopus.com/inward/record.url?scp=85047117711&partnerID=8YFLogxK
U2 - 10.1145/3178115
DO - 10.1145/3178115
M3 - Review article
AN - SCOPUS:85047117711
SN - 2157-6904
VL - 9
JO - ACM Transactions on Intelligent Systems and Technology
JF - ACM Transactions on Intelligent Systems and Technology
IS - 5
M1 - 49
ER -