To main content

Subjective Intelligibility of Deep Neural Network-Based Speech Enhancement

Abstract

Recent literature indicates increasing interest in deep neural networks for use in speech enhancement systems. Currently, these systems are mostly evaluated through objective measures
of speech quality and/or intelligibility. Subjective intelligibility evaluations of these systems have so far not been reported. In this paper we report the results of a speech recognition test with 15 participants, where the participants were asked to pick out
words in background noise before and after enhancement using a common deep neural network approach. We found that, although the objective measure STOI predicts that intelligibility
should improve or at the very least stay the same, the speech recognition threshold, which is a measure of intelligibility, deteriorated by 4 dB. These results indicate that STOI is not a
good predictor for the subjective intelligibility of deep neural network-based speech enhancement systems. We also found that the postprocessing technique of global variance normalisation does not significantly affect subjective intelligibility.

Category

Academic article

Language

English

Author(s)

Affiliation

  • SINTEF Digital / Connectivity Technologies and Platforms

Year

2017

Published in

Interspeech (USB)

ISSN

2308-457X

Publisher

International Speech Communication Association

Volume

2017-August

Page(s)

1968 - 1972

View this publication at Cristin