A Deep Learning Loss Function Based on the Perceptual Evaluation of the Speech Quality
MetadataShow full item record
AuthorMartín Doñas, Juan M.; Gómez García, Ángel Manuel; González López, José Andrés; Peinado Herreros, Antonio Miguel
Deep learning (DL)Speech enhancement
Martín-Doñas, J. M., Gomez, A. M., Gonzalez, J. A., & Peinado, A. M. (2018). A deep learning loss function based on the perceptual evaluation of the speech quality. IEEE Signal processing letters, 25(11), 1680-1684.
SponsorshipSpanish MINECO/FEDER (Grant Number: TEC2016-80141-P); Spanish Ministry of Education through the National Program FPU (Grant Number: FPU15/04161); NVIDIA Corporation with the donation of a Titan X GPU
This letter proposes a perceptual metric for speech quality evaluation, which is suitable, as a loss function, for training deep learning methods. This metric, derived from the perceptual evaluation of the speech quality algorithm, is computed in a per-frame basis and from the power spectra of the reference and processed speech signal. Thus, two disturbance terms, which account for distortion once auditory masking and threshold effects are factored in, amend the mean square error (MSE) loss function by introducing perceptual criteria based on human psychoacoustics. The proposed loss function is evaluated for noisy speech enhancement with deep neural networks. Experimental results show that our metric achieves significant gains in speech quality (evaluated using an objective metric and a listening test) when compared to using MSE or other perceptual-based loss functions from the literature.