Abstract
This paper addresses the problem of multichannel online dereverberation. The proposed method is carried out in the short-Time Fourier transform (STFT) domain, and for each frequency band independently. In the STFT domain, the time-domain room impulse response is approximately represented by the convolutive transfer function (CTF). The multichannel CTFs are adaptively identified based on the cross-relation method, and using the recursive least square criterion. Instead of the complex-valued CTF convolution model, we use a nonnegative convolution model between the STFT magnitude of the source signal and the CTF magnitude, which is just a coarse approximation of the former model, but is shown to be more robust against the CTF perturbations. Based on this nonnegative model, we propose an online STFT magnitude inverse filtering method. The inverse filters of the CTF magnitude are formulated based on the multiple-input/output inverse theorem, and adaptively estimated based on the gradient descent criterion. Finally, the inverse filtering is applied to the STFT magnitude of the microphone signals, obtaining an estimate of the STFT magnitude of the source signal. Experiments regarding both speech enhancement and automatic speech recognition are conducted, which demonstrate that the proposed method can effectively suppress reverberation, even for the difficult case of a moving speaker.
Original language | English |
---|---|
Article number | 8723138 |
Pages (from-to) | 1365-1377 |
Number of pages | 13 |
Journal | IEEE/ACM Transactions on Audio Speech and Language Processing |
Volume | 27 |
Issue number | 9 |
DOIs | |
State | Published - Sep 2019 |
Bibliographical note
Publisher Copyright:© 2014 IEEE.
Funding
Manuscript received December 5, 2018; revised April 5, 2019; accepted May 14, 2019. Date of publication May 27, 2019; date of current version June 13, 2019. This work was supported by the ERC Advanced Grant VHIA #340113. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Andy W. H. Khong. (Corresponding author: Xiaofei Li.) X. Li and R. Horaud are with the INRIA Grenoble Rhône-Alpes, Montbonnot Saint-Martin 38330, France (e-mail: [email protected]; [email protected]).
Funders | Funder number |
---|---|
Seventh Framework Programme | 340113 |
European Commission |
Keywords
- Online speech dereverberation
- channel identification
- inverse filtering
- multichannel equalization