Skip to main navigation Skip to search Skip to main content

Decoupled Multiple Speaker Direction-of-Arrival Estimator Under Reverberant Environments

  • Yonggang Hu
  • , Prasanga N. Samarasinghe
  • , Sharon Gannot
  • , Thushara D. Abhayapala
  • Australian National University

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

Direction-of-arrival (DOA) estimation for multiple simultaneous speakers in reverberant environments is still one of the challenging tasks in the audio signal processing field. A recent approach addresses this problem using a spherical harmonics domain feature named relative harmonic coefficients (RHC). Based on a bin-wise operation across the STFT (short-time Fourier transform) domain, this method detects the direct-path RHC in the first stage, followed by single source localization in the second stage. However, the method is computationally expensive as each STFT bin requires an exhaustive grid search over the two-dimensional (2-D) directional space. In this paper, we propose a significantly more computationally efficient alternative that decouples the azimuth and elevation 2-D search to two separate one-dimensional (1-D) search. The proposed multi-speaker localization algorithm comprises of two main steps, responsible for: (i) achieving a joint direct-path RHC detection and decoupled DOA estimation using 1-D search; and (ii) counting the number of speakers and estimating their DOAs based on the estimates from direct-path dominated STFT bins. Experiments using both simulated and real-life reverberant recordings confirm the significant computational complexity reduction while achieving competitive localization accuracy, compared to the baseline approaches. Although our proposed method performs in an unsupervised manner, it proves to be applicable even under unfavorable acoustic environments with a high reverberation level (e.g., T 60=1 second).

Original languageEnglish
Pages (from-to)3120-3133
Number of pages14
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Volume30
DOIs
StatePublished - 2022

Bibliographical note

Publisher Copyright:
© 2014 IEEE.

Keywords

  • Computationally efficient
  • decoupled DOA estimation
  • direct-path RHCs
  • multiple speaker DOA estimations
  • reverberant environments

Fingerprint

Dive into the research topics of 'Decoupled Multiple Speaker Direction-of-Arrival Estimator Under Reverberant Environments'. Together they form a unique fingerprint.

Cite this