Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment

Rotem Rousso, Eyal Cohen, Joseph Keshet, Eleanor Chodroff

Research output: Contribution to journalConference articlepeer-review

Abstract

Forced alignment (FA) plays a key role in speech research through the automatic time alignment of speech signals with corresponding text transcriptions. Despite the move towards end-to-end architectures for speech technology, FA is still dominantly achieved through a classic GMM-HMM acoustic model. This work directly compares alignment performance from leading automatic speech recognition (ASR) methods, WhisperX and Massively Multilingual Speech Recognition (MMS), against a Kaldi-based GMM-HMM system, the Montreal Forced Aligner (MFA). Performance was assessed on the manually aligned TIMIT and Buckeye datasets, with comparisons conducted only on words correctly recognized by WhisperX and MMS. The MFA outperformed both WhisperX and MMS, revealing a shortcoming of modern ASR systems. These findings highlight the need for advancements in forced alignment and emphasize the importance of integrating traditional expertise with modern innovation to foster progress.

Original languageEnglish
Pages (from-to)1525-1529
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
DOIs
StatePublished - 2024
Externally publishedYes
Event25th Interspeech Conferece 2024 - Kos Island, Greece
Duration: 1 Sep 20245 Sep 2024

Bibliographical note

Publisher Copyright:
© 2024 International Speech Communication Association. All rights reserved.

Keywords

  • forced alignment
  • phoneme alignment
  • word alignment

Fingerprint

Dive into the research topics of 'Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment'. Together they form a unique fingerprint.

Cite this