Automatic measurement of voice onset time and prevoicing using recurrent neural networks

Yossi Adi, Joseph Keshet, Olga Dmitrieva, Matt Goldrick

Research output: Contribution to journalConference articlepeer-review

11 Scopus citations

Abstract

Voice onset time (VOT) is defined as the time difference between the onset of the burst and the onset of voicing. When voicing begins preceding the burst, the stop is called prevoiced, and the VOT is negative. When voicing begins following the burst the VOT is positive. While most of the work on automatic measurement of VOT has focused on positive VOT mostly evident in American English, in many languages the VOT can be negative. We propose an algorithm that estimates if the stop is prevoiced, and measures either positive or negative VOT, respectively. More specifically, the input to the algorithm is a speech segment of an arbitrary length containing a single stop consonant, and the output is the time of the burst onset, the duration of the burst, and the time of the prevoicing onset with a confidence. Manually labeled data is used to train a recurrent neural network that can model the dynamic temporal behavior of the input signal, and outputs the events' onset and duration. Results suggest that the proposed algorithm is superior to the current state-of-the-art both in terms of the VOT measurement and in terms of prevoicing detection.

Original languageEnglish
Pages (from-to)3152-3155
Number of pages4
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume08-12-September-2016
DOIs
StatePublished - 2016
Event17th Annual Conference of the International Speech Communication Association, INTERSPEECH 2016 - San Francisco, United States
Duration: 8 Sep 201616 Sep 2016

Bibliographical note

Publisher Copyright:
Copyright © 2016 ISCA.

Funding

Research supported in part by NIH grant 1R21HD077140.

FundersFunder number
National Institutes of Health1R21HD077140

    Keywords

    • Prevoicing
    • Recurrent neural networks
    • Voice onset time

    Fingerprint

    Dive into the research topics of 'Automatic measurement of voice onset time and prevoicing using recurrent neural networks'. Together they form a unique fingerprint.

    Cite this