“Um…, It’s Really Difficult to… Um… Speak Fluently”: Neural Tracking of Spontaneous Speech

Galit Agmon, Manuela Jaeger, Reut Tsarfaty, Martin G. Bleichner, Elana Zion Golumbic

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Spontaneous real-life speech is imperfect in many ways. It contains disfluencies and ill-formed utterances and has a highly variable rate. When listening to spontaneous speech, the brain needs to contend with these features in order to extract the speaker’s meaning. Here, we studied how the neural response is affected by four specific factors that are prevalent in spontaneous colloquial speech: (1) the presence of fillers, (2) the need to detect syntactic boundaries in disfluent speech, and (3) variability in speech rate. Neural activity was recorded (using electroencephalography) from individuals as they listened to an unscripted, spontaneous narrative, which was analyzed in a time-resolved fashion to identify fillers and detect syntactic boundaries. When considering these factors in a speech-tracking analysis, which estimates a temporal response function (TRF) to describe the relationship between the stimulus and the neural response it generates, we found that the TRF was affected by all of them. This response was observed for lexical words but not for fillers, and it had an earlier onset for opening words vs. closing words of a clause and for clauses with slower speech rates. These findings broaden ongoing efforts to understand neural processing of speech under increasingly realistic conditions. They highlight the importance of considering the imperfect nature of real-life spoken language, linking past research on linguistically well-formed and meticulously controlled speech to the type of speech that the brain actually deals with on a daily basis.

Original languageEnglish
Pages (from-to)435-454
Number of pages20
JournalNeurobiology of Language
Volume4
Issue number3
DOIs
StatePublished - 30 Aug 2023

Bibliographical note

Publisher Copyright:
© 2023 Massachusetts Institute of Technology Published under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.

Funding

We would like to thank Paz Har-shai Yahav, Rotem Budagzad-Jacobson, Orel Levi, and Shiraz Levi for their assistance in speech annotation and data collection. Elana Zion Golumbic, Ministry of Science and Technology, Israel (https://dx.doi.org/10.13039 /501100006245), Award ID: 88962. Elana Zion Golumbic, Deutsche Forschungsgemeinschaft (https://dx.doi.org/10.13039/501100001659), Award ID: 490839860. Martin G. Bleichner, Deutsche Forschungsgemeinschaft (https://dx.doi.org/10.13039/501100001659), Award ID: 490839860. Martin G. Bleichner, Deutsche Forschungsgemeinschaft (https://dx.doi.org/10.13039/501100001659), Award ID: 411333557. Manuela Jaeger, Deutsche Forschungsgemeinschaft (https://dx.doi.org/10.13039/501100001659), Award ID: 490839860.

FundersFunder number
Deutsche Forschungsgemeinschaft490839860, 411333557
Ministry of science and technology, Israel88962

    Keywords

    • TRF analysis
    • disfluencies
    • speech rate
    • spontaneous speech
    • syntactic boundaries

    Fingerprint

    Dive into the research topics of '“Um…, It’s Really Difficult to… Um… Speak Fluently”: Neural Tracking of Spontaneous Speech'. Together they form a unique fingerprint.

    Cite this