Neural dynamics of phoneme sequencing in real speech jointly encode order and invariant content

Abstract

Speech consists of a continuously-varying acoustic signal. Yet human listeners experience it as a sequence of discrete units (phonemes and words). To identify how the brain continuously represents and updates speech units, we recorded two-hour magnetoencephalograms from 21 subjects listening to short narratives. Our encoding and decoding analyses show that the human brain uses a dynamic coding scheme to represent approximately three successive phonetic features at each time sample. These dynamic phonetic representations, not directly accessible from the acoustic signal, are active earlier when phonemes are more predictable, and are sustained when lexical identity is uncertain. The results reveal how phoneme sequences in natural speech are neurally represented and shed new light on how the human brain combines them to probe the mental lexicon. One sentence summaryThe human brain keeps track of the relative order of speech sound sequences by jointly encoding content and elapsed processing time