bioRxiv Science⌕ Search

Biology subjects

Sohoglu, E.

Publications and source records attributed to Sohoglu, E..

6 recordsLinked to original sources

Cortical tracking of connected speech is interactively modulated by top-down predictions and bottom-up signal quality

Prediction facilitates speech comprehension, but how predictions are combined with sensory input during perception remains unclear. Prior studies suggest that prediction error computations -- which represent the difference between heard and expected speech sounds -- play a central role in speech perception. However, these studies have relied on non-ecological listening conditions, involving isolated words predicted by artificial cues. In two experiments, we presented 61 listeners with semantically coherent sentences that ended in words of varying predictability. We also manipulated the signal quality of the final word by applying time-limited degradation. Using linear encoding models of EEG responses, we found that neural representations of speech features were jointly influenced by top-down predictions and bottom-up signal quality. Specifically, for unpredicted final words, increasing signal quality resulted in enhanced neural tracking of speech acoustic modulations in low frequency EEG (0-2 Hz delta band). In contrast, for strongly predicted final words, greater signal quality led to reduced tracking of speech modulations. Computational simulations revealed that this interaction is consistent with prediction error computations, but not with an alternative signal sharpening model. These findings extend the evidence for prediction error computations to more naturalistic listening situations.

neuroscience↗

Convergent neural signatures of speech prediction error across space, time and frequency

We used MEG and fMRI to determine how predictions are combined with speech input in superior temporal cortex. We compared neural responses to bisyllabic spoken words in which the first syllable strongly or weakly predicts the form of the second syllable (e.g. "bingo" versus "tango"). We further compared neural responses to the same second syllables when heard in an unfamiliar pseudoword and therefore in a situation in which predictions mismatch with sensory input (e.g. "snigo" and "meago"). Across multiple imaging modalities and analysis approaches (including information-based pattern analysis methods), we show that neural representations of second syllables are suppressed by strong predictions when predictions match sensory input. However, neural representations of the same second syllables show the opposite effect (i.e. enhanced representations following strongly than weakly-predicting syllables) when predictions mismatch with sensory input. Computational simulations show that this interaction between prediction strength and (mis)match is consistent with prediction error but not alternative (sharpened signal) computations. Neural signatures of prediction error are observed early (beginning 200 ms after the onset of the second syllable), localise to early auditory regions (in fMRI, bilateral Heschls gyrus and STG) and are expressed as changes in low-frequency (theta and alpha) power. Our study therefore provides convergent neural evidence that speech perception is supported by the computation of prediction errors in auditory brain regions. These prediction error computations play a central role in the identification of familiar spoken words and perception of unfamiliar pseudowords.

neuroscience↗

Predictive Neural Computations Support Spoken Word Recognition: Evidence from MEG and Competitor Priming

Human listeners achieve quick and effortless speech comprehension through computations of conditional probability using Bayes rule. However, the neural implementation of Bayesian perceptual inference remains unclear. Competitive-selection accounts (e.g. TRACE) propose that word recognition is achieved through direct inhibitory connections between units representing candidate words that share segments (e.g. hygiene and hijack share /haid{ezh}/). Manipulations that increase lexical uncertainty should increase neural responses associated with word recognition when words cannot be uniquely identified. In contrast, predictive-selection accounts (e.g. Predictive-Coding) proposes that spoken word recognition involves comparing heard and predicted speech sounds and using prediction error to update lexical representations. Increased lexical uncertainty in words like hygiene and hijack will increase prediction error and hence neural activity only at later time points when different segments are predicted. We collected MEG data from male and female listeners to test these two Bayesian mechanisms and used a competitor priming manipulation to change the prior probability of specific words. Lexical decision responses showed delayed recognition of target words (hygiene) following presentation of a neighbouring prime word (hijack) several minutes earlier. However, this effect was not observed with pseudoword primes (higent) or targets (hijure). Crucially, MEG responses in the STG showed greater neural responses for word-primed words after the point at which they were uniquely identified (after /haid{ezh}/ in hygiene) but not before while similar changes were again absent for pseudowords. These findings are consistent with accounts of spoken word recognition in which neural computations of prediction error play a central role. Significance StatementEffective speech perception is critical to daily life and involves computations that combine speech signals with prior knowledge of spoken words; that is, Bayesian perceptual inference. This study specifies the neural mechanisms that support spoken word recognition by testing two distinct implementations of Bayes perceptual inference. Most established theories propose direct competition between lexical units such that inhibition of irrelevant candidates leads to selection of critical words. Our results instead support predictive-selection theories (e.g. Predictive-Coding): by comparing heard and predicted speech sounds, neural computations of prediction error can help listeners continuously update lexical probabilities, allowing for more rapid word identification.

neuroscience↗

Sustained neural rhythms reveal endogenous oscillations supporting speech perception

Rhythmic sensory or electrical stimulation will produce rhythmic brain responses. These rhythmic responses are often interpreted as endogenous neural oscillations aligned (or "entrained") to the stimulus rhythm. However, stimulus-aligned brain responses can also be explained as a sequence of evoked responses, which only appear regular due to the rhythmicity of the stimulus, without necessarily involving underlying neural oscillations. To distinguish evoked responses from true oscillatory activity, we tested whether rhythmic stimulation produces oscillatory responses which continue after the end of the stimulus. Such sustained effects provide evidence for true involvement of neural oscillations. In Experiment 1, we found that rhythmic intelligible, but not unintelligible speech produces oscillatory responses in magnetoencephalography (MEG) which outlast the stimulus at parietal sensors. In Experiment 2, we found that transcranial alternating current stimulation (tACS) leads to rhythmic fluctuations in speech perception outcomes after the end of electrical stimulation. We further report that the phase relation between electroencephalography (EEG) responses and rhythmic intelligible speech can predict the tACS phase that leads to most accurate speech perception. Together, we provide fundamental results for several lines of research - including neural entrainment and tACS - and reveal endogenous neural oscillations as a key underlying principle for speech perception.

neuroscience↗

Rapid computations of spectrotemporal prediction error support perception of degraded speech

Human speech perception can be described as Bayesian perceptual inference but how are these Bayesian computations instantiated neurally? We use magnetoencephalographic recordings of brain responses to degraded spoken words as a function of signal quality and prior knowledge to demonstrate that spectrotemporal modulations in speech are more clearly represented in neural responses than alternative speech representations (e.g. spectrogram or articulatory features). We found an interaction between speech signal quality and expectations from prior written text on the quality of neural representations; increased signal quality enhanced neural representations of speech that mismatched with prior expectations, but led to greater suppression of speech that matched prior expectations. This interaction is a unique neural signature of prediction error computations and already apparent in neural responses within 250 ms of speech input. Our findings contribute towards the detailed specification of a computational model of speech perception based on predictive coding frameworks.

neuroscience↗

Multivoxel codes for representing and integrating acoustic features in human cortex

Using fMRI and multivariate pattern analysis, we determined whether acoustic features are represented by independent or integrated neural codes in human cortex. Male and female listeners heard band-pass noise varying simultaneously in spectral (frequency) and temporal (amplitude-modulation [AM] rate) features. In the superior temporal plane, changes in multivoxel activity due to frequency were largely invariant with respect to AM rate (and vice versa), consistent with an independent representation. In contrast, in posterior parietal cortex, neural representation was exclusively integrated and tuned to specific conjunctions of frequency and AM features. Direct between-region comparisons show that whereas independent coding of frequency and AM weakened with increasing levels of the hierarchy, integrated coding strengthened at the transition between non-core and parietal cortex. Our findings support the notion that primary auditory cortex can represent component acoustic features in an independent fashion and suggest a role for parietal cortex in feature integration and the structuring of acoustic input.\n\nSignificance statementA major goal for neuroscience is discovering the sensory features to which the brain is tuned and how those features are integrated into cohesive perception. We used whole-brain human fMRI and a statistical modeling approach to quantify the extent to which sound features are represented separately or in an integrated fashion in cortical activity patterns. We show that frequency and AM rate, two acoustic features that are fundamental to characterizing biological important sounds such as speech, are represented separately in primary auditory cortex but in an integrated fashion in parietal cortex. These findings suggest that representations in primary auditory cortex can be simpler than previously thought and also implicate a role for parietal cortex in integrating features for coherent perception.

neuroscience↗