bioRxiv Science⌕ Search

Biology subjects

Van Canneyt, J.

Publications and source records attributed to Van Canneyt, J..

6 recordsLinked to original sources

Neural tracking as an objective measure of auditory perception and speech intelligibility

When a person listens to sound, the brain time-locks to specific aspects of the sound. This is called neural tracking and it can be investigated by analysing neural responses (e.g., measured by electroencephalography) to continuous natural speech. Measures of neural tracking allow for an objective investigation of a range of auditory and linguistic processes in the brain during natural speech perception. This approach is more ecologically valid than traditional auditory evoked responses and has great potential for research and clinical applications. This article reviews the neural tracking framework and highlights three prominent examples of neural tracking analyses: neural tracking of the fundamental frequency of the voice (f0), the speech envelope and linguistic features. Each of these analyses provides a unique point of view into the human brains hierarchical stages of speech processing. F0-tracking assesses the encoding of fine temporal information in the early stages of the auditory pathway, i.e., from the auditory periphery up to early processing in the primary auditory cortex. Envelope tracking reflects bottom-up and top-down speechrelated processes in the auditory cortex and is likely necessary but not sufficient for speech intelligibility. Linguistic feature tracking (e.g. word or phoneme surprisal) relates to neural processes more directly related to speech intelligibility. Together these analyses form a multi-faceted objective assessment of an individuals auditory and linguistic processing.

neuroscience↗

Cortical compensation for hearing loss, but not age, in neural tracking of the fundamental frequency of the voice

Auditory processing is affected by advancing age and hearing loss, but the underlying mechanisms are still unclear. We investigated the effects of age and hearing loss on temporal processing of naturalistic stimuli in the auditory system. We analysed neural phase-locking to the fundamental frequency of the voice (f0) in 54 normal-hearing and 14 hearing-impaired adults between 17 and 82 years old. We found that both subcortical and cortical neural sources contributed to the responses. Results indicated that advancing age was related to smaller responses with less cortical response contributions, consistent with an age-related decrease in neural phase-locking ability. Conversely, hearing impaired subjects displayed larger responses compared to age-matched normal hearing controls. This was due to additional cortical response contributions which were stronger for participants with more severe hearing loss. This is consistent with the recruitment of additional cortical sources for auditory processing in persons with hearing impairment.

neuroscience↗

Enhanced neural tracking of the fundamental frequency of the voice

Objective F0 tracking is a novel method that investigates the neural processing of the fundamental frequency of the voice (f0) in continuous speech. Through linear modelling, a feature that reflects the stimulus f0 is predicted from the EEG data. Then, the neural response strength is evaluated through the correlation between the predicted and actual f0 feature. The aim of this study was to improve upon this f0 tracking method by optimizing the f0 feature. ApproachSpecifically, we aimed to design a feature that approximates the expected EEG responses to the f0. We hypothesized that this would improve neural tracking results, because the more similar the feature and the neural response are, the easier it will be to reconstruct the one from the other. Two techniques were explored: a phenomenological model to simulate neural processing in the auditory periphery and a low-pass filter to approximate the effect of more central processing on the f0 response. Since these optimizations target different aspects of the auditory system, they were also applied in a cumulative fashion. ResultsResults obtained from EEG evoked by a Flemish story in 34 subjects indicated that both the use of the auditory model and the addition of the low-pass filter significantly improved the correlations between the actual and reconstructed feature. The combination of both strategies almost doubled the mean correlation over subjects, from 0.78 to 0.13. Moreover, canonical correlation analysis with the modelled feature revealed two distinct processes contributing to the f0 response: one driven by the compound activity of auditory nerve fibers with center frequency up to 8 kHz and one driven predominantly by the auditory nerve fibers with center frequency below 1 kHz. SignificanceThe optimized f0 features developed in this study enhance the analysis of f0-tracking responses and facilitate future research and applications.

neuroscience↗

Neural tracking of the fundamental frequency of the voice: male voices preferred

Traditional electrophysiological methods to study temporal auditory processing of the fundamental frequency of the voice (f0) often use unnaturally repetitive stimuli. In this study, we investigated f0 processing of meaningful continuous speech. EEG responses evoked by stories in quiet were analysed with a novel method based on linear modelling that characterizes the neural tracking of the f0. We studied both the strength and the spatio-temporal properties of the f0-tracking response. Moreover, different samples of continuous speech (six stories by four speakers: two male and two female) were used to investigate the effect of voice characteristics on the f0 response. The results indicated that response strength is inversely related to f0 frequency and rate of f0 change throughout the story. As a result, the male-narrated stories in this study (low and steady f0) evoked stronger f0-tracking compared to female-narrated stories (high and variable f0), for which many responses were not significant. The spatio-temporal analysis revealed that f0-tracking response generators were not fixed in the brainstem but were voice-dependent as well. Voices with high and variable f0 evoked subcortically-dominated responses with a latency between 7 and 12 ms. Voices with low and steady f0 evoked responses that are both subcortically (latency of 13-15 ms) and cortically (latency of 23-26 ms) generated, with the right primary auditory cortex as a likely cortical source. Finally, additional experiments revealed that response strength greatly improves for voices with strong higher harmonics, which is particularly useful to boost the small responses evoked by voices with high f0.

neuroscience↗

From Modulated Noise to Natural Speech: the Effect of Stimulus Parameters on the Frequency Following Response

Frequency following responses (FFRs) can be evoked by a wide range of auditory stimuli, but for many stimulus parameters the effect on FFR strength is not fully understood. This complicates the comparison of earlier studies and the design of new studies. Furthermore, the most optimal stimulus parameters are unknown. To help resolve this issue, we investigated the effects of four important stimulus parameters and their interactions on the FFR. FFRs were measured in 16 normal hearing subjects evoked by stimuli with four levels of stimulus complexity (amplitude modulated noise, artificial vowels, natural vowels and nonsense words), three frequencies (around 105 Hz, 185 Hz and 245 Hz), three frequency contours (upward sweeping, downward sweeping and flat) and three vowels (Flemish /a:/, /u:/, and /i:/). We found that FFRs evoked by artificial vowels were on average 4 to 6 dB SNR larger than responses evoked by the other stimulus complexities, probably because of (unnaturally) strong higher harmonics. Moreover, response amplitude decreased with stimulus frequency but response SNR did not. Thirdly, frequency variation within the stimulus did not impact FFR strength, but only when rate of change remained low (e.g. not the case for sweeping natural vowels). Finally, the vowel /i:/ appeared to evoke larger response amplitudes compared to /a:/ and /u:/, but analysis power was too small to confirm this statistically. Differences in response strength between evoking vowels have been suggested to stem from destructive interference between response components. We show how a model of the auditory periphery can simulate these interference patterns and predict response strength. Altogether, the results of this study can guide stimulus choice for future FFR research and practical applications.

neuroscience↗

The effect of stimulus envelope shape on the auditory steady-state response

Auditory steady-state responses (ASSRs) are auditory evoked potentials that reflect phase-locked neural activity to periodic stimuli. ASSRs are often evoked by tones with a modulated envelope, with sinusoidal envelopes being most common. However, it is unclear if and how the shape of the envelope affects ASSR responses. In this study, we used various trapezoidal modulated tones to evoke ASSRs (modulation frequency = 40 Hz) and studied the effect of four envelope parameters: attack time, hold time, decay time and off time. ASSR measurements in 20 normal hearing subjects showed that envelope shape significantly influenced responses: increased off time and/or increased decay time led to responses with a larger signal-to-noise-ratio (SNR). Response phase delay was significantly influenced by attack time and to a lesser degree by off time. We also simulated neural population responses that approximate ASSRs with a model of the auditory periphery (Bruce et al. 2018). The modulation depth of the simulated responses, i.e. the difference between maximum and minimum firing rate, correlated highly with the response SNRs found in the ASSR measurements. Longer decay time and off time enhanced the modulation depth both by decreasing the minimum firing rate and by increasing the maximum firing rate. In conclusion, custom envelopes with long decay and off time provide larger response SNRs and the benefit over the commonly used sinusoidal envelope was in the range of several dB.

neuroscience↗