Top-down modulation of neural envelope tracking: the interplay with behavioral, self-reported and neural measures of listening effort

Abstract

When listening to natural speech, our neural activity tracks the speech envelope. Moreover, recent research has demonstrated that this neural envelope tracking can be affected by top-down processes. The present study was designed to examine if neural envelope tracking is modulated by the effort that a person expends during listening. Five measures were included to quantify listening effort: two behavioral measures based on a novel dual-task paradigm, a self-report effort measure and two neural measures related to neural phase synchronization and alpha power. Electroencephalography responses to sentences, presented at a wide range of subject-specific signal-to-noise ratios, were recorded in thirteen young, normal-hearing adults. A comparison of the five measures revealed different effects of listening effort as a function of speech understanding. Reaction times on the primary task and self-reported effort decreased with increasing speech understanding. In contrast, reaction times on the secondary task and alpha power showed a peak-shaped behavior with highest effort at intermediate speech understanding levels. We found a positive association between envelope tracking and speech understanding. While a significant effect of listening effort was found on theta-band envelope tracking, the effect size was negligible. Therefore, our results suggest that listening effort is not a confound when using envelope tracking to objectively measure speech understanding in young, normal-hearing adults.