Frequency transfer of the ventriloquism aftereffect

Abstract

Humans localise sounds in the horizontal plane by processing level and timing differences between the ears. This neurocomputational process is continuously and adaptively calibrated using visual input, as seen in the ventriloquism after effect: a shift in sound perception toward a previously seen light. It is unknown from where in the brain this aftereffect originates; adaptation could occur at an early level in the auditory system where neurons are narrowly tuned to frequency, at a later level in the auditory system where localisation cues are extracted, or outside the auditory system at a higher-level spatial map. To investigate this, we examined how the ventriloquism aftereffect generalises across sound frequencies. Participants localised seven narrowband sounds (0.5-8 kHz), targeting different localisation cues. We found that sound localisation accuracy in darkness varied slightly with frequency. When sounds were paired with a visual stimulus that was offset by 10 deg, participants exhibited a pronounced bias toward the light of about [~]63%, corresponding to the well-known ventriloquism effect. The bias was stronger for narrowband compared to broadband sounds. After exposure to a block of these audiovisual stimuli, a ventriloquism aftereffect in the form of a spatial bias of [~]12% was observed across all tested frequencies, largely independent of the frequency of the exposure sound. Together with earlier reports of both frequency-specific and frequency-general recalibration, our results indicate that under conditions of a fixed and consistent audiovisual spatial offset, the ventriloquism aftereffect generalises across sound frequencies, consistent with adaptation at a frequency-independent multisensory spatial stage.