Audiovisual stimulation using wearable shutter glasses robustly evokes 40 Hz neuronal activity but does not modulate associative memory

Abstract

Audiovisual stimulation is a promising approach for studying and modulating human neuronal gamma (>30 Hz) oscillations and associated memory processes. Portable setups can increase ecological validity and therapeutic potential, but options remain limited. See-through shutter glasses are a new mobile technology that adds a visual flicker effect to what the user naturally sees. Here, we validated this method in a multisensory, cognitively relevant setting. We leveraged a previous experimental design from our lab, aiming to A) characterise the neuronal gamma activity evoked by shutter glasses, and B) conceptually replicate the previously reported effect of audiovisual gamma stimulation on memory accuracy, in line with a Spike Timing Dependent Plasticity model. We recorded high-density Electroencephalography (EEG) from 24 healthy participants during an associative memory task. Video-sound pairs were presented with the sound amplitude-modulated at 40 Hz and 40 Hz visual flicker elicited by the shutter glasses, with a phase offset between both modalities. The visual flicker preceded the auditory modulation by 90 or 270 degrees. Participants were asked to remember the video-sound associations. They also underwent a visual-only condition and an electrically equivalent control condition. EEG evoked power and phase coherence were reconstructed at source level and analysed along with behavioural accuracy. As expected, the shutter glasses robustly increased EEG evoked power and phase coherence at 40 Hz compared to the control condition. Effects were widespread and stronger than in a previous study not using shutter glasses. However, we did not replicate the previously reported effects of audiovisual phase offsets on memory accuracy. This could be due to reduced statistical power or methodological differences. Nonetheless, the validation of shutter glasses in a multisensory setting and the EEG analysis software, now improved and open source, enable important further investigations of audiovisual gamma stimulation in research and clinical settings.