Multi-block RNN Autoencoders Enable Broadband ECoG Signal Reconstruction

Abstract

ObjectiveNeural dynamical models reconstruct neural data using dynamical systems. These models enable direct reconstruction and estimation of neural time-series data as well as estimation of neural latent states. Nonlinear neural dynamical models using recurrent neural networks in an encoder-decoder architecture have recently enabled accurate single-trial reconstructions of neural activity for neuronal spiking data. While these models have been applied to neural field potential data, they have only so far been applied to signal feature reconstruction (e.g. frequency band power), and have not yet produced direct reconstructions of broadband time-series data preserving signal phase and temporal resolution. ApproachHere we present two encoder-decoder model architectures - the RNN autoencoder (RAE) and multi-block RAE (MRAE) for direct time-series reconstruction of broadband neural data. We trained and tested models on multi-channel micro-Electricorticography (ECoG) recordings from non-human primate motor corticies during unconstrained behavior. Main ResultsWe show that RAE reconstructs micro-electrocorticography recordings, but has reconstruction accuracy that is band-limited to model scale. The MRAE architecture overcomes these time-bandwidth restrictions, yielding broadband (0-100 Hz), accurate reconstructions of ECoG data. SignificanceRAE and MRAE reconstruct broadband ECoG data through multiblock dynamical modeling. The MRAE overcomes time-bandwitdh restrictions to provide improved accuracy for long time duration signals. The reconstruction capabilities provided by these models for broadband neural signals like ECoG may enable the development of improved tools and analysis for basic scientific research and applications like brain-computer interfaces.