bioRxiv Science⌕ Search

Biology subjects

Lim, P. C.

Publications and source records attributed to Lim, P. C..

2 recordsLinked to original sources

Deep-Learning-Based Multivariate Pattern Analysis (dMVPA): A Tutorial and a Toolbox

In recent years, multivariate pattern analysis (MVPA) has been hugely beneficial for cognitive neuroscience by making new experiment designs possible and by increasing the inferential power of functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and other neuroimaging methodologies. In a similar time frame, "deep learning" (a term for the use of artificial neural networks with convolutional, recurrent, or similarly sophisticated architectures) has produced a parallel revolution in the field of machine learning and has been employed across a wide variety of applications. Traditional MVPA also uses a form of machine learning, but most commonly with much simpler techniques based on linear calculations; a number of studies have applied deep learning techniques to neuroimaging data, but we believe that those have barely scratched the surface of the potential deep learning holds for the field. In this paper, we provide a brief introduction to deep learning for those new to the technique, explore the logistical pros and cons of using deep learning to analyze neuroimaging data - which we term "deep MVPA," or dMVPA - and introduce a new software toolbox (the "Deep Learning In Neuroimaging: Exploration, Analysis, Tools, and Education" package, DeLINEATE for short) intended to facilitate dMVPA for neuroscientists (and indeed, scientists more broadly) everywhere.

neuroscience↗

Not-so-working memory: Drift in fMRI pattern representations during maintenance predicts errors in a visual working memory task

Working memory (WM) is critical to many aspects of cognition, but it frequently fails. Much WM research has focused on capacity limits, but even for single, simple features, the fidelity of individual representations is limited. Why is this? We used fMRI and a pattern-based index of \"representational drift\" to investigate how ongoing changes in brain activity patterns throughout the WM maintenance period predicted performance, using a delayed-match-to-sample task for a single item with a single critical feature: orientation. In trials where the target and probe stimuli matched, participants incorrectly reported more non-matches when their activity patterns drifted away from the target. In trials where the target and probe did not match, participants incorrectly reported more matches when their activity patterns drifted towards the probe. Our results suggest that WM errors are not simply due to unstructured noise, but also drift within representation space that can be indexed by neuroimaging.

neuroscience↗