Biology subjects

Shaikh, S.

Publications and source records attributed to Shaikh, S..

3 recordsLinked to original sources

bioRxiv2020

Towards Autonomous Intra-cortical Brain Machine Interfaces: Applying Bandit Algorithms for Online Reinforcement Learning

This paper presents application of Banditron - an online reinforcement learning algorithm (RL) in a discrete state intra-cortical Brain Machine Interface (iBMI) setting. We have analyzed two datasets from non-human primates (NHPs) - NHP A and NHP B each performing a 4-option discrete control task over a total of 8 days. Results show average improvements of {approx} 15%, 6% in NHP A and 15%, 21% in NHP B over state of the art algorithms - Hebbian Reinforcement Learning (HRL) and Attention Gated Reinforcement Learning (AGREL) respectively. Apart from yielding a superior decoding performance, Banditron is also the most computationally friendly as it requires two orders of magnitude less multiply-and-accumulate operations than HRL and AGREL. Furthermore, Banditron provides average improvements of at least 40%, 15% in NHPs A, B respectively compared to popularly employed supervised methods - LDA, SVM across test days. These results pave the way towards an alternate paradigm of temporally robust hardware friendly reinforcement learning based iBMIs.

bioengineering↗

bioRxiv2019

Sparse Ensemble Machine Learning to improve robustness of long-term decoding in iBMIs

This paper presents a novel sparse ensemble based machine learning approach to enhance robustness of intracortical Brain Machine Interfaces (iBMIs) in the face of non-stationary distribution of input neural data across time. Each classifier in the ensemble is trained on a randomly sampled (with replacement) set of input channels. These sparse connections ensure that with a high chance, few of the base classifiers should be less affected by the variations in some of the recording channels. We have tested the generality of this technique on different base classifiers - linear discriminant analysis (LDA), support vector machine (SVM), extreme learning machine (ELM) and multilayer perceptron (MLP). Results show decoding accuracy improvements of up to {approx} 21%, 13%, 19%, 10% in non-human primate (NHP) A and 7%, 9%, 7%, 9% in NHP B across test days while using the sparse ensemble approach over a single classifier model for LDA, SVM, ELM and MLP algorithms respectively. The technique also holds ground when the most informative electrode on the test day is dropped. Accordingly, improvements of up to {approx} 24%, 11%, 22%, 9% in NHP A and 14%, 19%, 7%, 28% in NHP B are obtained for LDA, SVM, ELM and MLP respectively.

bioengineering↗

bioRxiv2019

Towards Intelligent Intra-cortical BMI (i2BMI):Low-power Neuromorphic Decoders that outperform Kalman Filters

Fully implantable wireless intra-cortical Brain Machine Interfaces (iBMI) is one of the most promising next frontiers in the nascent field of neurotechnology. However, scaling the number of channels in such systems by another 10X is difficult due to power and bandwidth requirements of the wireless transmitter. One promising solution for that is to include more processing, up to the decoder, in the implant so that transmission data rate is reduced drastically. Earlier work on neuromorphic decoders only showed classification of discrete states. We present results for continuous state decoding using a low power neuromorphic decoder chip termed Spike-input Extreme Learning Machine (SELMA). We compared SELMA against state of the art Steady State Kalman Filter (SSKF) across two different datasets involving a total of 4 non-human primates (NHPs). Results show at least a 10% or more increase in the fraction of variance accounted for by SELMA over SSKF across the datasets. Furthermore, estimated energy consumption comparison shows SELMA consuming {approx} 9 nJ/update against SSKFs {approx} 7.4 nJ/update for an iBMI with a 10 degree of freedom control. Thus, SELMA yields better performance against SSKF with a marginal increase in energy consumption paving the way for reducing transmission data rates in future scaled BMI systems.

bioengineering↗