bioRxiv · 10.1101/2022.05.22.492968
Brain Serotonergic Fibers Suggest Anomalous Diffusion-Based Dropout in Artificial Neural Networks
Abstract
Random dropout has become a standard regularization technique in artificial neural networks (ANNs), but it is currently unknown whether an analogous mechanism exists in biological neural networks (BioNNs). If it does, its structure is likely to be optimized by hundreds of millions of years of evolution, which may suggest novel dropout strategies in large-scale ANNs. We propose that the brain serotonergic fibers meet some of the expected criteria because of their ubiquitous presence, stochastic structure, and ability to grow throughout the individuals lifespan. Since the trajectories of serotonergic fibers can be modeled as paths of anomalous diffusion processes, in this proof-of-concept study we investigated a dropout algorithm based on the superdiffusive fractional Brownian motion (FBM). This research contributes to biologically-inspired regularization in ANNs.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Lee, C., Zhang, Z., Janusonis, S.. 2022-05-24. Brain Serotonergic Fibers Suggest Anomalous Diffusion-Based Dropout in Artificial Neural Networks. https://doi.org/10.1101/2022.05.22.492968
Cite the original work for its findings. Save a collection to share your selection of sources.