PALMS: A Computational Implementation for Pavlovian Associative Learning Models Simulation

Abstract

In contrast to static formalisms, computational definitions describe the operational mechanisms of a model. Simulations are an essential part of the cycle of theory development and refinement, assisting researchers in formulating the precise definitions that models require, and making accurate predictions. This manuscript introduces a computational implementation of Pavlovian learning models in a Python environment, termed Pavlovian Associative Learning Models Simulation (PALMS). In addition to the canonical Rescorla-Wagner model, attentional approaches are implemented, including Pearce-Kaye-Hall, Mackintosh Extended, Le Pelleys Hybrid, and a novel extension of the Rescorla-Wagner model featuring a unified variable learning rate that synthesises Mackintoshs and Pearce and Halls opposing conceptualisations. To our knowledge, only the first attentional model has been previously specified computationally in a general design tool. PALMS integrates a graphical interface that permits the input of entire experimental designs in an alphanumeric format, akin to that used by experimental neuroscientists. It uniquely enables the simulation of experiments involving hundreds of stimuli, such as those used with human participants, and the computation of configural cues and configural-cue compounds across all models, thereby substantially broadening their predictive capabilities. A comprehensive description of the models implementation and the environment functionalities is provided in the paper; these include efficient and accurate operation and instant visualisation of predicted results across different models within a single architecture and environment. We evaluate PALMS by simulating five published experiments in the associative learning literature that assessed the predictive scope of existing models, and we show that this implementation provides neuroscientists with a useful tool for identifying critical variables, refining experimental designs, making precise predictions, comparing model fitness, and formulating new theoretical approaches. PALMS is licensed under the open-source GNU Lesser General Public License 3.0. The environment source code and the latest multiplatform release build are accessible as a GitHub repository at https://github.com/cal-r/PALMS-Simulator. Author summaryResearch on associative learning is multidisciplinary, encompassing disciplines such as neuroscience, AI, psychology, psychiatry, behavioural sciences, planning, and marketing. Unlike static formalisms, precise computational definitions specify how a model operates, enabling model simulation, swift and error-free prediction calculations, which are essential for testing theories, comparing predictions, holding models accountable, and providing a common language across fields. We introduce Pavlovian Associative Learning Models Simulation (PALMS), a user-friendly, open-source Python environment for simulating classical conditioning and studying the role of attention in learning. PALMS implements the prescriptive Rescorla-Wagner and attentional models: Pearce-Kaye-Hall, Mackintosh Extended, Le Pelleys Hybrid, and a new hybrid model with a unified variable learning rate that blends Mackintosh and Pearce-Halls conflicting views. Its graphical interface makes it easy for neuroscientists to enter experiments. Our computational implementation supports simulations with hundreds of stimuli, configural cues, and compounds, broadening the models predictive power. Designed for efficiency, it offers instant visual results and useful features. We evaluate PALMS by simulating five published experiments, highlighting its value for model comparison and refinement, and, more generally, as a tool to assist research.