Tool and hand adaptation and localization in immersive virtual reality

Abstract

The human brain readily adapts movements to achieve motor goals. Most visuomotor adaptation studies use planar reaching with a cursor, where misaligned feedback leads to compensatory adjustments, reach aftereffects, and shifts in perceived hand location. Whether these effects extend to more natural settings and tool use remains unclear. In the Hand Experiment, we showed that in immersive virtual reality (VR), adaptation to 30{degrees} and 60{degrees} visuomotor rotations produced robust reach aftereffects and the expected shifts in hand localization. In the Pen Experiment, we extended this paradigm to a familiar hand-held tool, assessing localization of both the tool tip and the hand. Adaptation with the pen induced comparable or greater recalibration effects than with the hand-cursor, including shifts in both perceived tool and hand position. These findings demonstrate that visuomotor adaptation in immersive VR generalizes beyond cursor-based tasks, revealing how the sensorimotor system recalibrates internal representations of both the body and tools in realistic 3D environments. Author summary for PLOS ONEThis study shows that when people adapt their movements in virtual reality, the brain recalibrates not only the sensed position of the hand but also of familiar tools, highlighting how we update body and tool representations in everyday-like environments.