bioRxiv Science⌕ Search

Biology subjects

Shih, J. J.

Publications and source records attributed to Shih, J. J..

2 recordsLinked to original sources

The Nested Hierarchy of Overt, Mouthed, and Imagined Speech Activity Evident in Intracranial Recordings

Recent studies have demonstrated that it is possible to decode and synthesize various aspects of acoustic speech directly from intracranial measurements of electrophysiological brain activity. In order to continue progressing toward the development of a practical speech neuroprosthesis for the individuals with speech impairments, better understanding and modeling of imagined speech processes are required. The present study uses intracranial brain recordings from participants that performed a speaking task with trials consisting of overt, mouthed, and imagined speech, representing various degrees of decreasing behavioral output. Speech activity detection models are constructed using spatial, spectral, and temporal brain activity features, and the features and model performances are characterized and compared across the three degrees of behavioral output. The results indicate there is a hierarchy in which the relevant channels for the lower behavioral output modes form nested subsets of the relevant channels from the higher behavioral output modes. This provides important insights for the elusive goal of developing more effective imagined speech decoding models with respect to the better-established overt speech decoding counterparts.

neuroscience↗

Widespread ripples synchronize human cortical activity

Declarative memory encoding, consolidation, and retrieval require the integration of elements encoded in widespread cortical locations. The mechanism whereby such binding of different components of mental events into unified representations occurs is unknown. The binding-bysynchrony theory proposes that distributed encoding areas are bound by synchronous oscillations enabling enhanced communication. However, evidence for such oscillations is sparse. Brief high-frequency oscillations ( ripples) occur in the hippocampus and cortex, and help organize memory recall and consolidation. Here, using intracranial recordings in humans, we report that these ~70ms duration 90Hz ripples often couple (within {+/-}500ms), co-occur ([≥]25ms overlap), and crucially, phase-lock (have consistent phase-lags) between widely distributed focal cortical locations during both sleep and waking, even between hemispheres. Cortical ripple co-occurrence is facilitated through activation across multiple sites, and phaselocking increases with more cortical sites co-rippling. Ripples in all cortical areas co-occur with hippocampal ripples but do not phase-lock with them, further suggesting that cortico-cortical synchrony is mediated by cortico-cortical connections. Ripple phase-lags vary across sleep nights, consistent with participation in different networks. During waking, we show that hippocampo-cortical and cortico-cortical co-ripples increase preceding successful delayed memory recall, when binding between the cue and response is essential. Ripples increase and phase-modulate unit firing, and co-ripples increase high-frequency correlations between areas, suggesting synchronized unit-spiking facilitating information exchange. Co-occurrence, phasesynchrony, and high-frequency correlation are maintained with little decrement over very long distances (25cm). Hippocampo-cortico-cortical co-ripples appear to possess the essential properties necessary to support binding-by-synchrony during memory retrieval, and perhaps generally in cognition. Significance StatementDifferent elements of a memory, or any mental event, are encoded in locations distributed across the cortex. A prominent hypothesis proposes that widespread networks are integrated with bursts of synchronized high-frequency oscillations called ripples, but evidence is limited. Here, using recordings inside the human brain, we show that ripples occur simultaneously in multiple lobes in both cortical hemispheres, and the hippocampus, generally during sleep and waking, and especially during memory recall. Ripples phase-lock local cell firing, and phase-synchronize with little decay between locations separated by up to 25cm, enabling long-distance integration. Indeed, co-rippling sites have increased correlation of very high-frequency activity which reflects cell firing. Thus, ripples may help bind information across the cortex in memory and other mental events.

neuroscience↗