Changing reference frames during the encoding of tactile events

The mindless act of swatting a mosquito on the hand poses a remarkable challenge for the brain. Given that the primary somatosensory cortex maps skin location independently of arm posture [1, 2], the brain must realign tactile coordinates in order to locate the origin of the stimuli in extrapersonal space. Previous studies have highlighted the behavioral relevance of such an external mapping of touch, which results from combining somatosensory input with proprioceptive and visual cues about body posture [3-7]. However, despite the widely held assumption about the existence of this remapping process from somatotopic to external space and various findings indirectly suggesting its consequences [8-11], a demonstration of its changing time course and nature was lacking. We examined the temporal course of this multisensory interaction and its implications for tactile awareness in humans using a crossmodal cueing paradigm [12, 13]. What we show is that before tactile events are referred to external locations [12-15], a fleeting, unconscious image of the tactile sensation abiding to a somatotopic frame of reference rules performance. We propose that this early somatotopic "glimpse" arises from the initial feed-forward sweep of neural activity to the primary somatosensory cortex, whereas the later externally-based, conscious experience reflects the activity of a somatosensory network involving recurrent connections from association areas.     

Spatial attention changes excitability of human visual cortex to direct stimulation

Conscious perception depends not only on sensory input, but also on attention [1, 2]. Recent studies in monkeys [3-6] and humans [7-12] suggest that influences of spatial attention on visual awareness may reflect top-down influences on excitability of visual cortex. Here we tested this specifically, by providing direct input into human visual cortex via cortical transcranial magnetic stimulation (TMS) to produce illusory visual percepts, called phosphenes. We found that a lower TMS intensity was needed to elicit a conscious phosphene when its apparent spatial location was attended, rather than unattended. Our results indicate that spatial attention can enhance visual-cortex excitability, and visual awareness, even when sensory signals from the eye via the thalamic pathway are bypassed.     

Crossmodal spatial influences of touch on extrastriate visual areas take current gaze direction into account

Recent results indicate that crossmodal interactions can affect activity in cortical regions traditionally regarded as "unimodal." Previously we found that combining touch on one hand with visual stimulation in the anatomically corresponding hemifield could boost responses in contralateral visual cortex. Here we manipulated which visual hemifield corresponded to the location of the stimulated hand, by changing gaze direction such that right-hand touch could now arise in either the left or right visual field. Crossmodal effects on visual cortex switched from one hemisphere to the other, depending on gaze direction, regardless of whether the hand was seen. This indicates that crossmodal influences of touch upon visual cortex depend on spatial alignment for the multimodal stimuli, with gaze posture taken into account.     

Characterization of visual percepts evoked by noninvasive stimulation of the human posterior parietal cortex

Phosphenes are commonly evoked by transcranial magnetic stimulation (TMS) to study the functional organization, connectivity, and excitability of the human visual brain. For years, phosphenes have been documented only from stimulating early visual areas (V1-V3) and a handful of specialized visual regions (V4, V5/MT+) in occipital cortex. Recently, phosphenes were reported after applying TMS to a region of posterior parietal cortex involved in the top-down modulation of visuo-spatial processing. In the present study, we systematically characterized parietal phosphenes to determine if they are generated directly by local mechanisms or emerge through indirect activation of other visual areas. Using technology developed in-house to record the subjective features of phosphenes, we found no systematic differences in the size, shape, location, or frame-of-reference of parietal phosphenes when compared to their occipital counterparts. In a second experiment, discrete deactivation by 1 Hz repetitive TMS yielded a double dissociation: phosphene thresholds increased at the deactivated site without producing a corresponding change at the non-deactivated location. Overall, the commonalities of parietal and occipital phosphenes, and our ability to independently modulate their excitability thresholds, lead us to conclude that they share a common neural basis that is separate from either of the stimulated regions.     

Crossmodal processing of object features in human anterior intraparietal cortex: an fMRI study implies equivalencies between humans and monkeys

The organization of macaque posterior parietal cortex (PPC) reflects its functional specialization in integrating polymodal sensory information for object recognition and manipulation. Neuropsychological and recent human imaging studies imply equivalencies between human and macaque PPC, and in particular, the cortex buried in the intraparietal sulcus (IPS). Using functional MRI, we tested the hypothesis that an area in human anterior intraparietal cortex is activated when healthy subjects perform a crossmodal visuo-tactile delayed matching-to-sample task with objects. Tactile or visual object presentation (encoding and recognition) both significantly activated anterior intraparietal cortex. As hypothesized, neural activity in this area was further enhanced when subjects transferred object information between modalities (crossmodal matching). Based on both the observed functional properties and the anatomical location, we suggest that this area in anterior IPS is the human equivalent of macaque area AIP.     

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

The rubber hand illusion (RHI) is a popular experimental paradigm. Participants view touch on an artificial rubber hand while the participants'' own hidden hand is touched. If the viewed and felt touches are given at the same time then this is sufficient to induce the compelling experience that the rubber hand is one''s own hand. The RHI can be used to investigate exactly how the brain constructs distinct body representations for one''s own body. Such representations are crucial for successful interactions with the external world. To obtain a subjective measure of the RHI, researchers typically ask participants to rate statements such as "I felt as if the rubber hand were my hand". Here we demonstrate how the crossmodal congruency task can be used to obtain an objective behavioral measure within this paradigm.The variant of the crossmodal congruency task we employ involves the presentation of tactile targets and visual distractors. Targets and distractors are spatially congruent (i.e. same finger) on some trials and incongruent (i.e. different finger) on others. The difference in performance between incongruent and congruent trials - the crossmodal congruency effect (CCE) - indexes multisensory interactions. Importantly, the CCE is modulated both by viewing a hand as well as the synchrony of viewed and felt touch which are both crucial factors for the RHI.The use of the crossmodal congruency task within the RHI paradigm has several advantages. It is a simple behavioral measure which can be repeated many times and which can be obtained during the illusion while participants view the artificial hand. Furthermore, this measure is not susceptible to observer and experimenter biases. The combination of the RHI paradigm with the crossmodal congruency task allows in particular for the investigation of multisensory processes which are critical for modulations of body representations as in the RHI.     

Right-hemispheric dominance for visual remapping in humans

We review evidence showing a right-hemispheric dominance for visuo-spatial processing and representation in humans. Accordingly, visual disorganization symptoms (intuitively related to remapping impairments) are observed in both neglect and constructional apraxia. More specifically, we review findings from the intervening saccade paradigm in humans--and present additional original data--which suggest a specific role of the asymmetrical network at the temporo-parietal junction (TPJ) in the right hemisphere in visual remapping: following damage to the right dorsal posterior parietal cortex (PPC) as well as part of the corpus callosum connecting the PPC to the frontal lobes, patient OK in a double-step saccadic task exhibited an impairment when the second saccade had to be directed rightward. This singular and lateralized deficit cannot result solely from the patient's cortical lesion and, therefore, we propose that it is due to his callosal lesion that may specifically interrupt the interhemispheric transfer of information necessary to execute accurate rightward saccades towards a remapped target location. This suggests a specialized right-hemispheric network for visuo-spatial remapping that subsequently transfers target location information to downstream planning regions, which are symmetrically organized.     

Early vision impairs tactile perception in the blind

Researchers have known for more than a century that crossing the hands can impair both tactile perception and the execution of appropriate finger movements. Sighted people find it more difficult to judge the temporal order when two tactile stimuli, one applied to either hand, are presented and their hands are crossed over the midline as compared to when they adopt a more typical uncrossed-hands posture. It has been argued that because of the dominant role of vision in motor planning and execution, tactile stimuli are remapped into externally defined coordinates (predominantly determined by visual inputs) that takes longer to achieve when external and body-centered codes (determined primarily by somatosensory/proprioceptive inputs) are in conflict and that involves both multisensory parietal and visual cortex. Here, we show that the performance of late, but not of congenitally, blind people was impaired by crossing the hands. Moreover, we provide the first empirical evidence for superior temporal order judgments (TOJs) for tactile stimuli in the congenitally blind. These findings suggest a critical role of childhood vision in modulating the perception of touch that may arise from the emergence of specific crossmodal links during development.     

Modality-specific control of strategic spatial attention in parietal cortex

The neural basis of selective spatial attention presents a significant challenge to cognitive neuroscience. Recent neuroimaging studies have suggested that regions of the parietal and temporal cortex constitute a "supramodal" network that mediates goal-directed attention in multiple sensory modalities. Here we used transcranial magnetic stimulation (TMS) to determine which cortical subregions control strategic attention in vision and touch. Healthy observers undertook an orienting task in which a central arrow cue predicted the location of a subsequent visual or somatosensory target. To determine the attentional role of cortical subregions at different stages of processing, TMS was delivered to the right hemisphere during cue or target events. Results indicated a critical role of the inferior parietal cortex in strategic orienting to visual events, but not to somatosensory events. These findings are inconsistent with the existence of a supramodal attentional network and instead provide direct evidence for modality-specific attentional processing in parietal cortex.     

Prefrontal cortex and somatosensory cortex in tactile crossmodal association: an independent component analysis of ERP recordings

Our previous studies on scalp-recorded event-related potentials (ERPs) showed that somatosensory N140 evoked by a tactile vibration in working memory tasks was enhanced when human subjects expected a coming visual stimulus that had been paired with the tactile stimulus. The results suggested that such enhancement represented the cortical activities involved in tactile-visual crossmodal association. In the present study, we further hypothesized that the enhancement represented the neural activities in somatosensory and frontal cortices in the crossmodal association. By applying independent component analysis (ICA) to the ERP data, we found independent components (ICs) located in the medial prefrontal cortex (around the anterior cingulate cortex, ACC) and the primary somatosensory cortex (SI). The activity represented by the IC in SI cortex showed enhancement in expectation of the visual stimulus. Such differential activity thus suggested the participation of SI cortex in the task-related crossmodal association. Further, the coherence analysis and the Granger causality spectral analysis of the ICs showed that SI cortex appeared to cooperate with ACC in attention and perception of the tactile stimulus in crossmodal association. The results of our study support with new evidence an important idea in cortical neurophysiology: higher cognitive operations develop from the modality-specific sensory cortices (in the present study, SI cortex) that are involved in sensation and perception of various stimuli.     

Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex

BACKGROUND: Regions in human frontal cortex may have modulatory top-down influences on retinotopic visual cortex, but to date neuroimaging methods have only been able to provide indirect evidence for such functional interactions between remote but interconnected brain regions. Here we combined transcranial magnetic stimulation (TMS) with concurrent functional magnetic resonance imaging (fMRI), plus psychophysics, to show that stimulation of the right human frontal eye-field (FEF) produced a characteristic topographic pattern of activity changes in retinotopic visual areas V1-V4, with functional consequences for visual perception. RESULTS: FEF TMS led to activity increases for retinotopic representations of the peripheral visual field, but to activity decreases for the central field, in areas V1-V4. These frontal influences on visual cortex occurred in a top-down manner, independently of visual input. TMS of a control site (vertex) did not elicit such visual modulations, and saccades, blinks, or pupil dilation could not account for our results. Finally, the effects of FEF TMS on activity in retinotopic visual cortex led to a behavioral prediction that we confirmed psychophysically by showing that TMS of the frontal site (again compared with vertex) enhanced perceived contrast for peripheral relative to central visual stimuli. CONCLUSIONS: Our results provide causal evidence that circuits originating in the human FEF can modulate activity in retinotopic visual cortex, in a manner that differentiates the central and peripheral visual field, with functional consequences for perception. More generally, our study illustrates how the new approach of concurrent TMS-fMRI can now reveal causal interactions between remote but interconnected areas of the human brain.     

Interactive coding of visual spatial frequency and auditory amplitude-modulation rate

Spatial frequency is a fundamental visual feature coded in primary visual cortex, relevant for perceiving textures, objects, hierarchical structures, and scenes, as well as for directing attention and eye movements. Temporal amplitude-modulation (AM) rate is a fundamental auditory feature coded in primary auditory cortex, relevant for perceiving auditory objects, scenes, and speech. Spatial frequency and temporal AM rate are thus fundamental building blocks of visual and auditory perception. Recent results suggest that crossmodal interactions are commonplace across the primary sensory cortices and that some of the underlying neural associations develop through consistent multisensory experience such as audio-visually perceiving speech, gender, and objects. We demonstrate that people consistently and absolutely (rather than relatively) match specific auditory AM rates to specific visual spatial frequencies. We further demonstrate that this crossmodal mapping allows amplitude-modulated sounds to guide attention to and modulate awareness of specific visual spatial frequencies. Additional results show that the crossmodal association is approximately linear, based on physical spatial frequency, and generalizes to tactile pulses, suggesting that the association develops through multisensory experience during manual exploration of surfaces.     

A Novel Approach for Documenting Phosphenes Induced by Transcranial Magnetic Stimulation

Stimulation of the human visual cortex produces a transient perception of light, known as a phosphene. Phosphenes are induced by invasive electrical stimulation of the occipital cortex, but also by non-invasive Transcranial Magnetic Stimulation (TMS)¹ of the same cortical regions. The intensity at which a phosphene is induced (phosphene threshold) is a well established measure of visual cortical excitability and is used to study cortico-cortical interactions, functional organization ², susceptibility to pathology ^3,4 and visual processing ^5-7. Phosphenes are typically defined by three characteristics: they are observed in the visual hemifield contralateral to stimulation; they are induced when the subject s eyes are open or closed, and their spatial location changes with the direction of gaze ². Various methods have been used to document phosphenes, but a standardized methodology is lacking. We demonstrate a reliable procedure to obtain phosphene threshold values and introduce a novel system for the documentation and analysis of phosphenes. We developed the Laser Tracking and Painting system (LTaP), a low cost, easily built and operated system that records the location and size of perceived phosphenes in real-time. The LTaP system provides a stable and customizable environment for quantification and analysis of phosphenes.Download video file.^{(84M, mp4)}     

Functional split between parietal and entorhinal cortices in the rat

Posterior parietal cortex (PPC) and medial entorhinal cortex (MEC) are important elements of the neural circuit for space, but whether representations in these areas are controlled by the same factors is unknown. We recorded single units simultaneously in PPC and MEC of freely foraging rats and found that a subset of PPC cells are tuned to specific modes of movement irrespective of the animals' location or heading, whereas grid cells in MEC expressed static spatial maps. The behavioral correlates of PPC cells switched completely when the same animals ran in a spatially structured maze or when they ran similar stereotypic sequences in an open arena. Representations in PPC were similar in identical mazes in different rooms where grid cells completely realigned their firing fields. The data suggest that representations in PPC are determined by the organization of actions while cells in MEC are driven by spatial inputs.     

Neonatal Restriction of Tactile Inputs Leads to Long-Lasting Impairments of Cross-Modal Processing

Optimal behavior relies on the combination of inputs from multiple senses through complex interactions within neocortical networks. The ontogeny of this multisensory interplay is still unknown. Here, we identify critical factors that control the development of visual-tactile processing by combining in vivo electrophysiology with anatomical/functional assessment of cortico-cortical communication and behavioral investigation of pigmented rats. We demonstrate that the transient reduction of unimodal (tactile) inputs during a short period of neonatal development prior to the first cross-modal experience affects feed-forward subcortico-cortical interactions by attenuating the cross-modal enhancement of evoked responses in the adult primary somatosensory cortex. Moreover, the neonatal manipulation alters cortico-cortical interactions by decreasing the cross-modal synchrony and directionality in line with the sparsification of direct projections between primary somatosensory and visual cortices. At the behavioral level, these functional and structural deficits resulted in lower cross-modal matching abilities. Thus, neonatal unimodal experience during defined developmental stages is necessary for setting up the neuronal networks of multisensory processing.     

Specificity and Plasticity of Thalamocortical Connections in Sema6A Mutant Mice

The establishment of connectivity between specific thalamic nuclei and cortical areas involves a dynamic interplay between the guidance of thalamocortical axons and the elaboration of cortical areas in response to appropriate innervation. We show here that Sema6A mutants provide a unique model to test current ideas on the interactions between subcortical and cortical guidance mechanisms and cortical regionalization. In these mutants, axons from the dorsal lateral geniculate nucleus (dLGN) are misrouted in the ventral telencephalon. This leads to invasion of presumptive visual cortex by somatosensory thalamic axons at embryonic stages. Remarkably, the misrouted dLGN axons are able to find their way to the visual cortex via alternate routes at postnatal stages and reestablish a normal pattern of thalamocortical connectivity. These findings emphasize the importance and specificity of cortical cues in establishing thalamocortical connectivity and the spectacular capacity of the early postnatal cortex for remapping initial sensory representations.     

The cutaneous rabbit illusion affects human primary sensory cortex somatotopically

We used functional magnetic resonance imaging (fMRI) to study neural correlates of a robust somatosensory illusion that can dissociate tactile perception from physical stimulation. Repeated rapid stimulation at the wrist, then near the elbow, can create the illusion of touches at intervening locations along the arm, as if a rabbit hopped along it. We examined brain activity in humans using fMRI, with improved spatial resolution, during this version of the classic cutaneous rabbit illusion. As compared with control stimulation at the same skin sites (but in a different order that did not induce the illusion), illusory sequences activated contralateral primary somatosensory cortex, at a somatotopic location corresponding to the filled-in illusory perception on the forearm. Moreover, the amplitude of this somatosensory activation was comparable to that for veridical stimulation including the intervening position on the arm. The illusion additionally activated areas of premotor and prefrontal cortex. These results provide direct evidence that illusory somatosensory percepts can affect primary somatosensory cortex in a manner that corresponds somatotopically to the illusory percept.     

Multisensory integration in cortex: shedding light on prickly issues

Interactions between different sensory modalities can be observed in unimodal areas of the cortex, as revealed by recent neuroimaging studies. A new report by Macaluso and colleagues ( [this issue of Neuron]) shows that crossmodal effects of tactile stimulation in visual cortex critically depend on the spatial congruence of multisensory inputs. This work is discussed in relation to neural and computational models of multisensory integration.     

A novel somatosensory spatial navigation system outside the hippocampal formation

Spatially selective firing of place cells, grid cells, boundary vector/border cells and head direction cells constitutes the basic building blocks of a canonical spatial navigation system centered on the hippocampal-entorhinal complex. While head direction cells can be found throughout the brain, spatial tuning outside the hippocampal formation is often non-specific or conjunctive to other representations such as a reward. Although the precise mechanism of spatially selective firing activity is not understood, various studies show sensory inputs, particularly vision, heavily modulate spatial representation in the hippocampal-entorhinal circuit. To better understand the contribution of other sensory inputs in shaping spatial representation in the brain, we performed recording from the primary somatosensory cortex in foraging rats. To our surprise, we were able to detect the full complement of spatially selective firing patterns similar to that reported in the hippocampal-entorhinal network, namely, place cells, head direction cells, boundary vector/border cells, grid cells and conjunctive cells, in the somatosensory cortex. These newly identified somatosensory spatial cells form a spatial map outside the hippocampal formation and support the hypothesis that location information modulates body representation in the somatosensory cortex. Our findings provide transformative insights into our understanding of how spatial information is processed and integrated in the brain, as well as functional operations of the somatosensory cortex in the context of rehabilitation with brain-machine interfaces.Subject terms: Biological techniques, Cell biology     

Noninformative vision improves the spatial resolution of touch in humans

Research on sensory perception now often considers more than one sense at a time. This approach reflects real-world situations, such as when a visible object touches us. Indeed, vision and touch show great interdependence: the sight of a body part can reduce tactile target detection times [1], visual and tactile attentional systems are spatially linked [2], and the texture of surfaces that are actively touched with the fingertips is perceived using both vision and touch [3]. However, these previous findings might be mediated by spatial attention [1, 2] or by improved guidance of movement [3] via visually enhanced body position sense [4--6]. Here, we investigate the direct effects of viewing the body on passive touch. We measured tactile two-point discrimination thresholds [7] on the forearm while manipulating the visibility of the arm but holding gaze direction constant. The spatial resolution of touch was better when the arm was visible than when it was not. Tactile performance was further improved when the view of the arm was magnified. In contrast, performance was not improved by viewing a neutral object at the arm's location, ruling out improved spatial orienting as a possible account. Controls confirmed that no information about the tactile stimulation was provided by visibility of the arm. This visual enhancement of touch may point to online reorganization of tactile receptive fields.