Perception of Body Ownership Is Driven by Bayesian Sensory Inference

Recent studies have shown that human perception of body ownership is highly malleable. A well-known example is the rubber hand illusion (RHI) wherein ownership over a dummy hand is experienced, and is generally believed to require synchronized stroking of real and dummy hands. Our goal was to elucidate the computational principles governing this phenomenon. We adopted the Bayesian causal inference model of multisensory perception and applied it to visual, proprioceptive, and tactile stimuli. The model reproduced the RHI, predicted that it can occur without tactile stimulation, and that synchronous stroking would enhance it. Various measures of ownership across two experiments confirmed the predictions: a large percentage of individuals experienced the illusion in the absence of any tactile stimulation, and synchronous stroking strengthened the illusion. Altogether, these findings suggest that perception of body ownership is governed by Bayesian causal inference—i.e., the same rule that appears to govern the perception of outside world.     

Bodily illusions modulate tactile perception

Touch differs from other exteroceptive senses in that the body itself forms part of the tactile percept. Interactions between proprioception and touch provide a powerful way to investigate the implicit body representation underlying touch. Here, we demonstrate that an intrinsic primary quality of a tactile object, for example its size, is directly affected by the perceived size of the body part touching it. We elicited proprioceptive illusions that the left index finger was either elongating or shrinking by vibrating the biceps or triceps tendon of the right arm while subjects grasped the tip of their left index finger. Subjects estimated the distance between two simultaneous tactile contacts on the left finger during tendon vibration. We found that tactile distances feel bigger when the touched body part feels elongated. Control tests showed that the modulation of touch was linked to the perceived index-finger size induced by tendon vibration. Vibrations that did not produce proprioceptive illusion had no effect on touch. Our results show that the perception of tactile objects is referenced to an implicit body representation and that proprioception contributes to this body representation. We also provide, for the first time, a quantitative, implicit measure of distortions of body size.     

Changing reference frames during the encoding of tactile events

The mindless act of swatting a mosquito on the hand poses a remarkable challenge for the brain. Given that the primary somatosensory cortex maps skin location independently of arm posture [1, 2], the brain must realign tactile coordinates in order to locate the origin of the stimuli in extrapersonal space. Previous studies have highlighted the behavioral relevance of such an external mapping of touch, which results from combining somatosensory input with proprioceptive and visual cues about body posture [3-7]. However, despite the widely held assumption about the existence of this remapping process from somatotopic to external space and various findings indirectly suggesting its consequences [8-11], a demonstration of its changing time course and nature was lacking. We examined the temporal course of this multisensory interaction and its implications for tactile awareness in humans using a crossmodal cueing paradigm [12, 13]. What we show is that before tactile events are referred to external locations [12-15], a fleeting, unconscious image of the tactile sensation abiding to a somatotopic frame of reference rules performance. We propose that this early somatotopic "glimpse" arises from the initial feed-forward sweep of neural activity to the primary somatosensory cortex, whereas the later externally-based, conscious experience reflects the activity of a somatosensory network involving recurrent connections from association areas.     

Crossing the Hands Increases Illusory Self-Touch

Manipulation of hand posture, such as crossing the hands, has been frequently used to study how the body and its immediately surrounding space are represented in the brain. Abundant data show that crossed arms posture impairs remapping of tactile stimuli from somatotopic to external space reference frame and deteriorates performance on several tactile processing tasks. Here we investigated how impaired tactile remapping affects the illusory self-touch, induced by the non-visual variant of the rubber hand illusion (RHI) paradigm. In this paradigm blindfolded participants (Experiment 1) had their hands either uncrossed or crossed over the body midline. The strength of illusory self-touch was measured with questionnaire ratings and proprioceptive drift. Our results showed that, during synchronous tactile stimulation, the strength of illusory self-touch increased when hands were crossed compared to the uncrossed posture. Follow-up experiments showed that the increase in illusion strength was not related to unfamiliar hand position (Experiment 2) and that it was equally strengthened regardless of where in the peripersonal space the hands were crossed (Experiment 3). However, while the boosting effect of crossing the hands was evident from subjective ratings, the proprioceptive drift was not modulated by crossed posture. Finally, in contrast to the illusion increase in the non-visual RHI, the crossed hand postures did not alter illusory ownership or proprioceptive drift in the classical, visuo-tactile version of RHI (Experiment 4). We argue that the increase in illusory self-touch is related to misalignment of somatotopic and external reference frames and consequently inadequate tactile-proprioceptive integration, leading to re-weighting of the tactile and proprioceptive signals.The present study not only shows that illusory self-touch can be induced by crossing the hands, but importantly, that this posture is associated with a stronger illusion.     

Rubber hands feel touch, but not in blind individuals

Psychology and neuroscience have a long-standing tradition of studying blind individuals to investigate how visual experience shapes perception of the external world. Here, we study how blind people experience their own body by exposing them to a multisensory body illusion: the somatic rubber hand illusion. In this illusion, healthy blindfolded participants experience that they are touching their own right hand with their left index finger, when in fact they are touching a rubber hand with their left index finger while the experimenter touches their right hand in a synchronized manner (Ehrsson et al. 2005). We compared the strength of this illusion in a group of blind individuals (n = 10), all of whom had experienced severe visual impairment or complete blindness from birth, and a group of age-matched blindfolded sighted participants (n = 12). The illusion was quantified subjectively using questionnaires and behaviorally by asking participants to point to the felt location of the right hand. The results showed that the sighted participants experienced a strong illusion, whereas the blind participants experienced no illusion at all, a difference that was evident in both tests employed. A further experiment testing the participants' basic ability to localize the right hand in space without vision (proprioception) revealed no difference between the two groups. Taken together, these results suggest that blind individuals with impaired visual development have a more veridical percept of self-touch and a less flexible and dynamic representation of their own body in space compared to sighted individuals. We speculate that the multisensory brain systems that re-map somatosensory signals onto external reference frames are less developed in blind individuals and therefore do not allow efficient fusion of tactile and proprioceptive signals from the two upper limbs into a single illusory experience of self-touch as in sighted individuals.     

Differential Contributions of Vision,Touch and Muscle Proprioception to the Coding of Hand Movements

To further elucidate the mechanisms underlying multisensory integration, this study examines the controversial issue of whether congruent inputs from three different sensory sources can enhance the perception of hand movement. Illusory sensations of clockwise rotations of the right hand were induced by either separately or simultaneously stimulating visual, tactile and muscle proprioceptive channels at various intensity levels. For this purpose, mechanical vibrations were applied to the pollicis longus muscle group in the subjects’ wrists, and a textured disk was rotated under the palmar skin of the subjects’ right hands while a background visual scene was projected onto the rotating disk. The elicited kinaesthetic illusions were copied by the subjects in real time and the EMG activity in the adductor and abductor wrist muscles was recorded. The results show that the velocity of the perceived movements and the amplitude of the corresponding motor responses were modulated by the nature and intensity of the stimulation. Combining two sensory modalities resulted in faster movement illusions, except for the case of visuo-tactile co-stimulation. When a third sensory input was added to the bimodal combinations, the perceptual responses increased only when a muscle proprioceptive stimulation was added to a visuo-tactile combination. Otherwise, trisensory stimulation did not override bimodal conditions that already included a muscle proprioceptive stimulation. We confirmed that vision or touch alone can encode the kinematic parameters of hand movement, as is known for muscle proprioception. When these three sensory modalities are available, they contribute unequally to kinaesthesia. In addition to muscle proprioception, the complementary kinaesthetic content of visual or tactile inputs may optimize the velocity estimation of an on-going movement, whereas the redundant kinaesthetic content of the visual and tactile inputs may rather enhance the latency of the perception.     

Noradrenergic modulation of tactile responses in rat cortex. Current source-density and unit analyses

This study describes the noradrenergic modulation of tactile afferent information in the sensorimotor cortex of urethane-anesthetized rats. Synaptic and spike responses to a mechanical stimulation of the hand palm were evaluated by means of current source-density analysis and unit activity recording in all cortical layers. Results showed that activation of the locus coeruleus decreased and shortened afferent synaptic excitation in supragranular, but not in deep layers. On the average, unit responses exhibited facilitated latency, moderately increased amplitude, enhanced postexcitatory inhibition and synchronization of responses across layers. The apparent paradox of this global phasic facilitation correlated with a decrease in input synaptic currents was discussed according to hypotheses which might explain its functional significance.     

Early vision impairs tactile perception in the blind

Researchers have known for more than a century that crossing the hands can impair both tactile perception and the execution of appropriate finger movements. Sighted people find it more difficult to judge the temporal order when two tactile stimuli, one applied to either hand, are presented and their hands are crossed over the midline as compared to when they adopt a more typical uncrossed-hands posture. It has been argued that because of the dominant role of vision in motor planning and execution, tactile stimuli are remapped into externally defined coordinates (predominantly determined by visual inputs) that takes longer to achieve when external and body-centered codes (determined primarily by somatosensory/proprioceptive inputs) are in conflict and that involves both multisensory parietal and visual cortex. Here, we show that the performance of late, but not of congenitally, blind people was impaired by crossing the hands. Moreover, we provide the first empirical evidence for superior temporal order judgments (TOJs) for tactile stimuli in the congenitally blind. These findings suggest a critical role of childhood vision in modulating the perception of touch that may arise from the emergence of specific crossmodal links during development.     

Neural mechanisms of tactile motion integration in somatosensory cortex

How are local motion signals integrated to form a global motion percept? We investigate the neural mechanisms of tactile motion integration by presenting tactile gratings and plaids to the fingertips of monkeys, using the tactile analogue of a visual monitor and recording the responses evoked in somatosensory cortical neurons. The perceived directions of the gratings and plaids are measured in parallel psychophysical experiments. We identify a population of somatosensory neurons that exhibit integration properties comparable to those induced by analogous visual stimuli in area MT and find that these neural responses account for the perceived direction of the stimuli across all stimulus conditions tested. The preferred direction of the neurons and the perceived direction of the stimuli can be predicted from the weighted average of the directions of the individual stimulus features, highlighting that the somatosensory system implements a vector average mechanism to compute tactile motion direction that bears striking similarities to its visual counterpart.     

Losing One's Hand: Visual-Proprioceptive Conflict Affects Touch Perception

Background

While the sense of bodily ownership has now been widely investigated through the rubber hand illusion (RHI), very little is known about the sense of disownership. It has been hypothesized that the RHI also affects the ownership feelings towards the participant''s own hand, as if the rubber hand replaced the participant''s actual hand. Somatosensory changes observed in the participants'' hand while experiencing the RHI have been taken as evidence for disownership of their real hand. Here we propose a theoretical framework to disambiguate whether such somatosensory changes are to be ascribed to the disownership of the real hand or rather to the anomalous visuo-proprioceptive conflict experienced by the participant during the RHI.

Methodology/Principal Findings

In experiment 1, reaction times (RTs) to tactile stimuli delivered to the participants'' hand slowed down following the establishment of the RHI. In experiment 2, the misalignment of visual and proprioceptive inputs was obtained via prismatic displacement, a situation in which ownership of the seen hand was doubtless. This condition slowed down the participants'' tactile RTs. Thus, similar effects on touch perception emerged following RHI and prismatic displacement. Both manipulations also induced a proprioceptive drift, toward the fake hand in the first experiment and toward the visual position of the participants'' hand in the second experiment.

Conclusions/Significance

These findings reveal that somatosensory alterations in the experimental hand resulting from the RHI result from cross-modal mismatch between the seen and felt position of the hand. As such, they are not necessarily a signature of disownership.     

Vestibular-Somatosensory Interactions: Effects of Passive Whole-Body Rotation on Somatosensory Detection

Vestibular signals are strongly integrated with information from several other sensory modalities. For example, vestibular stimulation was reported to improve tactile detection. However, this improvement could reflect either a multimodal interaction or an indirect interaction driven by vestibular effects on spatial attention and orienting. Here we investigate whether natural vestibular activation induced by passive whole-body rotation influences tactile detection. In particular, we assessed the ability to detect faint tactile stimuli to the fingertips of the left and right hand during spatially congruent or incongruent rotations. We found that passive whole-body rotations significantly enhanced sensitivity to faint shocks, without affecting response bias. Critically, this enhancement of somatosensory sensitivity did not depend on the spatial congruency between the direction of rotation and the hand stimulated. Thus, our results support a multimodal interaction, likely in brain areas receiving both vestibular and somatosensory signals.     

Touch inhibits touch: sanshool-induced paradoxical tingling reveals perceptual interaction between somatosensory submodalities

Human perception of touch is mediated by inputs from multiple channels. Classical theories postulate independent contributions of each channel to each tactile feature, with little or no interaction between channels. In contrast to this view, we show that inputs from two sub-modalities of mechanical input channels interact to determine tactile perception. The flutter-range vibration channel was activated anomalously using hydroxy-α-sanshool, a bioactive compound of Szechuan pepper, which chemically induces vibration-like tingling sensations. We tested whether this tingling sensation on the lips was modulated by sustained mechanical pressure. Across four experiments, we show that sustained touch inhibits sanshool tingling sensations in a location-specific, pressure-level and time-dependent manner. Additional experiments ruled out the mediation of this interaction by nociceptive or affective (C-tactile) channels. These results reveal novel inhibitory influence from steady pressure onto flutter-range tactile perceptual channels, consistent with early-stage interactions between mechanoreceptor inputs within the somatosensory pathway.     

Virtual Hand Illusion Induced by Visuomotor Correlations

Background

Our body schema gives the subjective impression of being highly stable. However, a number of easily-evoked illusions illustrate its remarkable malleability. In the rubber-hand illusion, illusory ownership of a rubber-hand is evoked by synchronous visual and tactile stimulation on a visible rubber arm and on the hidden real arm. Ownership is concurrent with a proprioceptive illusion of displacement of the arm position towards the fake arm. We have previously shown that this illusion of ownership plus the proprioceptive displacement also occurs towards a virtual 3D projection of an arm when the appropriate synchronous visuotactile stimulation is provided. Our objective here was to explore whether these illusions (ownership and proprioceptive displacement) can be induced by only synchronous visuomotor stimulation, in the absence of tactile stimulation.

Methodology/Principal Findings

To achieve this we used a data-glove that uses sensors transmitting the positions of fingers to a virtually projected hand in the synchronous but not in the asynchronous condition. The illusion of ownership was measured by means of questionnaires. Questions related to ownership gave significantly larger values for the synchronous than for the asynchronous condition. Proprioceptive displacement provided an objective measure of the illusion and had a median value of 3.5 cm difference between the synchronous and asynchronous conditions. In addition, the correlation between the feeling of ownership of the virtual arm and the size of the drift was significant.

Conclusions/Significance

We conclude that synchrony between visual and proprioceptive information along with motor activity is able to induce an illusion of ownership over a virtual arm. This has implications regarding the brain mechanisms underlying body ownership as well as the use of virtual bodies in therapies and rehabilitation.     

Manual chronostasis: tactile perception precedes physical contact

When saccading to a silent clock, observers sometimes think that the second hand has paused momentarily. This effect has been termed chronostasis and occurs because observers overestimate the time that they have seen the object of an eye movement. They seem to extrapolate its appearance back to just prior to the onset of the saccade rather than the time that it is actually fixated on the retina. Here, we describe a similar effect following an arm movement: subjects overestimate the time that their hand has been in contact with a newly touched object. The illusion's magnitude suggests backward extrapolation of tactile perception to a moment during the preceding reach. The illusion does not occur if the arm movement triggers a change in a continuously visible visual target: the time of onset of the change is estimated correctly. We hypothesize that chronostasis-like effects occur when movement produces uncertainty about the onset of a sensory event. Under these circumstances, the time at which neurons with receptive fields that shift in the temporal vicinity of a movement change their mappings may be used as a time marker for the onset of perceptual properties that are only established later.     

Orientation processing by synaptic integration across first-order tactile neurons

Our ability to manipulate objects relies on tactile inputs from first-order tactile neurons that innervate the glabrous skin of the hand. The distal axon of these neurons branches in the skin and innervates many mechanoreceptors, yielding spatially-complex receptive fields. Here we show that synaptic integration across the complex signals from the first-order neuronal population could underlie human ability to accurately (< 3°) and rapidly process the orientation of edges moving across the fingertip. We first derive spiking models of human first-order tactile neurons that fit and predict responses to moving edges with high accuracy. We then use the model neurons in simulating the peripheral neuronal population that innervates a fingertip. We train classifiers performing synaptic integration across the neuronal population activity, and show that synaptic integration across first-order neurons can process edge orientations with high acuity and speed. In particular, our models suggest that integration of fast-decaying (AMPA-like) synaptic inputs within short timescales is critical for discriminating fine orientations, whereas integration of slow-decaying (NMDA-like) synaptic inputs supports discrimination of coarser orientations and maintains robustness over longer timescales. Taken together, our results provide new insight into the computations occurring in the earliest stages of the human tactile processing pathway and how they may be critical for supporting hand function.     

Referral of Touch and Ownership between the Hands and the Role of the Somatosensory Cortices

Recent studies have shown that the feeling of body ownership can be fooled by simple visuo-tactile manipulations. Perceptual illusions have been reported in which participants sense phantom touch seen on a rubber hand (rubber hand illusion). While previous studies used homologous limbs for those experiments, we here examined an illusion where people feel phantom touch on a left rubber hand when they see it brushed simultaneously with brushes applied to their right hand. Thus, we investigated a referral of touch from the right to the left hand (across the body midline). Since it is known from animal studies that tactile illusions may alter early sensory processing, we expected a modulation of the primary somatosensory cortex (SI) corresponding to this illusion. Neuromagnetic source imaging of the functional topographic organization in SI showed a shift in left SI, associated with the strength of the referral of touch. Hence, we argue that SI seems to be closely associated with this perceptual illusion. The results suggest that the transfer of tactile information across the body midline could be mediated by neurons with bilateral tactile receptive fields (most likely BA2).     

The Importance of Synchrony and Temporal Order of Visual and Tactile Input for Illusory Limb Ownership Experiences – An fMRI Study Applying Virtual Reality

In the so-called rubber hand illusion, synchronous visuotactile stimulation of a visible rubber hand together with one''s own hidden hand elicits ownership experiences for the artificial limb. Recently, advanced virtual reality setups were developed to induce a virtual hand illusion (VHI). Here, we present functional imaging data from a sample of 25 healthy participants using a new device to induce the VHI in the environment of a magnetic resonance imaging (MRI) system. In order to evaluate the neuronal robustness of the illusion, we varied the degree of synchrony between visual and tactile events in five steps: in two conditions, the tactile stimulation was applied prior to visual stimulation (asynchrony of −300 ms or −600 ms), whereas in another two conditions, the tactile stimulation was applied after visual stimulation (asynchrony of +300 ms or +600 ms). In the fifth condition, tactile and visual stimulation was applied synchronously. On a subjective level, the VHI was successfully induced by synchronous visuotactile stimulation. Asynchronies between visual and tactile input of ±300 ms did not significantly diminish the vividness of illusion, whereas asynchronies of ±600 ms did. The temporal order of visual and tactile stimulation had no effect on VHI vividness. Conjunction analyses of functional MRI data across all conditions revealed significant activation in bilateral ventral premotor cortex (PMv). Further characteristic activation patterns included bilateral activity in the motion-sensitive medial superior temporal area as well as in the bilateral Rolandic operculum, suggesting their involvement in the processing of bodily awareness through the integration of visual and tactile events. A comparison of the VHI-inducing conditions with asynchronous control conditions of ±600 ms yielded significant PMv activity only contralateral to the stimulation site. These results underline the temporal limits of the induction of limb ownership related to multisensory body-related input.     

Overlaping taste and tactile maps of the oropharynx in the vagal lobe of the channel catfish,Ictalurus punctatus

Microelectrode mapping experiments indicate an ipsilateral representation of the oropharynx and a well-defined, bilateral input from the proximal portion of the maxillary barbels and snout region within the vagal lobe of channel catfish. The map of the oropharyngeal epithelium is distorted so that the gill arches are rotated through an angle of 90° along the transverse plane, and the dorsally mapped region of the gill rakers is tilted posteriorly in the sagittal plane of the vagal lobe. Multiunit recording studies fail to provide definitive boundaries of adjacently mapped domains of oropharyngeal structures. Gustatory receptive fields of neurons in the vagal lobe correspond to their location on the topological map obtained by tactile stimulation of the oropharyngeal epithelium. A few single unit recordings indicate restricted receptive fields and different response patterns of taste, tactile, and proprioceptive neurons in the vagal lobe of catfish.     

The proprioceptive map of the arm is systematic and stable, but idiosyncratic

Visual and somatosensory signals participate together in providing an estimate of the hand's spatial location. While the ability of subjects to identify the spatial location of their hand based on visual and proprioceptive signals has previously been characterized, relatively few studies have examined in detail the spatial structure of the proprioceptive map of the arm. Here, we reconstructed and analyzed the spatial structure of the estimation errors that resulted when subjects reported the location of their unseen hand across a 2D horizontal workspace. Hand position estimation was mapped under four conditions: with and without tactile feedback, and with the right and left hands. In the task, we moved each subject's hand to one of 100 targets in the workspace while their eyes were closed. Then, we either a) applied tactile stimulation to the fingertip by allowing the index finger to touch the target or b) as a control, hovered the fingertip 2 cm above the target. After returning the hand to a neutral position, subjects opened their eyes to verbally report where their fingertip had been. We measured and analyzed both the direction and magnitude of the resulting estimation errors. Tactile feedback reduced the magnitude of these estimation errors, but did not change their overall structure. In addition, the spatial structure of these errors was idiosyncratic: each subject had a unique pattern of errors that was stable between hands and over time. Finally, we found that at the population level the magnitude of the estimation errors had a characteristic distribution over the workspace: errors were smallest closer to the body. The stability of estimation errors across conditions and time suggests the brain constructs a proprioceptive map that is reliable, even if it is not necessarily accurate. The idiosyncrasy across subjects emphasizes that each individual constructs a map that is unique to their own experiences.     

Overlapping taste and tactile maps of the oropharynx in the vagal lobe of the channel catfish, Ictalurus punctatus

Microelectrode mapping experiments indicate an ipsilateral representation of the oropharynx and a well-defined, bilateral input from the proximal portion of the maxillary barbels and snout region within the vagal lobe of channel catfish. The map of the oropharyngeal epithelium is distorted so that the gill arches are rotated through an angle of 90 degrees along the transverse plane, and the dorsally mapped region of the gill rakers is tilted posteriorly in the sagittal plane of the vagal lobe. Multiunit recording studies fail to provide definitive boundaries of adjacently mapped domains of oropharyngeal structures. Gustatory receptive fields of neurons in the vagal lobe correspond to their location on the topological map obtained by tactile stimulation of the oropharyngeal epithelium. A few single unit recordings indicate restricted receptive fields and different response patterns of taste, tactile, and proprioceptive neurons in the vagal lobe of catfish.