Seeing your error alters my pointing: observing systematic pointing errors induces sensori-motor after-effects

During the procedure of prism adaptation, subjects execute pointing movements to visual targets under a lateral optical displacement: as consequence of the discrepancy between visual and proprioceptive inputs, their visuo-motor activity is characterized by pointing errors. The perception of such final errors triggers error-correction processes that eventually result into sensori-motor compensation, opposite to the prismatic displacement (i.e., after-effects). Here we tested whether the mere observation of erroneous pointing movements, similar to those executed during prism adaptation, is sufficient to produce adaptation-like after-effects. Neurotypical participants observed, from a first-person perspective, the examiner's arm making incorrect pointing movements that systematically overshot visual targets location to the right, thus simulating a rightward optical deviation. Three classical after-effect measures (proprioceptive, visual and visual-proprioceptive shift) were recorded before and after first-person's perspective observation of pointing errors. Results showed that mere visual exposure to an arm that systematically points on the right-side of a target (i.e., without error correction) produces a leftward after-effect, which mostly affects the observer's proprioceptive estimation of her body midline. In addition, being exposed to such a constant visual error induced in the observer the illusion "to feel" the seen movement. These findings indicate that it is possible to elicit sensori-motor after-effects by mere observation of movement errors.     

Evidence for dissociation between the perceptual and visuomotor systems in humans

When a visual stimulus is continuously moved behind a small stationary window, the window appears displaced in the direction of motion of the stimulus. In this study we showed that the magnitude of this illusion is dependent on (i) whether a perceptual or visuomotor task is used for judging the location of the window (ii) the directional signature of the stimulus, and (iii) whether or not there is a significant delay between the end of the visual presentation and the initiation of the localization measure. Our stimulus was a drifting sinusoidal grating windowed in space by a stationary, two-dimensional, Gaussian envelope (sigma=1 cycle of sinusoid). Localization measures were made following either a short (200 ms) or long (4.2 s) post-stimulus delay. The visuomotor localization error was up to three times greater than the perceptual error for a short delay. However, the visuomotor and perceptual localization measures were similar for a long delay. Our results provide evidence in support of the hypothesis that separate cortical pathways exist for visual perception and visually guided action and that delayed actions rely on stored perceptual information.     

Does My Step Look Big In This? A Visual Illusion Leads To Safer Stepping Behaviour

Background

Tripping is a common factor in falls and a typical safety strategy to avoid tripping on steps or stairs is to increase foot clearance over the step edge. In the present study we asked whether the perceived height of a step could be increased using a visual illusion and whether this would lead to the adoption of a safer stepping strategy, in terms of greater foot clearance over the step edge. The study also addressed the controversial question of whether motor actions are dissociated from visual perception.

Methodology/Principal Findings

21 young, healthy subjects perceived the step to be higher in a configuration of the horizontal-vertical illusion compared to a reverse configuration (p = 0.01). During a simple stepping task, maximum toe elevation changed by an amount corresponding to the size of the visual illusion (p<0.001). Linear regression analyses showed highly significant associations between perceived step height and maximum toe elevation for all conditions.

Conclusions/Significance

The perceived height of a step can be manipulated using a simple visual illusion, leading to the adoption of a safer stepping strategy in terms of greater foot clearance over a step edge. In addition, the strong link found between perception of a visual illusion and visuomotor action provides additional support to the view that the original, controversial proposal by Goodale and Milner (1992) of two separate and distinct visual streams for perception and visuomotor action should be re-evaluated.     

Evolution and Optimality of Similar Neural Mechanisms for Perception and Action during Search

A prevailing theory proposes that the brain''s two visual pathways, the ventral and dorsal, lead to differing visual processing and world representations for conscious perception than those for action. Others have claimed that perception and action share much of their visual processing. But which of these two neural architectures is favored by evolution? Successful visual search is life-critical and here we investigate the evolution and optimality of neural mechanisms mediating perception and eye movement actions for visual search in natural images. We implement an approximation to the ideal Bayesian searcher with two separate processing streams, one controlling the eye movements and the other stream determining the perceptual search decisions. We virtually evolved the neural mechanisms of the searchers'' two separate pathways built from linear combinations of primary visual cortex receptive fields (V1) by making the simulated individuals'' probability of survival depend on the perceptual accuracy finding targets in cluttered backgrounds. We find that for a variety of targets, backgrounds, and dependence of target detectability on retinal eccentricity, the mechanisms of the searchers'' two processing streams converge to similar representations showing that mismatches in the mechanisms for perception and eye movements lead to suboptimal search. Three exceptions which resulted in partial or no convergence were a case of an organism for which the targets are equally detectable across the retina, an organism with sufficient time to foveate all possible target locations, and a strict two-pathway model with no interconnections and differential pre-filtering based on parvocellular and magnocellular lateral geniculate cell properties. Thus, similar neural mechanisms for perception and eye movement actions during search are optimal and should be expected from the effects of natural selection on an organism with limited time to search for food that is not equi-detectable across its retina and interconnected perception and action neural pathways.     

Fooling the Eyes: The Influence of a Sound-Induced Visual Motion Illusion on Eye Movements

The question of whether perceptual illusions influence eye movements is critical for the long-standing debate regarding the separation between action and perception. To test the role of auditory context on a visual illusion and on eye movements, we took advantage of the fact that the presence of an auditory cue can successfully modulate illusory motion perception of an otherwise static flickering object (sound-induced visual motion effect). We found that illusory motion perception modulated by an auditory context consistently affected saccadic eye movements. Specifically, the landing positions of saccades performed towards flickering static bars in the periphery were biased in the direction of illusory motion. Moreover, the magnitude of this bias was strongly correlated with the effect size of the perceptual illusion. These results show that both an audio-visual and a purely visual illusion can significantly affect visuo-motor behavior. Our findings are consistent with arguments for a tight link between perception and action in localization tasks.     

Effects of the Ebbinghaus illusion on different behaviors: one- and two-handed grasping; one- and two-handed manual estimation; metric and comparative judgment

Many studies have suggested that visually-guided action is largely immune to the effects of several pictorial illusions that strongly influence perceptual judgments. The judgments in these experiments, however, have usually involved comparisons of multiple elements within a display, whereas the visually-guided actions have typically involved a pincer grip directed to only one display element. The three experiments presented here assess the influence of this confound on the perception versus action illusion dissociation. In general, the studies suggest (a) that the confound affects perceptual judgment but not grasping or manual estimation, and (b) that difficult visuomotor tasks are more affected by the Ebbinghaus illusion than easier tasks. In Experiment 1, participants reached for or made judgments about plastic disks placed in the center of the Ebbinghaus illusion display. Some participants reached for or made judgments about only the disk on the right, whereas others reached for or judged both disks simultaneously. A large effect of the illusion was found for grasping and comparative judgment, but not for manual estimation or metric judgment. In Experiment 2, the disks were elevated slightly to make gripping the targets easier, and the effects of the illusion on grasping were greatly reduced. For Experiment 3, participants performed the manual estimation task while the hands were placed in view, on the surface of the table, and the effects of the illusion were significantly increased. Taken together, the experiments indicate that task difficulty and hand visibility affect whether a task will be influenced by pictorial illusions or not. One- and two-handed grasping seem to be affected approximately equally.     

A motion illusion reveals mechanisms of perceptual stabilization

Visual illusions are valuable tools for the scientific examination of the mechanisms underlying perception. In the peripheral drift illusion special drift patterns appear to move although they are static. During fixation small involuntary eye movements generate retinal image slips which need to be suppressed for stable perception. Here we show that the peripheral drift illusion reveals the mechanisms of perceptual stabilization associated with these micromovements. In a series of experiments we found that illusory motion was only observed in the peripheral visual field. The strength of illusory motion varied with the degree of micromovements. However, drift patterns presented in the central (but not the peripheral) visual field modulated the strength of illusory peripheral motion. Moreover, although central drift patterns were not perceived as moving, they elicited illusory motion of neutral peripheral patterns. Central drift patterns modulated illusory peripheral motion even when micromovements remained constant. Interestingly, perceptual stabilization was only affected by static drift patterns, but not by real motion signals. Our findings suggest that perceptual instabilities caused by fixational eye movements are corrected by a mechanism that relies on visual rather than extraretinal (proprioceptive or motor) signals, and that drift patterns systematically bias this compensatory mechanism. These mechanisms may be revealed by utilizing static visual patterns that give rise to the peripheral drift illusion, but remain undetected with other patterns. Accordingly, the peripheral drift illusion is of unique value for examining processes of perceptual stabilization.     

Self and other in the human motor system

Observation of another's action can selectively facilitate the brain's motor circuits for making the same action . A "mirror-matching mechanism" might map observed actions onto the observer's own motor representations . Crucially, this view suggests that the brain represents others' actions like one's own. However, this hypothesis has been difficult to test because the experience of one's own body differs from that of others' bodies with respect to viewpoint, morphological features, familiarity, and the hallmark feature of kinaesthetic experience. We used an established method for manipulating the sense of body ownership ("rubber-hand illusion") to compare effects of observing actions that either were or were not illusorily attributed to the subject's own body. We show that observing another's actions facilitated the motor system, whereas observing identical actions, which were illusorily attributed to the subject's own body, showed the opposite pattern. Thus, motor facilitation strongly depends on the agent to whom the observed action is attributed. This result contradicts previous concepts of equivalence between one's own actions and actions of others and suggests that social differentiation, not equivalence, is characteristic of the human action system.     

Action evaluation is modulated dominantly by internal sensorimotor information and partly by noncausal external cue

Previous studies demonstrated that human motor actions are not always monitored by perceptual awareness and that implicit motor control plays a key role in performing actions. In addition, appropriate evaluation of our own motor behavior is vital for human life. Here we combined a reaching task with a visual backward masking paradigm to induce an implicit motor response that is congruent or incongruent with the visual perception. We used this to investigate (i) how we evaluate such implicit motor response that could be inconsistent with perceptual awareness and (ii) the possible contributions of reaching error, external visual cues, and internal sensorimotor information to this evaluation. Participants were instructed, after each trial, to rate their own reaching performance on a 5-point scale (i.e., smooth-clumsy). They also needed to identify a color presented at a fixation point that could be changed just after the reaching start. The color was linked to the prime-mask congruency (i.e., congruent-green, incongruent-blue) in the practice phase, and then inconsistent pairs (congruent-blue or incongruent-green) were introduced in the test phase. We found early trajectory deviations induced by the invisible prime stimulus, and such implicit motor responses are significantly correlated with the action evaluation score. The results suggest the "conscious" action evaluation is properly monitoring online sensory outcomes derived by implicit motor control. Furthermore, statistical path analyses showed that internal sensorimotor information from the motor behavior modulated by the invisible prime was the predominant cue for the action evaluation, while the color-cue association learned in the practice phase in some cases biases the action evaluation in the test phase.     

The dissociation between perception and action in the Ebbinghaus illusion: nonillusory effects of pictorial cues on grasp

According to a recently proposed distinction [1] between vision for perception and vision for action, visually guided movements should be largely immune to the perceptually compelling changes in size produced by pictorial illusions. Tests of this prediction that use the Ebbinghaus illusion have revealed only small effects of the illusion on grasp scaling as compared to its effect on perception [2-4]. Nevertheless, some have argued that the small effect on grasp implies that there is a single representation of size for both perception and action [5]. Recent findings, however, suggest that the 2-D pictorial elements, such as those comprising illusory backgrounds, can sometimes be treated as obstacles and thereby influence the programming of grasp [6]. The arrangement of the 2-D elements commonly used in previous studies examining the Ebbinghaus illusion could therefore give rise to an effect on grasp scaling that is independent of its effect on perceptual judgements, even though the two effects are in the same direction. We present evidence demonstrating that when the gap between the target and the illusion-making elements in the Ebbinghaus illusion is equidistant across different perceptual conditions (Figure 1a), the apparent effect of the illusion on grasp scaling is eliminated.     

Directional anisotropies reveal a functional segregation of visual motion processing for perception and action

Human exhibits an anisotropy in direction perception: discrimination is superior when motion is around horizontal or vertical rather than diagonal axes. In contrast to the consistent directional anisotropy in perception, we found only small idiosyncratic anisotropies in smooth pursuit eye movements, a motor action requiring accurate discrimination of visual motion direction. Both pursuit and perceptual direction discrimination rely on signals from the middle temporal visual area (MT), yet analysis of multiple measures of MT neuronal responses in the macaque failed to provide evidence of a directional anisotropy. We conclude that MT represents different motion directions uniformly, and subsequent processing creates a directional anisotropy in pathways unique to perception. Our data support the hypothesis that, at least for visual motion, perception and action are guided by inputs from separate sensory streams. The directional anisotropy of perception appears to originate after the two streams have segregated and downstream from area MT.     

Dynamic perceptual changes in audiovisual simultaneity

Background

The timing at which sensory input reaches the level of conscious perception is an intriguing question still awaiting an answer. It is often assumed that both visual and auditory percepts have a modality specific processing delay and their difference determines perceptual temporal offset.

Methodology/Principal Findings

Here, we show that the perception of audiovisual simultaneity can change flexibly and fluctuates over a short period of time while subjects observe a constant stimulus. We investigated the mechanisms underlying the spontaneous alternations in this audiovisual illusion and found that attention plays a crucial role. When attention was distracted from the stimulus, the perceptual transitions disappeared. When attention was directed to a visual event, the perceived timing of an auditory event was attracted towards that event.

Conclusions/Significance

This multistable display illustrates how flexible perceived timing can be, and at the same time offers a paradigm to dissociate perceptual from stimulus-driven factors in crossmodal feature binding. Our findings suggest that the perception of crossmodal synchrony depends on perceptual binding of audiovisual stimuli as a common event.     

Corollary Discharge Failure in an Oculomotor Task Is Related to Delusional Ideation in Healthy Individuals

Predicting the sensory consequences of saccadic eye movements likely plays a crucial role in planning sequences of saccades and in maintaining visual stability despite saccade-caused retinal displacements. Deficits in predictive activity, such as that afforded by a corollary discharge signal, have been reported in patients with schizophrenia, and may lead to the emergence of positive symptoms, in particular delusions of control and auditory hallucinations. We examined whether a measure of delusional thinking in the general, non-clinical population correlated with measures of predictive activity in two oculomotor tasks. The double-step task measured predictive activity in motor control, and the in-flight displacement task measured predictive activity in trans-saccadic visual perception. Forty-one healthy adults performed both tasks and completed a questionnaire to assess delusional thinking. The quantitative measure of predictive activity we obtained correlated with the tendency towards delusional ideation, but only for the motor task, and not the perceptual task: Individuals with higher levels of delusional thinking showed less self-movement information use in the motor task. Variation of the degree of self-generated movement knowledge as a function of the prevalence of delusional ideation in the normal population strongly supports the idea that corollary discharge deficits measured in schizophrenic patients in previous researches are not due to neuroleptic medication. We also propose that this difference in results between the perceptual and the motor tasks may point to a dissociation between corollary discharge for perception and corollary discharge for action.     

Your own action influences how you perceive another person's action

A growing body of neuroimaging and neurophysiology studies has demonstrated the motor system's involvement in the observation of actions, but the functional significance of this is still unclear. One hypothesis suggests that the motor system decodes observed actions. This hypothesis predicts that performing a concurrent action should influence the perception of an observed action. We tested this prediction by asking subjects to judge the weight of a box lifted by an actor while the subject either lifted or passively held a light or heavy box. We found that actively lifting a box altered the perceptual judgment; an observed box was judged to be heavier when subjects were lifting the light box, and it was judged to be lighter when they were lifting the heavy box. This result is surprising because previous studies have found facilitating effects of movement on perceptual judgments and facilitating effects of observed actions on movements, but here we found the opposite. We hypothesize that this effect can be understood in terms of overlapping neural systems for motor control and action-understanding if multiple models of possible observed and performed actions are processed.     

Tactile rivalry demonstrated with an ambiguous apparent-motion quartet

When observers view ambiguous visual stimuli, their perception will often alternate between the possible interpretations, a phenomenon termed perceptual rivalry [1]. To induce perceptual rivalry in the tactile domain, we developed a new tactile illusion, based on the visual apparent-motion quartet [2]. Pairs of 200 ms vibrotactile stimuli were applied to the finger pad at intervals separated by 300 ms. The location of each successive stimulus pair alternated between the opposing diagonal corners of the approximately 1 cm(2) stimulation array. This stimulation sequence led all participants to report switches between the perception of motion traveling either up and down or left and right across their fingertip. Adaptation to tactile stimulation biased toward one direction caused subsequent ambiguous stimulation to be experienced in the opposing direction. In contrast, when consecutive trials of ambiguous stimulation were presented, motion was generally perceived in the direction consistent with the motion reported in the previous trial. Voluntary eye movements induced shifts in the tactile perception toward a motion axis aligned along a world-centered coordinate frame. Because the tactile quartet results in switching perceptual states despite unvaried sensory input, it is ideally suited to future studies of the neural processes associated with conscious tactile perception.     

Human motor cortex excitability during the perception of others' action

Neuroscience research during the past ten years has fundamentally changed the traditional view of the motor system. In monkeys, the finding that premotor neurons also discharge during visual stimulation (visuomotor neurons) raises new hypotheses about the putative role played by motor representations in perceptual functions. Among visuomotor neurons, mirror neurons might be involved in understanding the actions of others and might, therefore, be crucial in interindividual communication. Functional brain imaging studies enabled us to localize the human mirror system, but the demonstration that the motor cortex dynamically replicates the observed actions, as if they were executed by the observer, can only be given by fast and focal measurements of cortical activity. Transcranial magnetic stimulation enables us to instantaneously estimate corticospinal excitability, and has been used to study the human mirror system at work during the perception of actions performed by other individuals. In the past ten years several TMS experiments have been performed investigating the involvement of motor system during others' action observation. Results suggest that when we observe another individual acting we strongly 'resonate' with his or her action. In other words, our motor system simulates underthreshold the observed action in a strictly congruent fashion. The involved muscles are the same as those used in the observed action and their activation is temporally strictly coupled with the dynamics of the observed action.     

Absence of cue-recruitment for extrinsic signals: sounds, spots, and swirling dots fail to influence perceived 3D rotation direction after training

The visual system can learn to use information in new ways to construct appearance. Thus, signals such as the location or translation direction of an ambiguously rotating wire frame cube, which are normally uninformative, can be learned as cues to determine the rotation direction. This perceptual learning occurs when the formerly uninformative signal is statistically associated with long-trusted visual cues (such as binocular disparity) that disambiguate appearance during training. In previous demonstrations, the newly learned cue was intrinsic to the perceived object, in that the signal was conveyed by the same image elements as the object itself. Here we used extrinsic new signals and observed no learning. We correlated three new signals with long-trusted cues in the rotating cube paradigm: one crossmodal (an auditory signal) and two within modality (visual). Cue recruitment did not occur in any of these conditions, either in single sessions or in ten sessions across as many days. These results suggest that the intrinsic/extrinsic distinction is important for the perceptual system in determining whether it can learn and use new information from the environment to construct appearance. Extrinsic cues do have perceptual effects (e.g. the "bounce-pass" illusion and McGurk effect), so we speculate that extrinsic signals must be recruited for perception, but only if certain conditions are met. These conditions might specify the age of the observer, the strength of the long-trusted cues, or the amount of exposure to the correlation.     

The second-agent effect: communicative gestures increase the likelihood of perceiving a second agent

Background

Beyond providing cues about an agent''s intention, communicative actions convey information about the presence of a second agent towards whom the action is directed (second-agent information). In two psychophysical studies we investigated whether the perceptual system makes use of this information to infer the presence of a second agent when dealing with impoverished and/or noisy sensory input.

Methodology/Principal Findings

Participants observed point-light displays of two agents (A and B) performing separate actions. In the Communicative condition, agent B''s action was performed in response to a communicative gesture by agent A. In the Individual condition, agent A''s communicative action was replaced with a non-communicative action. Participants performed a simultaneous masking yes-no task, in which they were asked to detect the presence of agent B. In Experiment 1, we investigated whether criterion c was lowered in the Communicative condition compared to the Individual condition, thus reflecting a variation in perceptual expectations. In Experiment 2, we manipulated the congruence between A''s communicative gesture and B''s response, to ascertain whether the lowering of c in the Communicative condition reflected a truly perceptual effect. Results demonstrate that information extracted from communicative gestures influences the concurrent processing of biological motion by prompting perception of a second agent (second-agent effect).

Conclusions/Significance

We propose that this finding is best explained within a Bayesian framework, which gives a powerful rationale for the pervasive role of prior expectations in visual perception.     

Visual coding for action violates fundamental psychophysical principles

According to Weber's law, a basic perceptual principle of psychological science, sensitivity to changes along a given physical dimension decreases when stimulus intensity increases [1]. In other words, the ‘just noticeable difference’ (JND) for weaker stimuli is smaller — hence resolution power is greater — than that for stronger stimuli on the same sensory continuum. Although Weber's law characterizes human perception for virtually all sensory dimensions, including visual length [2] and [3], there have been no attempts to test its validity for visually guided action. For this purpose, we asked participants to either grasp or make perceptual size estimations for real objects varying in length. A striking dissociation was found between grasping and perceptual estimations: in the perceptual conditions, JND increased with physical size in accord with Weber's law; but in the grasping condition, JND was unaffected by the same variation in size of the referent objects. Therefore, Weber's law was violated for visually guided action, but not for perceptual estimations. These findings document a fundamental difference in the way that object size is computed for action and for perception and suggest that the visual coding for action is based on absolute metrics even at a very basic level of processing.     

Nonvisual motor training influences biological motion perception

Experimental evidence suggests a link between perception and the execution of actions . In particular, it has been proposed that motor programs might directly influence visual action perception . According to this hypothesis, the acquisition of novel motor behaviors should improve their visual recognition, even in the absence of visual learning. We tested this prediction by using a new experimental paradigm that dissociates visual and motor learning during the acquisition of novel motor patterns. The visual recognition of gait patterns from point-light stimuli was assessed before and after nonvisual motor training. During this training, subjects were blindfolded and learned a novel coordinated upper-body movement based only on verbal and haptic feedback. The learned movement matched one of the visual test patterns. Despite the absence of visual stimulation during training, we observed a selective improvement of the visual recognition performance for the learned movement. Furthermore, visual recognition performance after training correlated strongly with the accuracy of the execution of the learned motor pattern. These results prove, for the first time, that motor learning has a direct and highly selective influence on visual action recognition that is not mediated by visual learning.