Sensory processing of motor inaccuracy depends on previously performed movement and on subsequent motor corrections: a study of the saccadic system

When goal-directed movements are inaccurate, two responses are generated by the brain: a fast motor correction toward the target and an adaptive motor recalibration developing progressively across subsequent trials. For the saccadic system, there is a clear dissociation between the fast motor correction (corrective saccade production) and the adaptive motor recalibration (primary saccade modification). Error signals used to trigger corrective saccades and to induce adaptation are based on post-saccadic visual feedback. The goal of this study was to determine if similar or different error signals are involved in saccadic adaptation and in corrective saccade generation. Saccadic accuracy was experimentally altered by systematically displacing the visual target during motor execution. Post-saccadic error signals were studied by manipulating visual information in two ways. First, the duration of the displaced target after primary saccade termination was set at 15, 50, 100 or 800 ms in different adaptation sessions. Second, in some sessions, the displaced target was followed by a visual mask that interfered with visual processing. Because they rely on different mechanisms, the adaptation of reactive saccades and the adaptation of voluntary saccades were both evaluated. We found that saccadic adaptation and corrective saccade production were both affected by the manipulations of post-saccadic visual information, but in different ways. This first finding suggests that different types of error signal processing are involved in the induction of these two motor corrections. Interestingly, voluntary saccades required a longer duration of post-saccadic target presentation to reach the same amount of adaptation as reactive saccades. Finally, the visual mask interfered with the production of corrective saccades only during the voluntary saccades adaptation task. These last observations suggest that post-saccadic perception depends on the previously performed action and that the differences between saccade categories of motor correction and adaptation occur at an early level of visual processing.     

The Fixation and Saccade P3

Although most instances of object recognition during natural viewing occur in the presence of saccades, the neural correlates of objection recognition have almost exclusively been examined during fixation. Recent studies have indicated that there are post-saccadic modulations of neural activity immediately following eye movement landing; however, whether post-saccadic modulations affect relatively late occurring cognitive components such as the P3 has not been explored. The P3 as conventionally measured at fixation is commonly used in brain computer interfaces, hence characterizing the post-saccadic P3 could aid in the development of improved brain computer interfaces that allow for eye movements. In this study, the P3 observed after saccadic landing was compared to the P3 measured at fixation. No significant differences in P3 start time, temporal persistence, or amplitude were found between fixation and saccade trials. Importantly, sensory neural responses canceled in the target minus distracter comparisons used to identify the P3. Our results indicate that relatively late occurring cognitive neural components such as the P3 are likely less sensitive to post saccadic modulations than sensory neural components and other neural activity occurring shortly after eye movement landing. Furthermore, due to the similarity of the fixation and saccade P3, we conclude that the P3 following saccadic landing could possibly be used as a viable signal in brain computer interfaces allowing for eye movements.     

Contrast dependence of smooth pursuit eye movements following a saccade to superimposed targets

Dorsal stream areas provide motion information used by the oculomotor system to generate pursuit eye movements. Neurons in these areas saturate at low levels of luminance contrast. We therefore hypothesized that during the early phase of pursuit, eye velocity would exhibit an oculomotor gain function that saturates at low luminance contrast. To test this, we recorded eye movements in two macaques trained to saccade to an aperture in which a pattern of dots moved left or right. Shortly after the end of the saccade, the eyes followed the direction of motion with an oculomotor gain that increased with contrast before saturating. The addition of a second pattern of dots, moving in the opposite direction and superimposed on the first, resulted in a rightward shift of the contrast-dependent oculomotor gain function. The magnitude of this shift increased with the contrast of the second pattern of dots. Motion was nulled when the two patterns were equal in contrast. Next, we varied contrast over time. Contrast differences that disappeared before saccade onset biased post-saccadic eye movements at short latency. Changes in contrast occurring during or after saccade termination did not influence eye movements for approximately 150 ms. Earlier studies found that eye movements can be explained by a vector average computation when both targets are equal in contrast. We suggest that this averaging computation may reflect a special case of divisive normalization, yielding saturating contrast response functions that shift to the right with opposed motion, averaging motions when targets are equated in contrast.     

Ganzfeld Stimulation or Sleep Enhance Long Term Motor Memory Consolidation Compared to Normal Viewing in Saccadic Adaptation Paradigm

Adaptation of saccade amplitude in response to intra-saccadic target displacement is a type of implicit motor learning which is required to compensate for physiological changes in saccade performance. Once established trials without intra-saccadic target displacement lead to de-adaptation or extinction, which has been attributed either to extra-retinal mechanisms of spatial constancy or to the influence of the stable visual surroundings. Therefore we investigated whether visual deprivation (“Ganzfeld”-stimulation or sleep) can partially maintain this motor learning compared to free viewing of the natural surroundings. Thirty-five healthy volunteers performed two adaptation blocks of 100 inward adaptation trials – interspersed by an extinction block – which were followed by a two-hour break with or without visual deprivation (VD). Using additional adaptation and extinction blocks short and long (4 weeks) term memory of this implicit motor learning were tested. In the short term, motor memory tested immediately after free viewing was superior to adaptation performance after VD. In the long run, however, effects were opposite: motor memory and relearning of adaptation was superior in the VD conditions. This could imply independent mechanisms that underlie the short-term ability of retrieving learned saccadic gain and its long term consolidation. We suggest that subjects mainly rely on visual cues (i.e., retinal error) in the free viewing condition which makes them prone to changes of the visual stimulus in the extinction block. This indicates the role of a stable visual array for resetting adapted saccade amplitudes. In contrast, visual deprivation (GS and sleep), might train subjects to rely on extra-retinal cues, e.g., efference copy or prediction to remap their internal representations of saccade targets, thus leading to better consolidation of saccadic adaptation.     

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets’ luminance but also crucially on high-level factors like the expected reward or a targets’ relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.     

Spatiotopic visual maps revealed by saccadic adaptation in humans

Saccadic adaptation [1] is a powerful experimental paradigm to probe the mechanisms of eye movement control and spatial vision, in which saccadic amplitudes change in response to false visual feedback. The adaptation occurs primarily in the motor system [2, 3], but there is also evidence for visual adaptation, depending on the size and the permanence of the postsaccadic error [4-7]. Here we confirm that adaptation has a strong visual component and show that the visual component of the adaptation is spatially selective in external, not retinal coordinates. Subjects performed?a memory-guided, double-saccade, outward-adaptation task designed to maximize visual adaptation and to dissociate the visual and motor corrections. When the memorized saccadic target was in the same position (in external space) as that used in the adaptation training, saccade targeting was strongly influenced by adaptation (even if not matched in retinal or cranial position), but when in the same retinal or cranial but different external spatial position, targeting was unaffected by adaptation, demonstrating unequivocal spatiotopic selectivity. These results point to the existence of a spatiotopic neural representation for eye movement control that adapts in response to saccade error signals.     

Natural and drug-induced variations of velocity and duration of human saccadic eye movements: Evidence for a control of the neural pulse generator by local feedback

The present report considers goal directed human saccadic eye movements. It addresses the question how a given perceived target excentricity is transformed into the innervation pattern that creates the saccade to the target. More specifically, it investigates whether this pattern is an appropriately selected preprogram or whether it is continuously controlled by a local feedback loop that compares a non-visual eye position signal to the perceived target excentricity (a visual signal would be too slow). To this end, the relation between the accuracy of saccades aimed at a given target and their velocity and duration was examined. Duration and velocity were found to vary by as much as 60% while the amplitude showed no related variation and had an almost constant accuracy of about 90%. By administrating diazepam, the variability of saccade duration and velocity could be further increased, but still the amplitude remained almost constant. These results favour the hypothesis that saccadic innervation is controlled by a local feedback loop.This investigation was supported by Deutsche Forschungsgemeinschaft, SFB 70, Gruppe Ulm     

The Mechanism of Saccade Motor Pattern Generation Investigated by a Large-Scale Spiking Neuron Model of the Superior Colliculus

The subcortical saccade-generating system consists of the retina, superior colliculus, cerebellum and brainstem motoneuron areas. The superior colliculus is the site of sensory-motor convergence within this basic visuomotor loop preserved throughout the vertebrates. While the system has been extensively studied, there are still several outstanding questions regarding how and where the saccade eye movement profile is generated and the contribution of respective parts within this system. Here we construct a spiking neuron model of the whole intermediate layer of the superior colliculus based on the latest anatomy and physiology data. The model consists of conductance-based spiking neurons with quasi-visual, burst, buildup, local inhibitory, and deep layer inhibitory neurons. The visual input is given from the superficial superior colliculus and the burst neurons send the output to the brainstem oculomotor nuclei. Gating input from the basal ganglia and an integral feedback from the reticular formation are also included.We implement the model in the NEST simulator and show that the activity profile of bursting neurons can be reproduced by a combination of NMDA-type and cholinergic excitatory synaptic inputs and integrative inhibitory feedback. The model shows that the spreading neural activity observed in vivo can keep track of the collicular output over time and reset the system at the end of a saccade through activation of deep layer inhibitory neurons. We identify the model parameters according to neural recording data and show that the resulting model recreates the saccade size-velocity curves known as the saccadic main sequence in behavioral studies. The present model is consistent with theories that the superior colliculus takes a principal role in generating the temporal profiles of saccadic eye movements, rather than just specifying the end points of eye movements.     

A Mathematical Model of Optimal Saccadic Eye Movement by a Pair of Muscles

This paper presents a model of saccadic eye movements. Eye movements are considered as being ballistic, since saccades (rapid concurrent movements of both eyes) occur several hundred thousand times per day; visual perception of the environment is interrupted by a saccade. The optimal control was constructed for the motion considered in three consecutively refined assumptions. The controls included in the time-optimal problem were the resultant moment of force exerted by the extraocular muscles, individual moments of force exerted by either muscle of the agonist–antagonist pair, and finally, the rate of change of these moments. This approach is consistent with the view that is currently upheld by physiologists, who believe that a saccade is programmed by the central nervous system before the beginning of an eye movement and is scarcely adjusted during the movement itself. The solution of the optimal control problem and the results obtained by subsequent numerical modeling of saccadic trajectories were compared with the published experimental data. The saccadic trajectories were compared based on the main sequence, the known consistent relationship between saccade amplitude and duration, which is the most widely applied and commonly accepted way of describing saccade data. The main sequence of saccades obtained from the solution of the optimal control problem formulated in the most complete form agreed well with published experimental results.     

Visual stability and the motion aftereffect: a psychophysical study revealing spatial updating

Eye movements create an ever-changing image of the world on the retina. In particular, frequent saccades call for a compensatory mechanism to transform the changing visual information into a stable percept. To this end, the brain presumably uses internal copies of motor commands. Electrophysiological recordings of visual neurons in the primate lateral intraparietal cortex, the frontal eye fields, and the superior colliculus suggest that the receptive fields (RFs) of special neurons shift towards their post-saccadic positions before the onset of a saccade. However, the perceptual consequences of these shifts remain controversial. We wanted to test in humans whether a remapping of motion adaptation occurs in visual perception.The motion aftereffect (MAE) occurs after viewing of a moving stimulus as an apparent movement to the opposite direction. We designed a saccade paradigm suitable for revealing pre-saccadic remapping of the MAE. Indeed, a transfer of motion adaptation from pre-saccadic to post-saccadic position could be observed when subjects prepared saccades. In the remapping condition, the strength of the MAE was comparable to the effect measured in a control condition (33±7% vs. 27±4%). Contrary, after a saccade or without saccade planning, the MAE was weak or absent when adaptation and test stimulus were located at different retinal locations, i.e. the effect was clearly retinotopic. Regarding visual cognition, our study reveals for the first time predictive remapping of the MAE but no spatiotopic transfer across saccades. Since the cortical sites involved in motion adaptation in primates are most likely the primary visual cortex and the middle temporal area (MT/V5) corresponding to human MT, our results suggest that pre-saccadic remapping extends to these areas, which have been associated with strict retinotopy and therefore with classical RF organization. The pre-saccadic transfer of visual features demonstrated here may be a crucial determinant for a stable percept despite saccades.     

Responses of collicular fixation neurons to gaze shift perturbations in head-unrestrained monkey reveal gaze feedback control

A prominent hypothesis in motor control is that endpoint errors are minimized because motor commands are updated in real time via internal feedback loops. We investigated in monkey whether orienting saccadic gaze shifts made in the dark with coordinated eye-head movements are controlled by feedback. We recorded from superior colliculus fixation neurons (SCFNs) that fired tonically during fixation and were silent during gaze shifts. When we briefly (相似文献   

Eye movements modulate visual receptive fields of V4 neurons

The receptive field, defined as the spatiotemporal selectivity of neurons to sensory stimuli, is central to our understanding of the neuronal mechanisms of perception. However, despite the fact that eye movements are critical during normal vision, the influence of eye movements on the structure of receptive fields has never been characterized. Here, we map the receptive fields of macaque area V4 neurons during saccadic eye movements and find that receptive fields are remarkably dynamic. Specifically, before the initiation of a saccadic eye movement, receptive fields shrink and shift towards the saccade target. These spatiotemporal dynamics may enhance information processing of relevant stimuli during the scanning of a visual scene, thereby assisting the selection of saccade targets and accelerating the analysis of the visual scene during free viewing.     

Probability of Seeing Increases Saccadic Readiness

Associating movement directions or endpoints with monetary rewards or costs influences movement parameters in humans, and associating movement directions or endpoints with food reward influences movement parameters in non-human primates. Rewarded movements are facilitated relative to non-rewarded movements. The present study examined to what extent successful foveation facilitated saccadic eye movement behavior, with the hypothesis that foveation may constitute an informational reward. Human adults performed saccades to peripheral targets that either remained visible after saccade completion or were extinguished, preventing visual feedback. Saccades to targets that were systematically extinguished were slower and easier to inhibit than saccades to targets that afforded successful foveation, and this effect was modulated by the probability of successful foveation. These results suggest that successful foveation facilitates behavior, and that obtaining the expected sensory consequences of a saccadic eye movement may serve as a reward for the oculomotor system.     

The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off

In primates, it is well known that there is a consistent relationship between the duration, peak velocity and amplitude of saccadic eye movements, known as the ‘main sequence’. The reason why such a stereotyped relationship evolved is unknown. We propose that a fundamental constraint on the deployment of foveal vision lies in the motor system that is perturbed by signal-dependent noise (proportional noise) on the motor command. This noise imposes a compromise between the speed and accuracy of an eye movement. We propose that saccade trajectories have evolved to optimize a trade-off between the accuracy and duration of the movement. Taking a semi-analytical approach we use Pontryagin’s minimum principle to show that there is an optimal trajectory for a given amplitude and duration; and that there is an optimal duration for a given amplitude. It follows that the peak velocity is also fixed for a given amplitude. These predictions are in good agreement with observed saccade trajectories and the main sequence. Moreover, this model predicts a small saccadic dead-zone in which it is better to stay eccentric of target than make a saccade onto target. We conclude that the main sequence has evolved as a strategy to optimize the trade-off between accuracy and speed.     

The composition of central programs subserving horizontal eye movements in man

A hypothesis is presented which describes, in biomechanical terms, the central programs underlying horizontal eye movements in man. It is suggested that eye movements are produced by means of programmed shifts of the so-called invariant muscle characteristics (static force vs angle of gaze). These shifts lead to a change of the equilibrium point resulting from the interaction of agnnist and antagonist muscles and, as a consequence, to movement and the attainment of a new position of gaze. A reciprocal or a coactivation command to agonist and antagonist muscles occurs when their characteristics shift with respect to the coordinate in the same or opposite directions, respectively. It is proposed that during pursuit and saccadic eye movements a supperposition of the both central commands occurs. During a saccade, the reciprocal command develops evenly up to a certain level. The initial and final levels of the reciprocal command dictate the respective position of gaze and therefore the size of the saccade. The coactivation command develops to a maximum level and is slowly switched off when the new position of gaze has been achieved. The magnitude of the coactivation command seems to be not connected with an absolute position of gaze. It provides probably a stability of the movement and, in particular, prevents overshoot and oscillation during the saccade. The same timing of these commands occurs during pursuit movements, but the magnitude of the coactivation command and the rates of the development of the both commands are less in this case and correlate with the velocity of the movement. This hypothesis enables the tension changes in the muscle during saccadic and pursuit movements to be simulated in qualitative accordance with unique experimental data obtained by Collins et al. (1975). The functional significance of superposition of these motor commands and similarity in the efferent organization of eye and limb movements are discussed.     

Looking for Discriminating Is Different from Looking for Looking’s Sake

Recent studies provide evidence for task-specific influences on saccadic eye movements. For instance, saccades exhibit higher peak velocity when the task requires coordinating eye and hand movements. The current study shows that the need to process task-relevant visual information at the saccade endpoint can be, in itself, sufficient to cause such effects. In this study, participants performed a visual discrimination task which required a saccade for successful completion. We compared the characteristics of these task-related saccades to those of classical target-elicited saccades, which required participants to fixate a visual target without performing a discrimination task. The results show that task-related saccades are faster and initiated earlier than target-elicited saccades. Differences between both saccade types are also noted in their saccade reaction time distributions and their main sequences, i.e., the relationship between saccade velocity, duration, and amplitude.     

Visual attention and stability

In the present review, we address the relationship between attention and visual stability. Even though with each eye, head and body movement the retinal image changes dramatically, we perceive the world as stable and are able to perform visually guided actions. However, visual stability is not as complete as introspection would lead us to believe. We attend to only a few items at a time and stability is maintained only for those items. There appear to be two distinct mechanisms underlying visual stability. The first is a passive mechanism: the visual system assumes the world to be stable, unless there is a clear discrepancy between the pre- and post-saccadic image of the region surrounding the saccade target. This is related to the pre-saccadic shift of attention, which allows for an accurate preview of the saccade target. The second is an active mechanism: information about attended objects is remapped within retinotopic maps to compensate for eye movements. The locus of attention itself, which is also characterized by localized retinotopic activity, is remapped as well. We conclude that visual attention is crucial in our perception of a stable world.     

A model that integrates eye velocity commands to keep track of smooth eye displacements

Past results have reported conflicting findings on the oculomotor system’s ability to keep track of smooth eye movements in darkness. Whereas some results indicate that saccades cannot compensate for smooth eye displacements, others report that memory-guided saccades during smooth pursuit are spatially correct. Recently, it was shown that the amount of time before the saccade made a difference: short-latency saccades were retinotopically coded, whereas long-latency saccades were spatially coded. Here, we propose a model of the saccadic system that can explain the available experimental data. The novel part of this model consists of a delayed integration of efferent smooth eye velocity commands. Two alternative physiologically realistic neural mechanisms for this integration stage are proposed. Model simulations accurately reproduced prior findings. Thus, this model reconciles the earlier contradictory reports from the literature about compensation for smooth eye movements before saccades because it involves a slow integration process. Action Editor: Jonathan D. Victor     

Evidence for the lateral intraparietal area as the parietal eye field.

It has long been appreciated that the posterior parietal cortex plays a role in the processing of saccadic eye movements. Only recently has it been discovered that a small cortical area, the lateral intraparietal area, within this much larger area appears to be specialized for saccadic eye movements. Unlike other cortical areas in the posterior parietal cortex, the lateral intraparietal area has strong anatomical connections to other saccade centers, and its cells have saccade-related responses that begin before the saccades. The lateral intraparietal area appears to be neither a strictly visual nor strictly motor structure; rather it performs visuomotor integration functions including determining the spatial location of saccade targets and forming plans to make eye movements.     

A competitive integration model of exogenous and endogenous eye movements

We present a model of the eye movement system in which the programming of an eye movement is the result of the competitive integration of information in the superior colliculi (SC). This brain area receives input from occipital cortex, the frontal eye fields, and the dorsolateral prefrontal cortex, on the basis of which it computes the location of the next saccadic target. Two critical assumptions in the model are that cortical inputs are not only excitatory, but can also inhibit saccades to specific locations, and that the SC continue to influence the trajectory of a saccade while it is being executed. With these assumptions, we account for many neurophysiological and behavioral findings from eye movement research. Interactions within the saccade map are shown to account for effects of distractors on saccadic reaction time (SRT) and saccade trajectory, including the global effect and oculomotor capture. In addition, the model accounts for express saccades, the gap effect, saccadic reaction times for antisaccades, and recorded responses from neurons in the SC and frontal eye fields in these tasks.