Does the perception of moving eyes trigger reflexive visual orienting in autism?

Does movement of the eyes in one or another direction function as an automatic attentional cue to a location of interest? Two experiments explored the directional movement of the eyes in a full face for speed of detection of an aftercoming location target in young people with autism and in control participants. Our aim was to investigate whether a low-level perceptual impairment underlies the delay in gaze following characteristic of autism. The participants'' task was to detect a target appearing on the left or right of the screen either 100 ms or 800 ms after a face cue appeared with eyes averting to the left or right. Despite instructions to ignore eye-movement in the face cue, people with autism and control adolescents were quicker to detect targets that had been preceded by an eye movement cue congruent with target location compared with targets preceded by an incongruent eye movement cue. The attention shifts are thought to be reflexive because the cue was to be ignored, and because the effect was found even when cue-target duration was short (100 ms). Because (experiment two) the effect persisted even when the face was inverted, it would seem that the direction of movement of eyes can provide a powerful (involuntary) cue to a location.     

Enhanced tactile performance at the destination of an upcoming saccade

Previous work has demonstrated that upcoming saccades influence visual and auditory performance even for stimuli presented before the saccade is executed. These studies suggest a close relationship between saccade generation and visual/auditory attention. Furthermore, they provide support for Rizzolatti et al.'s premotor model of attention, which suggests that the same circuits involved in motor programming are also responsible for shifts in covert orienting (shifting attention without moving the eyes or changing posture). In a series of experiments, we demonstrate that saccade programming also affects tactile perception. Participants made speeded saccades to the left and right side as well as tactile discriminations of up versus down. The first experiment demonstrates that participants were reliably faster at responding to tactile stimuli near the location of upcoming saccades. In our second experiment, we had the subjects cross their hands and demonstrated that the effect occurs in visual space (rather than the early representations of touch). In our third experiment, the tactile events usually occurred on the opposite side of upcoming eye movement. We found that the benefit at the saccade target location vanished, suggesting that this shift is not obligatory but that it may be vetoed on the basis of expectation.     

Reach preparation enhances visual performance and appearance

We investigated the impact of the preparation of reach movements on visual perception by simultaneously quantifying both an objective measure of visual sensitivity and the subjective experience of apparent contrast. Using a two-by-two alternative forced choice task, observers compared the orientation (clockwise or counterclockwise) and the contrast (higher or lower) of a Standard Gabor and a Test Gabor, the latter of which was presented during reach preparation, at the reach target location or the opposite location. Discrimination performance was better overall at the reach target than at the opposite location. Perceived contrast increased continuously at the target relative to the opposite location during reach preparation, that is, after the onset of the cue indicating the reach target. The finding that performance and appearance do not evolve in parallel during reach preparation points to a distinction with saccade preparation, for which we have shown previously there is a parallel temporal evolution of performance and appearance. Yet akin to saccade preparation, this study reveals that overall reach preparation enhances both visual performance and appearance.     

Dissociable spatial and temporal effects of inhibition of return

Inhibition of return (IOR) refers to the relative suppression of processing at locations that have recently been attended. It is frequently explored using a spatial cueing paradigm and is characterized by slower responses to cued than to uncued locations. The current study investigates the impact of IOR on overt visual orienting involving saccadic eye movements. Using a spatial cueing paradigm, our experiments have demonstrated that at a cue-target onset asynchrony (CTOA) of 400 ms saccades to the vicinity of cued locations are not only delayed (temporal cost) but also biased away (spatial effect). Both of these effects are basically no longer present at a CTOA of 1200 ms. At a shorter 200 ms CTOA, the spatial effect becomes stronger while the temporal cost is replaced by a temporal benefit. These findings suggest that IOR has a spatial effect that is dissociable from its temporal effect. Simulations using a neural field model of the superior colliculus (SC) revealed that a theory relying on short-term depression (STD) of the input pathway can explain most, but not all, temporal and spatial effects of IOR.     

Contrast dependence of smooth pursuit eye movements following a saccade to superimposed targets

Dorsal stream areas provide motion information used by the oculomotor system to generate pursuit eye movements. Neurons in these areas saturate at low levels of luminance contrast. We therefore hypothesized that during the early phase of pursuit, eye velocity would exhibit an oculomotor gain function that saturates at low luminance contrast. To test this, we recorded eye movements in two macaques trained to saccade to an aperture in which a pattern of dots moved left or right. Shortly after the end of the saccade, the eyes followed the direction of motion with an oculomotor gain that increased with contrast before saturating. The addition of a second pattern of dots, moving in the opposite direction and superimposed on the first, resulted in a rightward shift of the contrast-dependent oculomotor gain function. The magnitude of this shift increased with the contrast of the second pattern of dots. Motion was nulled when the two patterns were equal in contrast. Next, we varied contrast over time. Contrast differences that disappeared before saccade onset biased post-saccadic eye movements at short latency. Changes in contrast occurring during or after saccade termination did not influence eye movements for approximately 150 ms. Earlier studies found that eye movements can be explained by a vector average computation when both targets are equal in contrast. We suggest that this averaging computation may reflect a special case of divisive normalization, yielding saturating contrast response functions that shift to the right with opposed motion, averaging motions when targets are equated in contrast.     

Evidence for the lateral intraparietal area as the parietal eye field.

It has long been appreciated that the posterior parietal cortex plays a role in the processing of saccadic eye movements. Only recently has it been discovered that a small cortical area, the lateral intraparietal area, within this much larger area appears to be specialized for saccadic eye movements. Unlike other cortical areas in the posterior parietal cortex, the lateral intraparietal area has strong anatomical connections to other saccade centers, and its cells have saccade-related responses that begin before the saccades. The lateral intraparietal area appears to be neither a strictly visual nor strictly motor structure; rather it performs visuomotor integration functions including determining the spatial location of saccade targets and forming plans to make eye movements.     

Saccadic eye movements and the detection of fast-moving gratings

Experiments are presented in which the effect of saccadic eye movements on the visibility of sinusoidal gratings drifting with velocities between 2 deg/s and 400 deg/s is investigated. The results demonstrate that saccades are highly useful for detecting this class of stimuli. Due to a saccade, otherwise subthreshold stimuli become visible as short, distinct flashes of the seemingly statinoary pattern. The paper analyzes in detail the dependence of the amount of facilitation on saccade size and relative direction and isolates the additional effect of saccadic suppression. A simple model is proposed which predicts the experimental findings.     

Pre-Saccadic Shifts of Visual Attention

The locations of visual objects to which we attend are initially mapped in a retinotopic frame of reference. Because each saccade results in a shift of images on the retina, however, the retinotopic mapping of spatial attention must be updated around the time of each eye movement. Mathôt and Theeuwes [1] recently demonstrated that a visual cue draws attention not only to the cue''s current retinotopic location, but also to a location shifted in the direction of the saccade, the “future-field”. Here we asked whether retinotopic and future-field locations have special status, or whether cue-related attention benefits exist between these locations. We measured responses to targets that appeared either at the retinotopic or future-field location of a brief, non-predictive visual cue, or at various intermediate locations between them. Attentional cues facilitated performance at both the retinotopic and future-field locations for cued relative to uncued targets, as expected. Critically, this cueing effect also occurred at intermediate locations. Our results, and those reported previously [1], imply a systematic bias of attention in the direction of the saccade, independent of any predictive remapping of attention that compensates for retinal displacements of objects across saccades [2].     

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets’ luminance but also crucially on high-level factors like the expected reward or a targets’ relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.     

The effect of saccades on threshold perception — A model study

The effect of saccadic eye movements on threshold perception is investigated theoretically. The proposed model considers eye movements by taking into account the shifting of the stimulus pattern on the retina during the occurrence of an eye movement. Saccades are characterized by high velocity and short duration. These motions cause overshoots in the response of linear filters to certain stimulus patterns. Therefore, the model predicts facilitation effects of saccades in the perception of low spatial frequency patterns and patterns flickering with high temporal frequencies. These results agree with experimentally obtained data presented in a subsequent paper. A simple approach is formulated which approximates the complex shifting function of a saccade by a switching of the pattern.     

The Role of the Caudal Superior Parietal Lobule in Updating Hand Location in Peripheral Vision: Further Evidence from Optic Ataxia

Patients with optic ataxia (OA), who are missing the caudal portion of their superior parietal lobule (SPL), have difficulty performing visually-guided reaches towards extra-foveal targets. Such gaze and hand decoupling also occurs in commonly performed non-standard visuomotor transformations such as the use of a computer mouse. In this study, we test two unilateral OA patients in conditions of 1) a change in the physical location of the visual stimulus relative to the plane of the limb movement, 2) a cue that signals a required limb movement 180° opposite to the cued visual target location, or 3) both of these situations combined. In these non-standard visuomotor transformations, the OA deficit is not observed as the well-documented field-dependent misreach. Instead, OA patients make additional eye movements to update hand and goal location during motor execution in order to complete these slow movements. Overall, the OA patients struggled when having to guide centrifugal movements in peripheral vision, even when they were instructed from visual stimuli that could be foveated. We propose that an intact caudal SPL is crucial for any visuomotor control that involves updating ongoing hand location in space without foveating it, i.e. from peripheral vision, proprioceptive or predictive information.     

Craniotopic updating of visual space across saccades in the human posterior parietal cortex

The neural mechanisms underlying the craniotopic updating of visual space across saccadic eye movements are poorly understood. Previous single-unit recording studies in primates and clinical studies in brain-damaged patients have shown that the posterior parietal cortex (PPC) has a key role in this process. In the present study, we used single-pulse transcranial magnetic stimulation (TMS) to disrupt the processing within the PPC during a task that requires craniotopic updating: double saccades. In this task, two targets are presented in quick succession and the subject is required to make a saccade to each location as accurately as possible. We show here that TMS delivered to the PPC just prior to the second saccade effectively disrupts the craniotopic coding normally observed in this task. This causes subjects to revert to saccades more consistent with a representation of the targets based on their positions relative to one another. By contrast, stimulation at earlier times between the two saccades did not disrupt performance. These results suggest that extraretinal information generated during the first perisaccadic period is not put into functional use until just prior to the second saccade.     

Apparent Motion from Outside the Visual Field,Retinotopic Cortices May Register Extra-Retinal Positions

Observers made a saccade between two fixation markers while a probe was flashed sequentially at two locations on a side screen. The first probe was presented in the far periphery just within the observer''s visual field. This target was extinguished and the observers made a large saccade away from the probe, which would have left it far outside the visual field if it had still been present. The second probe was then presented, displaced from the first in the same direction as the eye movement and by about the same distance as the saccade step. Because both eyes and probes shifted by similar amounts, there was little or no shift between the first and second probe positions on the retina. Nevertheless, subjects reported seeing motion corresponding to the spatial displacement not the retinal displacement. When the second probe was presented, the effective location of the first probe lay outside the visual field demonstrating that apparent motion can be seen from a location outside the visual field to a second location inside the visual field. Recent physiological results suggest that target locations are “remapped” on retinotopic representations to correct for the effects of eye movements. Our results suggest that the representations on which this remapping occurs include locations that fall beyond the limits of the retina.     

Saccade latency during probability presentation of the visual targets in man

The latent periods of saccadic eye movements in response to peripheral visual stimuli were measured in 8 right-handed healthy subjects using Posner's paradigm "COST-BENEFIT". In 6 subjects, the saccade latency in response to visual target presented in expected location in valid condition was shorter than that in neutral condition ("benefit"). Increase in saccade latency in response to the visual target presented in unexpected location in valid condition versus neutral condition took place only in 4 subjects ("cost"). A decrease in left-directed saccade latency in response to expected target presented in the left hemifield and increase in saccade latency in response to unexpected left target in comparison with analogous right-directed saccades were observed in valid condition. This phenomenon can be explained by the dominance of the right hemisphere in the processes of spatial orientation and "disengage" of attention.     

Eye movements modulate visual receptive fields of V4 neurons

The receptive field, defined as the spatiotemporal selectivity of neurons to sensory stimuli, is central to our understanding of the neuronal mechanisms of perception. However, despite the fact that eye movements are critical during normal vision, the influence of eye movements on the structure of receptive fields has never been characterized. Here, we map the receptive fields of macaque area V4 neurons during saccadic eye movements and find that receptive fields are remarkably dynamic. Specifically, before the initiation of a saccadic eye movement, receptive fields shrink and shift towards the saccade target. These spatiotemporal dynamics may enhance information processing of relevant stimuli during the scanning of a visual scene, thereby assisting the selection of saccade targets and accelerating the analysis of the visual scene during free viewing.     

Anticipatory Smooth Eye Movements in Autism Spectrum Disorder

Smooth pursuit eye movements are important for vision because they maintain the line of sight on targets that move smoothly within the visual field. Smooth pursuit is driven by neural representations of motion, including a surprisingly strong influence of high-level signals representing expected motion. We studied anticipatory smooth eye movements (defined as smooth eye movements in the direction of expected future motion) produced by salient visual cues in a group of high-functioning observers with Autism Spectrum Disorder (ASD), a condition that has been associated with difficulties in either generating predictions, or translating predictions into effective motor commands. Eye movements were recorded while participants pursued the motion of a disc that moved within an outline drawing of an inverted Y-shaped tube. The cue to the motion path was a visual barrier that blocked the untraveled branch (right or left) of the tube. ASD participants showed strong anticipatory smooth eye movements whose velocity was the same as that of a group of neurotypical participants. Anticipatory smooth eye movements appeared on the very first cued trial, indicating that trial-by-trial learning was not responsible for the responses. These results are significant because they show that anticipatory capacities are intact in high-functioning ASD in cases where the cue to the motion path is highly salient and unambiguous. Once the ability to generate anticipatory pursuit is demonstrated, the study of the anticipatory responses with a variety of types of cues provides a window into the perceptual or cognitive processes that underlie the interpretation of events in natural environments or social situations.     

Refixation frequency and memory mechanisms in visual search

Visual search-looking for a target object in the presence of a number of distractor items-is an everyday activity for humans (for example, finding the car in a busy car park) and animals (for example, foraging for food). Our understanding of visual search has been enriched by an interdisciplinary effort using a wide range of research techniques including behavioural studies in humans [1], single-cell electrophysiology [2], transcranial magnetic stimulation [3], event-related potentials [4] and studies of patients with focal brain injury [5]. A central question is what kind of information controls the search process. Visual search is typically accompanied by a series of eye movements, and investigating the nature and location of fixations helps to identify the kind of information that might control the search process. It has already been demonstrated that objects are fixated if they are visually similar to the target [6]. Also, if an item has been fixated, it is less likely to be returned to on the subsequent saccade. This automatic process is referred to as inhibition of return (IOR [7,8]). Here, we investigated the role of memory for which items had been fixated previously. We found that, during search, subjects often refixated items that had been previously fixated. Although there were fewer return saccades than would be expected by chance, the number of refixations indicated limited functional memory, indeed the memory effects that were present may primarily be a result of IOR.     

Saccadic Momentum and Facilitation of Return Saccades Contribute to an Optimal Foraging Strategy

The interest in saccadic IOR is funneled by the hypothesis that it serves a clear functional purpose in the selection of fixation points: the facilitation of foraging. In this study, we arrive at a different interpretation of saccadic IOR. First, we find that return saccades are performed much more often than expected from the statistical properties of saccades and saccade pairs. Second, we find that fixation durations before a saccade are modulated by the relative angle of the saccade, but return saccades show no sign of an additional temporal inhibition. Thus, we do not find temporal saccadic inhibition of return. Interestingly, we find that return locations are more salient, according to empirically measured saliency (locations that are fixated by many observers) as well as stimulus dependent saliency (defined by image features), than regular fixation locations. These results and the finding that return saccades increase the match of individual trajectories with a grand total priority map evidences the return saccades being part of a fixation selection strategy that trades off exploration and exploitation.     

Predicting the Valence of a Scene from Observers’ Eye Movements

Multimedia analysis benefits from understanding the emotional content of a scene in a variety of tasks such as video genre classification and content-based image retrieval. Recently, there has been an increasing interest in applying human bio-signals, particularly eye movements, to recognize the emotional gist of a scene such as its valence. In order to determine the emotional category of images using eye movements, the existing methods often learn a classifier using several features that are extracted from eye movements. Although it has been shown that eye movement is potentially useful for recognition of scene valence, the contribution of each feature is not well-studied. To address the issue, we study the contribution of features extracted from eye movements in the classification of images into pleasant, neutral, and unpleasant categories. We assess ten features and their fusion. The features are histogram of saccade orientation, histogram of saccade slope, histogram of saccade length, histogram of saccade duration, histogram of saccade velocity, histogram of fixation duration, fixation histogram, top-ten salient coordinates, and saliency map. We utilize machine learning approach to analyze the performance of features by learning a support vector machine and exploiting various feature fusion schemes. The experiments reveal that ‘saliency map’, ‘fixation histogram’, ‘histogram of fixation duration’, and ‘histogram of saccade slope’ are the most contributing features. The selected features signify the influence of fixation information and angular behavior of eye movements in the recognition of the valence of images.     

Probability of Seeing Increases Saccadic Readiness

Associating movement directions or endpoints with monetary rewards or costs influences movement parameters in humans, and associating movement directions or endpoints with food reward influences movement parameters in non-human primates. Rewarded movements are facilitated relative to non-rewarded movements. The present study examined to what extent successful foveation facilitated saccadic eye movement behavior, with the hypothesis that foveation may constitute an informational reward. Human adults performed saccades to peripheral targets that either remained visible after saccade completion or were extinguished, preventing visual feedback. Saccades to targets that were systematically extinguished were slower and easier to inhibit than saccades to targets that afforded successful foveation, and this effect was modulated by the probability of successful foveation. These results suggest that successful foveation facilitates behavior, and that obtaining the expected sensory consequences of a saccadic eye movement may serve as a reward for the oculomotor system.