Predicting the eye fixation locations in the gray scale images in the visual scenes with different semantic contents

In recent years, there has been considerable interest in visual attention models (saliency map of visual attention). These models can be used to predict eye fixation locations, and thus will have many applications in various fields which leads to obtain better performance in machine vision systems. Most of these models need to be improved because they are based on bottom-up computation that does not consider top-down image semantic contents and often does not match actual eye fixation locations. In this study, we recorded the eye movements (i.e., fixations) of fourteen individuals who viewed images which consist natural (e.g., landscape, animal) and man-made (e.g., building, vehicles) scenes. We extracted the fixation locations of eye movements in two image categories. After extraction of the fixation areas (a patch around each fixation location), characteristics of these areas were evaluated as compared to non-fixation areas. The extracted features in each patch included the orientation and spatial frequency. After feature extraction phase, different statistical classifiers were trained for prediction of eye fixation locations by these features. This study connects eye-tracking results to automatic prediction of saliency regions of the images. The results showed that it is possible to predict the eye fixation locations by using of the image patches around subjects’ fixation points.     

Immaturity of the oculomotor saccade and vergence interaction in dyslexic children: evidence from a reading and visual search study

Studies comparing binocular eye movements during reading and visual search in dyslexic children are, at our knowledge, inexistent. In the present study we examined ocular motor characteristics in dyslexic children versus two groups of non dyslexic children with chronological/reading age-matched. Binocular eye movements were recorded by an infrared system (mobileEBT®, e(ye)BRAIN) in twelve dyslexic children (mean age 11 years old) and a group of chronological age-matched (N = 9) and reading age-matched (N = 10) non dyslexic children. Two visual tasks were used: text reading and visual search. Independently of the task, the ocular motor behavior in dyslexic children is similar to those reported in reading age-matched non dyslexic children: many and longer fixations as well as poor quality of binocular coordination during and after the saccades. In contrast, chronological age-matched non dyslexic children showed a small number of fixations and short duration of fixations in reading task with respect to visual search task; furthermore their saccades were well yoked in both tasks. The atypical eye movement''s patterns observed in dyslexic children suggest a deficiency in the visual attentional processing as well as an immaturity of the ocular motor saccade and vergence systems interaction.     

Modelling eye movements in a categorical search task

We introduce a model of eye movements during categorical search, the task of finding and recognizing categorically defined targets. It extends a previous model of eye movements during search (target acquisition model, TAM) by using distances from an support vector machine classification boundary to create probability maps indicating pixel-by-pixel evidence for the target category in search images. Other additions include functionality enabling target-absent searches, and a fixation-based blurring of the search images now based on a mapping between visual and collicular space. We tested this model on images from a previously conducted variable set-size (6/13/20) present/absent search experiment where participants searched for categorically defined teddy bear targets among random category distractors. The model not only captured target-present/absent set-size effects, but also accurately predicted for all conditions the numbers of fixations made prior to search judgements. It also predicted the percentages of first eye movements during search landing on targets, a conservative measure of search guidance. Effects of set size on false negative and false positive errors were also captured, but error rates in general were overestimated. We conclude that visual features discriminating a target category from non-targets can be learned and used to guide eye movements during categorical search.     

Very Slow Search and Reach: Failure to Maximize Expected Gain in an Eye-Hand Coordination Task

We examined an eye-hand coordination task where optimal visual search and hand movement strategies were inter-related. Observers were asked to find and touch a target among five distractors on a touch screen. Their reward for touching the target was reduced by an amount proportional to how long they took to locate and reach to it. Coordinating the eye and the hand appropriately would markedly reduce the search-reach time. Using statistical decision theory we derived the sequence of interrelated eye and hand movements that would maximize expected gain and we predicted how hand movements should change as the eye gathered further information about target location. We recorded human observers'' eye movements and hand movements and compared them with the optimal strategy that would have maximized expected gain. We found that most observers failed to adopt the optimal search-reach strategy. We analyze and describe the strategies they did adopt.     

Further Evidence against a Momentum Explanation for IOR

Reaction times to targets presented in the same location as a preceding cue are greater than those to targets presented opposite the cued location. This observation can be explained as a result of inhibition at the attended location (IOR), or as facilitation at the location opposite the cue (opposite facilitation effect or OFE). Past research has demonstrated that IOR is observed reliably, whereas OFE is observed only occasionally. The present series of four experiments allows us to determine whether or not OFE can be explained by eye movements as suggested by previous authors. Participants'' eye movements were monitored as they were presented with an array of four placeholders aligned with the four cardinal axes. Exogenous cues and targets were presented successively. Participants (N=37) completed either: i.) cue-manual and cue-saccade experiments, ignoring the cue and then responding with a keypress or saccade, respectively, or ii.) manual-manual and saccade-saccade experiments, responding to both the cue and the target with a keypress or saccade respectively. Results demonstrated a reliable IOR effect in each of the four experiments (reaction time greater for same versus adjacent and opposite cue-target trials). None of the four experiments demonstrated evidence of an OFE (reaction times were not significantly lower for opposite versus adjacent cue-target trials). These results are inconsistent with a momentum-based account of cue-target task performance, and furthermore suggest that the OFE cannot be attributed to occasional eye movements to the cue and/or target in previous studies.     

Self-motion-induced eye movements: effects on visual acuity and navigation

Self-motion disturbs the stability of retinal images by inducing optic flow. Objects of interest need to be fixated or tracked, yet these eye movements can infringe on the experienced retinal flow that is important for visual navigation. Separating the components of optic flow caused by an eye movement from those due to self-motion, as well as using optic flow for visual navigation while simultaneously maintaining visual acuity on near targets, represent key challenges for the visual system. Here we summarize recent advances in our understanding of how the visuomotor and vestibulomotor systems function and interact, given the complex task of compensating for instabilities of retinal images, which typically vary as a function of retinal location and differ for each eye.     

Craniotopic updating of visual space across saccades in the human posterior parietal cortex

The neural mechanisms underlying the craniotopic updating of visual space across saccadic eye movements are poorly understood. Previous single-unit recording studies in primates and clinical studies in brain-damaged patients have shown that the posterior parietal cortex (PPC) has a key role in this process. In the present study, we used single-pulse transcranial magnetic stimulation (TMS) to disrupt the processing within the PPC during a task that requires craniotopic updating: double saccades. In this task, two targets are presented in quick succession and the subject is required to make a saccade to each location as accurately as possible. We show here that TMS delivered to the PPC just prior to the second saccade effectively disrupts the craniotopic coding normally observed in this task. This causes subjects to revert to saccades more consistent with a representation of the targets based on their positions relative to one another. By contrast, stimulation at earlier times between the two saccades did not disrupt performance. These results suggest that extraretinal information generated during the first perisaccadic period is not put into functional use until just prior to the second saccade.     

Mechanisms of neural integration in the parietal lobe for visual attention.

The impulse discharges of neurons in the inferior parietal association cortex (area 7) were studied in the alert, behaving rhesus monkey, trained to fixate and follow visual targets. Four classes of cells related to visual or visuomotor function were found. Cells of one of these are sensitive to visual stimuli and have large, contralateral receptive fields with maximal sensitivity in the far temporal quadrants. Cells of the other three classes are related to visuomotor functions: visual fixation, tracking, and saccades. They are neither sensory nor motor in the usual sense for they are activated only by interested fixation of gaze or tracking, or before visually evoked saccadic eye movements. They are not activated during the spontaneous saccades and fixations that the monkey makes while casually exploring his environment. It is hypothesized that the light-sensitive neurons provide the visual input to the visuomotor cells that, in turn, produce a command signal for the direction of visual attention and for shifting the focus of attention from one target to another.     

Eye movements of stumptailed monkeys during discriminative performance: An overview

There are a number of statements that can be made about eye movements of monkeys during the learning of simple and complex discriminative problems that are probably applicable to a wide variety of visual tasks. There are systematic changes in eye movements as a function of practice. Some of these changes occur long after grosser measures of performance, such as frequency of correct choices, have reached an asymptote. Hence, short-term studies of visual information processing may be misleading. Duration of visual fixations and frequency of visual fixations are independent measures, reflecting different cognitive processes. Studies which measure only total looking time confound these two measures and, thus, may miss important information. Eye movements appear to be an important, if not essential, component of the chain of events constituting the cognitive processing underlying performance on visual tasks.     

The role of attentional priority and saliency in determining capacity limits in enumeration and visual working memory

Many common tasks require us to individuate in parallel two or more objects out of a complex scene. Although the mechanisms underlying our abilities to count the number of items, remember the visual properties of objects and to make saccadic eye movements towards targets have been studied separately, each of these tasks require selection of individual objects and shows a capacity limit. Here we show that a common factor--salience--determines the capacity limit in the various tasks. We manipulated bottom-up salience (visual contrast) and top-down salience (task relevance) in enumeration and visual memory tasks. As one item became increasingly salient, the subitizing range was reduced and memory performance for all other less-salient items was decreased. Overall, the pattern of results suggests that our abilities to enumerate and remember small groups of stimuli are grounded in an attentional priority or salience map which represents the location of important items.     

Contrast dependence of smooth pursuit eye movements following a saccade to superimposed targets

Dorsal stream areas provide motion information used by the oculomotor system to generate pursuit eye movements. Neurons in these areas saturate at low levels of luminance contrast. We therefore hypothesized that during the early phase of pursuit, eye velocity would exhibit an oculomotor gain function that saturates at low luminance contrast. To test this, we recorded eye movements in two macaques trained to saccade to an aperture in which a pattern of dots moved left or right. Shortly after the end of the saccade, the eyes followed the direction of motion with an oculomotor gain that increased with contrast before saturating. The addition of a second pattern of dots, moving in the opposite direction and superimposed on the first, resulted in a rightward shift of the contrast-dependent oculomotor gain function. The magnitude of this shift increased with the contrast of the second pattern of dots. Motion was nulled when the two patterns were equal in contrast. Next, we varied contrast over time. Contrast differences that disappeared before saccade onset biased post-saccadic eye movements at short latency. Changes in contrast occurring during or after saccade termination did not influence eye movements for approximately 150 ms. Earlier studies found that eye movements can be explained by a vector average computation when both targets are equal in contrast. We suggest that this averaging computation may reflect a special case of divisive normalization, yielding saturating contrast response functions that shift to the right with opposed motion, averaging motions when targets are equated in contrast.     

Sensory and behavioral properties of neurons in posterior parietal cortex of the awake, trained monkey.

Neurons in posterior parietal cortex of the awake, trained monkey respond to passive visual and/or somatosensory stimuli. In general, the receptive fields of these cells are large and nonspecific. When these neurons are studied during visually guided hand movements and eye movements, most of their activity can be accounted for by passive sensory stimulation. However, for some visual cells, the response to a stimulus is enhanced when it is to be the target for a saccadic eye movement. This enhancement is selective for eye movements into the visual receptive field since it does not occur with eye movements to other parts of the visual field. Cells that discharge in association with a visual fixation task have foveal receptive fields and respond to the spots of light used as fixation targets. Cells discharging selectively in association with different directions of tracking eye movements have directionally selective responses to moving visual stimuli. Every cell in our sample discharging in association with movement could be driven by passive sensory stimuli. We conclude that the activity of neurons in posterior parietal cortex is dependent on and indicative of external stimuli but not predictive of movement.     

Fix your eyes in the space you could reach: neurons in the macaque medial parietal cortex prefer gaze positions in peripersonal space

Interacting in the peripersonal space requires coordinated arm and eye movements to visual targets in depth. In primates, the medial posterior parietal cortex (PPC) represents a crucial node in the process of visual-to-motor signal transformations. The medial PPC area V6A is a key region engaged in the control of these processes because it jointly processes visual information, eye position and arm movement related signals. However, to date, there is no evidence in the medial PPC of spatial encoding in three dimensions. Here, using single neuron recordings in behaving macaques, we studied the neural signals related to binocular eye position in a task that required the monkeys to perform saccades and fixate targets at different locations in peripersonal and extrapersonal space. A significant proportion of neurons were modulated by both gaze direction and depth, i.e., by the location of the foveated target in 3D space. The population activity of these neurons displayed a strong preference for peripersonal space in a time interval around the saccade that preceded fixation and during fixation as well. This preference for targets within reaching distance during both target capturing and fixation suggests that binocular eye position signals are implemented functionally in V6A to support its role in reaching and grasping.     

On the Hunt: Searching for Poorly Defined Camouflaged Targets

As camouflaged targets share visual characteristics with the environment within which they are embedded, searchers rarely have access to a perfect visual template of such targets. Instead, they must rely on less specific representations to guide search. Although search for camouflaged and non-specified targets have both received attention in the literature, to date they have not been explored in a combined context. Here we introduce a new paradigm for characterizing behavior during search for camouflaged targets in natural scenes, while also exploring how the fidelity of the target template affects search processes. Search scenes were created from forest images, with targets a distortion (varied size) of that image at a random location. In Experiment 1 a preview of the target was provided; in Experiment 2 there was no preview. No differences were found between experiments on nearly all measures. Generally, reaction times and accuracy improved with familiarity on the task (more so for small targets). Analysis of eye movements indicated that performance benefits were related to improvements in both Search and Target Verification time. Combined, our data suggest that search for camouflaged targets can be improved over a short time-scale, even when targets are poorly defined.     

Accuracy, stability, and corrective behavior in a visuomotor tracking task: a preliminary study

Visuomotor tracking tasks have been used to elucidate the underlying mechanisms that allow for the coordination of a movement to an environmental event. The main purpose of the present study was to examine the relationship between accuracy and stability of tracking performance and the amount of corrective movements that emerge for various coordination patterns in a unimanual visuomotor tracking task. Participants (N = 6) produced rhythmic elbow flexion-extension motions and were required to track an external sinusoidal signal at five different relative phases, 0°, 45°, 90°, 135°, and 180°. Differential accuracy and stability were found among the five tracking patterns with the 0° relative phase pattern being the most accurate and stable pattern. Corrective movements were correlated with changes in accuracy only for the 0° relative phase pattern, with more corrections emerging for less accurate performance. The amount of corrective movements decreased as the stability of tracking performance increased for the 0°, 45°, and 135° patterns. For the 90° and 180° tracking patterns, the amount of corrective movements was not correlated with pattern accuracy or pattern stability. The results demonstrate that corrective behaviors are an important motor process in maintaining the stability of stable perception-action coordination patterns, while offering little benefit for unstable perception-action patterns.     

Reading and Visual Search: A Developmental Study in Normal Children

Studies dealing with developmental aspects of binocular eye movement behaviour during reading are scarce. In this study we have explored binocular strategies during reading and during visual search tasks in a large population of normal young readers. Binocular eye movements were recorded using an infrared video-oculography system in sixty-nine children (aged 6 to 15) and in a group of 10 adults (aged 24 to 39). The main findings are (i) in both tasks the number of progressive saccades (to the right) and regressive saccades (to the left) decreases with age; (ii) the amplitude of progressive saccades increases with age in the reading task only; (iii) in both tasks, the duration of fixations as well as the total duration of the task decreases with age; (iv) in both tasks, the amplitude of disconjugacy recorded during and after the saccades decreases with age; (v) children are significantly more accurate in reading than in visual search after 10 years of age. Data reported here confirms and expands previous studies on children''s reading. The new finding is that younger children show poorer coordination than adults, both while reading and while performing a visual search task. Both reading skills and binocular saccades coordination improve with age and children reach a similar level to adults after the age of 10. This finding is most likely related to the fact that learning mechanisms responsible for saccade yoking develop during childhood until adolescence.     

Eye-Hand Coordination during Visuomotor Adaptation with Different Rotation Angles

This study examined adaptive changes of eye-hand coordination during a visuomotor rotation task. Young adults made aiming movements to targets on a horizontal plane, while looking at the rotated feedback (cursor) of hand movements on a monitor. To vary the task difficulty, three rotation angles (30°, 75°, and 150°) were tested in three groups. All groups shortened hand movement time and trajectory length with practice. However, control strategies used were different among groups. The 30° group used proportionately more implicit adjustments of hand movements than other groups. The 75° group used more on-line feedback control, whereas the 150° group used explicit strategic adjustments. Regarding eye-hand coordination, timing of gaze shift to the target was gradually changed with practice from the late to early phase of hand movements in all groups, indicating an emerging gaze-anchoring behavior. Gaze locations prior to the gaze anchoring were also modified with practice from the cursor vicinity to an area between the starting position and the target. Reflecting various task difficulties, these changes occurred fastest in the 30° group, followed by the 75° group. The 150° group persisted in gazing at the cursor vicinity. These results suggest that the function of gaze control during visuomotor adaptation changes from a reactive control for exploring the relation between cursor and hand movements to a predictive control for guiding the hand to the task goal. That gaze-anchoring behavior emerged in all groups despite various control strategies indicates a generality of this adaptive pattern for eye-hand coordination in goal-directed actions.     

Spatial and temporal measurements of eye movement in children with dyslexia

This paper presents the first reading data in Croatian collected with an eye-tracking device. The eye-tracking method allows for research into two crucial levels underlying reading: the visual and the cognitive. The aim of this paper is to show the differences in eye movements in children with dyslexia using the principles of cognitive-control view. Despite the well-known definitions and vast literature on dyslexia, the neural basis of dyslexia varies greatly on the individual level. The three children studied in this paper were tested behaviorally using set of language tests for language behavior assessment on all language levels: phonology, morphology, syntax, lexicon and pragmatics. Two children had low scores on most language tests, and all three children had poor reading and writing level. Each of the children had to read two texts silently while their eye movements were recorded by means of an infrared eye-tracking system. We analyzed the number, position, and duration of fixations and the number and position of regressive (or back) saccades. Our results show intergroup differences (between a typically developing child and the three children with dyslexia), and intragroup differences (among all three children with dyslexia). The great number of fixations, longer duration of fixations, and great number of regression saccades are the main features that differentiate the children with dyslexia form the typically developing child. The only difference found between language and visual subtypes of dyslexia was a shorter duration of fixations for the child with a visual processing disorder.     

Comparative Physiological Characteristics of Experimental Neuroses in Vertebrates

Familiarization with a situation and the search for relevant information is accomplished by eye movements that alternate with visual fixations. The duration of the fixations depends on the complexity of the perceptual problem and generally ranges between 150 and 600 msec. Longer fixations rarely occur.     

Gambling in the visual periphery: a conjoint-measurement analysis of human ability to judge visual uncertainty

Recent work in motor control demonstrates that humans take their own motor uncertainty into account, adjusting the timing and goals of movement so as to maximize expected gain. Visual sensitivity varies dramatically with retinal location and target, and models of optimal visual search typically assume that the visual system takes retinal inhomogeneity into account in planning eye movements. Such models can then use the entire retina rather than just the fovea to speed search. Using a simple decision task, we evaluated human ability to compensate for retinal inhomogeneity. We first measured observers'' sensitivity for targets, varying contrast and eccentricity. Observers then repeatedly chose between targets differing in eccentricity and contrast, selecting the one they would prefer to attempt: e.g., a low contrast target at 2° versus a high contrast target at 10°. Observers knew they would later attempt some of their chosen targets and receive rewards for correct classifications. We evaluated performance in three ways. Equivalence: Do observers'' judgments agree with their actual performance? Do they correctly trade off eccentricity and contrast and select the more discriminable target in each pair? Transitivity: Are observers'' choices self-consistent? Dominance: Do observers understand that increased contrast improves performance? Decreased eccentricity? All observers exhibited patterned failures of equivalence, and seven out of eight observers failed transitivity. There were significant but small failures of dominance. All these failures together reduced their winnings by 10%–18%.