Temporal encoding of spatial information during active visual fixation

Humans and other species continually perform microscopic eye movements, even when attending to a single point. These movements, which include drifts and microsaccades, are under oculomotor control, elicit strong neural responses, and have been thought to serve important functions. The influence of these fixational eye movements on the acquisition and neural processing of visual information remains unclear. Here, we show that during viewing of natural scenes, microscopic eye movements carry out a crucial information-processing step: they remove predictable correlations in natural scenes by equalizing the spatial power of the retinal image within the frequency range of ganglion cells' peak sensitivity. This transformation, which had been attributed to center-surround receptive field organization, occurs prior to any neural processing and reveals a form of matching between the statistics of natural images and those of normal eye movements. We further show that the combined effect of microscopic eye movements and retinal receptive field organization is to convert spatial luminance discontinuities into synchronous firing events, beginning the process of edge detection. Thus, microscopic eye movements are fundamental to two goals of early visual processing: redundancy reduction and feature extraction.     

Neuronal activity of the external oculomotor nucleus during saccadic eye movement in the waking cat

The activity of antidromically identified abducens nucleus motoneurons and inter-nuclear neurons has been recorded during saccadic eye movements in the alert cat. The activity of these neurons has been demonstrated to be the sum of a velocity component proportional to eye velocity plus a position component proportional to instantaneous eye position during the movement. Results are discussed in relation to proposed models about the generation of saccadic eye movements.     

Evidence for the lateral intraparietal area as the parietal eye field.

It has long been appreciated that the posterior parietal cortex plays a role in the processing of saccadic eye movements. Only recently has it been discovered that a small cortical area, the lateral intraparietal area, within this much larger area appears to be specialized for saccadic eye movements. Unlike other cortical areas in the posterior parietal cortex, the lateral intraparietal area has strong anatomical connections to other saccade centers, and its cells have saccade-related responses that begin before the saccades. The lateral intraparietal area appears to be neither a strictly visual nor strictly motor structure; rather it performs visuomotor integration functions including determining the spatial location of saccade targets and forming plans to make eye movements.     

Predicting the eye fixation locations in the gray scale images in the visual scenes with different semantic contents

In recent years, there has been considerable interest in visual attention models (saliency map of visual attention). These models can be used to predict eye fixation locations, and thus will have many applications in various fields which leads to obtain better performance in machine vision systems. Most of these models need to be improved because they are based on bottom-up computation that does not consider top-down image semantic contents and often does not match actual eye fixation locations. In this study, we recorded the eye movements (i.e., fixations) of fourteen individuals who viewed images which consist natural (e.g., landscape, animal) and man-made (e.g., building, vehicles) scenes. We extracted the fixation locations of eye movements in two image categories. After extraction of the fixation areas (a patch around each fixation location), characteristics of these areas were evaluated as compared to non-fixation areas. The extracted features in each patch included the orientation and spatial frequency. After feature extraction phase, different statistical classifiers were trained for prediction of eye fixation locations by these features. This study connects eye-tracking results to automatic prediction of saliency regions of the images. The results showed that it is possible to predict the eye fixation locations by using of the image patches around subjects’ fixation points.     

The Relation between Reading Skills and Eye Movement Patterns in Adolescent Readers: Evidence from a Regular Orthography

Over the past decades, the relation between reading skills and eye movement behavior has been well documented in English-speaking cohorts. As English and German differ substantially with regard to orthographic complexity (i.e. grapheme-phoneme correspondence), we aimed to delineate specific characteristics of how reading speed and reading comprehension interact with eye movements in typically developing German-speaking (Austrian) adolescents. Eye movements of 22 participants (14 females; mean age = 13;6 years;months) were tracked while they were performing three tasks, namely silently reading words, texts, and pseudowords. Their reading skills were determined by means of a standardized German reading speed and reading comprehension assessment (Lesegeschwindigkeits- und -verständnistest für Klassen 6−12). We found that (a) reading skills were associated with various eye movement parameters in each of the three reading tasks; (b) better reading skills were associated with an increased efficiency of eye movements, but were primarily linked to spatial reading parameters, such as the number of fixations per word, the total number of saccades and saccadic amplitudes; (c) reading speed was a more reliable predictor for eye movement parameters than reading comprehension; (d) eye movements were highly correlated across reading tasks, which indicates consistent reading performances. Contrary to findings in English-speaking cohorts, the reading skills neither consistently correlated with temporal eye movement parameters nor with the number or percentage of regressions made while performing any of the three reading tasks. These results indicate that, although reading skills are associated with eye movement patterns irrespective of language, the temporal and spatial characteristics of this association may vary with orthographic consistency.     

Iterative Fragmentation of Cognitive Maps in a Visual Imagery Task

It remains unclear whether spontaneous eye movements during visual imagery reflect the mental generation of a visual image (i.e. the arrangement of the component parts of a mental representation). To address this specificity, we recorded eye movements in an imagery task and in a phonological fluency (non-imagery) task, both consisting in naming French towns from long-term memory. Only in the condition of visual imagery the spontaneous eye positions reflected the geographic position of the towns evoked by the subjects. This demonstrates that eye positions closely reflect the mapping of mental images. Advanced analysis of gaze positions using the bi-dimensional regression model confirmed the spatial correlation of gaze and towns’ locations in every single individual in the visual imagery task and in none of the individuals when no imagery accompanied memory retrieval. In addition, the evolution of the bi-dimensional regression’s coefficient of determination revealed, in each individual, a process of generating several iterative series of a limited number of towns mapped with the same spatial distortion, despite different individual order of towns’ evocation and different individual mappings. Such consistency across subjects revealed by gaze (the mind’s eye) gives empirical support to theories postulating that visual imagery, like visual sampling, is an iterative fragmented processing.     

Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics

Based on an information theoretical approach, we investigate feature selection processes in saccadic object and scene analysis. Saccadic eye movements of human observers are recorded for a variety of natural and artificial test images. These experimental data are used for a statistical evaluation of the fixated image regions. Analysis of second-order statistics indicates that regions with higher spatial variance have a higher probability to be fixated, but no significant differences beyond these variance effects could be found at the level of power spectra. By contrast, an investigation with higher-order statistics, as reflected in the bispectral density, yielded clear structural differences between the image regions selected by saccadic eye movements as opposed to regions selected by a random process. These results indicate that nonredundant, intrinsically two-dimensional image features like curved lines and edges, occlusions, isolated spots, etc. play an important role in the saccadic selection process which must be integrated with top-down knowledge to fully predict object and scene analysis by human observers.     

On identification of saccades from sinusoidal eye movement signals

Sinusoidal eye movements and potential saccadic eye movements are examined using the syntactic pattern recognition method presented previously. A few computer tests are presented for the verification of potential saccades from signals of sinusoidal eye movements. The technique was developed and tested with electro-oculographic signals. The verification of saccades consists of three tests: the estimation of average noise peaks in an eye movement signal; an angular velocity threshold; and the comparison between a sinusoidal eye movement signal and the corresponding stimulus signal. The technique is also efficient for noisy signals of eye movements, which were stimulated by both predictive and non-predictive sinusoidal stimulus movements.     

Measurements of simultaneously recorded spiking activity and local field potentials suggest that spatial selection emerges in the frontal eye field

The frontal eye field (FEF) participates in selecting the location of behaviorally relevant stimuli for guiding attention and eye movements. We simultaneously recorded local field potentials (LFPs) and spiking activity in the FEF of monkeys performing memory-guided saccade and covert visual search tasks. We compared visual latencies and the time course of spatially selective responses in LFPs and spiking activity. Consistent with the view that LFPs represent synaptic input, visual responses appeared first in the LFPs followed by visual responses in the spiking activity. However, spatially selective activity identifying the location of the target in the visual search array appeared in the spikes about 30 ms before it appeared in the LFPs. Because LFPs reflect dendritic input and spikes measure neuronal output in a local brain region, this temporal relationship suggests that spatial selection necessary for attention and eye movements is computed locally in FEF from spatially nonselective inputs.     

Threshold perception and saccadic eye movements

Involuntary eye movements were recorded during threshold detection tasks under various experimental conditions. The data were analyzed for interdependencies between stimulus parameters, detection performance, and oculomotor behaviour.The data demonstrate that under certain conditions, saccadic parameters are adaptive to specific stimulus properties. Further, the data suggest that for stationary patterns with low spatial frequencies and for gratings flickering with high temporal frequencies, detection is facilitated considerably by the occurrence of a saccadic eye movement. These facilitation effects are consistent with the predictions of a theoretical model presented in a previous paper.     

Unit activity in the superior colliculus of the cat following passive eye movements.

Unit response in the superior colliculus and underlying structures has been examined in the choralose-anaesthetized cat following passive movement of an occluded eye. One group of units was sensitive to small saccadic movements, responded regardless of the initial postion of the eye, and in most instances responded to movements in opposit directions. A second numerically smaller group also responded when they eye was moved at saccadic velocity but only when the eye passed a fixed point. Such units with fixed positional thresholds were found following movements in both nasal and temporal directions as well as to both upward and downward movement. Both types of unit response were found after transection of the optic nerve and were also recorded when individual extraocular muscles were subjected to controlled stretch. It is assumed that most unit activity seen after passive movement of the occluded eye is due to activity in extraocular muscle receptors. In the deep layers of the superior colliculus responses to small eye movements were found to be due to the activation of very low threshold receptors sensitive to vibration in the facial area.     

Exogenous orienting of attention depends upon the ability to execute eye movements

Shifts of attention can be made overtly by moving the eyes or covertly with attention being allocated to a region of space that does not correspond to the current direction of gaze. However, the precise relationship between eye movements and the covert orienting of attention remains controversial. The influential premotor theory proposes that the covert orienting of attention is produced by the programming of (unexecuted) eye movements and thus predicts a strong relationship between the ability to execute eye movements and the operation of spatial attention. Here, we demonstrate for the first time that impaired spatial attention is observed in an individual (AI) who is neurologically healthy but who cannot execute eye movements as a result of a congenital impairment in the elasticity of her eye muscles. This finding provides direct support for the role of the eye-movement system in the covert orienting of attention and suggests that whereas intact cortical structures may be necessary for normal attentional reflexes, they are not sufficient. The ability to move our eyes is essential for the development of normal patterns of spatial attention.     

On the Functions of Eye Movements

Many studies have been devoted to the investigation of eye movements. Procedures for recording eye movements (11), as well as concrete clinical (6, 7), engineering (3), and developmental investigations (9), are many and varied. However, in spite of the fact that various investigators have accumulated an enormous quantity of material, the diverse functions played by eye movements in the solution of various problems by humans have not been sufficiently discussed.     

Vision and the foraging technique of Great Cormorants Phalacrocorax carbo: pursuit or close‐quarter foraging?

Predatory diving birds, such as cormorants (Phalacrocoracidae), have been generally regarded as visually guided pursuit foragers. However, due to their poor visual resolution underwater, it has recently been hypothesized that Great Cormorants do not in fact employ a pursuit-dive foraging technique. They appear capable of detecting typical prey only at short distances, and primarily use a foraging technique in which prey may be detected only at close quarters or flushed from a substratum or hiding place. In birds, visual field parameters, such as the position and extent of the region of binocular vision, and how these are altered by eye movements, appear to be determined primarily by feeding ecology. Therefore, to understand further the feeding technique of Great Cormorants we have determined retinal visual fields and eye movement amplitudes using an ophthalmoscopic reflex technique. We show that visual fields and eye movements in cormorants exhibit close similarity with those of other birds, such as herons (Ardeidae) and hornbills (Bucerotidae), which forage terrestrially typically using a close-quarter prey detection or flushing technique and/or which need to examine items held in the bill before ingestion. We argue that this visual field topography and associated eye movements is a general characteristic of birds whose foraging requires the detection of nearby mobile prey items from within a wide arc around the head, accurate capture of that prey using the bill, and visual examination of the caught prey held in the bill. This supports the idea that cormorants, although visually guided predators, are not primarily pursuit predators, and that their visual fields exhibit convergence towards a set of characteristics that meet the perceptual challenges of close-quarter prey detection or flush foraging in both aquatic and terrestrial environments.     

Very Slow Search and Reach: Failure to Maximize Expected Gain in an Eye-Hand Coordination Task

We examined an eye-hand coordination task where optimal visual search and hand movement strategies were inter-related. Observers were asked to find and touch a target among five distractors on a touch screen. Their reward for touching the target was reduced by an amount proportional to how long they took to locate and reach to it. Coordinating the eye and the hand appropriately would markedly reduce the search-reach time. Using statistical decision theory we derived the sequence of interrelated eye and hand movements that would maximize expected gain and we predicted how hand movements should change as the eye gathered further information about target location. We recorded human observers'' eye movements and hand movements and compared them with the optimal strategy that would have maximized expected gain. We found that most observers failed to adopt the optimal search-reach strategy. We analyze and describe the strategies they did adopt.     

Torsion movements of the human eye. IV. Passive body movements, effect of skeletal muscle reflexes, opticokinetic torsion tracking

A comparative study of torsional movement of the eye in passive and active tilting of the head and body of the object was carried out. Similarity of torsional movement of the eyes in passive and active movements was shown. It was found by the method of exclusion and selective stimulation of vestibular, cervikal, lumbar optokinetic reflexes, that neither the cervikal, nor lumbar reflexes elicited spontaneous torsional movements of the eyes and had no influence on them. A direct study (coinciding with rotation direction of the stimulus of head rotation) and the reverse (noncoinciding) torsional tracing of a rotating disc and tracing without head movements was investigated. During direct tracing depression of saccades and extention of the slow phase of torsion was found; during the reverse one--a decrease of the eye drist and increase of the amplitude and number of saccades. Phenomena of a seeming acceleration and deceleration of disc rotation etc. have been observed. It was found that with torsional saccades vision was retained. The presence of optokinetic control of phases of torsional eye movements formation has been recorded. Tracing without rotation of the head was accompanied by torsional nistagmus. Possible causes of incomplete stabilisation and optokinetic torsional tracing are discussed.     

An eye movement study for identification of suitable font characters for presentation on a computer screen

We are experiencing a shifting of media: from the printed paper to the computer screen. This transition is modifying the process of how we read and understand a text. It is very difficult to conclude on suitability of font characters based upon subjective evaluation method only. Present study evaluates the effect of font type on human cognitive workload during perception of individual alphabets on a computer screen. Twenty six young subjects volunteered for this study. Here, subjects have been shown individual characters of different font types and their eye movements have been recorded. A binocular eye movement recorder was used for eye movement recording. The results showed that different eye movement parameters such as pupil diameter, number of fixations, fixation duration were less for font type Verdana. The present study recommends the use of font type Verdana for presentation of individual alphabets on various electronic displays in order to reduce cognitive workload.     

Goal-related activity in V4 during free viewing visual search. Evidence for a ventral stream visual salience map

Natural exploration of complex visual scenes depends on saccadic eye movements toward important locations. Saccade targeting is thought to be mediated by a retinotopic map that represents the locations of salient features. In this report, we demonstrate that extrastriate ventral area V4 contains a retinotopic salience map that guides exploratory eye movements during a naturalistic free viewing visual search task. In more than half of recorded cells, visually driven activity is enhanced prior to saccades that move the fovea toward the location previously occupied by a neuron's spatial receptive field. This correlation suggests that bottom-up processing in V4 influences the oculomotor planning process. Half of the neurons also exhibit top-down modulation of visual responses that depends on search target identity but not visual stimulation. Convergence of bottom-up and top-down processing streams in area V4 results in an adaptive, dynamic map of salience that guides oculomotor planning during natural vision.     

Observations on Eye Movements in Amphibian Larvae

Observations have shown that amphibian larvae, contrary to what has been stated in the literature, have different kinds of eye movements. All of the anurans observed (Xenopus, Rana, Bufo, Hyperoleus and Bombina) have some kind of reflex eye movements effected through stimuli from the labyrinth organs as a response to movements of the body, while only Rana and Bufo have spontaneous scanning movements. Of the urodelians (Ambystoma and Triturus), larvae of Ambystoma have no observable eye movements, while Triturus larvae have reflex eye movements associated with movements of the neck, as well as spontaneous scanning movements; both kinds of movements differ from those seen in Anura.     

无眼动条件下中文阅读的研究

设计了计算机控制的中文阅读材料的不同显示方式,并对各种阅读过程中的徙动波形进行记录和分析。实验结果表明,无眼动的阅读速度较正常有眼动高,分别为853字/分和640字/分。通过固定窗口显示方式和知动窗口显示方式条件下中文阅读的比较,排除了强迫阅读的因素,说明有无眼动是产生阅读速度差异的主要原因;根据以上实验结果,可得出结论,在有眼动的情况下,除了saccade抑制影响阅读和识别外,主要的因素在于高级中枢对位置信号的处理,眼动的驱动控制及运动过程影响了高级中枢对阅读内容和识别内容的解码速率。无眼动阅读的速度主要受到高级中枢解码速率和记忆的影响,而不是周边视觉系统的限制。实验结果还表明,在无眼动的情况下,周边信息对阅读不仅不起帮助作用,反而起到干扰作用。