Figure-ground activity in V1 and guidance of saccadic eye movements.

Every day we shift our gaze about 150.000 times mostly without noticing it. The direction of these gaze shifts are not random but directed by sensory information and internal factors. After each movement the eyes hold still for a brief moment so that visual information at the center of our gaze can be processed in detail. This means that visual information at the saccade target location is sufficient to accurately guide the gaze shift but yet is not sufficiently processed to be fully perceived. In this paper I will discuss the possible role of activity in the primary visual cortex (V1), in particular figure-ground activity, in oculo-motor behavior. Figure-ground activity occurs during the late response period of V1 neurons and correlates with perception. The strength of figure-ground responses predicts the direction and moment of saccadic eye movements. The superior colliculus, a gaze control center that integrates visual and motor signals, receives direct anatomical connections from V1. These projections may convey the perceptual information that is required for appropriate gaze shifts. In conclusion, figure-ground activity in V1 may act as an intermediate component linking visual and motor signals.     

Tuning Properties of MT and MSTd and Divisive Interactions for Eye-Movement Compensation

The primate brain intelligently processes visual information from the world as the eyes move constantly. The brain must take into account visual motion induced by eye movements, so that visual information about the outside world can be recovered. Certain neurons in the dorsal part of monkey medial superior temporal area (MSTd) play an important role in integrating information about eye movements and visual motion. When a monkey tracks a moving target with its eyes, these neurons respond to visual motion as well as to smooth pursuit eye movements. Furthermore, the responses of some MSTd neurons to the motion of objects in the world are very similar during pursuit and during fixation, even though the visual information on the retina is altered by the pursuit eye movement. We call these neurons compensatory pursuit neurons. In this study we develop a computational model of MSTd compensatory pursuit neurons based on physiological data from single unit studies. Our model MSTd neurons can simulate the velocity tuning of monkey MSTd neurons. The model MSTd neurons also show the pursuit compensation property. We find that pursuit compensation can be achieved by divisive interaction between signals coding eye movements and signals coding visual motion. The model generates two implications that can be tested in future experiments: (1) compensatory pursuit neurons in MSTd should have the same direction preference for pursuit and retinal visual motion; (2) there should be non-compensatory pursuit neurons that show opposite preferred directions of pursuit and retinal visual motion.     

Optimizing visual motion perception during eye movements.

We usually perceive a stationary, stable world and we are able to correctly estimate the direction of heading from optic flow despite coherent visual motion induced by eye movements. This astonishing example of perceptual invariance results from a comparison of visual information with internal reference signals predicting the visual consequences of an eye movement. Here we demonstrate that the reference signal predicting the consequences of smooth-pursuit eye movements is continuously calibrated on the basis of direction-selective interactions between the pursuit motor command and the rotational flow induced by the eye movement, thereby minimizing imperfections of the reference signal and guaranteeing an ecologically optimal interpretation of visual motion.     

Population-Vector Analysis by Primate Prefrontal Neuron Activities

The population-vector analysis was applied to visualize neuronal processes of sensory-to-motor transformation in the prefrontal cortex while two monkeys performed two types of oculomotor delayed-response (ODR) tasks. In a standard ODR task, monkeys were required to make a quick eye movement to where thevisual cue had been presented 3 s before, whereas in R-ODR task, monkeys wererequired to make an eye movement 90^°clockwise to the direction that the visual cue had been presented. In both tasks, directions of population vectors calculated from cue- and response-period activity were almost the same as cue directions and saccade directions, respectively, indicating that population vectors of cue- and response-period activity represent information of visual inputs and motor outputs, respectively. To visualize neuronal processes of information transformation, population vectors were calculated every 250 ms during a whole trial. In ODR task, population vectors weredirected the same direction as the cue direction during the delay period. However, in R-ODR task, population vector rotated gradually from the direction similar to the cue direction to the saccade direction during the delay period. These results indicate that visual-to-motor transformation occurs during the delay period and that this process can be visualized by the population-vectoranalysis.     

Modelling the visual world of a velvet worm

In many animal phyla, eyes are small and provide only low-resolution vision for general orientation in the environment. Because these primitive eyes rarely have a defined image plane, traditional visual-optics principles cannot be applied. To assess the functional capacity of such eyes we have developed modelling principles based on ray tracing in 3D reconstructions of eye morphology, where refraction on the way to the photoreceptors and absorption in the photopigment are calculated incrementally for ray bundles from all angles within the visual field. From the ray tracing, we calculate the complete angular acceptance function of each photoreceptor in the eye, revealing the visual acuity for all parts of the visual field. We then use this information to generate visual filters that can be applied to high resolution images or videos to convert them to accurate representations of the spatial information seen by the animal. The method is here applied to the 0.1 mm eyes of the velvet worm Euperipatoides rowelli (Onychophora). These eyes of these terrestrial invertebrates consist of a curved cornea covering an irregular but optically homogeneous lens directly joining a retina packed with photoreceptive rhabdoms. 3D reconstruction from histological sections revealed an asymmetric eye, where the retina is deeper in the forward-pointing direction. The calculated visual acuity also reveals performance differences across the visual field, with a maximum acuity of about 0.11 cycles/deg in the forward direction despite laterally pointing eyes. The results agree with previous behavioural measurements of visual acuity, and suggest that velvet worm vision is adequate for orientation and positioning within the habitat.     

Computational visual ecology in the pelagic realm

Visual performance and visual interactions in pelagic animals are notoriously hard to investigate because of our restricted access to the habitat. The pelagic visual world is also dramatically different from benthic or terrestrial habitats, and our intuition is less helpful in understanding vision in unfamiliar environments. Here, we develop a computational approach to investigate visual ecology in the pelagic realm. Using information on eye size, key retinal properties, optical properties of the water and radiance, we develop expressions for calculating the visual range for detection of important types of pelagic targets. We also briefly apply the computations to a number of central questions in pelagic visual ecology, such as the relationship between eye size and visual performance, the maximum depth at which daylight is useful for vision, visual range relations between prey and predators, counter-illumination and the importance of various aspects of retinal physiology. We also argue that our present addition to computational visual ecology can be developed further, and that a computational approach offers plenty of unused potential for investigations of visual ecology in both aquatic and terrestrial habitats.     

Neuronal mechanisms for visual stability: progress and problems

How our vision remains stable in spite of the interruptions produced by saccadic eye movements has been a repeatedly revisited perceptual puzzle. The major hypothesis is that a corollary discharge (CD) or efference copy signal provides information that the eye has moved, and this information is used to compensate for the motion. There has been progress in the search for neuronal correlates of such a CD in the monkey brain, the best animal model of the human visual system. In this article, we briefly summarize the evidence for a CD pathway to frontal cortex, and then consider four questions on the relation of neuronal mechanisms in the monkey brain to stable visual perception. First, how can we determine whether the neuronal activity is related to stable visual perception? Second, is the activity a possible neuronal correlate of the proposed transsaccadic memory hypothesis of visual stability? Third, are the neuronal mechanisms modified by visual attention and does our perceived visual stability actually result from neuronal mechanisms related primarily to the central visual field? Fourth, does the pathway from superior colliculus through the pulvinar nucleus to visual cortex contribute to visual stability through suppression of the visual blur produced by saccades?     

Both Lexical and Non-Lexical Characters Are Processed during Saccadic Eye Movements

On average our eyes make 3–5 saccadic movements per second when we read, although their neural mechanism is still unclear. It is generally thought that saccades help redirect the retinal fovea to specific characters and words but that actual discrimination of information only occurs during periods of fixation. Indeed, it has been proposed that there is active and selective suppression of information processing during saccades to avoid experience of blurring due to the high-speed movement. Here, using a paradigm where a string of either lexical (Chinese) or non-lexical (alphabetic) characters are triggered by saccadic eye movements, we show that subjects can discriminate both while making saccadic eye movement. Moreover, discrimination accuracy is significantly better for characters scanned during the saccadic movement to a fixation point than those not scanned beyond it. Our results showed that character information can be processed during the saccade, therefore saccades during reading not only function to redirect the fovea to fixate the next character or word but allow pre-processing of information from the ones adjacent to the fixation locations to help target the next most salient one. In this way saccades can not only promote continuity in reading words but also actively facilitate reading comprehension.     

Perisaccadic mislocalization orthogonal to saccade direction

Saccadic eye movements transiently distort perceptual space. Visual objects flashed shortly before or during a saccade are mislocalized along the saccade direction, resembling a compression of space around the saccade target. These mislocalizations reflect transient errors of processes that construct spatial stability across eye movements. They may arise from errors of reference signals associated with saccade direction and amplitude or from visual or visuomotor remapping processes focused on the saccade target's position. The second case would predict apparent position shifts toward the target also in directions orthogonal to the saccade. We report that such orthogonal mislocalization indeed occurs. Surprisingly, however, the orthogonal mislocalization is restricted to only part of the visual field. This part comprises distant positions in saccade direction but does not depend on the target's position. Our findings can be explained by a combination of directional and positional reference signals that varies in time course across the visual field.     

The subtlety of simple eyes: the tuning of visual fields to perceptual challenges in birds

Birds show interspecific variation both in the size of the fields of individual eyes and in the ways that these fields are brought together to produce the total visual field. Variation is found in the dimensions of all main parameters: binocular region, cyclopean field and blind areas. There is a phylogenetic signal with respect to maximum width of the binocular field in that passerine species have significantly broader field widths than non-passerines; broadest fields are found among crows (Corvidae). Among non-passerines, visual fields show considerable variation within families and even within some genera. It is argued that (i) the main drivers of differences in visual fields are associated with perceptual challenges that arise through different modes of foraging, and (ii) the primary function of binocularity in birds lies in the control of bill position rather than in the control of locomotion. The informational function of binocular vision does not lie in binocularity per se (two eyes receiving slightly different information simultaneously about the same objects from which higher-order depth information is extracted), but in the contralateral projection of the visual field of each eye. Contralateral projection ensures that each eye receives information from a symmetrically expanding optic flow-field from which direction of travel and time to contact targets can be extracted, particularly with respect to the control of bill position.     

Active sensing in a freely walking spider: look where to go

The Central American hunting spider Cupiennius salei, like most other spiders, has eight eyes, one pair of principal eyes and three pairs of secondary eyes. The principal eyes and one pair of the secondary eyes have almost completely overlapping visual fields, and presumably differ in function. The retinae of the principal eyes can be moved independently by two pairs of eye muscles each, whereas the secondary eyes do not have such eye muscles. The behavioural relevance of retinal movements of freely moving spiders was investigated by a novel dual-channel telemetric registration of the eye muscle activities. Walking spiders shifted the ipsilateral retina with respect to the walking direction before, during and after a turning movement. The change in the direction of vision in the ipsilateral anterior median eye was highly correlated with the walking direction, regardless of the actual light conditions. The contralateral retina remained in its resting position. This indicates that Cupiennius salei shifts it visual field in the walking direction not only during but sometimes previous to an intended turn, and therefore “peers” actively into the direction it wants to turn.     

Driving as night falls: the contribution of retinal flow and visual direction to the control of steering

We have the ability to locomote at high speeds, and we usually negotiate bends safely, even when visual information is degraded, for example, when driving at night. There are three sources of visual information that could support successful steering. An observer fixating a steering target that is eccentric to the current heading must rotate their gaze. The gaze rotation may be detected by using head and eye movement signals (extra-retinal direction: ERD) or their retinal counterpart, visual direction (VD). The gaze rotation also transforms the global retinal flow (RF) field, which may enable direct steering judgments. In this study, we manipulate VD and RF to determine their contribution toward steering a curved path in the presence of ERD. The results suggest a model that uses a weighted combination of all three information sources, but results also suggest that this weighting may change in reduced visibility, such as in low-light conditions.     

The functions of the proprioceptors of the eye muscles

This article sets out to present a fairly comprehensive review of our knowledge about the functions of the receptors that have been found in the extraocular muscles--the six muscles that move each eye of vertebrates in its orbit--of all the animals in which they have been sought, including Man. Since their discovery at the beginning of the 20th century these receptors have, at various times, been credited with important roles in the control of eye movement and the construction of extrapersonal space and have also been denied any function whatsoever. Experiments intended to study the actions of eye muscle receptors and, even more so, opinions (and indeed polemic) derived from these observations have been influenced by the changing fashions and beliefs about the more general question of how limb position and movement is detected by the brain and which signals contribute to those aspects of this that are perceived (kinaesthesis). But the conclusions drawn from studies on the eye have also influenced beliefs about the mechanisms of kinaesthesis and, arguably, this influence has been even larger than that in the converse direction. Experimental evidence accumulated over rather more than a century is set out and discussed. It supports the view that, at the beginning of the 21st century, there are excellent grounds for believing that the receptors in the extraocular muscles are indeed proprioceptors, that is to say that the signals that they send into the brain are used to provide information about the position and movement of the eye in the orbit. It seems that this information is important in the control of eye movements of at least some types, and in the determination by the brain of the direction of gaze and the relationship of the organism to its environment. In addition, signals from these receptors in the eye muscles are seen to be necessary for the development of normal mechanisms of visual analysis in the mammalian visual cortex and for both the development and maintenance of normal visuomotor behaviour. Man is among those vertebrates to whose brains eye muscle proprioceptive signals provide information apparently used in normal sensorimotor functions; these include various aspects of perception, and of the control of eye movement. It is possible that abnormalities of the eye muscle proprioceptors and their signals may play a part in the genesis of some types of human squint (strabismus); conversely studies of patients with squint in the course of their surgical or pharmacological treatment have yielded much interesting evidence about the central actions of the proprioceptive signals from the extraocular muscles. The results of experiments on the eye have played a large part in the historical controversy, now in at least its third century, about the origin of signals that inform the brain about movement of parts of the body. Some of these results, and more of the interpretations of them, now need to be critically re-examined. The re-examination in the light of recent experiments that is presented here does not support many of the conclusions confidently drawn in the past and leads to both new insights and fresh questions about the roles of information from motor signals flowing out of the brain and that from signals from the peripheral receptors flowing into it. There remain many lacunae in our knowledge and filling some of these will, it is contended, be essential to advance our understanding further. It is argued that such understanding of eye muscle proprioception is a necessary part of the understanding of the physiology and pathophysiology of eye movement control and that it is also essential to an account of how organisms, including Man, build and maintain knowledge of their relationship to the external visual world. The eye would seem to provide a uniquely favourable system in which to study the way in which information derived within the brain about motor actions may interact with signals flowing in from peripheral receptors. The review is constructed in relatively independent sections that deal with particular topics. It ends with a fairly brief piece in which the author sets out some personal views about what has been achieved recently and what most immediately needs to be done. It also suggests some lines of study that appear to the author to be important for the future.     

Nested reentrant and recurrent computation in early vision: a Bayesian neuromorphic model applied to hyperacuity

 Hyperacuity is demonstrated in a neuromorphic model of the early visual system. The model incorporates Bayesian principles which are embodied in the dynamics of reentrant and recurrent feedback processes. Each retinotopically mapped area in the model represents a transformation of data from the visual field. Sensory information propagates in a bottom-up direction from one area to the next, while information based on Bayesian priors propagates in a top-down direction through reentrant connections. The ‘bottom-up’ and ‘top-down’ information maintain a separate existence in distinct layers of the model, but they interact through local connections within each area. Transformations between one area and the next are defined by the reentrant synaptic connections between areas, while local prior probability maps are defined by local recurrent connections within layers. The representation of hyperacuity is accomplished using a model of functional multiplicity: the large ratio of neurons in striate cortex compared with the number of afferent fibers projecting from the lateral geniculate nucleus. High functional multiplicity, in conjunction with hierarchical reentrant processing, allows the model to represent a fine-grained restoration of the line structure of visual input. Received : 26 April 1995 / Accepted in revised form : 27 July 1996     

Lateralized visual behavior in bottlenose dolphins (Tursiops truncatus) performing audio-visual tasks: the right visual field advantage

Analyzing cerebral asymmetries in various species helps in understanding brain organization. The left and right sides of the brain (lateralization) are involved in different cognitive and sensory functions. This study focuses on dolphin visual lateralization as expressed by spontaneous eye preference when performing a complex cognitive task; we examine lateralization when processing different visual stimuli displayed on an underwater touch-screen (two-dimensional figures, three-dimensional figures and dolphin/human video sequences). Three female bottlenose dolphins (Tursiops truncatus) were submitted to a 2-, 3- or 4-, choice visual/auditory discrimination problem, without any food reward: the subjects had to correctly match visual and acoustic stimuli together. In order to visualize and to touch the underwater target, the dolphins had to come close to the touch-screen and to position themselves using monocular vision (left or right eye) and/or binocular naso-ventral vision. The results showed an ability to associate simple visual forms and auditory information using an underwater touch-screen. Moreover, the subjects showed a spontaneous tendency to use monocular vision. Contrary to previous findings, our results did not clearly demonstrate right eye preference in spontaneous choice. However, the individuals' scores of correct answers were correlated with right eye vision, demonstrating the advantage of this visual field in visual information processing and suggesting a left hemispheric dominance. We also demonstrated that the nature of the presented visual stimulus does not seem to have any influence on the animals' monocular vision choice.     

Sensory basis of vigilance behavior in birds: synthesis and future prospects

Birds gather visual information through scanning behavior to make decisions relevant for survival (e.g., detecting predators and finding food). The goal of this study was (a) to review some visual properties involved in scanning behavior (retinal specialization for visual resolution and motion detection, visual acuity, and size of the blind area), and (b) hypothesize how the inter-specific variability in these properties may lead to different scanning strategies. The avian visual system has a high degree of heterogeneity in visual performance across the visual field, with some sectors providing higher levels of visual resolution and motion detection (e.g., retinal specializations) than others (e.g., peripheral retina and blind area). Thus, information quality will vary in different parts of the visual field, which contradicts some theoretical assumptions on information gathering. Birds need to move their eyes and heads to align the retinal specializations to different sectors of visual space. The rates of eye and head movements can then be used as proxies for scanning strategies. I propose specific predictions as to how each of the visual properties studied can affect scanning strategies in the context of predator detection in different habitat types and with different levels of predation risk. Establishing the degree of association between sensory specializations and scanning strategies can enhance our understanding of the evolution of anti-predator behavior.     

Eye movements modulate visual receptive fields of V4 neurons

The receptive field, defined as the spatiotemporal selectivity of neurons to sensory stimuli, is central to our understanding of the neuronal mechanisms of perception. However, despite the fact that eye movements are critical during normal vision, the influence of eye movements on the structure of receptive fields has never been characterized. Here, we map the receptive fields of macaque area V4 neurons during saccadic eye movements and find that receptive fields are remarkably dynamic. Specifically, before the initiation of a saccadic eye movement, receptive fields shrink and shift towards the saccade target. These spatiotemporal dynamics may enhance information processing of relevant stimuli during the scanning of a visual scene, thereby assisting the selection of saccade targets and accelerating the analysis of the visual scene during free viewing.     

Vision: a brake on the speed of sight

We move our eyes more often than our heart beats. Our brain seems to cope effortlessly with the consequences of these rapid visual alterations, but a new study shows that similar scene changes in the absence of eye movements delay the speed of information processing. So are there costs in constantly shifting our focus of gaze?     

Eye-Head Coordination for Visual Cognitive Processing

We investigated coordinated movements between the eyes and head (“eye-head coordination”) in relation to vision for action. Several studies have measured eye and head movements during a single gaze shift, focusing on the mechanisms of motor control during eye-head coordination. However, in everyday life, gaze shifts occur sequentially and are accompanied by movements of the head and body. Under such conditions, visual cognitive processing influences eye movements and might also influence eye-head coordination because sequential gaze shifts include cycles of visual processing (fixation) and data acquisition (gaze shifts). In the present study, we examined how the eyes and head move in coordination during visual search in a large visual field. Subjects moved their eyes, head, and body without restriction inside a 360° visual display system. We found patterns of eye-head coordination that differed those observed in single gaze-shift studies. First, we frequently observed multiple saccades during one continuous head movement, and the contribution of head movement to gaze shifts increased as the number of saccades increased. This relationship between head movements and sequential gaze shifts suggests eye-head coordination over several saccade-fixation sequences; this could be related to cognitive processing because saccade-fixation cycles are the result of visual cognitive processing. Second, distribution bias of eye position during gaze fixation was highly correlated with head orientation. The distribution peak of eye position was biased in the same direction as head orientation. This influence of head orientation suggests that eye-head coordination is involved in gaze fixation, when the visual system processes retinal information. This further supports the role of eye-head coordination in visual cognitive processing.