Function of a fly motion-sensitive neuron matches eye movements during free flight

Sensing is often implicitly assumed to be the passive acquisition of information. However, part of the sensory information is generated actively when animals move. For instance, humans shift their gaze actively in a sequence of saccades towards interesting locations in a scene. Likewise, many insects shift their gaze by saccadic turns of body and head, keeping their gaze fixed between saccades. Here we employ a novel panoramic virtual reality stimulator and show that motion computation in a blowfly visual interneuron is tuned to make efficient use of the characteristic dynamics of retinal image flow. The neuron is able to extract information about the spatial layout of the environment by utilizing intervals of stable vision resulting from the saccadic viewing strategy. The extraction is possible because the retinal image flow evoked by translation, containing information about object distances, is confined to low frequencies. This flow component can be derived from the total optic flow between saccades because the residual intersaccadic head rotations are small and encoded at higher frequencies. Information about the spatial layout of the environment can thus be extracted by the neuron in a computationally parsimonious way. These results on neuronal function based on naturalistic, behaviourally generated optic flow are in stark contrast to conclusions based on conventional visual stimuli that the neuron primarily represents a detector for yaw rotations of the animal.     

Detection of object motion by a fly neuron during simulated flight

Object detection on the basis of relative motion was investigated in the fly at the neuronal level. A representative of the figure detection cells (FD-cells), the FD1b-cell, was characterized with respect to its responses to optic flow which simulated the presence of an object during translatory flight. The figure detection cells reside in the fly's third visual neuropil and are believed to play a central role in mediating object-directed turning behaviour. The dynamical response properties as well as the mean response amplitudes of the FD1b-cell depend on the temporal frequency of object motion and on the presence or absence of background motion. The responses of the FD1b-cell to object motion during simulated translatory flight were compared to behavioural responses of the fly as obtained with identical stimuli in a previous study. The behavioural responses could only partly be explained on the basis of the FD1b-cell's responses. Further processing between the third visual neuropil and the final motor output has to be assumed which involves (1) facilitation of the object-induced responses during translatory background motion at moderate temporal frequencies, and (2) inhibition of the object-induced turning responses during translatory background motion at high temporal frequencies. Accepted: 9 October 1999     

A model of the saccadic sensorimotor system of salamanders

A model of the saccadic system of salamanders on the basis of electrophysiological and anatomical results is presented. The model includes centers found to be significant for the guidance of saccades in these comparatively simple vertebrates. In particular, these are the optic tectum, the bulbar reticular formation and the motor system. The latter consists of two pairs of neck-muscles, an epaxial and a hypaxial one driven by their respective motoneurons. The model includes a visual, a sensori-motor, and a motor level. At the sensory level, the retinal coordinates are transferred to the optic tectum to establish an orthogonal map of visual angles. A secondary visual map of the ipsilateral eye with a pointsymmetrical organization exists in addition. The premotor system of the tectum was modelled according to an ensemble-coding principle. Thus, local activation of the visual map results in recruitment of an appropriate number of tectal premotor units. Simulation of the model reproduces correct metric properties of salamander saccades under varying stimulus presentations.     

Optic flow-based collision-free strategies: From insects to robots

Flying insects are able to fly smartly in an unpredictable environment. It has been found that flying insects have smart neurons inside their tiny brains that are sensitive to visual motion also called optic flow. Consequently, flying insects rely mainly on visual motion during their flight maneuvers such as: takeoff or landing, terrain following, tunnel crossing, lateral and frontal obstacle avoidance, and adjusting flight speed in a cluttered environment. Optic flow can be defined as the vector field of the apparent motion of objects, surfaces, and edges in a visual scene generated by the relative motion between an observer (an eye or a camera) and the scene. Translational optic flow is particularly interesting for short-range navigation because it depends on the ratio between (i) the relative linear speed of the visual scene with respect to the observer and (ii) the distance of the observer from obstacles in the surrounding environment without any direct measurement of either speed or distance. In flying insects, roll stabilization reflex and yaw saccades attenuate any rotation at the eye level in roll and yaw respectively (i.e. to cancel any rotational optic flow) in order to ensure pure translational optic flow between two successive saccades. Our survey focuses on feedback-loops which use the translational optic flow that insects employ for collision-free navigation. Optic flow is likely, over the next decade to be one of the most important visual cues that can explain flying insects' behaviors for short-range navigation maneuvers in complex tunnels. Conversely, the biorobotic approach can therefore help to develop innovative flight control systems for flying robots with the aim of mimicking flying insects’ abilities and better understanding their flight.     

Mechanisms of neural integration in the parietal lobe for visual attention.

The impulse discharges of neurons in the inferior parietal association cortex (area 7) were studied in the alert, behaving rhesus monkey, trained to fixate and follow visual targets. Four classes of cells related to visual or visuomotor function were found. Cells of one of these are sensitive to visual stimuli and have large, contralateral receptive fields with maximal sensitivity in the far temporal quadrants. Cells of the other three classes are related to visuomotor functions: visual fixation, tracking, and saccades. They are neither sensory nor motor in the usual sense for they are activated only by interested fixation of gaze or tracking, or before visually evoked saccadic eye movements. They are not activated during the spontaneous saccades and fixations that the monkey makes while casually exploring his environment. It is hypothesized that the light-sensitive neurons provide the visual input to the visuomotor cells that, in turn, produce a command signal for the direction of visual attention and for shifting the focus of attention from one target to another.     

Saccadic head movements of the praying mantis, with particular reference to visual and proprioceptive information

ABSTRACT. Horizontal head movements of the praying mantis, Sphodromantis lineola Burm., were recorded continuously. They responded to the presence of a live blowfly prey in the antero-lateral visual field with a rapid saccadic head movement. The angular movement of a fixation saccade was correlated positively to the displacement of the prey from the prothoracic midline. Saccade magnitude and velocity are related. After the stimulus moved out of the visual field, the mantis made a second saccadic head movement, a return saccade towards the body midline. We observed return saccades in which the head overshot or undershot the body midline, as well as saccades which returned the head exactly to its initial position. In 92% of trials with intact mantids, the return movement succeeded eventually in rotating the head back to its initial position, whereas after removal of the neck hair plates this occurred in only 47% of trials. There is a consistent relation between saccade extent and velocity. Velocities of return saccades were slower than those of fixation saccades. It is suggested that sensory inputs from the neck hair plate proprioceptors modify both the magnitude and the angular velocity of fixation and return saccadic head movements.     

Sensory processing of motor inaccuracy depends on previously performed movement and on subsequent motor corrections: a study of the saccadic system

When goal-directed movements are inaccurate, two responses are generated by the brain: a fast motor correction toward the target and an adaptive motor recalibration developing progressively across subsequent trials. For the saccadic system, there is a clear dissociation between the fast motor correction (corrective saccade production) and the adaptive motor recalibration (primary saccade modification). Error signals used to trigger corrective saccades and to induce adaptation are based on post-saccadic visual feedback. The goal of this study was to determine if similar or different error signals are involved in saccadic adaptation and in corrective saccade generation. Saccadic accuracy was experimentally altered by systematically displacing the visual target during motor execution. Post-saccadic error signals were studied by manipulating visual information in two ways. First, the duration of the displaced target after primary saccade termination was set at 15, 50, 100 or 800 ms in different adaptation sessions. Second, in some sessions, the displaced target was followed by a visual mask that interfered with visual processing. Because they rely on different mechanisms, the adaptation of reactive saccades and the adaptation of voluntary saccades were both evaluated. We found that saccadic adaptation and corrective saccade production were both affected by the manipulations of post-saccadic visual information, but in different ways. This first finding suggests that different types of error signal processing are involved in the induction of these two motor corrections. Interestingly, voluntary saccades required a longer duration of post-saccadic target presentation to reach the same amount of adaptation as reactive saccades. Finally, the visual mask interfered with the production of corrective saccades only during the voluntary saccades adaptation task. These last observations suggest that post-saccadic perception depends on the previously performed action and that the differences between saccade categories of motor correction and adaptation occur at an early level of visual processing.     

Gaze Strategy in the Free Flying Zebra Finch (Taeniopygia guttata)

Fast moving animals depend on cues derived from the optic flow on their retina. Optic flow from translational locomotion includes information about the three-dimensional composition of the environment, while optic flow experienced during a rotational self motion does not. Thus, a saccadic gaze strategy that segregates rotations from translational movements during locomotion will facilitate extraction of spatial information from the visual input. We analysed whether birds use such a strategy by highspeed video recording zebra finches from two directions during an obstacle avoidance task. Each frame of the recording was examined to derive position and orientation of the beak in three-dimensional space. The data show that in all flights the head orientation was shifted in a saccadic fashion and was kept straight between saccades. Therefore, birds use a gaze strategy that actively stabilizes their gaze during translation to simplify optic flow based navigation. This is the first evidence of birds actively optimizing optic flow during flight.     

Visuomotor transformation in the fly gaze stabilization system

For sensory signals to control an animal's behavior, they must first be transformed into a format appropriate for use by its motor systems. This fundamental problem is faced by all animals, including humans. Beyond simple reflexes, little is known about how such sensorimotor transformations take place. Here we describe how the outputs of a well-characterized population of fly visual interneurons, lobula plate tangential cells (LPTCs), are used by the animal's gaze-stabilizing neck motor system. The LPTCs respond to visual input arising from both self-rotations and translations of the fly. The neck motor system however is involved in gaze stabilization and thus mainly controls compensatory head rotations. We investigated how the neck motor system is able to selectively extract rotation information from the mixed responses of the LPTCs. We recorded extracellularly from fly neck motor neurons (NMNs) and mapped the directional preferences across their extended visual receptive fields. Our results suggest that-like the tangential cells-NMNs are tuned to panoramic retinal image shifts, or optic flow fields, which occur when the fly rotates about particular body axes. In many cases, tangential cells and motor neurons appear to be tuned to similar axes of rotation, resulting in a correlation between the coordinate systems the two neural populations employ. However, in contrast to the primarily monocular receptive fields of the tangential cells, most NMNs are sensitive to visual motion presented to either eye. This results in the NMNs being more selective for rotation than the LPTCs. Thus, the neck motor system increases its rotation selectivity by a comparatively simple mechanism: the integration of binocular visual motion information.     

Myoinhibitory peptide (MIP) immunoreactivity in the visual system of the blowfly <Emphasis Type="Italic">Calliphora vomitoria</Emphasis> in relation to putative clock neurons and serotonergic neurons

A few types of peptidergic clock neurons have been identified in the fruitfly Drosophila, whereas in blowflies, only pigment-dispersing factor (PDF)-immunoreactive lateral ventral clock neurons (LN_vs) have been described. In blowflies, but not Drosophila, a subset of these PDF-expressing neurons supplies axon branches to a region outside the synaptic layer of the lamina, the most peripheral optic lobe neuropil. In Drosophila, similar lamina processes are instead supplied by non-clock neurons (LMIo) that express myoinhibitory peptide (MIP). We have investigated the distribution of MIP-immunoreactive neurons in the visual system of the blowfly Calliphora vomitoria and found neurons resembling the three LMIos, but without processes to the lamina. In Calliphora, PDF-immunoreactive processes of LN_vs in the lamina closely impinge on branching serotonin-immunoreactive axon terminations in the same region. We have also identified, in the blowfly, two types of putative clock neurons that label with an antiserum to ion-transport peptide (ITP). The presence of serotonin-immunoreactive neurons supplying processes to the lamina seems to be a conserved feature in dipteran flies. The morphology of the two types of ITP-immunoreactive clock neurons might also be conserved. However, peptidergic neurons with branches converging on the serotonin-immunoreactive neurons in the lamina are of different morphological types and express PDF in blowflies and MIP in Drosophila. The central circuitry of these PDF- and MIP-expressing neurons probably differs; consequently, whether their convergence on serotonergic neurons subserves similar functions in the two species is unclear.     

Responses of blowfly motion-sensitive neurons to reconstructed optic flow along outdoor flight paths

The retinal image flow a blowfly experiences in its daily life on the wing is determined by both the structure of the environment and the animal’s own movements. To understand the design of visual processing mechanisms, there is thus a need to analyse the performance of neurons under natural operating conditions. To this end, we recorded flight paths of flies outdoors and reconstructed what they had seen, by moving a panoramic camera along exactly the same paths. The reconstructed image sequences were later replayed on a fast, panoramic flight simulator to identified, motion sensitive neurons of the so-called horizontal system (HS) in the lobula plate of the blowfly, which are assumed to extract self-motion parameters from optic flow. We show that under real life conditions HS-cells not only encode information about self-rotation, but are also sensitive to translational optic flow and, thus, indirectly signal information about the depth structure of the environment. These properties do not require an elaboration of the known model of these neurons, because the natural optic flow sequences generate—at least qualitatively—the same depth-related response properties when used as input to a computational HS-cell model and to real neurons.     

Attention governs action in the primate frontal eye field

While the motor and attentional roles of the frontal eye field (FEF) are well documented, the relationship between them is unknown. We exploited the known influence of visual motion on the apparent positions of targets, and measured how this illusion affects saccadic eye movements during FEF microstimulation. Without microstimulation, saccades to a moving grating are biased in the direction of motion, consistent with the apparent position illusion. Here we show that microstimulation of spatially aligned FEF representations increases the influence of this illusion on saccades. Rather than simply impose a fixed-vector signal, subthreshold stimulation directed saccades away from the FEF movement field, and instead more strongly in the direction of visual motion. These results demonstrate that the attentional effects of FEF stimulation govern visually guided saccades, and suggest that the two roles of the FEF work together to select both the features of a target and the appropriate movement to foveate it.     

Integration of binocular optic flow in cervical neck motor neurons of the fly

Global visual motion elicits an optomotor response of the eye that stabilizes the visual input on the retina. Here, we analyzed the neck motor system of the blowfly to understand binocular integration of visual motion information underlying a head optomotor response. We identified and characterized two cervical nerve motor neurons (called CNMN6 and CNMN7) tuned precisely to an optic flow corresponding to pitch movements of the head. By means of double recordings and dye coupling, we determined that these neurons are connected ipsilaterally to two vertical system cells (VS2 and VS3), and contralaterally to one horizontal system cell (HSS). In addition, CNMN7 turned out to be connected to the ipsilateral CNMN6 and to its contralateral counterpart. To analyze a potential function of this circuit, we performed behavioral experiments and found that the optomotor pitch response of the fly head was only observable when both eyes were intact. Thus, this neural circuit performs two visuomotor transformations: first, by integrating binocular visual information it enhances the tuning to the optic flow resulting from pitch movements of the head, and second it could assure an even head declination by coordinating the activity of the CNMN7 neurons on both sides.     

On your mark, get set: brainstem circuitry underlying saccadic initiation

Saccades are rapid eye movements that are used to move the visual axis toward targets of interest in the visual field. The time to initiate a saccade is dependent upon many factors. Here we review some of the recent advances in our understanding of the these processes in primates. Neurons in the superior colliculus and brainstem reticular formation are organised into a network to control saccades. Some neurons are active during visual fixation, while others are active during the preparation and execution of saccades. Several factors can influence the excitability levels of these neurons prior to the appearance of a new saccadic target. These pre-target changes in excitability are correlated to subsequent changes in behavioural performance. Our results show how neuronal signals in the superior colliculus and brainstem reticular formation can be shaped by contextual factors and demonstrate how situational experience can expedite motor behaviour via the advanced preparation of motor programs.     

Saccade control in a simulated robot camera-head system: neural net architectures for efficient learning of inverse kinematics

The high speed of saccades means that they cannot be guided by visual feedback, so that any saccadic control system must know in advance the correct output signals to fixate a particular retinal position. To investigate neural-net architectures for learning this inverse-kinematics problem we simulated a 4 deg-of-freedom robot camera-head system, in which the head could pan and tilt and the cameras pan and verge. The main findings were: (1) Linear nets, multilayer perceptrons (MLPs) trained by backpropagation, and cerebellar model arithmetic computers (CMACs) all learnt rapidly to 5–10% accuracy when given perfect error feedback. (2) For additional accuracy (down to 2%) two-layer nets learnt much faster than a single MLP or CMAC: the best combination tried was to have a CMAC learn the errors of a trained linear net. (3) Imperfect error signals were provided by a crude controller whose output was simply proportional to retinal input in the relevant axis, thereby providing a mechanism for (a) controlling the camera-head system when the feedforward neural net controller was wrong or inoperative, and (b) converting sensory error signals into motor error signals as required in supervised learning. It proved possible to train neural-net controllers using these imperfect error signals over a range of learning rates and crude-controller gains. These results suggest that appropriate neural-net architectures can provide practical, accurate and robust adaptive control for saccadic movements. In addition, the arrangement of a crude controller teaching a sophisticated one may be similar to that used by the primate saccadic system, with brainstem circuitry teaching the cerebellum.     

Tests of Models for Saccade–Vergence Interaction using Novel Stimulus Conditions

During natural activities, two types of eye movements - saccades and vergence - are used in concert to point the fovea of each eye at features of interest. Some electrophysiological studies support the concept of independent neurobiological substrates for saccades and vergence, namely saccadic and vergence burst neurons. Discerning the interaction of these two components is complicated by the near-synchronous occurrence of saccadic and vergence components. However, by positioning the far target below the near target, it is possible to induce responses in which the peak velocity of the vertical saccadic component precedes the peak velocity of the horizontal vergence component by approximately 75 ms. When saccade-vergence responses are temporally dissociated in this way, the vergence velocity waveform changes, becoming less skewed. We excluded the possibility that such change in skewing was due to visual feedback by showing that similar behavior occurred in darkness. We then tested a saccade-related vergence burst neuron (SVBN) model proposed by Zee et al. in J Neurophysiol 68:1624-1641 (1992), in which omnipause neurons remove inhibition from both saccadic and vergence burst neurons. The technique of parameter estimation was used to calculate optimal values for responses from human subjects in which saccadic and convergence components of response were either nearly synchronized or temporally dissociated. Although the SVBN model could account for convergence waveforms when saccadic and vergence components were nearly synchronized, it could not when the components were temporally dissociated. We modified the model so that the saccadic pulse changed the parameter values of the convergence burst units if both components were synchronized. The modified model accounted for velocity waveforms of both synchronous and dissociated convergence movements. We conclude that both the saccadic pulse and omnipause neuron inhibition influence the generation of vergence movements when they are made synchronously with saccades.     

Latency of visually evoked saccadic eye movements

The paper deals with the initiation of visually guided saccades, in order to break down the saccadic reaction time into functionally different periods of time. It takes into account that spatial processing of information is so basic that modelling of saccadic control properties should include spatio-temporal arrangements. The output signal of the saccadic system was measured in response to visual stimuli in which the time between the appearance of a visual stimulus in the peripheral field and the disappearance of the central fixation point was varied. The variation of the mean saccadic latency time, measured with respect to the onset of the peripheral stimulus, as a function of stimulus asynchrony was highly significant. This variation may be represented by a so-called gap-overlap curve, which is characterized here by means of five parameters. A facilitation model is introduced to fit the results of the gap-overlap experiments. The facilitation model for the initiation of visually evoked saccades incorporates a mechanism which governs the efficiency of processing of signals that arise from a stimulus presented at a particular position in space. It explains how visual information may be affected by other sensory information before it is used to command further saccades. It allows determination of saccadic system parameters, such as the peripheral and the foveal afferent processing time, the central processing time for a saccade and the degree of facilitation. These quantities were found to be characteristic for the given test subjects, and where these data could be compared with neurophysiological data, the agreement was within the experimental error.     

Linear ensemble-coding in midbrain superior colliculus specifies the saccade kinematics

Recently, we proposed an ensemble-coding scheme of the midbrain superior colliculus (SC) in which, during a saccade, each spike emitted by each recruited SC neuron contributes a fixed minivector to the gaze-control motor output. The size and direction of this 'spike vector' depend exclusively on a cell's location within the SC motor map (Goossens and Van Opstal, in J Neurophysiol 95: 2326-2341, 2006). According to this simple scheme, the planned saccade trajectory results from instantaneous linear summation of all spike vectors across the motor map. In our simulations with this model, the brainstem saccade generator was simplified by a linear feedback system, rendering the total model (which has only three free parameters) essentially linear. Interestingly, when this scheme was applied to actually recorded spike trains from 139 saccade-related SC neurons, measured during thousands of eye movements to single visual targets, straight saccades resulted with the correct velocity profiles and nonlinear kinematic relations ('main sequence properties' and 'component stretching'). Hence, we concluded that the kinematic nonlinearity of saccades resides in the spatial-temporal distribution of SC activity, rather than in the brainstem burst generator. The latter is generally assumed in models of the saccadic system. Here we analyze how this behaviour might emerge from this simple scheme. In addition, we will show new experimental evidence in support of the proposed mechanism.     

Saccades differentially modulate human LGN and V1 responses in the presence and absence of visual stimulation

Saccades occur several times each second in normal human vision. The visual image moves across the retina at high velocity during a saccade, yet no blurring of the visual scene is perceived . Active suppression of visual input may account for this perceptual continuity, but the neural mechanisms underlying such saccadic suppression remain unclear. We used functional MRI to specifically examine responses in the lateral geniculate nucleus (LGN) and primary visual cortex (V1) during saccades. Activity in both V1 and LGN was strongly modulated by saccades. Furthermore, this modulation depended on whether visual stimulation was present or absent. In complete darkness, saccades led to reliable signal increases in V1 and LGN, whereas in the presence of visual stimulation, saccades led to suppression of visually evoked responses. These findings represent unequivocal evidence for saccadic suppression in human LGN and retinotopically defined V1 and are consistent with the earliest site of saccadic suppression lying at or before V1.     

Visual stability and the motion aftereffect: a psychophysical study revealing spatial updating

Eye movements create an ever-changing image of the world on the retina. In particular, frequent saccades call for a compensatory mechanism to transform the changing visual information into a stable percept. To this end, the brain presumably uses internal copies of motor commands. Electrophysiological recordings of visual neurons in the primate lateral intraparietal cortex, the frontal eye fields, and the superior colliculus suggest that the receptive fields (RFs) of special neurons shift towards their post-saccadic positions before the onset of a saccade. However, the perceptual consequences of these shifts remain controversial. We wanted to test in humans whether a remapping of motion adaptation occurs in visual perception.The motion aftereffect (MAE) occurs after viewing of a moving stimulus as an apparent movement to the opposite direction. We designed a saccade paradigm suitable for revealing pre-saccadic remapping of the MAE. Indeed, a transfer of motion adaptation from pre-saccadic to post-saccadic position could be observed when subjects prepared saccades. In the remapping condition, the strength of the MAE was comparable to the effect measured in a control condition (33±7% vs. 27±4%). Contrary, after a saccade or without saccade planning, the MAE was weak or absent when adaptation and test stimulus were located at different retinal locations, i.e. the effect was clearly retinotopic. Regarding visual cognition, our study reveals for the first time predictive remapping of the MAE but no spatiotopic transfer across saccades. Since the cortical sites involved in motion adaptation in primates are most likely the primary visual cortex and the middle temporal area (MT/V5) corresponding to human MT, our results suggest that pre-saccadic remapping extends to these areas, which have been associated with strict retinotopy and therefore with classical RF organization. The pre-saccadic transfer of visual features demonstrated here may be a crucial determinant for a stable percept despite saccades.