Tuning Properties of MT and MSTd and Divisive Interactions for Eye-Movement Compensation

The primate brain intelligently processes visual information from the world as the eyes move constantly. The brain must take into account visual motion induced by eye movements, so that visual information about the outside world can be recovered. Certain neurons in the dorsal part of monkey medial superior temporal area (MSTd) play an important role in integrating information about eye movements and visual motion. When a monkey tracks a moving target with its eyes, these neurons respond to visual motion as well as to smooth pursuit eye movements. Furthermore, the responses of some MSTd neurons to the motion of objects in the world are very similar during pursuit and during fixation, even though the visual information on the retina is altered by the pursuit eye movement. We call these neurons compensatory pursuit neurons. In this study we develop a computational model of MSTd compensatory pursuit neurons based on physiological data from single unit studies. Our model MSTd neurons can simulate the velocity tuning of monkey MSTd neurons. The model MSTd neurons also show the pursuit compensation property. We find that pursuit compensation can be achieved by divisive interaction between signals coding eye movements and signals coding visual motion. The model generates two implications that can be tested in future experiments: (1) compensatory pursuit neurons in MSTd should have the same direction preference for pursuit and retinal visual motion; (2) there should be non-compensatory pursuit neurons that show opposite preferred directions of pursuit and retinal visual motion.     

Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements

To track a moving object, its motion must first be distinguished from that of the background. The center-surround properties of neurons in the middle temporal visual area (MT) may be important for signaling the relative motion between object and background. To test this, we microstimulated within MT and measured the effects on monkeys' eye movements to moving targets. We found that stimulation at "local motion" sites, where receptive fields possessed antagonistic surrounds, shifted pursuit in the preferred direction of the neurons, whereas stimulation at "wide-field motion" sites shifted pursuit in the opposite, or null, direction. We propose that activating wide-field sites simulated background motion, thus inducing a target motion signal in the opposite direction. Our results support the hypothesis that neuronal center-surround mechanisms contribute to the behavioral segregation of objects from the background.     

Inverse perspective mapping simplifies optical flow computation and obstacle detection

We present a scheme for obstacle detection from optical flow which is based on strategies of biological information processing. Optical flow is established by a local voting (non-maximum suppression) over the outputs of correlation-type motion detectors similar to those found in the fly visual system. The computational theory of obstacle detection is discussed in terms of space-variances of the motion field. An efficient mechanism for the detection of disturbances in the expected motion field is based on inverse perspective mapping, i.e., a coordinate transform or retinotopic mapping applied to the image. It turns out that besides obstacle detection, inverse perspective mapping has additional advantages for regularizing optical flow algorithms. Psychophysical evidence for body-scaled obstacle detection and related neurophysiological results are discussed.     

Detection of rotating gravity signals

It is shown in the preceding paper that neurons with two-dimensional spatio-temporal properties to linear acceleration behave like one-dimensional rate sensors: they encode the component of angular velocity (associated with a rotating linear acceleration vector) that is normal to their response plane. During off-vertical axis rotation (OVAR) otolith-sensitive neurons are activated by the gravity vector as it rotates relative to the head. Unlike one-dimensional linear accelerometer neurons which exhibit equal response magnitudes for both directions of rotation, two-dimensional neurons can be shown to respond with unequal magnitudes to clockwise and counterclockwise off-vertical axis rotations. The magnitudes of the sinusoidal responses of these neurons is not only directionally selective but also proportional to rotational velocity. Thus, responses from such two-dimensional neurons may represent the first step in the computations necessary to generate the steady-state eye velocity during OVAR. An additional step involving a nonlinear operation is necessary to transform the sinusoidally modulated output of these neurons into a signal proportional to sustained eye velocity. Similarly to models of motion detection in the visual system, this transformation is proposed to be achieved through neuronal operations involving mathematical multiplication followed by a leaky integration by the velocity storage mechanism. The proposed model for the generation of maintained eye velocity during OVAR is based on anatomical and physiological properties of vestibular nuclei neurons and capable of predicting the experimentally observed steady-state characteristics of the eye velocity.     

A quantitative synchronization model for smooth pursuit target tracking

We propose a quantitative model for human smooth pursuit tracking of a continuously moving visual target which is based on synchronization of an internal expectancy model of the target position coupled to the retinal target signal. The model predictions are tested in a smooth circular pursuit eye tracking experiment with transient target blanking of variable duration. In subjects with a high tracking accuracy, the model accounts for smooth pursuit and repeatedly reproduces quantitatively characteristic patterns of the eye dynamics during target blanking. In its simplest form, the model has only one free parameter, a coupling constant. An extended model with a second parameter, a time delay or memory term, accounts for predictive smooth pursuit eye movements which advance the target. The model constitutes an example of synchronization of a complex biological system with perceived sensory signals. Cognitive and Neurobiological Research Consortium in Traumatic Brain Injury (CNRC-TBI).     

Effects of Attention to Auditory Motion on Cortical Activations during Smooth Pursuit Eye Tracking

Background

In contrast to traditional views that consider smooth pursuit as a relatively automatic process, evidence has been reported for the importance of attention for accurate pursuit performance. However, the exact role that attention might play in the maintenance of pursuit remains unclear.

Methodology/Principal Findings

We analysed the neuronal activity associated with healthy subjects executing smooth pursuit eye movements (SPEM) during concurrent attentive tracking of a moving sound source, which was either in-phase or in antiphase to the executed eye movements. Assuming that attentional resources must be allocated to the moving sound source, the simultaneous execution of SPEM and auditory tracking in diverging directions should result in increased load on common attentional resources. By using an auditory stimulus as a distractor rather then a visual stimulus we guaranteed that cortical activity cannot be caused by conflicts between two simultaneous visual motion stimuli. Our results revealed that the smooth pursuit task with divided attention led to significantly higher activations bilaterally in the posterior parietal cortex and lateral and medial frontal cortex, presumably containing the parietal, frontal and supplementary eye fields respectively.

Conclusions

The additional cortical activation in these areas is apparently due to the process of dividing attention between the execution of SPEM and the covert tracking of the auditory target. On the other hand, even though attention had to be divided the attentional resources did not seem to be exhausted, since the identification of the direction of the auditory target and the quality of SPEM were unaffected by the congruence between visual and auditory motion stimuli. Finally, we found that this form of task-related attention modulated not only the cortical pursuit network in general but also affected modality specific and supramodal attention regions.     

Complex predictive eye pursuit in monkey: a model system for cerebellar studies of skilled movement

Smooth pursuit eye movements provide a good model system for cerebellar studies of complex motor control in monkeys. First, the pursuit system exhibits predictive control along complex trajectories and this control improves with training. Second, the flocculus/paraflocculus region of the cerebellum appears to generate this control. Lesions impair pursuit and neural activity patterns are closely related to eye motion during complex pursuit. Importantly, neural responses lead eye motion during predictive pursuit and lag eye motion during non-predictable target motions that require visual control. The idea that flocculus/paraflocculus predictive control is non-visual is also supported by a lack of correlation between neural activity and retinal image motion during pursuit. Third, biologically accurate neural network models of the flocculus/paraflocculus allow the exploration and testing of pursuit mechanisms. Our current model can generate predictive control without visual input in a manner that is compatible with the extensive experimental data available for this cerebellar system. Similar types of non-visual cerebellar control are likely to facilitate the wide range of other skilled movements that are observed.     

Dynamic theory of action-perception patterns: the “moving room” paradigm

Action-perception patterns are studied theoretically in terms of equations of motion that capture the coordination capacity of the nervous system. We consider intrinsic dynamics in the absence of visual information that contain a single posture state as a fixed point attractor. We couple these intrinsic dynamics to visual information that stabilizes posture in the visual world. This leads to a theory of postural sway induced by an optic flow field (moving room paradigm). The optic flow is parametrized in a simplest approximation by the expansion rate of a relevant perceptual target. We show how temporal stability as the key concept of this theory can lead to prediction and serve as a measure of perceptual coupling. Finally, we discuss the relation of the present theory to biological cybernetics.     

A putative suprachiasmatic nucleus of birds responds to visual motion

In mammals, the suprachiasmatic nucleus (SCN) is a pacemaker regulating daily rhythms. In birds, two retinorecipient nuclei have been called the avian SCN, one in the lateral hypothalamus and the other more medial and rostral. We asked whether the protooncogene c-fos is expressed in either nucleus after light exposure during subjective night, but not during subjective day, as is the case in the SCN of mammals.Chicks raised with one eye covered by a diffuser were exposed to vertically moving surroundings, after the difuser had been switched to the other eye.Surprisingly, we saw strong Fos label only in the lateral nucleus contralateral to the eye newly exposed to visual motion, but not in the ipsilateral nucleus nor in either medial SCN. No label was seen in animals kept in darkness or if the diffuser was not switched. Fos labeling did not differ between subjective day and night. The sensitivity to novel motion is also seen in motion-processing nuclei of the accessory optic system and pretectum; this suggests either that the lateral SCN is not the SCN, but part of the motion pathway, or that the avian SCN may be motion-sensitive during both day and night.     

Which retinal and extra-retinal information is crucial for circular vection?

In contradistinction to conventional wisdom, we propose that retinal image slip of a visual scene (optokinetic pattern, OP) does not constitute the only crucial input for visually induced percepts of self-motion (vection). Instead, the hypothesis is investigated that there are three input factors: 1) OP retinal image slip, 2) motion of the ocular orbital shadows across the retinae, and 3) smooth pursuit eye movements (efference copy). To test this hypothesis, we visually induced percepts of sinusoidal rotatory self-motion (circular vection, CV) in the absence of vestibular stimulation. Subjects were presented with three concurrent stimuli: a large visual OP, a fixation point to be pursued with the eyes (both projected in superposition on a semi-circular screen), and a dark window frame placed close to the eyes to create artificial visual field boundaries that simulate ocular orbital rim boundary shadows, but which could be moved across the retinae independent from eye movements. In different combinations these stimuli were independently moved or kept stationary. When moved together (horizontally and sinusoidally around the subject's head), they did so in precise temporal synchrony at 0.05 Hz. The results show that the occurrence of CV requires retinal slip of the OP and/or relative motion between the orbital boundary shadows and the OP. On the other hand, CV does not develop when the two retinal slip signals equal each other (no relative motion) and concur with pursuit eye movements (as it is the case, e.g., when we follow with the eyes the motion of a target on a stationary visual scene). The findings were formalized in terms of a simulation model. In the model two signals coding relative motion between OP and head are fused and fed into the mechanism for CV, a visuo-oculomotor one, derived from OP retinal slip and eye movement efference copy, and a purely visual signal of relative motion between the orbital rims (head) and the OP. The latter signal is also used, together with a version of the oculomotor efference copy, for a mechanism that suppresses CV at a later stage of processing in conditions in which the retinal slip signals are self-generated by smooth pursuit eye movements.     

Visibility of movement gradients

We report on the sensitivity of human observers with respect to the detection of transients in otherwise uniformly moving two-dimensional random-dot patterns. The target field is divided into two halfs that each contains a moving random-dot pattern. The patterns in the two halffields are mutually uncorrelated. Parameters are the average velocity and the difference-velocity for the two halfs. These velocities are both vectors that can be varied in magnitude and in their direction with respect to the border of the two halffields. In order to quantify the sensitivity of the visual system to such patterns, we added (linear addition) spatio-temporal white noise (snow) to the pattern. Then the sensitivity is quantified by way of the threshold signal-to-noise ratio necessary to discriminate the composite pattern from a single smoothly uniformly moving pattern. The signal-to-noise ratio specifies the square of the ratio between the signal r.m.s. contrast and the r.m.s. contrast of the masking stimulus (spatio-temporal white noise or snow). The r.m.s. contrast of the complex pattern (signal and noise) is kept invariant. We find that the detection performance is independent of the direction of either the average or difference-velocity with respect to the border, and can be completely described in terms of a minimum requirement for the magnitude of the difference-velocity. The magnitude of the difference-velocity must exceed the magnitude of the average velocity in order to lead to a perceivable transient. In his formulation the Weberlaw for the detection of velocity transients in uniformly moving noise patterns is applicable to both differences in magnitude and direction of the velocities.     

The interpretation of biological motion

The term biological motion has been coined by Johansson (1973) to refer to the ambulatory patterns of terrestrial bipeds and quadripeds. In this paper a computational theory of the visual perception of biological motion is proposed. The specific problem addressed is how the three dimensional structure and motions of animal limbs may be computed from the two dimensional motions of their projected images. It is noted that the limbs of animals typically do not move arbitrarily during ambulation. Rather, for anatomical reasons, they typically move in single planes for extended periods of time. This simple anatomical constraint is exploited as the basis for utilizing a planarity assumption in the interpretation of biological motion. The analysis proposed is: (1) divide the image into groups of two or three elements each; (2) test each group for pairwise-rigid planar motion; (3) combine the results from (2). Fundamental to the analysis are two structure from planar motion propositions. The first states that the structure and motion of two points rigidly linked and rotating in a plane is recoverable from three orthographic projections. The second states that the structure and motion of three points forming two highed rods constrained to move in a plane is recoverable from two orthographic projections. The psychological relevance of the analysis and possible interactions with top down recognition processes are discussed.     

Two distinct visual motion mechanisms for smooth pursuit: evidence from individual differences

Smooth-pursuit eye velocity to a moving target is more accurate after an initial catch-up saccade than before, an enhancement that is poorly understood. We present an individual-differences-based method for identifying mechanisms underlying a physiological response and use it to test whether visual motion signals driving pursuit differ pre- and postsaccade. Correlating moment-to-moment measurements of pursuit over time with two psychophysical measures of speed estimation during fixation, we find two independent associations across individuals. Presaccadic pursuit acceleration is predicted by the precision of low-level (motion-energy-based) speed estimation, and postsaccadic pursuit precision is predicted by the precision of high-level (position-tracking) speed estimation. These results provide evidence that a low-level motion signal influences presaccadic acceleration and an independent high-level motion signal influences postsaccadic precision, thus presenting a plausible mechanism for postsaccadic enhancement of pursuit.     

Orientation sensitivity of the visual movement detection system activating the landing response of the blowflies,Calliphora, and Phaenicia: A behavioural investigation

The orientation sensitivity of the visual movement detection system relative to the axes of the eye was investigated for the landing response by changing the direction of movement of a periodic striped pattern (unidirectional movement) and a two-stripe pattern consiting of two stripes moving apart (bidirectional movement). In the momocular, equatorial regions of the eye progressive motion proves to be most effective, whereas in the frontal (equational), binocular region descendive motion is most effective in eliciting the landing response, probably caused by binocular interactions. A strong enhancement of the response is induced by stimulation in the binocular region of the two eyes. The orientation of elementary movement detectors relative to the axes of the ommatidial array is discussed. The findings are summarized in a functional model of the landing response.     

Frame of reference transformations in motion perception during smooth pursuit eye movements

Smooth pursuit eye movements change the retinal image velocity of objects in the visual field. In order to change from a retinocentric frame of reference into a head-centric one, the visual system has to take the eye movements into account. Studies on motion perception during smooth pursuit eye movements have measured either perceived speed or perceived direction during smooth pursuit to investigate this frame of reference transformation, but never both at the same time. We devised a new velocity matching task, in which participants matched both perceived speed and direction during fixation to that during pursuit. In Experiment 1, the velocity matches were determined for a range of stimulus directions, with the head-centric stimulus speed kept constant. In Experiment 2, the retinal stimulus speed was kept approximately constant, with the same range of stimulus directions. In both experiments, the velocity matches for all directions were shifted against the pursuit direction, suggesting an incomplete transformation of the frame of reference. The degree of compensation was approximately constant across stimulus direction. We fitted the classical linear model, the model of Turano and Massof (2001) and that of Freeman (2001) to the velocity matches. The model of Turano and Massof fitted the velocity matches best, but the differences between de model fits were quite small. Evaluation of the models and comparison to a few alternatives suggests that further specification of the potential effect of retinal image characteristics on the eye movement signal is needed.     

A model for the neuronal implementation of selective visual attention based on temporal correlation among neurons

We propose a model for the neuronal implementation of selective visual attention based on temporal correlation among groups of neurons. Neurons in primary visual cortex respond to visual stimuli with a Poisson distributed spike train with an appropriate, stimulus-dependent mean firing rate. The spike trains of neurons whose receptive fields donot overlap with the focus of attention are distributed according to homogeneous (time-independent) Poisson process with no correlation between action potentials of different neurons. In contrast, spike trains of neurons with receptive fields within the focus of attention are distributed according to non-homogeneous (time-dependent) Poisson processes. Since the short-term average spike rates of all neurons with receptive fields in the focus of attention covary, correlations between these spike trains are introduced which are detected by inhibitory interneurons in V4. These cells, modeled as modified integrate-and-fire neurons, function as coincidence detectors and suppress the response of V4 cells associated with non-attended visual stimuli. The model reproduces quantitatively experimental data obtained in cortical area V4 of monkey by Moran and Desimone (1985).     

Measuring the Arousal Space of a Sit-and-Wait Predator: A Comparison of Predictive Models

The present study set out to compare two predictive models, Holling (1966) and Hardman and Turnbull (1980), to describe the arousal space for the aquatic sit-and-wait predator, Ranatra dispar. When tested in the horizontal plane the fit of Holling's model was good, although a better fit was achieved by using the untransformed angle of prey to body axis term . The second, multiple regression model, gave smaller residuals for low food deprivation periods but larger for longer periods. In the vertical plane the Holling model was unsatisfactory. It is suggested that the changes in number and size of ommatidia from dorsal to ventral region of the eye is largely responsible. A multiple regression model is described that predicts the arousal field of R. dispar in the vertical plane. It is suggested that the general applicability of such models to other visual predators is restricted if apparent hunger effects are not included in their development.     

Variability of the molecular mass of α-subunit in phycocyanins of colonial Microcystis aeruginosa f. aeruginosa in different eutrophic pond and lakes

Electrospray ionization mass spectra of phycocyaninsof eight samples from natural blooms of Microcystis aeruginosa f. aeruginosa collectedat different eutrophic pond and lakes indicated thatthe subunits of phycocyanins in the samespecies have different molecular masses, whereas the subunits have almost constant molecularmasses. A negative linear relationship between themolecular mass of subunit of phycocyanin andthe concentration of chlorophyll of natural andcolonial cyanobacterial samples was found. Aninterannual similarity of the subunitmolecular masses of phycocyanins was observed fromsamples collected at the same sampling site at LakeKasumigaura during 1994 and 1995. A locationalvariability of the subunit molecular massesof phycocyanins was also observed among samplescollected at three eutrophic pond and lakes.     

Motion Control in Saccade and Smooth Pursuit for Bionic Eye Based on Three-dimensional Coordinates

Saccade and smooth pursuit are two important functions of human eye.In order to enable bionic eye to imitate the two functions,a control method that implements saccade and smooth pursuit based on the three-dimensional coordinates of target is proposed.An optimal observation position is defined for bionic eye based on three-dimensional coordinates.A kind of motion planning method with high accuracy is developed.The motion parameters of stepper motor consisting of angle acceleration and turning time are computed according to the position deviation,the target's angular velocity and the stepper motor's current angular velocity in motion planning.The motors are controlled with the motion parameters moving to given position with desired angular velocity in schedule time.The experimental results show that the bionic eye can move to optimal observation positions in 0.6 s from initial location and the accuracy of 3D coordinates is improved.In addition,the bionic eye can track a target within the error of less than 20 pixels based on three-dimensional coordinates.It is verified that saccade and smooth pursuit of bionic eye based on three-dimensional coordinates are feasible.     

Influence of prior and visual information on eye movements in amblyopic children

This study analyzed the characteristics of pursuit and assessed the influence of prior and visual information on eye velocity and saccades in amblyopic and control children, in comparison to adults. Eye movements of 41 children (21 amblyopes and 20 controls) were compared to eye movements of 55 adults (18 amblyopes and 37 controls). Participants were asked to pursue a target moving at a constant velocity. The target was either a ‘standard’ target, with a uniform color intensity, or a ‘noisy’ target, with blurry edges, to mimic the blurriness of an amblyopic eye. Analysis of pursuit patterns showed that the onset was delayed, and the gain was decreased in control children with a noisy target in comparison to amblyopic or control children with a standard target. Furthermore, a significant effect of prior and visual information on pursuit velocity and saccades was found across all participants. Moreover, the modulation of the effect of visual information on the pursuit velocity by group, that is amblyopes or controls with a standard target, and controls with a noisy target, was more limited in children. In other words, the effect of visual information was higher in control adults with a standard target compared to control children with the same target. However, in the case of a blurry target, either in control participants with a noisy target or in amblyopic participants with a standard target, the effect of visual information was larger in children.