The perception of visual motion.

Recent developments have led to a greater insight into the complex processes of perception of visual motion. A better understanding of the neuronal circuitry involved and advances in electrophysiological techniques have allowed researchers to alter the perception of an animal with a stimulating electrode. In addition, studies have further elucidated the processes by which signals are combined and compared, allowing a greater understanding of the effects of selective brain damage.     

Low-level visual processing of biological motion.

Biological motion displays depict a moving human figure by means of just a few isolated points of light attached to the major joints of the body. Naive observers readily interpret the moving pattern of dots as representing a human figure, despite the complete absence of form cues. This paper reports a series of experiments which investigated the visual processes underlying the phenomenon. Results suggest that (i) the effect relies upon responses in low-level motion-detecting processes, which operate over short temporal and spatial intervals and respond to local modulations in image intensity; and (ii) the effect does not involve hierarchical visual analysis of motion components, nor does it require the presence of dots which move in rigid relation to each other. Instead, movements of the extremities are crucial. Data are inconsistent with current theoretical treatments.     

Saccadic eye movements modulate visual responses in the lateral geniculate nucleus

We studied the effects of saccadic eye movements on visual signaling in the primate lateral geniculate nucleus (LGN), the earliest stage of central visual processing. Visual responses were probed with spatially uniform flickering stimuli, so that retinal processing was uninfluenced by eye movements. Nonetheless, saccades had diverse effects, altering not only response strength but also the temporal and chromatic properties of the receptive field. Of these changes, the most prominent was a biphasic modulation of response strength, weak suppression followed by strong enhancement. Saccadic modulation was widespread, and affected both of the major processing streams in the LGN. Our results demonstrate that during natural viewing, thalamic response properties can vary dramatically, even over the course of a single fixation.     

Measurement of the 2D affine Lie group parameters for visual motion analysis.

A class of linear operators is presented for estimating the local components of 2D translation, dilatation, rotation, and the shear/deformations which span the six degrees of freedom of motion of arbitrarily textured surfaces. This results in a model of visual motion analysis which proposes that the local transformations in the image are analysed by decomposing them into the six one-parameter subgroups of the 2D affine group. Each of the required invariant integral operators are easily specified by the characters of these six subgroups. The 2D affine group, however, does not have a simple structure. It is a Lie group which possesses a semi-direct product manifold, and classical harmonic analysis cannot proceed unless some mechanism is prescribed to isolate the 2D 'general linear' transformations from the 2D translations. It must also do so using measures which receive only local support from the image, since the global affine group model is only valid tangentially. A form of 'active perception' is thereby implicated; it is proposed that spatial indexing and 2D tracking is needed in order to form reliable estimates of 3D motion parameters using local operators in a data-driven fashion.     

Optimizing visual motion perception during eye movements.

We usually perceive a stationary, stable world and we are able to correctly estimate the direction of heading from optic flow despite coherent visual motion induced by eye movements. This astonishing example of perceptual invariance results from a comparison of visual information with internal reference signals predicting the visual consequences of an eye movement. Here we demonstrate that the reference signal predicting the consequences of smooth-pursuit eye movements is continuously calibrated on the basis of direction-selective interactions between the pursuit motor command and the rotational flow induced by the eye movement, thereby minimizing imperfections of the reference signal and guaranteeing an ecologically optimal interpretation of visual motion.     

Auditory motion information drives visual motion perception

Background

Vision provides the most salient information with regard to the stimulus motion. However, it has recently been demonstrated that static visual stimuli are perceived as moving laterally by alternating left-right sound sources. The underlying mechanism of this phenomenon remains unclear; it has not yet been determined whether auditory motion signals, rather than auditory positional signals, can directly contribute to visual motion perception.

Methodology/Principal Findings

Static visual flashes were presented at retinal locations outside the fovea together with a lateral auditory motion provided by a virtual stereo noise source smoothly shifting in the horizontal plane. The flash appeared to move by means of the auditory motion when the spatiotemporal position of the flashes was in the middle of the auditory motion trajectory. Furthermore, the lateral auditory motion altered visual motion perception in a global motion display where different localized motion signals of multiple visual stimuli were combined to produce a coherent visual motion perception.

Conclusions/Significance

These findings suggest there exist direct interactions between auditory and visual motion signals, and that there might be common neural substrates for auditory and visual motion processing.     

Steady-state measures of visual suppression

In the early visual system, suppression occurs between neurons representing different stimulus properties. This includes features such as orientation (cross-orientation suppression), eye-of-origin (interocular suppression) and spatial location (surround suppression), which are thought to involve distinct anatomical pathways. We asked if these separate routes to suppression can be differentiated by their pattern of gain control on the contrast response function measured in human participants using steady-state electroencephalography. Changes in contrast gain shift the contrast response function laterally, whereas changes in response gain scale the function vertically. We used a Bayesian hierarchical model to summarise the evidence for each type of gain control. A computational meta-analysis of 16 previous studies found the most evidence for contrast gain effects with overlaid masks, but no clear evidence favouring either response gain or contrast gain for other mask types. We then conducted two new experiments, comparing suppression from four mask types (monocular and dichoptic overlay masks, and aligned and orthogonal surround masks) on responses to sine wave grating patches flickering at 5Hz. At the occipital pole, there was strong evidence for contrast gain effects in all four mask types at the first harmonic frequency (5Hz). Suppression generally became stronger at more lateral electrode sites, but there was little evidence of response gain effects. At the second harmonic frequency (10Hz) suppression was stronger overall, and involved both contrast and response gain effects. Although suppression from different mask types involves distinct anatomical pathways, gain control processes appear to serve a common purpose, which we suggest might be to suppress less reliable inputs.     

Saccadic motor planning by integrating visual information and pre-information on neural dynamic fields

A functional model of target selection in the saccadic system is presented, incorporating elements of visual processing, motor planning, and motor control. We address the integration of visual information with pre-information. which is provided by manipulating the probability that a target appears at a certain location. This integration is achieved within a dynamic representation of planned eye movement which is modeled through distributions of activation on a topographic field. Visual input evokes activation, which is also constrained by lateral interaction within the field and by preshaping input representing pre-information. The model describes target selection observable in paradigms in which visual goals are presented at more than one location. Specifically, we model the transition from averaging, where endpoints of first saccades fall between two visual target locations, to decision making, where endpoints of first saccades fall accurately onto one of two simultaneously presented visual targets. We make predictions about how metrical biases of first saccades are induced by pre-information about target locations acquired by learning. When coupled to a motor control stage, activation dynamics on the planning level contribute to stabilizing gaze under fixation conditions. The neurophysiological relevance of our functional model is discussed.     

Energy filters,motion uncertainty,and motion sensitive cells in the visual cortex: a mathematical analysis

Energy filters are tuned to space-time frequency orientations. In order to compute velocity it is necessary to use a collection of filters, each tuned to a different space-time frequency. Here we analyze, in a probabilistic framework, the properties of the motion uncertainty. Its lower bound, which can be explicitly computed through the Cramér-Rao inequality, will have different values depending on the filter parameters. We show for the Gabor filter that, in order to minimize the motion uncertainty, the spatial and temporal filter sizes cannot be arbitrarily chosen; they are only allowed to vary over a limited range of values such that the temporal filter bandwidth is larger than the spatial bandwidth. This property is shared by motion sensitive cells in the primary visual cortex of the cat, which are known to be direction selective and are tuned to spacetime frequency orientations. We conjecture that these cells have larger temporal bandwidth relative to their spatial bandwidth because they compute velocity with maximum efficiency, that is, with a minimum motion uncertainty.     

Diurnal modulation of visual motion prediction

Predicting the future position of moving objects is an essential cognitive function used for many daily activities, such as driving, walking and reaching. The experiments described in this paper show a marked diurnal modulation of motion prediction in inflating image perception. This motion prediction was shown to be more accurate in the afternoon than in the morning. In contrast, such modulation could not be found in deflating image perception. Such diurnal fluctuations may be mediated by circadian properties of retinal cone photoreceptors.     

Neural correlates of visual motion prediction

Predicting the trajectories of moving objects in our surroundings is important for many life scenarios, such as driving, walking, reaching, hunting and combat. We determined human subjects' performance and task-related brain activity in a motion trajectory prediction task. The task required spatial and motion working memory as well as the ability to extrapolate motion information in time to predict future object locations. We showed that the neural circuits associated with motion prediction included frontal, parietal and insular cortex, as well as the thalamus and the visual cortex. Interestingly, deactivation of many of these regions seemed to be more closely related to task performance. The differential activity during motion prediction vs. direct observation was also correlated with task performance. The neural networks involved in our visual motion prediction task are significantly different from those that underlie visual motion memory and imagery. Our results set the stage for the examination of the effects of deficiencies in these networks, such as those caused by aging and mental disorders, on visual motion prediction and its consequences on mobility related daily activities.     

Generalized flash suppression of salient visual targets

A pattern of light striking the retina of an alert observer is normally readily perceived. While a handful of conditions exist in which even salient visual stimuli can be rendered invisible, the mechanisms underlying such suppression remain poorly understood. Here, we describe experiments using a novel stimulation sequence that gives rise to the sudden and reliable subjective disappearance of a wide range of visual patterns. We found that a parafoveal target immediately vanished from perception following the abrupt onset of a surrounding texture. The probability of disappearance was influenced by the ocular configuration of the target and surround, as well as their spatial separation. In addition, suppression was critically dependent upon several hundred milliseconds of stimulus-specific adaptation. These findings demonstrate that the all-or-none disappearance of a salient visual target, which is reminiscent of a high-level selection process, is inextricably linked to topographic stimulus representations, presumably in the early visual cortex.     

Updating visual space during motion in depth

Whether we are riding in a car or walking, our internal map of the environment must be continuously updated to maintain spatial constancy. Using a memory eye movement task, we examined whether nonhuman primates can keep track of changes in the distance of nearby objects when moved toward or away from them. We report that memory-guided eye movements take into account the change in distance traveled, illustrating that monkeys can update retinal disparity information in order to reconstruct three-dimensional visual space during motion in depth. This ability was compromised after destruction of the vestibular labyrinths, suggesting that the extraretinal signals needed for updating can arise from vestibular information signaling self-motion through space.     

A general model for visual motion detection

We propose a general model for detection of both first-order motion and second-order motion. In this model an input stimulus is divided into a number of partially overlapping spatiotemporal local regions. Spatiotemporal frequency analysis is done for every local region using Gabor filters, then the input stimulus (original spatiotemporal signal) is replaced by the outputs of Gabor filters. Local motion is detected by applying Gabor motion detectors to each local spatiotemporal pattern depicted by each local feature value. Outputs of all the detectors are integrated to give the final output for global motion of the input stimulus. The model was simulated on a computer and was confirmed to correctly detect second-order motion as well as first-order motion.     

Encoding of motion in real time by the fly visual system.

Direction-selective cells in the fly visual system that have large receptive fields play a decisive role in encoding the time-dependent optic flow the animal encounters during locomotion. Recent experiments on the computations performed by these cells have highlighted the significance of dendritic integration and have addressed the role of spikes versus graded membrane potential changes in encoding optic flow information. It is becoming increasingly clear that the way optic flow is encoded in real time is constrained both by the computational needs of the animal in visually guided behaviour as well as by the specific properties of the underlying neuronal hardware.     

Saccadic head movements of the praying mantis, with particular reference to visual and proprioceptive information

ABSTRACT. Horizontal head movements of the praying mantis, Sphodromantis lineola Burm., were recorded continuously. They responded to the presence of a live blowfly prey in the antero-lateral visual field with a rapid saccadic head movement. The angular movement of a fixation saccade was correlated positively to the displacement of the prey from the prothoracic midline. Saccade magnitude and velocity are related. After the stimulus moved out of the visual field, the mantis made a second saccadic head movement, a return saccade towards the body midline. We observed return saccades in which the head overshot or undershot the body midline, as well as saccades which returned the head exactly to its initial position. In 92% of trials with intact mantids, the return movement succeeded eventually in rotating the head back to its initial position, whereas after removal of the neck hair plates this occurred in only 47% of trials. There is a consistent relation between saccade extent and velocity. Velocities of return saccades were slower than those of fixation saccades. It is suggested that sensory inputs from the neck hair plate proprioceptors modify both the magnitude and the angular velocity of fixation and return saccadic head movements.