Afterimage-like effects in the motion-sensitive neuron H1

A powerful effect resembling an afterimage is demonstrated on the pathway to the motion-sensitive neuron H1. This effect is independent of the locally generated gain control described in an earlier paper (Maddess & Laughlin 1985, Proc. R. Soc. Lond. B 225, 251). The afterimage, produced across the eye by a stationary pattern, causes the sensitivity to movement to be different according to the local stimulus history, and the effects of low-contrast (0.1) patterns, presented for as little as a few hundred milliseconds, remain for up to 2 s. Moving patterns interact with the afterimage to modulate the spike rate of H1. The afterimage increases with contrast but saturates at contrasts above 0.5. Low spatial frequencies generate afterimages less effectively than moderate ones; this result indicates that the afterimage process could lie at, or after, lateral inhibition between tonic units. This is supported by the fact that the altered sensitivity profiles generated by single bright and dark vertical bars initially resemble Mach bands. However, this character alters as the afterimage decays, and the depression of H1's response to moving bright stimuli, produced by the afterimage of a dark bar, continues to grow for up to 1 s after the adapting bar is removed. A short-lived (0.5 s) reduction of H1's directional selectivity accompanies strong afterimage formation. All these factors, especially the saturation at low contrasts and the spatial frequency tuning, rule out light adaptation by photoreceptors as the afterimage source. Luminances used were also low enough to exclude influence by the pupil mechanism. Lastly, responses to patterns that are occasionally jumped by large or small distances are broadened by stimuli that produce an afterimage. Responses to small displacements have previously been described as 'velocity impulse responses' (Srinivasan 1983, Vision Res. 23, 659; Zaagman et al. 1983, IEEE Trans. SMC 13, 900) and so the response broadening (stimulus blurring) can be taken as a reduction of the fly's temporal resolution of moving objects. Previously reported work shows that afterimages seen in humans and the effect reported here act over the same range of temporal frequencies rather than retinal drift speeds. This may suggest an important role for afterimage-like effects in the processing of the low temporal frequency components of moving images. Certainly, the fly's afterimage system reduces the visibility of moving objects within patches of an image that, have on average, contained slowly varying motion signals.(ABSTRACT TRUNCATED AT 400 WORDS)     

Spatiotopic visual maps revealed by saccadic adaptation in humans

Saccadic adaptation [1] is a powerful experimental paradigm to probe the mechanisms of eye movement control and spatial vision, in which saccadic amplitudes change in response to false visual feedback. The adaptation occurs primarily in the motor system [2, 3], but there is also evidence for visual adaptation, depending on the size and the permanence of the postsaccadic error [4-7]. Here we confirm that adaptation has a strong visual component and show that the visual component of the adaptation is spatially selective in external, not retinal coordinates. Subjects performed?a memory-guided, double-saccade, outward-adaptation task designed to maximize visual adaptation and to dissociate the visual and motor corrections. When the memorized saccadic target was in the same position (in external space) as that used in the adaptation training, saccade targeting was strongly influenced by adaptation (even if not matched in retinal or cranial position), but when in the same retinal or cranial but different external spatial position, targeting was unaffected by adaptation, demonstrating unequivocal spatiotopic selectivity. These results point to the existence of a spatiotopic neural representation for eye movement control that adapts in response to saccade error signals.     

A key role of starburst amacrine cells in originating retinal directional selectivity and optokinetic eye movement.

The directional selectivity of retinal ganglion cell responses represents a primitive pattern recognition that operates within a retinal neural circuit. The cellular origin and mechanism of directional selectivity were investigated by selectively eliminating retinal starburst amacrine cells, using immunotoxin-mediated cell targeting techniques. Starburst cell ablation in the adult retina abolished not only directional selectivity of ganglion cell responses but also an optokinetic eye reflex derived by stimulus movement. Starburst cells therefore serve as the key element that discriminates the direction of stimulus movement through integrative synaptic transmission and play a pivotal role in information processing that stabilizes image motion.     

A Computational Model of Afterimage Rotation in the Peripheral Drift Illusion Based on Retinal ON/OFF Responses

Human observers perceive illusory rotations after the disappearance of circularly repeating patches containing dark-to-light luminance. This afterimage rotation is a very powerful phenomenon, but little is known about the mechanisms underlying it. Here, we use a computational model to show that the afterimage rotation can be explained by a combination of fast light adaptation and the physiological architecture of the early visual system, consisting of ON- and OFF-type visual pathways. In this retinal ON/OFF model, the afterimage rotation appeared as a rotation of focus lines of retinal ON/OFF responses. Focus lines rotated clockwise on a light background, but counterclockwise on a dark background. These findings were consistent with the results of psychophysical experiments, which were also performed by us. Additionally, the velocity of the afterimage rotation was comparable with that observed in our psychophysical experiments. These results suggest that the early visual system (including the retina) is responsible for the generation of the afterimage rotation, and that this illusory rotation may be systematically misinterpreted by our high-level visual system.     

Adaptive Colour Contrast Coding in the Salamander Retina Efficiently Matches Natural Scene Statistics

The visual system continually adjusts its sensitivity to the statistical properties of the environment through an adaptation process that starts in the retina. Colour perception and processing is commonly thought to occur mainly in high visual areas, and indeed most evidence for chromatic colour contrast adaptation comes from cortical studies. We show that colour contrast adaptation starts in the retina where ganglion cells adjust their responses to the spectral properties of the environment. We demonstrate that the ganglion cells match their responses to red-blue stimulus combinations according to the relative contrast of each of the input channels by rotating their functional response properties in colour space. Using measurements of the chromatic statistics of natural environments, we show that the retina balances inputs from the two (red and blue) stimulated colour channels, as would be expected from theoretical optimal behaviour. Our results suggest that colour is encoded in the retina based on the efficient processing of spectral information that matches spectral combinations in natural scenes on the colour processing level.     

Smooth Pursuit Eye Movements Improve Temporal Resolution for Color Perception

Human observers see a single mixed color (yellow) when different colors (red and green) rapidly alternate. Accumulating evidence suggests that the critical temporal frequency beyond which chromatic fusion occurs does not simply reflect the temporal limit of peripheral encoding. However, it remains poorly understood how the central processing controls the fusion frequency. Here we show that the fusion frequency can be elevated by extra-retinal signals during smooth pursuit. This eye movement can keep the image of a moving target in the fovea, but it also introduces a backward retinal sweep of the stationary background pattern. We found that the fusion frequency was higher when retinal color changes were generated by pursuit-induced background motions than when the same retinal color changes were generated by object motions during eye fixation. This temporal improvement cannot be ascribed to a general increase in contrast gain of specific neural mechanisms during pursuit, since the improvement was not observed with a pattern flickering without changing position on the retina or with a pattern moving in the direction opposite to the background motion during pursuit. Our findings indicate that chromatic fusion is controlled by a cortical mechanism that suppresses motion blur. A plausible mechanism is that eye-movement signals change spatiotemporal trajectories along which color signals are integrated so as to reduce chromatic integration at the same locations (i.e., along stationary trajectories) on the retina that normally causes retinal blur during fixation.     

Visual pattern recognition based on spatio-temporal patterns of retinal ganglion cells’ activities

Neural information is processed based on integrated activities of relevant neurons. Concerted population activity is one of the important ways for retinal ganglion cells to efficiently organize and process visual information. In the present study, the spike activities of bullfrog retinal ganglion cells in response to three different visual patterns (checker-board, vertical gratings and horizontal gratings) were recorded using multi-electrode arrays. A measurement of subsequence distribution discrepancy (MSDD) was applied to identify the spatio-temporal patterns of retinal ganglion cells' activities in response to different stimulation patterns. The results show that the population activity patterns were different in response to different stimulation patterns, such difference in activity pattern was consistently detectable even when visual adaptation occurred during repeated experimental trials. Therefore, the stimulus pattern can be reliably discriminated according to the spatio-temporal pattern of the neuronal activities calculated using the MSDD algorithm.     

Changes in visual receptive fields with microstimulation of frontal cortex

The influence of attention on visual cortical neurons has been described in terms of its effect on the structure of receptive fields (RFs), where multiple stimuli compete to drive neural responses and ultimately behavior. We stimulated the frontal eye field (FEF) of passively fixating monkeys and produced changes in V4 responses similar to known effects of voluntary attention. Subthreshold FEF stimulation enhanced visual responses at particular locations within the RF and altered the interaction between pairs of RF stimuli to favor those aligned with the activated FEF site. Thus, we could influence which stimulus drove the responses of individual V4 neurons. These results suggest that spatial signals involved in saccade preparation are used to covertly select among multiple stimuli appearing within the RFs of visual cortical neurons.     

Adaptation to Changes in Higher-Order Stimulus Statistics in the Salamander Retina

Adaptation in the retina is thought to optimize the encoding of natural light signals into sequences of spikes sent to the brain. While adaptive changes in retinal processing to the variations of the mean luminance level and second-order stimulus statistics have been documented before, no such measurements have been performed when higher-order moments of the light distribution change. We therefore measured the ganglion cell responses in the tiger salamander retina to controlled changes in the second (contrast), third (skew) and fourth (kurtosis) moments of the light intensity distribution of spatially uniform temporally independent stimuli. The skew and kurtosis of the stimuli were chosen to cover the range observed in natural scenes. We quantified adaptation in ganglion cells by studying linear-nonlinear models that capture well the retinal encoding properties across all stimuli. We found that the encoding properties of retinal ganglion cells change only marginally when higher-order statistics change, compared to the changes observed in response to the variation in contrast. By analyzing optimal coding in LN-type models, we showed that neurons can maintain a high information rate without large dynamic adaptation to changes in skew or kurtosis. This is because, for uncorrelated stimuli, spatio-temporal summation within the receptive field averages away non-gaussian aspects of the light intensity distribution.     

Retinal adaptation to object motion

Due to fixational eye movements, the image on the retina is always in motion, even when one views a stationary scene. When an object moves within the scene, the corresponding patch of retina experiences a different motion trajectory than the surrounding region. Certain retinal ganglion cells respond selectively to this condition, when the motion in the cell's receptive field center is different from that in the surround. Here we show that this response is strongest at the very onset of differential motion, followed by gradual adaptation with a time course of several seconds. Different subregions of a ganglion cell's receptive field can adapt independently. The circuitry responsible for differential motion adaptation lies in the inner retina. Several candidate mechanisms were tested, and the adaptation most likely results from synaptic depression at the synapse from bipolar to ganglion cell. Similar circuit mechanisms may act more generally to emphasize novel features of a visual stimulus.     

Different temporal structure for form versus surface cortical color systems--evidence from chromatic non-linear VEP

Physiological studies of color processing have typically measured responses to spatially varying chromatic stimuli such as gratings, while psychophysical studies of color include color naming, color and light, as well as spatial and temporal chromatic sensitivities. This raises the question of whether we have one or several cortical color processing systems. Here we show from non-linear analysis of human visual evoked potentials (VEP) the presence of distinct and independent temporal signatures for form and surface color processing. Surface color stimuli produced most power in the second order Wiener kernel, indicative of a slowly recovering neural system, while chromatic form stimulation produced most power in the first order kernel (showing rapid recovery). We find end-spectral saturation-dependent signals, easily separable from achromatic signals for surface color stimuli. However physiological responses to form color stimuli, though varying somewhat with saturation, showed similar waveform components. Lastly, the spectral dependence of surface and form color VEP was different, with the surface color responses almost vanishing with yellow-grey isoluminant stimulation whereas the form color VEP shows robust recordable signals across all hues. Thus, surface and form colored stimuli engage different neural systems within cortex, pointing to the need to establish their relative contributions under the diverse chromatic stimulus conditions used in the literature.     

Responses to lightness variations in early human visual cortex

Lightness is the apparent reflectance of a surface, and it depends not only on the actual luminance of the surface but also on the context in which the surface is viewed [1-10]. The cortical mechanisms of lightness processing are largely unknown, and the role of early cortical areas is still a matter of debate [11-17]. We studied the cortical responses to lightness variations in early stages of the human visual system with functional magnetic resonance imaging (fMRI) while observers were performing a demanding fixation task. The set of dynamically presented visual stimuli included the rectangular version of the classic Craik-O'Brien stimulus [3, 18, 19] and a variant that led to a weaker lightness effect, as well as a pattern with actual luminance variations. We found that the cortical activity in retinotopic areas, including the primary visual cortex (V1), is correlated with context-dependent lightness variations.     

Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons

The response of a cortical cell to a repeated stimulus can be highly variable from one trial to the next. Much lower variability has been reported of retinal cells. We recorded visual responses simultaneously from three successive stages of the cat visual system: retinal ganglion cells (RGCs), thalamic (LGN) relay cells, and simple cells in layer 4 of primary visual cortex. Spike count variability was lower than that of a Poisson process at all three stages but increased at each stage. Absolute and relative refractory periods largely accounted for the reliability at all three stages. Our results show that cortical responses can be more reliable than previously thought. The differences in reliability in retina, LGN, and cortex can be explained by (1) decreasing firing rates and (2) decreasing absolute and relative refractory periods.     

Transformation of Stimulus Correlations by the Retina

Redundancies and correlations in the responses of sensory neurons may seem to waste neural resources, but they can also carry cues about structured stimuli and may help the brain to correct for response errors. To investigate the effect of stimulus structure on redundancy in retina, we measured simultaneous responses from populations of retinal ganglion cells presented with natural and artificial stimuli that varied greatly in correlation structure; these stimuli and recordings are publicly available online. Responding to spatio-temporally structured stimuli such as natural movies, pairs of ganglion cells were modestly more correlated than in response to white noise checkerboards, but they were much less correlated than predicted by a non-adapting functional model of retinal response. Meanwhile, responding to stimuli with purely spatial correlations, pairs of ganglion cells showed increased correlations consistent with a static, non-adapting receptive field and nonlinearity. We found that in response to spatio-temporally correlated stimuli, ganglion cells had faster temporal kernels and tended to have stronger surrounds. These properties of individual cells, along with gain changes that opposed changes in effective contrast at the ganglion cell input, largely explained the pattern of pairwise correlations across stimuli where receptive field measurements were possible.     

Daytime light exposure dynamically enhances brain responses

In humans, light enhances both alertness and performance during nighttime and daytime [1-4] and influences regional brain function [5]. These effects do not correspond to classical visual responses but involve a non-image forming (NIF) system, which elicits greater endocrine, physiological, neurophysiological, and behavioral responses to shorter light wavelengths than to wavelengths geared toward the visual system [6-11]. During daytime, the neural changes induced by light exposure, and their time courses, are largely unknown. With functional magnetic resonance imaging (fMRI), we characterized the neural correlates of the alerting effect of daytime light by assessing the responses to an auditory oddball task [12-15], before and after a short exposure to a bright white light. Light-induced improvement in subjective alertness was linearly related to responses in the posterior thalamus. In addition, light enhanced responses in a set of cortical areas supporting attentional oddball effects, and it prevented decreases of activity otherwise observed during continuous darkness. Responses to light were remarkably dynamic. They declined within minutes after the end of the light stimulus, following various region-specific time courses. These findings suggest that light can modulate activity of subcortical structures involved in alertness, thereby dynamically promoting cortical activity in networks involved in ongoing nonvisual cognitive processes.     

Perceived motion in complementary afterimages: verification of a neural network theory

Steady fixation of a regular pattern like a bar grating or concentric circles leads to a complementary afterimage at pattern offset. The afterimage has the appearance of shimmering lines that are locally orthogonal to the orientations of the inducing image. Additionally, the afterimage includes motion running parallel to the orientation of the afterimage lines. We argue that this afterimage motion supports the existence of a cue to motion that is based on the spatial organization of oriented responses. This cue was previously proposed after analysis of a neural network model of visual perception. We test predictions of the model on various types of complementary afterimage inducing stimuli. When a contrast or size gradient is included in the inducing image, the afterimage motion moves toward the higher part of the gradient, in agreement with the model. Implications of this cue for computational and neurophysiological theories of motion perception are discussed.     

Adaptation of oriented and unoriented color-selective neurons in human visual areas

Primary visual cortex contains at least two distinct populations of color-selective cells: neurons in one have circularly symmetric receptive fields and respond best to reddish and greenish light, while neurons in another have oriented receptive fields and a variety of color preferences. The relative prevalence and perceptual roles of the two kinds of neurons remain controversial, however. We used fMRI and a selective adaptation technique to measure responses attributable to these two populations. The technique revealed evidence of adaptation in both populations and indicated that they each produced strong signals in V1 and other human visual areas. The activity of both sets of neurons was also reflected in color appearance measurements made with the same stimuli. Thus, both oriented and unoriented color-selective cells in V1 are important components of the neural pathways that underlie perception of color.     

Human visual system integrates color signals along a motion trajectory

Whether fundamental visual attributes, such as color, motion, and shape, are analyzed separately in specialized pathways has been one of the central questions of visual neuroscience. Although recent studies have revealed various forms of cross-attribute interactions, including significant contributions of color signals to motion processing, it is still widely believed that color perception is relatively independent of motion processing. Here, we report a new color illusion, motion-induced color mixing, in which moving bars, the color of each of which alternates between two colors (e.g., red and green), are perceived as the mixed color (e.g., yellow) even though the two colors are never superimposed on the retina. The magnitude of color mixture is significantly stronger than that expected from direction-insensitive spatial integration of color signals. This illusion cannot be ascribed to optical image blurs, including those induced by chromatic aberration, or to involuntary eye movements of the observer. Our findings indicate that color signals are integrated not only at the same retinal location, but also along a motion trajectory. It is possible that this neural mechanism helps us to see veridical colors for moving objects by reducing motion blur, as in the case of luminance-based pattern perception.     

An instructive role for patterned spontaneous retinal activity in mouse visual map development

Complex neural circuits in the mammalian brain develop through a combination of genetic instruction and activity-dependent refinement. The relative role of these factors and the form of neuronal activity responsible for circuit development is a matter of significant debate. In the mammalian visual system, retinal ganglion cell projections to the brain are mapped with respect to retinotopic location and eye of origin. We manipulated the pattern of spontaneous retinal waves present during development without changing overall activity levels through the transgenic expression of β2-nicotinic acetylcholine receptors in retinal ganglion cells of mice. We used this manipulation to demonstrate that spontaneous retinal activity is not just permissive, but instructive in the emergence of eye-specific segregation and retinotopic refinement in the mouse visual system. This suggests that specific patterns of spontaneous activity throughout the developing brain are essential in the emergence of specific and distinct patterns of neuronal connectivity.     

The role of the posterior parietal cortex in coordinate transformations for visual-motor integration

Lesion to the posterior parietal cortex in monkeys and humans produces spatial deficits in movement and perception. In recording experiments from area 7a, a cortical subdivision in the posterior parietal cortex in monkeys, we have found neurons whose responses are a function of both the retinal location of visual stimuli and the position of the eyes in the orbits. By combining these signals area 7 a neurons code the location of visual stimuli with respect to the head. However, these cells respond over only limited ranges of eye positions (eye-position-dependent coding). To code location in craniotopic space at all eye positions (eye-position-independent coding) an additional step in neural processing is required that uses information distributed across populations of area 7a neurons. We describe here a neural network model, based on back-propagation learning, that both demonstrates how spatial location could be derived from the population response of area 7a neurons and accurately accounts for the observed response properties of these neurons.