Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration

A central goal in sensory neuroscience is to understand the neuronal signal processing involved in the encoding of natural stimuli. A critical step towards this goal is the development of successful computational encoding models. For ganglion cells in the vertebrate retina, the development of satisfactory models for responses to natural visual scenes is an ongoing challenge. Standard models typically apply linear integration of visual stimuli over space, yet many ganglion cells are known to show nonlinear spatial integration, in particular when stimulated with contrast-reversing gratings. We here study the influence of spatial nonlinearities in the encoding of natural images by ganglion cells, using multielectrode-array recordings from isolated salamander and mouse retinas. We assess how responses to natural images depend on first- and second-order statistics of spatial patterns inside the receptive field. This leads us to a simple extension of current standard ganglion cell models. We show that taking not only the weighted average of light intensity inside the receptive field into account but also its variance over space can partly account for nonlinear integration and substantially improve response predictions of responses to novel images. For salamander ganglion cells, we find that response predictions for cell classes with large receptive fields profit most from including spatial contrast information. Finally, we demonstrate how this model framework can be used to assess the spatial scale of nonlinear integration. Our results underscore that nonlinear spatial stimulus integration translates to stimulation with natural images. Furthermore, the introduced model framework provides a simple, yet powerful extension of standard models and may serve as a benchmark for the development of more detailed models of the nonlinear structure of receptive fields.     

Simulation of retinal ganglion cell response using fast independent component analysis

Advances in neurobiology suggest that neuronal response of the primary visual cortex to natural stimuli may be attributed to sparse approximation of images, encoding stimuli to activate specific neurons although the underlying mechanisms are still unclear. The responses of retinal ganglion cells (RGCs) to natural and random checkerboard stimuli were simulated using fast independent component analysis. The neuronal response to stimuli was measured using kurtosis and Treves–Rolls sparseness, and the kurtosis, lifetime and population sparseness were analyzed. RGCs exhibited significant lifetime sparseness in response to natural stimuli and random checkerboard stimuli. About 65 and 72% of RGCs do not fire all the time in response to natural and random checkerboard stimuli, respectively. Both kurtosis of single neurons and lifetime response of single neurons values were larger in the case of natural than in random checkerboard stimuli. The population of RGCs fire much less in response to random checkerboard stimuli than natural stimuli. However, kurtosis of population sparseness and population response of the entire neurons were larger with natural than random checkerboard stimuli. RGCs fire more sparsely in response to natural stimuli. Individual neurons fire at a low rate, while the occasional “burst” of neuronal population transmits information efficiently.     

Transformation of Stimulus Correlations by the Retina

Redundancies and correlations in the responses of sensory neurons may seem to waste neural resources, but they can also carry cues about structured stimuli and may help the brain to correct for response errors. To investigate the effect of stimulus structure on redundancy in retina, we measured simultaneous responses from populations of retinal ganglion cells presented with natural and artificial stimuli that varied greatly in correlation structure; these stimuli and recordings are publicly available online. Responding to spatio-temporally structured stimuli such as natural movies, pairs of ganglion cells were modestly more correlated than in response to white noise checkerboards, but they were much less correlated than predicted by a non-adapting functional model of retinal response. Meanwhile, responding to stimuli with purely spatial correlations, pairs of ganglion cells showed increased correlations consistent with a static, non-adapting receptive field and nonlinearity. We found that in response to spatio-temporally correlated stimuli, ganglion cells had faster temporal kernels and tended to have stronger surrounds. These properties of individual cells, along with gain changes that opposed changes in effective contrast at the ganglion cell input, largely explained the pattern of pairwise correlations across stimuli where receptive field measurements were possible.     

Adaptive Colour Contrast Coding in the Salamander Retina Efficiently Matches Natural Scene Statistics

The visual system continually adjusts its sensitivity to the statistical properties of the environment through an adaptation process that starts in the retina. Colour perception and processing is commonly thought to occur mainly in high visual areas, and indeed most evidence for chromatic colour contrast adaptation comes from cortical studies. We show that colour contrast adaptation starts in the retina where ganglion cells adjust their responses to the spectral properties of the environment. We demonstrate that the ganglion cells match their responses to red-blue stimulus combinations according to the relative contrast of each of the input channels by rotating their functional response properties in colour space. Using measurements of the chromatic statistics of natural environments, we show that the retina balances inputs from the two (red and blue) stimulated colour channels, as would be expected from theoretical optimal behaviour. Our results suggest that colour is encoded in the retina based on the efficient processing of spectral information that matches spectral combinations in natural scenes on the colour processing level.     

Intrinsic cone adaptation modulates feedback efficiency from horizontal cells to cones.

Processing of visual stimuli by the retina changes strongly during light/dark adaptation. These changes are due to both local photoreceptor-based processes and to changes in the retinal network. The feedback pathway from horizontal cells to cones is known to be one of the pathways that is modulated strongly during adaptation. Although this phenomenon is well described, the mechanism for this change is poorly characterized. The aim of this paper is to describe the mechanism for the increase in efficiency of the feedback synapse from horizontal cells to cones. We show that a train of flashes can increase the feedback response from the horizontal cells, as measured in the cones, up to threefold. This process has a time constant of approximately 3 s and can be attributed to processes intrinsic to the cones. It does not require dopamine, is not the result of changes in the kinetics of the cone light response and is not due to changes in horizontal cells themselves. During a flash train, cones adapt to the mean light intensity, resulting in a slight (4 mV) depolarization of the cones. The time constant of this depolarization is approximately 3 s. We will show that at this depolarized membrane potential, a light-induced change of the cone membrane potential induces a larger change in the calcium current than in the unadapted condition. Furthermore, we will show that negative feedback from horizontal cells to cones can modulate the calcium current more efficiently at this depolarized cone membrane potential. The change in horizontal cell response properties during the train of flashes can be fully attributed to these changes in the synaptic efficiency. Since feedback has major consequences for the dynamic, spatial, and spectral processing, the described mechanism might be very important to optimize the retina for ambient light conditions.     

A Simple Model of Optimal Population Coding for Sensory Systems

A fundamental task of a sensory system is to infer information about the environment. It has long been suggested that an important goal of the first stage of this process is to encode the raw sensory signal efficiently by reducing its redundancy in the neural representation. Some redundancy, however, would be expected because it can provide robustness to noise inherent in the system. Encoding the raw sensory signal itself is also problematic, because it contains distortion and noise. The optimal solution would be constrained further by limited biological resources. Here, we analyze a simple theoretical model that incorporates these key aspects of sensory coding, and apply it to conditions in the retina. The model specifies the optimal way to incorporate redundancy in a population of noisy neurons, while also optimally compensating for sensory distortion and noise. Importantly, it allows an arbitrary input-to-output cell ratio between sensory units (photoreceptors) and encoding units (retinal ganglion cells), providing predictions of retinal codes at different eccentricities. Compared to earlier models based on redundancy reduction, the proposed model conveys more information about the original signal. Interestingly, redundancy reduction can be near-optimal when the number of encoding units is limited, such as in the peripheral retina. We show that there exist multiple, equally-optimal solutions whose receptive field structure and organization vary significantly. Among these, the one which maximizes the spatial locality of the computation, but not the sparsity of either synaptic weights or neural responses, is consistent with known basic properties of retinal receptive fields. The model further predicts that receptive field structure changes less with light adaptation at higher input-to-output cell ratios, such as in the periphery.     

Optogenetics in Mice Performing a Visual Discrimination Task: Measurement and Suppression of Retinal Activation and the Resulting Behavioral Artifact

Optogenetic techniques are used widely to perturb and interrogate neural circuits in behaving animals, but illumination can have additional effects, such as the activation of endogenous opsins in the retina. We found that illumination, delivered deep into the brain via an optical fiber, evoked a behavioral artifact in mice performing a visually guided discrimination task. Compared with blue (473 nm) and yellow (589 nm) illumination, red (640 nm) illumination evoked a greater behavioral artifact and more activity in the retina, the latter measured with electrical recordings. In the mouse, the sensitivity of retinal opsins declines steeply with wavelength across the visible spectrum, but propagation of light through brain tissue increases with wavelength. Our results suggest that poor retinal sensitivity to red light was overcome by relatively robust propagation of red light through brain tissue and stronger illumination of the retina by red than by blue or yellow light. Light adaptation of the retina, via an external source of illumination, suppressed retinal activation and the behavioral artifact without otherwise impacting behavioral performance. In summary, long wavelength optogenetic stimuli are particularly prone to evoke behavioral artifacts via activation of retinal opsins in the mouse, but light adaptation of the retina can provide a simple and effective mitigation of the artifact.     

Presynaptic mechanism for slow contrast adaptation in mammalian retinal ganglion cells

Visual neurons, from retina to cortex, adapt slowly to stimulus contrast. Following a switch from high to low contrast, a neuron rapidly decreases its responsiveness and recovers over 5-20 s. Cortical adaptation arises from an intrinsic cellular mechanism: a sodium-dependent potassium conductance that causes prolonged hyperpolarization. Spiking can drive this mechanism, raising the possibility that the same mechanism exists in retinal ganglion cells. We found that adaptation in ganglion cells corresponds to a slowly recovering afterhyperpolarization (AHP), but, unlike in cortical cells, this AHP is not primarily driven by an intrinsic cellular property: spiking was not sufficient to generate adaptation. Adaptation was strongest following spatial stimuli tuned to presynaptic bipolar cells rather than the ganglion cell; it was driven by a reduced excitatory conductance, and it persisted while blocking GABA and glycine receptors, K((Ca)) channels, or mGluRs. Thus, slow adaptation arises from reduced glutamate release from presynaptic (nonspiking) bipolar cells.     

Axonal transmission in the retina introduces a small dispersion of relative timing in the ganglion cell population response

Background

Visual stimuli elicit action potentials in tens of different retinal ganglion cells. Each ganglion cell type responds with a different latency to a given stimulus, thus transforming the high-dimensional input into a temporal neural code. The timing of the first spikes between different retinal projection neurons cells may further change along axonal transmission. The purpose of this study is to investigate if intraretinal conduction velocity leads to a synchronization or dispersion of the population signal leaving the eye.

Methodology/Principal Findings

We ‘imaged’ the initiation and transmission of light-evoked action potentials along individual axons in the rabbit retina at micron-scale resolution using a high-density multi-transistor array. We measured unimodal conduction velocity distributions (1.3±0.3 m/sec, mean ± SD) for axonal populations at all retinal eccentricities with the exception of the central part that contains myelinated axons. The velocity variance within each piece of retina is caused by ganglion cell types that show narrower and slightly different average velocity tuning. Ganglion cells of the same type respond with similar latency to spatially homogenous stimuli and conduct with similar velocity. For ganglion cells of different type intraretinal conduction velocity and response latency to flashed stimuli are negatively correlated, indicating that differences in first spike timing increase (up to 10 msec). Similarly, the analysis of pair-wise correlated activity in response to white-noise stimuli reveals that conduction velocity and response latency are negatively correlated.

Conclusion/Significance

Intraretinal conduction does not change the relative spike timing between ganglion cells of the same type but increases spike timing differences among ganglion cells of different type. The fastest retinal ganglion cells therefore act as indicators of new stimuli for postsynaptic neurons. The intraretinal dispersion of the population activity will not be compensated by variability in extraretinal conduction times, estimated from data in the literature.     

Shifts in coding properties and maintenance of information transmission during adaptation in barrel cortex

Neuronal responses to ongoing stimulation in many systems change over time, or “adapt.” Despite the ubiquity of adaptation, its effects on the stimulus information carried by neurons are often unknown. Here we examine how adaptation affects sensory coding in barrel cortex. We used spike-triggered covariance analysis of single-neuron responses to continuous, rapidly varying vibrissa motion stimuli, recorded in anesthetized rats. Changes in stimulus statistics induced spike rate adaptation over hundreds of milliseconds. Vibrissa motion encoding changed with adaptation as follows. In every neuron that showed rate adaptation, the input–output tuning function scaled with the changes in stimulus distribution, allowing the neurons to maintain the quantity of information conveyed about stimulus features. A single neuron that did not show rate adaptation also lacked input–output rescaling and did not maintain information across changes in stimulus statistics. Therefore, in barrel cortex, rate adaptation occurs on a slow timescale relative to the features driving spikes and is associated with gain rescaling matched to the stimulus distribution. Our results suggest that adaptation enhances tactile representations in primary somatosensory cortex, where they could directly influence perceptual decisions.     

Melanopsin-Derived Visual Responses under Light Adapted Conditions in the Mouse dLGN

A direct projection from melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs) reaches the primary visual thalamus (dorsal lateral geniculate nucleus; dLGN). The significance of this melanopsin input to the visual system is only recently being investigated. One unresolved question is the degree to which neurons in the dLGN could use melanopsin to track dynamic changes in light intensity under light adapted conditions. Here we set out to address this question. We were able to present full field steps visible only to melanopsin by switching between rod-isoluminant ‘yellow’ and ‘blue’ lights in a mouse lacking cone function (Cnga3^-/-). In the retina these stimuli elicited melanopsin-like responses from a subset of ganglion cells. When presented to anaesthetised mice, we found that ~25-30% of visually responsive neurones in the contralateral dLGN responded to these melanopsin-isolating steps with small increases in firing rate. Such responses could be elicited even with fairly modest increases in effective irradiance (32% Michelson contrast for melanopsin). These melanopsin-driven responses were apparent at bright backgrounds (corresponding to twilight-daylight conditions), but their threshold irradiance was strongly dependent upon prior light exposure when stimuli were superimposed on a spectrally neutral ramping background light. While both onset and offset latencies were long for melanopsin-derived responses compared to those evoked by rods, there was great variability in these parameters with some cells responding to melanopsin steps in <1 s. These data indicate that a subset of dLGN units can employ melanopsin signals to detect modest changes in irradiance under photopic conditions.     

Dark rearing alters the normal development of spatiotemporal response properties but not of contrast detection threshold in mouse retinal ganglion cells

The mouse visual system is immature when the eyes open two weeks after birth. As in other mammals, some of the maturation that occurs in the subsequent weeks is known to depend on visual experience. Development of the retina, which as the first stage of vision provides the visual information to the brain, also depends on light‐driven activity for proper development but has been less well studied than visual cortical development. The critical properties for retinal encoding of images include detection of contrast and responsiveness to the broad range of temporal stimulus frequencies present in natural stimuli. Here we show that contrast detection threshold and temporal frequency response characteristics of ON and OFF retinal ganglion cells (RGCs), which are poor at eye opening, subsequently undergo maturation, improving RGC performance. Further, we find that depriving mice of visual experience from before birth by rearing them in the dark causes ON and OFF RGCs to have smaller receptive field centers but does not affect their contrast detection threshold development. The modest developmental increase in temporal frequency responsiveness of RGCs in mice reared on a normal light cycle was inhibited by dark rearing only in ON but not OFF RGCs. Thus, these RGC response characteristics are in many ways unaffected by the experience‐dependent changes to synaptic and spontaneous activity known to occur in the mouse retina in the two weeks after eye opening, but specific differences are apparent in the ON vs. OFF RGC populations. © 2014 Wiley Periodicals, Inc. Develop Neurobiol 74: 692–706, 2014     

Stimulus-dependent Maximum Entropy Models of Neural Population Codes

Neural populations encode information about their stimulus in a collective fashion, by joint activity patterns of spiking and silence. A full account of this mapping from stimulus to neural activity is given by the conditional probability distribution over neural codewords given the sensory input. For large populations, direct sampling of these distributions is impossible, and so we must rely on constructing appropriate models. We show here that in a population of 100 retinal ganglion cells in the salamander retina responding to temporal white-noise stimuli, dependencies between cells play an important encoding role. We introduce the stimulus-dependent maximum entropy (SDME) model—a minimal extension of the canonical linear-nonlinear model of a single neuron, to a pairwise-coupled neural population. We find that the SDME model gives a more accurate account of single cell responses and in particular significantly outperforms uncoupled models in reproducing the distributions of population codewords emitted in response to a stimulus. We show how the SDME model, in conjunction with static maximum entropy models of population vocabulary, can be used to estimate information-theoretic quantities like average surprise and information transmission in a neural population.     

Changes in the colour of light cue circadian activity

The discovery of melanopsin, the non-visual opsin present in intrinsically photosensitive retinal ganglion cells (ipRGCs), has created great excitement in the field of circadian biology. Now, researchers have emphasized melanopsin as the main photopigment governing circadian activity in vertebrates. Circadian biologists have tested this idea under standard laboratory, 12h Light: 12h Dark, lighting conditions that lack the dramatic daily colour changes of natural skylight. Here we used a stimulus paradigm in which the colour of the illumination changed throughout the day, thus mimicking natural skylight, but luminance, sensed intrinsically by melanopsin containing ganglion cells, was kept constant. We show in two species of cichlid, Aequidens pulcher and Labeotropheus fuelleborni, that changes in light colour, not intensity, are the primary determinants of natural circadian activity. Moreover, opponent-cone photoreceptor inputs to ipRGCs mediate the sensation of wavelength change, and not the intrinsic photopigment, melanopsin. These results have implications for understanding the evolutionary biology of non-visual photosensory pathways and answer long-standing questions about the nature and distribution of photopigments in organisms, including providing a solution to the mystery of why nocturnal animals routinely have mutations that interrupt the function of their short wavelength sensitive photopigment gene.     

江豚和白鱀豚视网膜神经节细胞的研究

江豚和白暨豚视网膜神经节细胞根据其形态结构可分为1、2两型。其密度分布在大多数江豚和1头白(既鱼)豚呈两个高密度区。第一高密度区位于视网膜鼻侧偏腹方,第二高密度区位于颞侧偏背方。第一和第二高密度区的细胞的最高密度在江豚大多数分别为每平方毫米250和210左右,在一例白暨豚约180和140以上。其组成、密度分布及细胞总数在采自长江和黄海沿岸的江豚之间差异不显著。在白(既鱼)豚由于大神经节细胞相对增多,细胞平均直径比江豚的大;细胞数在40微米左右处形成特有的第二个峰;2型的细胞极少,且没有发现典型的星形神经节细胞。 几种豚类的视网膜神经节细胞的比较表明,在适应弱光环境的过程中,视网膜神经节细胞的组成发生了一些改变:2型的神经节细胞逐渐减少甚至消失;大神经节细胞相对增多;神经节细胞密度减小。视觉敏度提高,锐度下降。     

Adaptation-dependent synchronous activity contributes to receptive field size change of bullfrog retinal ganglion cell

Nearby retinal ganglion cells of similar functional subtype have a tendency to discharge spikes in synchrony. The synchronized activity is involved in encoding some aspects of visual input. On the other hand, neurons always continuously adjust their activities in adaptation to some features of visual stimulation, including mean ambient light, contrast level, etc. Previous studies on adaptation were primarily focused on single neuronal activity, however, it is also intriguing to investigate the adaptation process in population neuronal activities. In the present study, by using multi-electrode recording system, we simultaneously recorded spike discharges from a group of dimming detectors (OFF-sustained type ganglion cells) in bullfrog retina. The changes in receptive field properties and synchronization strength during contrast adaptation were analyzed. It was found that, when perfused using normal Ringer's solution, single neuronal receptive field size was reduced during contrast adaptation, which was accompanied by weakening in synchronization strength between adjacent neurons' activities. When dopamine (1 μM) was applied, the adaptation-related receptive field area shrinkage and synchronization weakening were both eliminated. The activation of D1 receptor was involved in the adaptation-related modulation of synchronization and receptive field. Our results thus suggest that the size of single neuron's receptive field is positively related to the strength of its synchronized activity with its neighboring neurons, and the dopaminergic pathway is responsible for the modulation of receptive field property and synchronous activity of the ganglion cells during the adaptation process.     

Sensitivity of a sensory process to short time delays: A study in pattern induced flicker colors (PIFCs)

Pattern induced flicker colors (PIFCs) were generated by means of a modified version of Benham's top, the stimulus pattern of which could be varied continuously during stimulation by the human subjects. The sensitivity of the color sensation to small phase shifts between the periodic stimuli on neighboring retinal areas was recorded under several conditions of stimulus parameters. A mathematical model was developed to describe the influence of the stimulus parameters on the recorded sensory effect. Concerning the underlying neurophysiological processes, a hypothesis is advanced according to which the phase sensitive lateral interaction within the retina changes the spatial excitation distribution within color coding receptive fields of the retinal ganglion cells. The resulting ganglion cell excitation is supposed to generate PIFCs.     

Fluctuations in amino acid-H3 incorporation into the proteins of the isolated retina]

The rate of amino acid incorporation into the mouse retina proteins was measured in dynamics of dark adaptation and at different terms of their stimulation by light. It was found that variations in dry weight of the ganglion retinal cells and in the incorporation of amino acids into their proteins occurred rhythmically, with the period of about one hour.     

Distribution of glial fibrillary acidic protein in normal and gliotic human retina

The distribution of glial fibrillary acidic protein (GFAP) in normal human retina and in retinae with gliosis due to different diseases was studied by immunohistochemical methods. In normal retina, an evident GFAP-positivity is encountered only in the nerve fiber and ganglion cell layers; Müller cells do not stain. In retinal gliosis, together with an enhanced positivity of the perivascular and accessory glia, a strong staining for GFAP is observed in Müller cells, which extends from the inner to the outer limiting layers. A correlation between the intensity of immunohistochemical glial staining, its anatomical localization and the degree of retinal changes is suggested.