Recursive features of circular receptive fields

The distribution of excitability in retinal receptive fields may be well approximated by functions with recursive features. Physiological data do not exclude an implementation of recursive structures in the visual system. It is the most remarkable advantage of a recursive visual system, that cortical receptive fields tuned to different spatial frequencies will have an identical neuronal circuitry. Structural consequences for retina, LGN and visual cortex are discussed.     

Features and functions of nonlinear spatial integration by retinal ganglion cells

Ganglion cells in the vertebrate retina integrate visual information over their receptive fields. They do so by pooling presynaptic excitatory inputs from typically many bipolar cells, which themselves collect inputs from several photoreceptors. In addition, inhibitory interactions mediated by horizontal cells and amacrine cells modulate the structure of the receptive field. In many models, this spatial integration is assumed to occur in a linear fashion. Yet, it has long been known that spatial integration by retinal ganglion cells also incurs nonlinear phenomena. Moreover, several recent examples have shown that nonlinear spatial integration is tightly connected to specific visual functions performed by different types of retinal ganglion cells. This work discusses these advances in understanding the role of nonlinear spatial integration and reviews recent efforts to quantitatively study the nature and mechanisms underlying spatial nonlinearities. These new insights point towards a critical role of nonlinearities within ganglion cell receptive fields for capturing responses of the cells to natural and behaviorally relevant visual stimuli. In the long run, nonlinear phenomena of spatial integration may also prove important for implementing the actual neural code of retinal neurons when designing visual prostheses for the eye.     

Emergence of spatiotemporal receptive fields and its application to motion detection

A model of motion sensitivity as observed in some cells of area V1 of the visual cortex is proposed. Motion sensitivity is achieved by a combination of different spatiotemporal receptive fields, in particular, spatial and temporal differentiators. The receptive fields emerge if a Hebbian learning rule is applied to the network. Similar to a Linsker model the network has a spatially convergent, linear feedforward structure. Additionally, however, delays omnipresent in the brain are incorporated in the model. The emerging spatiotemporal receptive fields are derived explicitly by extending the approach of MacKay and Miller. The response characteristic of the network is calculated in frequency space and shows that the network can be considered as a spacetime filter for motion in one direction. The emergence of different types of receptive field requires certain structural constraints regarding the spatial and temporal arborisation. These requirements can be derived from the theoretical analysis and might be compared with neuroanatomical data. In this way an explicit link between structure and function of the network is established.     

Initial processing of visual information within the retina and the LGN

The initial stage of information processing by the visual system reduces the information contained in the continuous image on the retina into a discrete set of responses which are carried from the lateral geniculate nucleus (LGN) to the visual cortex.-1. The optimal sampling of the light intensity distribution in the visual environment is achieved only if each channel in the visual pathways carries undistorted information corresponding to an image element. The visual system approaches as closely as possible the scheme of optimal spatial sampling, retaining the full information on the low spatial frequency content of the object light intensity. The ideal receptive field of a sustained LGN cell is then of the form J ₁ (Kr)/Kr.-2. The experimentally determined receptive fields of sustained LGN cells (and to some extent retinal ganglion cells as well) in cat closely resemble the functional form J ₁ (Kr)/Kr. The centre-surround organization of the receptive fields is therefore understood as a scheme which leads to a maximal information flow through the visual pathways.-3. The optimal sampling scheme cannot be realized by the retina alone, because of restrictions on the size of neural networks. It is therefore constructed in two stages, ending at the LGN level. A recombination of ganglion cell signals into optimal receptive fields is a major role of the LGN.     

A unified neural network model of spatiotemporal processing in X and Y retinal ganglion cells

This article makes use of a push-pull shunting network, which was introduced in the companion article, to model certain properties of X and Y retinal ganglion cells. Input to the push-pull network is preprocessed by a nonlinear mechanism for temporal adaptation, which is ascribed here to photoreceptor dynamics. The complete circuit is used to show that a simple change in receptive field morphology within a single model equation can change the network's response characteristics to closely resemble those of either X or Y cells. Specifically, an increase in width of the receptive field center mechanism is sufficient to account for generation of on-off (Y-like) instead of null (X-like) responses to modulated gratings. In agreement with experimental data, the Y cell on-off response is independent of spatial phase. Also, the model accurately predicts that on-off responses can be observed in X cells for particular stimulus configurations. Taken together, the results show how the retina combines individually inadequate modules to efficiently handle the tasks required for accurate spatial and temporal visual information processing. The model is also able to clarify a number of controversial experimental findings on the nature of spatiotemporal visual processing in the retina.     

Receptive field families

It is generally agreed upon that size invariance and the absence of spurious resolution are two requirements that characterize well behaved spatial samping in visual systems. We show that these properties taken together constrain the structure of receptive fields to a very large degree. Only those field structures that arise as solutions of a certain linear partial differential equation of the second order prove to satisfy these general constraints. The equation admits of complete, orthonormal families of solutions. These families have to be regarded as the possible receptive field families subject to certain symmetry conditions. They can be transformed into each other via unitary transformations. Thus a single representation suffices to construct all the others. This theory permits us to classify the possible linear receptive field structures exhaustively, and to define their internal and external interrelations. This induces a principled taxonomy of linear receptive fields.     

Spatial frequency analysis in early visual processing

The existence of multiple channels, or multiple receptive field sizes, in the visual system does not commit us to any particular theory of spatial encoding in vision. However, distortions of apparent spatial frequency and width in a wide variety of conditions favour the idea that each channel carries a width- or frequency-related code or 'label' rather than a 'local sign' or positional label. When distortions of spatial frequency occur without prior adaptation (e.g. at low contrast or low luminance) they are associated with lowered sensitivity, and may be due to a mismatch between the perceptual labels and the actual tuning of the channels. A low-level representation of retinal space could be constructed from the spatial information encoded by the channels, rather than being projected intact from the retina.     

A spatio-temporal model of ganglion cell receptive field in the cat retina

A spatio-temporal model of ganglion cell receptive fields is proposed on the basis of receptive field characteristics of cat retinal ganglion cells reported in our previous paper. The model consists of the linear and nonlinear mechanisms in the ganglion cell receptive field. The linear mechanism is assumed to be composed of antagonistic center and surround mechanisms. Then, by integrating these mechanisms we construct a spatio-temporal impulse response function of ganglion cell receptive field. Here we assume that spatio-temporal impulse response function may be factored into spatial and temporal terms. By Fouriertransforming the spatio-temporal impulse response function, we can obtain the spatio-temporal transfer function. Contrast sensitivity characteristics of X-and Y-cells in the cat retina may be explained by the transfer function.     

rAAV-Mediated Subcellular Targeting of Optogenetic Tools in Retinal Ganglion Cells In Vivo

Expression of optogenetic tools in surviving inner retinal neurons to impart retinal light sensitivity has been a new strategy for restoring vision after photoreceptor degeneration. One potential approach for restoring retinal light sensitivity after photoreceptor degeneration is to express optogenetic tools in retinal ganglion cells (RGCs). For this approach, restoration of ON and OFF center-surround receptive fields in RGCs, a key feature of visual information processing, may be important. A possible solution is to differentially express depolarizing and hyperpolarizing optogenetic tools, such as channelrhodopsin-2 and halorhodopsin, to the center and peripheral regions of the RGC dendritic field by using protein targeting motifs. Recombinant adeno-associated virus (rAAV) vectors have proven to be a powerful vehicle for in vitro and in vivo gene delivery, including in the retina. Therefore, the search for protein targeting motifs that can achieve rAAV-mediated subcellular targeted expression would be particularly valuable for developing therapeutic applications. In this study, we identified two protein motifs that are suitable for rAAV-mediated subcellular targeting for generating center-surround receptive fields while reducing the axonal expression in RGCs. Resulting morphological dendritic field and physiological response field by center-targeting were significantly smaller than those produced by surround-targeting. rAAV motif-mediated protein targeting could also be a valuable tool for studying physiological function and clinical applications in other areas of the central nervous system.     

Pattern-dependent response modulations in motion-sensitive visual interneurons--a model study

Even if a stimulus pattern moves at a constant velocity across the receptive field of motion-sensitive neurons, such as lobula plate tangential cells (LPTCs) of flies, the response amplitude modulates over time. The amplitude of these response modulations is related to local pattern properties of the moving retinal image. On the one hand, pattern-dependent response modulations have previously been interpreted as 'pattern-noise', because they deteriorate the neuron's ability to provide unambiguous velocity information. On the other hand, these modulations might also provide the system with valuable information about the textural properties of the environment. We analyzed the influence of the size and shape of receptive fields by simulations of four versions of LPTC models consisting of arrays of elementary motion detectors of the correlation type (EMDs). These models have previously been suggested to account for many aspects of LPTC response properties. Pattern-dependent response modulations decrease with an increasing number of EMDs included in the receptive field of the LPTC models, since spatial changes within the visual field are smoothed out by the summation of spatially displaced EMD responses. This effect depends on the shape of the receptive field, being the more pronounced--for a given total size--the more elongated the receptive field is along the direction of motion. Large elongated receptive fields improve the quality of velocity signals. However, if motion signals need to be localized the velocity coding is only poor but the signal provides--potentially useful--local pattern information. These modelling results suggest that motion vision by correlation type movement detectors is subject to uncertainty: you cannot obtain both an unambiguous and a localized velocity signal from the output of a single cell. Hence, the size and shape of receptive fields of motion sensitive neurons should be matched to their potential computational task.     

Spatiotemporal specificity of neuronal activity directs the modification of receptive fields in the developing retinotectal system

The precise temporal relation between pre- and postsynaptic activity modulates the strength of synaptic connections. Despite its extensive characterization in vivo and in vitro, the degree to which spike timing-dependent plasticity can shape receptive field properties is unclear. We use in vivo patch-clamp recordings of tectal neurons in developing Xenopus tadpoles to control the precise timing of action potentials with respect to the arrival of a subset of visual inputs evoked by local light stimulation on the retina. The pattern of visual inputs onto a tectal neuron was tracked over time by rapid reverse correlation mapping of receptive fields. Spike timing-dependent potentiation or depression of a subset of synapses reliably shifts the spatial receptive fields toward or away from the trained subregion of visual space, respectively. These results demonstrate that natural patterns of activity evoked by sensory stimuli play an instructive role in the developing nervous system.     

A computational theory of visual receptive fields

A receptive field constitutes a region in the visual field where a visual cell or a visual operator responds to visual stimuli. This paper presents a theory for what types of receptive field profiles can be regarded as natural for an idealized vision system, given a set of structural requirements on the first stages of visual processing that reflect symmetry properties of the surrounding world. These symmetry properties include (i) covariance properties under scale changes, affine image deformations, and Galilean transformations of space–time as occur for real-world image data as well as specific requirements of (ii) temporal causality implying that the future cannot be accessed and (iii) a time-recursive updating mechanism of a limited temporal buffer of the past as is necessary for a genuine real-time system. Fundamental structural requirements are also imposed to ensure (iv) mutual consistency and a proper handling of internal representations at different spatial and temporal scales. It is shown how a set of families of idealized receptive field profiles can be derived by necessity regarding spatial, spatio-chromatic, and spatio-temporal receptive fields in terms of Gaussian kernels, Gaussian derivatives, or closely related operators. Such image filters have been successfully used as a basis for expressing a large number of visual operations in computer vision, regarding feature detection, feature classification, motion estimation, object recognition, spatio-temporal recognition, and shape estimation. Hence, the associated so-called scale-space theory constitutes a both theoretically well-founded and general framework for expressing visual operations. There are very close similarities between receptive field profiles predicted from this scale-space theory and receptive field profiles found by cell recordings in biological vision. Among the family of receptive field profiles derived by necessity from the assumptions, idealized models with very good qualitative agreement are obtained for (i) spatial on-center/off-surround and off-center/on-surround receptive fields in the fovea and the LGN, (ii) simple cells with spatial directional preference in V1, (iii) spatio-chromatic double-opponent neurons in V1, (iv) space–time separable spatio-temporal receptive fields in the LGN and V1, and (v) non-separable space–time tilted receptive fields in V1, all within the same unified theory. In addition, the paper presents a more general framework for relating and interpreting these receptive fields conceptually and possibly predicting new receptive field profiles as well as for pre-wiring covariance under scaling, affine, and Galilean transformations into the representations of visual stimuli. This paper describes the basic structure of the necessity results concerning receptive field profiles regarding the mathematical foundation of the theory and outlines how the proposed theory could be used in further studies and modelling of biological vision. It is also shown how receptive field responses can be interpreted physically, as the superposition of relative variations of surface structure and illumination variations, given a logarithmic brightness scale, and how receptive field measurements will be invariant under multiplicative illumination variations and exposure control mechanisms.     

Temporal pattern discrimination within the receptive field of cat retinal ganglion cells

ON-center and OFF-center receptive fields of cat retinal ganglion cells can be divided into two categories: sensitive (type N) and insensitive (type L) to three statistical temporal visual stimuli with different second order statistics but identical first order statistics (Tsukada et al. 1982). The temporal pattern sensitivity of type N response is closely related to the nonlinear stage of Y cells depending on the interaction between center and surround mechanism. The temporal pattern sensitivity of type N responses has a spatial profile within the receptive field; it is highly sensitive in the center region of the receptive field and less sensitive toward the field periphery. The temporal pattern sensitivity in the center region of the receptive field to statistical properties (irregular or regular) of a surrounding flash annulus shows modulation like a switching element: when the surrounding area is stimulated by a more regular flash stimulus with normal distribution of inter-stimulus intervals the system is sensitive (switching on) to the temporal pattern, while a change to an irregular one with an exponential distribution makes it insensitive (switching off) to the temporal pattern.     

A Simple Model of Optimal Population Coding for Sensory Systems

A fundamental task of a sensory system is to infer information about the environment. It has long been suggested that an important goal of the first stage of this process is to encode the raw sensory signal efficiently by reducing its redundancy in the neural representation. Some redundancy, however, would be expected because it can provide robustness to noise inherent in the system. Encoding the raw sensory signal itself is also problematic, because it contains distortion and noise. The optimal solution would be constrained further by limited biological resources. Here, we analyze a simple theoretical model that incorporates these key aspects of sensory coding, and apply it to conditions in the retina. The model specifies the optimal way to incorporate redundancy in a population of noisy neurons, while also optimally compensating for sensory distortion and noise. Importantly, it allows an arbitrary input-to-output cell ratio between sensory units (photoreceptors) and encoding units (retinal ganglion cells), providing predictions of retinal codes at different eccentricities. Compared to earlier models based on redundancy reduction, the proposed model conveys more information about the original signal. Interestingly, redundancy reduction can be near-optimal when the number of encoding units is limited, such as in the peripheral retina. We show that there exist multiple, equally-optimal solutions whose receptive field structure and organization vary significantly. Among these, the one which maximizes the spatial locality of the computation, but not the sparsity of either synaptic weights or neural responses, is consistent with known basic properties of retinal receptive fields. The model further predicts that receptive field structure changes less with light adaptation at higher input-to-output cell ratios, such as in the periphery.     

Receptive Fields in Primate Retina Are Coordinated to Sample Visual Space More Uniformly

In the visual system, large ensembles of neurons collectively sample visual space with receptive fields (RFs). A puzzling problem is how neural ensembles provide a uniform, high-resolution visual representation in spite of irregularities in the RFs of individual cells. This problem was approached by simultaneously mapping the RFs of hundreds of primate retinal ganglion cells. As observed in previous studies, RFs exhibited irregular shapes that deviated from standard Gaussian models. Surprisingly, these irregularities were coordinated at a fine spatial scale: RFs interlocked with their neighbors, filling in gaps and avoiding large variations in overlap. RF shapes were coordinated with high spatial precision: the observed uniformity was degraded by angular perturbations as small as 15°, and the observed populations sampled visual space with more than 50% of the theoretical ideal uniformity. These results show that the primate retina encodes light with an exquisitely coordinated array of RF shapes, illustrating a higher degree of functional precision in the neural circuitry than previously appreciated.     

Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration

A central goal in sensory neuroscience is to understand the neuronal signal processing involved in the encoding of natural stimuli. A critical step towards this goal is the development of successful computational encoding models. For ganglion cells in the vertebrate retina, the development of satisfactory models for responses to natural visual scenes is an ongoing challenge. Standard models typically apply linear integration of visual stimuli over space, yet many ganglion cells are known to show nonlinear spatial integration, in particular when stimulated with contrast-reversing gratings. We here study the influence of spatial nonlinearities in the encoding of natural images by ganglion cells, using multielectrode-array recordings from isolated salamander and mouse retinas. We assess how responses to natural images depend on first- and second-order statistics of spatial patterns inside the receptive field. This leads us to a simple extension of current standard ganglion cell models. We show that taking not only the weighted average of light intensity inside the receptive field into account but also its variance over space can partly account for nonlinear integration and substantially improve response predictions of responses to novel images. For salamander ganglion cells, we find that response predictions for cell classes with large receptive fields profit most from including spatial contrast information. Finally, we demonstrate how this model framework can be used to assess the spatial scale of nonlinear integration. Our results underscore that nonlinear spatial stimulus integration translates to stimulation with natural images. Furthermore, the introduced model framework provides a simple, yet powerful extension of standard models and may serve as a benchmark for the development of more detailed models of the nonlinear structure of receptive fields.     

Invariance of visual operations at the level of receptive fields

The brain is able to maintain a stable perception although the visual stimuli vary substantially on the retina due to geometric transformations and lighting variations in the environment. This paper presents a theory for achieving basic invariance properties already at the level of receptive fields. Specifically, the presented framework comprises (i) local scaling transformations caused by objects of different size and at different distances to the observer, (ii) locally linearized image deformations caused by variations in the viewing direction in relation to the object, (iii) locally linearized relative motions between the object and the observer and (iv) local multiplicative intensity transformations caused by illumination variations. The receptive field model can be derived by necessity from symmetry properties of the environment and leads to predictions about receptive field profiles in good agreement with receptive field profiles measured by cell recordings in mammalian vision. Indeed, the receptive field profiles in the retina, LGN and V1 are close to ideal to what is motivated by the idealized requirements. By complementing receptive field measurements with selection mechanisms over the parameters in the receptive field families, it is shown how true invariance of receptive field responses can be obtained under scaling transformations, affine transformations and Galilean transformations. Thereby, the framework provides a mathematically well-founded and biologically plausible model for how basic invariance properties can be achieved already at the level of receptive fields and support invariant recognition of objects and events under variations in viewpoint, retinal size, object motion and illumination. The theory can explain the different shapes of receptive field profiles found in biological vision, which are tuned to different sizes and orientations in the image domain as well as to different image velocities in space-time, from a requirement that the visual system should be invariant to the natural types of image transformations that occur in its environment.     

Receptive field microstructure and dendritic geometry of retinal ganglion cells

We studied the fine spatial structure of the receptive fields of retinal ganglion cells and its relationship to the dendritic geometry of these cells. Cells from which recordings had been made were microinjected with Lucifer yellow, so that responses generated at precise locations within the receptive field center could be directly compared with that cell's dendritic structure. While many cells with small receptive fields had domeshaped sensitivity profiles, the majority of large receptive fields were composed of multiple regions of high sensitivity. The density of dendritic branches at any one location did not predict the regions of high sensitivity. Instead, the interactions between a ganglion cell's dendritic tree and the local mosaic of bipolar cell axons seem to define the fine structure of the receptive field center.     

An overall description of retinotopic mapping in the cat's visual cortex areas 17, 18, and 19

Mathematical functions are derived which model the retinotopic mapping in the cat's visual cortical areas 17, 18, and 19. All three mappings are simple modifications of a complex power function with an exponent of 0.43. This function is decomposed so as to give an intermediate stage which is common to all three mappings and can be regarded as a model of the lateral geniculate nucleus mapping. The influence of retinotopic mapping on visual receptive fields was studied. The results show that a dependence of the receptive field properties on the position in the visual field is to be expected.