A Synaptic Mechanism for Temporal Filtering of Visual Signals

The visual system transmits information about fast and slow changes in light intensity through separate neural pathways. We used in vivo imaging to investigate how bipolar cells transmit these signals to the inner retina. We found that the volume of the synaptic terminal is an intrinsic property that contributes to different temporal filters. Individual cells transmit through multiple terminals varying in size, but smaller terminals generate faster and larger calcium transients to trigger vesicle release with higher initial gain, followed by more profound adaptation. Smaller terminals transmitted higher stimulus frequencies more effectively. Modeling global calcium dynamics triggering vesicle release indicated that variations in the volume of presynaptic compartments contribute directly to all these differences in response dynamics. These results indicate how one neuron can transmit different temporal components in the visual signal through synaptic terminals of varying geometries with different adaptational properties.     

Dark rearing alters the normal development of spatiotemporal response properties but not of contrast detection threshold in mouse retinal ganglion cells

The mouse visual system is immature when the eyes open two weeks after birth. As in other mammals, some of the maturation that occurs in the subsequent weeks is known to depend on visual experience. Development of the retina, which as the first stage of vision provides the visual information to the brain, also depends on light‐driven activity for proper development but has been less well studied than visual cortical development. The critical properties for retinal encoding of images include detection of contrast and responsiveness to the broad range of temporal stimulus frequencies present in natural stimuli. Here we show that contrast detection threshold and temporal frequency response characteristics of ON and OFF retinal ganglion cells (RGCs), which are poor at eye opening, subsequently undergo maturation, improving RGC performance. Further, we find that depriving mice of visual experience from before birth by rearing them in the dark causes ON and OFF RGCs to have smaller receptive field centers but does not affect their contrast detection threshold development. The modest developmental increase in temporal frequency responsiveness of RGCs in mice reared on a normal light cycle was inhibited by dark rearing only in ON but not OFF RGCs. Thus, these RGC response characteristics are in many ways unaffected by the experience‐dependent changes to synaptic and spontaneous activity known to occur in the mouse retina in the two weeks after eye opening, but specific differences are apparent in the ON vs. OFF RGC populations. © 2014 Wiley Periodicals, Inc. Develop Neurobiol 74: 692–706, 2014     

Spectral Characteristics of Phase Sensitivity and Discharge Rate of Neurons in the Ascending Tectofugal Visual System

Drifting gratings can modulate the activity of visual neurons at the temporal frequency of the stimulus. In order to characterize the temporal frequency modulation in the cat’s ascending tectofugal visual system, we recorded the activity of single neurons in the superior colliculus, the suprageniculate nucleus, and the anterior ectosylvian cortex during visual stimulation with drifting sine-wave gratings. In response to such stimuli, neurons in each structure showed an increase in firing rate and/or oscillatory modulated firing at the temporal frequency of the stimulus (phase sensitivity). To obtain a more complete characterization of the neural responses in spatiotemporal frequency domain, we analyzed the mean firing rate and the strength of the oscillatory modulations measured by the standardized Fourier component of the response at the temporal frequency of the stimulus. We show that the spatiotemporal stimulus parameters that elicit maximal oscillations often differ from those that elicit a maximal discharge rate. Furthermore, the temporal modulation and discharge-rate spectral receptive fields often do not overlap, suggesting that the detection range for visual stimuli provided jointly by modulated and unmodulated response components is larger than the range provided by a one response component.     

Rapid dynamics of contrast responses in the cat primary visual cortex

The visual information we receive during natural vision changes rapidly and continuously. The visual system must adapt to the spatiotemporal contents of the environment in order to efficiently process the dynamic signals. However, neuronal responses to luminance contrast are usually measured using drifting or stationary gratings presented for a prolonged duration. Since motion in our visual field is continuous, the signals received by the visual system contain an abundance of transient components in the contrast domain. Here using a modified reverse correlation method, we studied the properties of responses of neurons in the cat primary visual cortex to different contrasts of grating stimuli presented statically and transiently for 40 ms, and showed that neurons can effectively discriminate the rapidly changing contrasts. The change in the contrast response function (CRF) over time mainly consisted of an increment in contrast gain (CRF shifts to left) in the developing phase of temporal responses and a decrement in response gain (CRF shifts downward) in the decay phase. When the distribution range of stimulus contrasts was increased, neurons demonstrated decrement in contrast gain and response gain. Our results suggest that contrast gain control (contrast adaptation) and response gain control mechanisms are well established during the first tens of milliseconds after stimulus onset and may cooperatively mediate the rapid dynamic responses of visual cortical neurons to the continuously changing contrast. This fast contrast adaptation may play a role in detecting contrast contours in the context of visual scenes that are varying rapidly.     

Amplitude-temporal parameters of the evoked potentials of the visual and motor areas in the visual perception and mental representation of an image

Amplitude-temporal analysis was carried out of the EP components of the visual and motor areas elicited by neutral (diffuse light) and structural (checker board pattern) stimuli in different situations, defined by instruction. Interserial comparisons showed that at any instruction, the latency of the first EP component of the motor areas is reduced; as a result it can appear here simultaneously with the EP of the visual areas. At the instruction involving the subject in the process of active change of perception, activation of the right hemisphere, including the motor area, is manifest by EP parameters, while the right occipital area is activated in response to the structural stimulus, and the left one--in response to the neutral stimulus. At complication of the stimulus or instruction, the period is prolonged when the latency of EP components of the motor area is shorter than the latency of the isopolar components of the visual area--from 120 to 150 ms in response to the neutral stimuli and the neutral with their counting; from 90 to 150 ms in response to the structural stimuli; from 80 to 210 ms in response to the neutral stimuli with mental representation of the structural one.     

Nonlinear visuoauditory integration in the mouse superior colliculus

Sensory information from different modalities is processed in parallel, and then integrated in associative brain areas to improve object identification and the interpretation of sensory experiences. The Superior Colliculus (SC) is a midbrain structure that plays a critical role in integrating visual, auditory, and somatosensory input to assess saliency and promote action. Although the response properties of the individual SC neurons to visuoauditory stimuli have been characterized, little is known about the spatial and temporal dynamics of the integration at the population level. Here we recorded the response properties of SC neurons to spatially restricted visual and auditory stimuli using large-scale electrophysiology. We then created a general, population-level model that explains the spatial, temporal, and intensity requirements of stimuli needed for sensory integration. We found that the mouse SC contains topographically organized visual and auditory neurons that exhibit nonlinear multisensory integration. We show that nonlinear integration depends on properties of auditory but not visual stimuli. We also find that a heuristically derived nonlinear modulation function reveals conditions required for sensory integration that are consistent with previously proposed models of sensory integration such as spatial matching and the principle of inverse effectiveness.     

Spatiotemporal specificity of neuronal activity directs the modification of receptive fields in the developing retinotectal system

The precise temporal relation between pre- and postsynaptic activity modulates the strength of synaptic connections. Despite its extensive characterization in vivo and in vitro, the degree to which spike timing-dependent plasticity can shape receptive field properties is unclear. We use in vivo patch-clamp recordings of tectal neurons in developing Xenopus tadpoles to control the precise timing of action potentials with respect to the arrival of a subset of visual inputs evoked by local light stimulation on the retina. The pattern of visual inputs onto a tectal neuron was tracked over time by rapid reverse correlation mapping of receptive fields. Spike timing-dependent potentiation or depression of a subset of synapses reliably shifts the spatial receptive fields toward or away from the trained subregion of visual space, respectively. These results demonstrate that natural patterns of activity evoked by sensory stimuli play an instructive role in the developing nervous system.     

Integration of auditory and visual information about objects in superior temporal sulcus

Two categories of objects in the environment-animals and man-made manipulable objects (tools)-are easily recognized by either their auditory or visual features. Although these features differ across modalities, the brain integrates them into a coherent percept. In three separate fMRI experiments, posterior superior temporal sulcus and middle temporal gyrus (pSTS/MTG) fulfilled objective criteria for an integration site. pSTS/MTG showed signal increases in response to either auditory or visual stimuli and responded more to auditory or visual objects than to meaningless (but complex) control stimuli. pSTS/MTG showed an enhanced response when auditory and visual object features were presented together, relative to presentation in a single modality. Finally, pSTS/MTG responded more to object identification than to other components of the behavioral task. We suggest that pSTS/MTG is specialized for integrating different types of information both within modalities (e.g., visual form, visual motion) and across modalities (auditory and visual).     

Slow Feature Analysis on Retinal Waves Leads to V1 Complex Cells

The developing visual system of many mammalian species is partially structured and organized even before the onset of vision. Spontaneous neural activity, which spreads in waves across the retina, has been suggested to play a major role in these prenatal structuring processes. Recently, it has been shown that when employing an efficient coding strategy, such as sparse coding, these retinal activity patterns lead to basis functions that resemble optimal stimuli of simple cells in primary visual cortex (V1). Here we present the results of applying a coding strategy that optimizes for temporal slowness, namely Slow Feature Analysis (SFA), to a biologically plausible model of retinal waves. Previously, SFA has been successfully applied to model parts of the visual system, most notably in reproducing a rich set of complex-cell features by training SFA with quasi-natural image sequences. In the present work, we obtain SFA units that share a number of properties with cortical complex-cells by training on simulated retinal waves. The emergence of two distinct properties of the SFA units (phase invariance and orientation tuning) is thoroughly investigated via control experiments and mathematical analysis of the input-output functions found by SFA. The results support the idea that retinal waves share relevant temporal and spatial properties with natural visual input. Hence, retinal waves seem suitable training stimuli to learn invariances and thereby shape the developing early visual system such that it is best prepared for coding input from the natural world.     

A linear model for symmetric receptive fields: implications for classification tests with flashed and moving images

The purpose of this study was to explore the effects of spatial and temporal properties on the expected responses of visual neurons that have linear receptive fields (RFs), particularly those having a mirror symmetric distribution of spatial subregions. Receptive fields that are symmetric in at least one spatial dimension occur in neurons of the retina, the lateral geniculate nucleus (LGN), and the visual cortex of mammals. Responses to flashing bars, moving bars, and moving edges were studied for different configurations of an analog RF model in which spatial and temporal aspects were varied independently. Responses of the model at intermediate stimulus speeds were found to agree with responses in the literature for X and Y units of the LGN and often for simple units of the visual cortex. In particular, having separated regions of response to light and dark edges, an identifying property of simple cells, was found to be a linear consequence of RF regions responding inversely to stimuli of opposite polarity. Model differences from responses of cortical complex units show that a linear model cannot mimic their responses, and imply that complex units employ major nonlinearities in coding image polarity (light vs dark), which signifies a nonlinearity in coding intensity. Because sudden flux changes inherent in flashing bars test mainly temporal RF properties, and slowly moving edges test mainly spatial properties, these two tests form a useful minimal set with which to describe and classify RFs. The usefulness of this set derives both from its sensitivity to spatial and temporal variables, and from the correlation between the linearity of a cell's processing of stimulus intensity and its RF classification.     

Saccadic eye movements modulate visual responses in the lateral geniculate nucleus

We studied the effects of saccadic eye movements on visual signaling in the primate lateral geniculate nucleus (LGN), the earliest stage of central visual processing. Visual responses were probed with spatially uniform flickering stimuli, so that retinal processing was uninfluenced by eye movements. Nonetheless, saccades had diverse effects, altering not only response strength but also the temporal and chromatic properties of the receptive field. Of these changes, the most prominent was a biphasic modulation of response strength, weak suppression followed by strong enhancement. Saccadic modulation was widespread, and affected both of the major processing streams in the LGN. Our results demonstrate that during natural viewing, thalamic response properties can vary dramatically, even over the course of a single fixation.     

The Impact of Spatial Incongruence on an Auditory-Visual Illusion

Background

The sound-induced flash illusion is an auditory-visual illusion – when a single flash is presented along with two or more beeps, observers report seeing two or more flashes. Previous research has shown that the illusion gradually disappears as the temporal delay between auditory and visual stimuli increases, suggesting that the illusion is consistent with existing temporal rules of neural activation in the superior colliculus to multisensory stimuli. However little is known about the effect of spatial incongruence, and whether the illusion follows the corresponding spatial rule. If the illusion occurs less strongly when auditory and visual stimuli are separated, then integrative processes supporting the illusion must be strongly dependant on spatial congruence. In this case, the illusion would be consistent with both the spatial and temporal rules describing response properties of multisensory neurons in the superior colliculus.

Methodology/Principal Findings

The main aim of this study was to investigate the importance of spatial congruence in the flash-beep illusion. Selected combinations of one to four short flashes and zero to four short 3.5 KHz tones were presented. Observers were asked to count the number of flashes they saw. After replication of the basic illusion using centrally-presented stimuli, the auditory and visual components of the illusion stimuli were presented either both 10 degrees to the left or right of fixation (spatially congruent) or on opposite (spatially incongruent) sides, for a total separation of 20 degrees.

Conclusions/Significance

The sound-induced flash fission illusion was successfully replicated. However, when the sources of the auditory and visual stimuli were spatially separated, perception of the illusion was unaffected, suggesting that the “spatial rule” does not extend to describing behavioural responses in this illusion. We also find no evidence for an associated “fusion” illusion reportedly occurring when multiple flashes are accompanied by a single beep.     

See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex

Our understanding of multisensory integration has advanced because of recent functional neuroimaging studies of three areas in human lateral occipito-temporal cortex: superior temporal sulcus, area LO and area MT (V5). Superior temporal sulcus is activated strongly in response to meaningful auditory and visual stimuli, but responses to tactile stimuli have not been well studied. Area LO shows strong activation in response to both visual and tactile shape information, but not to auditory representations of objects. Area MT, an important region for processing visual motion, also shows weak activation in response to tactile motion, and a signal that drops below resting baseline in response to auditory motion. Within superior temporal sulcus, a patchy organization of regions is activated in response to auditory, visual and multisensory stimuli. This organization appears similar to that observed in polysensory areas in macaque superior temporal sulcus, suggesting that it is an anatomical substrate for multisensory integration. A patchy organization might also be a neural mechanism for integrating disparate representations within individual sensory modalities, such as representations of visual form and visual motion.     

Visual pattern discrimination by population retinal ganglion cells’ activities during natural movie stimulation

In the visual system, neurons often fire in synchrony, and it is believed that synchronous activities of group neurons are more efficient than single cell response in transmitting neural signals to down-stream neurons. However, whether dynamic natural stimuli are encoded by dynamic spatiotemporal firing patterns of synchronous group neurons still needs to be investigated. In this paper we recorded the activities of population ganglion cells in bullfrog retina in response to time-varying natural images (natural scene movie) using multi-electrode arrays. In response to some different brief section pairs of the movie, synchronous groups of retinal ganglion cells (RGCs) fired with similar but different spike events. We attempted to discriminate the movie sections based on temporal firing patterns of single cells and spatiotemporal firing patterns of the synchronous groups of RGCs characterized by a measurement of subsequence distribution discrepancy. The discrimination performance was assessed by a classification method based on Support Vector Machines. Our results show that different movie sections of the natural movie elicited reliable dynamic spatiotemporal activity patterns of the synchronous RGCs, which are more efficient in discriminating different movie sections than the temporal patterns of the single cells’ spike events. These results suggest that, during natural vision, the down-stream neurons may decode the visual information from the dynamic spatiotemporal patterns of the synchronous group of RGCs’ activities.     

High-pass filtering of input signals by the Ih current in a non-spiking neuron, the retinal rod bipolar cell

Hyperpolarization-activated cyclic nucleotide-sensitive (HCN) channels mediate the I(f) current in heart and I(h) throughout the nervous system. In spiking neurons I(h) participates primarily in different forms of rhythmic activity. Little is known, however, about its role in neurons operating with graded potentials as in the retina, where all four channel isoforms are expressed. Intriguing evidence for an involvement of I(h) in early visual processing are the side effects reported, in dim light or darkness, by cardiac patients treated with HCN inhibitors. Moreover, electroretinographic recordings indicate that these drugs affect temporal processing in the outer retina. Here we analyzed the functional role of HCN channels in rod bipolar cells (RBCs) of the mouse. Perforated-patch recordings in the dark-adapted slice found that RBCs exhibit I(h), and that this is sensitive to the specific blocker ZD7288. RBC input impedance, explored by sinusoidal frequency-modulated current stimuli (0.1-30 Hz), displays band-pass behavior in the range of I(h) activation. Theoretical modeling and pharmacological blockade demonstrate that high-pass filtering of input signals by I(h), in combination with low-pass filtering by passive properties, fully accounts for this frequency-tuning. Correcting for the depolarization introduced by shunting through the pipette-membrane seal, leads to predict that in darkness I(h) is tonically active in RBCs and quickens their responses to dim light stimuli. Immunohistochemistry targeting candidate subunit isoforms HCN1-2, in combination with markers of RBCs (PKC) and rod-RBC synaptic contacts (bassoon, mGluR6, Kv1.3), suggests that RBCs express HCN2 on the tip of their dendrites. The functional properties conferred by I(h) onto RBCs may contribute to shape the retina's light response and explain the visual side effects of HCN inhibitors.     

Membrane filtering properties of the bumblebee (Bombus terrestris) photoreceptors across three spectral classes

Filtering properties of the membrane form an integral part of the mechanisms producing the light-induced electrical signal in insect photoreceptors. Insect photoreceptors vary in response speed between different species, but recently it has also been shown that different spectral photoreceptor classes within a species possess diverse response characteristics. However, it has not been quantified what roles phototransduction and membrane properties play in such diversity. Here, we use electrophysiological methods in combination with system analysis to study whether the membrane properties could create the variation of the response speed found in the bumblebee (Bombus terrestris) photoreceptors. We recorded intracellular responses from each photoreceptor class to white noise-modulated current stimuli and defined their input resistance and linear filtering properties. We found that green sensitive cells exhibit smaller input resistance and membrane impedance than other cell classes. Since green sensitive cells are the fastest photoreceptor class in the bumblebee retina, our results suggest that the membrane filtering properties are correlated with the speed of light responses across the spectral classes. In general, our results provide a compelling example of filtering at the sensory cell level where the biophysical properties of the membrane are matched to the performance requirements set by visual ecology.     

Temporal mechanisms of multimodal binding

The simultaneity of signals from different senses—such as vision and audition—is a useful cue for determining whether those signals arose from one environmental source or from more than one. To understand better the sensory mechanisms for assessing simultaneity, we measured the discrimination thresholds for time intervals marked by auditory, visual or auditory–visual stimuli, as a function of the base interval. For all conditions, both unimodal and cross-modal, the thresholds followed a characteristic ‘dipper function’ in which the lowest thresholds occurred when discriminating against a non-zero interval. The base interval yielding the lowest threshold was roughly equal to the threshold for discriminating asynchronous from synchronous presentations. Those lowest thresholds occurred at approximately 5, 15 and 75 ms for auditory, visual and auditory–visual stimuli, respectively. Thus, the mechanisms mediating performance with cross-modal stimuli are considerably slower than the mechanisms mediating performance within a particular sense. We developed a simple model with temporal filters of different time constants and showed that the model produces discrimination functions similar to the ones we observed in humans. Both for processing within a single sense, and for processing across senses, temporal perception is affected by the properties of temporal filters, the outputs of which are used to estimate time offsets, correlations between signals, and more.     

Spatial and temporal properties of luminosity horizontal cells in the turtle retina

Luminosity horizontal cells in the turtle retina respond approximately linearly to visual stimuli with contrast levels spanning a large part of the physiological range. We characterized the response properties of these cells under conditions of low photopic background illumination by measuring their spatial and temporal frequency transfer functions. Our experimental results indicate in two ways that, under these conditions, feedback from luminosity horizontal cells to cones does not play a major role in the mechanisms underlying the spatial and temporal tuning of horizontal cell responses. First, the shape of the spatial transfer function depended only weakly on the temporal frequency with which it was measured. Second, the shape of the temporal transfer function depended only weakly on the spatial frequency with which it was measured.     

The relative importance of ultraviolet and longer wavelengths in the response properties of fly visual systems

A generalized analysis of the generator potential responses of R1-6 cells of Calliphora provides remarkable information on the visual properties for the Diptera. This shows that, although these cells have two peak response sensivities for monochromatic stimuli at 350 and 480 nm under single color stimulus conditions, and when the background illumination is either zero or in the region of 450–560 nm, the sensitivity to ultraviolet light is practically eliminated for background illumination in either the ultraviolet or the region around 600 nm or when any simultaneous dynamic stimulus in the region of 480–550 nm is also applied. These results seem somewhat perplexing to an understanding of the behavioral vision properties. It also is not consistant with the concept that the ultraviolet response is initiated by a sensitizing pigment within these cells that transfers energy to the rhodopsin-metarhodopsin process. However, it strengthens other evidence that the limited condition of ultraviolet responses comes from interaction from R7,8 cells but does not play an important behavioral role in the visual system fed from cells R1-6. As discussed in this paper, any high level pattern recognition controlling behavioral response to ultraviolet stimuli comes from the R7,8 cell system.