Representation of color stimuli in awake macaque primary visual cortex

We investigated the responses of single neurons in primary visual cortex (area V1) of awake monkeys to chromatic stimuli. Chromatic tuning properties, determined for homogeneous color patches presented on a neutral gray background, varied strongly between cells. The continuum of preferred chromaticities and tuning widths indicated a distributed representation of color signals in V1. When stimuli were presented on colored backgrounds, chromatic tuning was different in most neurons, and the changes in tuning were consistent with some degree of sensitivity of the neurons to the chromatic contrast between stimulus and background. Quantitatively, the average response changes matched the magnitudes of color induction effects measured in human subjects under corresponding stimulus conditions.     

Neuronal selectivity,population sparseness,and ergodicity in the inferior temporal visual cortex

The sparseness of the encoding of stimuli by single neurons and by populations of neurons is fundamental to understanding the efficiency and capacity of representations in the brain, and was addressed as follows. The selectivity and sparseness of firing to visual stimuli of single neurons in the primate inferior temporal visual cortex were measured to a set of 20 visual stimuli including objects and faces in macaques performing a visual fixation task. Neurons were analysed with significantly different responses to the stimuli. The firing rate distribution of 36% of the neurons was exponential. Twenty-nine percent of the neurons had too few low rates to be fitted by an exponential distribution, and were fitted by a gamma distribution. Interestingly, the raw firing rate distribution taken across all neurons fitted an exponential distribution very closely. The sparseness a ^s or selectivity of the representation of the set of 20 stimuli provided by each of these neurons (which takes a maximal value of 1.0) had an average across all neurons of 0.77, indicating a rather distributed representation. The sparseness of the representation of a given stimulus by the whole population of neurons, the population sparseness a ^p, also had an average value of 0.77. The similarity of the average single neuron selectivity a ^s and population sparseness for any one stimulus taken at any one time a ^p shows that the representation is weakly ergodic. For this to occur, the different neurons must have uncorrelated tuning profiles to the set of stimuli.     

Representation of response categories in visual cortex

It is known that single neurons in visual area V4 are selective for visual features and that their responses are modulated by selective attention. Surprisingly, a new study by Mirabella et al. in this issue of Neuron found that V4 neurons also signal the behavioral response category of the attended feature.     

Phase-of-firing coding of natural visual stimuli in primary visual cortex

We investigated the hypothesis that neurons encode rich naturalistic stimuli in terms of their spike times relative to the phase of ongoing network fluctuations rather than only in terms of their spike count. We recorded local field potentials (LFPs) and multiunit spikes from the primary visual cortex of anaesthetized macaques while binocularly presenting a color movie. We found that both the spike counts and the low-frequency LFP phase were reliably modulated by the movie and thus conveyed information about it. Moreover, movie periods eliciting higher firing rates also elicited a higher reliability of LFP phase across trials. To establish whether the LFP phase at which spikes were emitted conveyed visual information that could not be extracted by spike rates alone, we compared the Shannon information about the movie carried by spike counts to that carried by the phase of firing. We found that at low LFP frequencies, the phase of firing conveyed 54% additional information beyond that conveyed by spike counts. The extra information available in the phase of firing was crucial for the disambiguation between stimuli eliciting high spike rates of similar magnitude. Thus, phase coding may allow primary cortical neurons to represent several effective stimuli in an easily decodable format.     

Effects of long-term visual experience on responses of distinct classes of single units in inferior temporal cortex

As a precursor to the selection of a stimulus for gaze and attention, a midbrain network categorizes stimuli into "strongest" and "others." The categorization tracks flexibly, in real time, the absolute strength of the strongest stimulus. In this study, we take a first-principles approach to computations that are essential for such categorization. We demonstrate that classical feedforward lateral inhibition cannot produce flexible categorization. However, circuits in which the strength of lateral inhibition varies with the relative strength of competing stimuli categorize successfully. One particular implementation--reciprocal inhibition of feedforward lateral inhibition--is structurally the simplest, and it outperforms others in flexibly categorizing rapidly and reliably. Strong predictions of this anatomically supported circuit model are validated by neural responses measured in the owl midbrain. The results demonstrate the extraordinary power of a remarkably simple, neurally grounded circuit motif in producing flexible categorization, a computation fundamental to attention, perception, and decision making.     

Representation of three-dimensional visual space in the cerebral cortex

This article reviews two issues relevant to the topic of how three-dimensional space is represented in the cerebral cortex. The first is the question of how individual neurons encode information that might contribute to stereoscopic estimation of visual depth. Particular attention is given to the current understanding of the neural representation of motion through three-dimensional space and to the complexities that arise in interpreting neuronal responses to this complex stimulus parameter. The second issue considered is the disorderlines that exists in the retinotopic mapping of the visual field in some cortical visual areas. Several extrastriate areas have been found to contain maps of the contralateral visual hemifield that are disorderly in the sense that the representation of various parts of the visual field are often misplaced or grossly over-or under-represented. It is suggested that this disorderlines may in some cases represent adaptations to facilitate certain types of visual functions.     

Recognition of visual stimuli from multiple neuronal activity in monkey visual cortex

Response patterns recorded with 30 microelectrodes from area 17 of anaesthetized monkeys are analysed. A proportion of the patterns are used to define prototype response patterns. These in turn are used to recognize the stimulus from further non-averaged response patterns. In comparison, recognition by a feedforward neural network is much slower, and slightly inferior. The excitation time structure, with a resolution of about 20 ms, is found to contribute strongly to the recognition. There is some inter-ocular recognition for oriented moving bars, and for on and off phases of switched lights, but none for colours. Generalizations over some stimulus parameters (i.e. cases of confusion) are examined: If small jerking shapes are incorrectly recognized, in general the jerk direction often is the correct one. The onset of a response can most easily be found by determining the dissimilarity relative to spontaneous activity in a sliding window.     

Unit responses of the squirrel visual cortex to shaped visual stimuli

Visual cortical unit responses of the squirrelSciurus vulgaris to shaped visual stimuli (stationary and moving spots and bands) were studied. Neurons responding selectively to the direction of stimulus movement and orientation of lines and those not responding selectively to these features were distinguished. Many neurons, whether responding selectively or not to movement direction, were specifically sensitive to high speeds of movement, of the order of hundreds of degrees per second. This selectivity in neurons responding selectively to movement direction persisted at these high speeds, despite the short time taken by the stimulus to move across the receptive field. Neurons responding selectively to line orientation were sensitive to lower speeds of stimulus movement — from units to tens of degrees per second. Neuronal sensitivity to high speeds of stimulus movement is achieved through rapid summation of excitation from large areas of the receptive field crossed by the fast-moving stimulus. Selectivity of the response to movement direction is produced under these conditions with the aid of directed short-latency inhibition, inhibiting unit activity for stimulus movement in "zero" direction.     

Monitoring of selections of visual stimuli and the primate frontal cortex.

This investigation shows that lesions confined to the middle sector of the dorsolateral frontal cortex, i.e. cytoarchitectonic areas 46 and 9, cause a striking impairment in the ability of non-human primates to recall which one from a set of stimuli they chose, without in any way affecting their ability to recognize that they had previously seen those stimuli. By contrast, lesions placed within the adjacent posterior dorsolateral frontal cortex affect neither recognition of visual stimuli nor recall of prior choices. These findings delineate the mid-dorsolateral frontal cortex as a critical component of a neural system mediating the monitoring of self-generated responses.     

Tuning for cruciform stimuli in visual cortex neurons of cat

In the primary visual cortex of an immobilized awake cat, nearly one-third of the neurons studied (8 out of 22) were found to respond to flashing cruciform light stimuli 1.5–4 times better than to single stimulations with the strips of preferred orientation. It is suggested that such neurons can detect angles and line intersections.Neirofiziologiya/Neurophysiology, Vol. 25, No. 5, pp. 362–364, September–October, 1993.     

Responses of neurons in primary and inferior temporal visual cortices to natural scenes.

The primary visual cortex (V1) is the first cortical area to receive visual input, and inferior temporal (IT) areas are among the last along the ventral visual pathway. We recorded, in area V1 of anaesthetized cats and area IT of awake macaque monkeys, responses of neurons to videos of natural scenes. Responses were analysed to test various hypotheses concerning the nature of neural coding in these two regions. A variety of spike-train statistics were measured including spike-count distributions, interspike interval distributions, coefficients of variation, power spectra, Fano factors and different sparseness measures. All statistics showed non-Poisson characteristics and several revealed self-similarity of the spike trains. Spike-count distributions were approximately exponential in both visual areas for eight different videos and for counting windows ranging from 50 ms to 5 seconds. The results suggest that the neurons maximize their information carrying capacity while maintaining a fixed long-term-average firing rate, or equivalently, minimize their average firing rate for a fixed information carrying capacity.     

Short-term memory trace in rapidly adapting synapses of inferior temporal cortex

Visual short-term memory tasks depend upon both the inferior temporal cortex (ITC) and the prefrontal cortex (PFC). Activity in some neurons persists after the first (sample) stimulus is shown. This delay-period activity has been proposed as an important mechanism for working memory. In ITC neurons, intervening (nonmatching) stimuli wipe out the delay-period activity; hence, the role of ITC in memory must depend upon a different mechanism. Here, we look for a possible mechanism by contrasting memory effects in two architectonically different parts of ITC: area TE and the perirhinal cortex. We found that a large proportion (80%) of stimulus-selective neurons in area TE of macaque ITCs exhibit a memory effect during the stimulus interval. During a sequential delayed matching-to-sample task (DMS), the noise in the neuronal response to the test image was correlated with the noise in the neuronal response to the sample image. Neurons in perirhinal cortex did not show this correlation. These results led us to hypothesize that area TE contributes to short-term memory by acting as a matched filter. When the sample image appears, each TE neuron captures a static copy of its inputs by rapidly adjusting its synaptic weights to match the strength of their individual inputs. Input signals from subsequent images are multiplied by those synaptic weights, thereby computing a measure of the correlation between the past and present inputs. The total activity in area TE is sufficient to quantify the similarity between the two images. This matched filter theory provides an explanation of what is remembered, where the trace is stored, and how comparison is done across time, all without requiring delay period activity. Simulations of a matched filter model match the experimental results, suggesting that area TE neurons store a synaptic memory trace during short-term visual memory.     

Auditory modulation of the inferior temporal cortex neurons in rhesus monkey

We performed a systematic study to check whether neurons in the area TE (the anterior part of inferotemporal cortex) in rhesus monkey, regarded as the last stage of the ventral visual pathway, could be modulated by auditory stimuli. Two fixating rhesus monkeys were presented with visual, auditory or combined audiovisual stimuli while neuronal responses were recorded. We have found that the visually sensitive neurons are also modulated by audiovisual stimuli. This modulation is manifested as the change of response rate. Our results have shown also that the visual neurons were responsive to the sole auditory stimuli. Therefore, the concept of inferotemporal cortex unimodality in information processing should be re-evaluated.     

Active maintenance of associative mnemonic signal in monkey inferior temporal cortex

We investigated the contribution of the inferior temporal (IT) cortical neurons to the active maintenance of internal representations. The activity of single neurons in the IT cortex was recorded while the monkeys performed a sequential-type associative memory task in which distractor stimuli interrupted the delay epoch between the cue and target (paired-associate) stimuli. For each neuron, information about each stimulus conveyed by the delay activity was estimated as a coefficient of multiple regression analysis. We found that target information derived from long-term memory (LTM) persisted despite the distractors. By contrast, cue information derived from the visual system was attenuated and frequently replaced by distractor information. These results suggest that LTM-derived information required for upcoming behavior is actively maintained in the IT neurons, whereas visually derived information tends to be updated irrespective of behavioral relevance.     

The representation of erroneously perceived stimuli in the primary visual cortex

In order to attain a correct interpretation of an ambiguous visual stimulus, the brain may have to elaborate on the sensory evidence. Are the neurons that carry the sensory evidence also involved in generating an interpretation? To address this question, we studied the activity of neurons in the primary visual cortex of macaque monkeys involved in a task in which they have to trace a curve mentally, without moving their eyes. On a percentage of trials, the monkeys made errors and traced the wrong curve. Here, we show that these errors are predicted by activity in area V1. Thus, neurons in the primary visual cortex do not only represent sensory events, but also the way in which they are interpreted by the monkey.     

Processing of complex stimuli and natural scenes in the visual cortex

A major part of vision research builds on the assumption that processing of visual stimuli can be understood on the basis of knowledge about the processing of simplified, artificial stimuli. Recent experimental advances, however, show that a combination of responses to simplified stimuli does not adequately describe responses to natural visual scenes. The systems performance exceeds the performance predicted from understanding its basic constituents. This highlights the fact that the visual system is specifically adapted to the properties of its everyday input and can only fully be understood when probed with naturalistic stimuli.     

The temporal flexibility of attentional selection in the visual cortex

Visual attention operates by biasing competitive interactions between neural representations, favoring relevant over irrelevant visual inputs. Attention can enhance the processing of relevant information using location-based, feature-based or object-based selection mechanisms. Studies using event-related potential and event-related magnetic field recordings, together with functional magnetic resonance imaging, show that the temporal sequencing of these different selection mechanisms is flexible. Depending on the specific processing demands of the experimental task, location-based, feature-based or object-based selection might be given temporal priority on a time scale of tens of milliseconds.     

Timescales of multineuronal activity patterns reflect temporal structure of visual stimuli

The investigation of distributed coding across multiple neurons in the cortex remains to this date a challenge. Our current understanding of collective encoding of information and the relevant timescales is still limited. Most results are restricted to disparate timescales, focused on either very fast, e.g., spike-synchrony, or slow timescales, e.g., firing rate. Here, we investigated systematically multineuronal activity patterns evolving on different timescales, spanning the whole range from spike-synchrony to mean firing rate. Using multi-electrode recordings from cat visual cortex, we show that cortical responses can be described as trajectories in a high-dimensional pattern space. Patterns evolve on a continuum of coexisting timescales that strongly relate to the temporal properties of stimuli. Timescales consistent with the time constants of neuronal membranes and fast synaptic transmission (5-20 ms) play a particularly salient role in encoding a large amount of stimulus-related information. Thus, to faithfully encode the properties of visual stimuli the brain engages multiple neurons into activity patterns evolving on multiple timescales.