Feature-based attention in the frontal eye field and area V4 during visual search

When we search for a target in a crowded visual scene, we often use the distinguishing features of the target, such as color or shape, to guide our attention and eye movements. To investigate the neural mechanisms of feature-based attention, we simultaneously recorded neural responses in the frontal eye field (FEF) and area V4 while monkeys performed a visual search task. The responses of cells in both areas were modulated by feature attention, independent of spatial attention, and the magnitude of response enhancement was inversely correlated with the number of saccades needed to find the target. However, an analysis of the latency of sensory and attentional influences on responses suggested that V4 provides bottom-up sensory information about stimulus features, whereas the FEF provides a top-down attentional bias toward target features that modulates sensory processing in V4 and that could be used to guide the eyes to a searched-for target.     

Reverberation of recent visual experience in spontaneous cortical waves

Spontaneous waves of activity propagating across large cortical areas may play important roles in sensory processing and circuit refinement. However, whether these waves are in turn shaped by sensory experience remains unclear. Here we report that visually evoked cortical activity reverberates in subsequent spontaneous waves. Voltage-sensitive dye imaging in rat visual cortex shows that following repetitive presentation of a given visual stimulus, spatiotemporal activity patterns resembling the evoked response appear more frequently in the spontaneous waves. This effect is specific to the response pattern evoked by the repeated stimulus, and it persists for several minutes without further visual stimulation. Such wave-mediated reverberation could contribute to short-term memory and help to consolidate the transient effects of recent sensory experience into long-lasting cortical modifications.     

Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network

Even in the absence of sensory stimulation the brain is spontaneously active. This background “noise” seems to be the dominant cause of the notoriously high trial-to-trial variability of neural recordings. Recent experimental observations have extended our knowledge of trial-to-trial variability and spontaneous activity in several directions: 1. Trial-to-trial variability systematically decreases following the onset of a sensory stimulus or the start of a motor act. 2. Spontaneous activity states in sensory cortex outline the region of evoked sensory responses. 3. Across development, spontaneous activity aligns itself with typical evoked activity patterns. 4. The spontaneous brain activity prior to the presentation of an ambiguous stimulus predicts how the stimulus will be interpreted. At present it is unclear how these observations relate to each other and how they arise in cortical circuits. Here we demonstrate that all of these phenomena can be accounted for by a deterministic self-organizing recurrent neural network model (SORN), which learns a predictive model of its sensory environment. The SORN comprises recurrently coupled populations of excitatory and inhibitory threshold units and learns via a combination of spike-timing dependent plasticity (STDP) and homeostatic plasticity mechanisms. Similar to balanced network architectures, units in the network show irregular activity and variable responses to inputs. Additionally, however, the SORN exhibits sequence learning abilities matching recent findings from visual cortex and the network’s spontaneous activity reproduces the experimental findings mentioned above. Intriguingly, the network’s behaviour is reminiscent of sampling-based probabilistic inference, suggesting that correlates of sampling-based inference can develop from the interaction of STDP and homeostasis in deterministic networks. We conclude that key observations on spontaneous brain activity and the variability of neural responses can be accounted for by a simple deterministic recurrent neural network which learns a predictive model of its sensory environment via a combination of generic neural plasticity mechanisms.     

Sensory and behavioral properties of neurons in posterior parietal cortex of the awake, trained monkey.

Neurons in posterior parietal cortex of the awake, trained monkey respond to passive visual and/or somatosensory stimuli. In general, the receptive fields of these cells are large and nonspecific. When these neurons are studied during visually guided hand movements and eye movements, most of their activity can be accounted for by passive sensory stimulation. However, for some visual cells, the response to a stimulus is enhanced when it is to be the target for a saccadic eye movement. This enhancement is selective for eye movements into the visual receptive field since it does not occur with eye movements to other parts of the visual field. Cells that discharge in association with a visual fixation task have foveal receptive fields and respond to the spots of light used as fixation targets. Cells discharging selectively in association with different directions of tracking eye movements have directionally selective responses to moving visual stimuli. Every cell in our sample discharging in association with movement could be driven by passive sensory stimuli. We conclude that the activity of neurons in posterior parietal cortex is dependent on and indicative of external stimuli but not predictive of movement.     

Eye and head movements to visual and auditory targets

Coordinated eye-head movements evoked by the presentation of visual, auditory and combined audio-visual targets were studied in 24 human subjects. At 60 deg located targets latencies of eye and head movements were shorter for auditory than for visual stimuli. Latencies were shorter for bisensory than for monosensory targets. The eye and head latencies were differently influenced by the modality of the stimulus when the eccentricity of the target was changed, but not by the variation of the stimulus duration. The different responses of the eye and the head depending on target modality and target eccentricity can be partially attributed to perceptual and central processing mechanisms, and are important to answer the question about the initial event in coordinated eye-head orientation.     

Reward-dependent gain and bias of visual responses in primate superior colliculus

Eye movements are often influenced by expectation of reward. Using a memory-guided saccade task with an asymmetric reward schedule, we show that visual responses of monkey SC neurons increase when the visual stimulus indicates an upcoming reward. The increase occurred in two distinct manners: (1) reactively, as an increase in the gain of the visual response when the stimulus indicated an upcoming reward; (2) proactively, as an increase in anticipatory activity when reward was expected in the neuron's response field. These effects were observed mostly in saccade-related SC neurons in the deeper layer which would receive inputs from the cortical eye fields and the basal ganglia. These results, together with recent findings, suggest that the gain modulation may be determined by the inputs from both the cortical eye fields and the basal ganglia, whereas the anticipatory bias may be derived mainly from the basal ganglia.     

Remapping for visual stability

Visual perception is based on both incoming sensory signals and information about ongoing actions. Recordings from single neurons have shown that corollary discharge signals can influence visual representations in parietal, frontal and extrastriate visual cortex, as well as the superior colliculus (SC). In each of these areas, visual representations are remapped in conjunction with eye movements. Remapping provides a mechanism for creating a stable, eye-centred map of salient locations. Temporal and spatial aspects of remapping are highly variable from cell to cell and area to area. Most neurons in the lateral intraparietal area remap stimulus traces, as do many neurons in closely allied areas such as the frontal eye fields the SC and extrastriate area V3A. Remapping is not purely a cortical phenomenon. Stimulus traces are remapped from one hemifield to the other even when direct cortico-cortical connections are removed. The neural circuitry that produces remapping is distinguished by significant plasticity, suggesting that updating of salient stimuli is fundamental for spatial stability and visuospatial behaviour. These findings provide new evidence that a unified and stable representation of visual space is constructed by redundant circuitry, comprising cortical and subcortical pathways, with a remarkable capacity for reorganization.     

Auditory Evoked Bursts in Mouse Visual Cortex during Isoflurane Anesthesia

General anesthesia is not a uniform state of the brain. Ongoing activity differs between light and deep anesthesia and cortical response properties are modulated in dependence of anesthetic dosage. We investigated how anesthesia level affects cross-modal interactions in primary sensory cortex. To examine this, we continuously measured the effects of visual and auditory stimulation during increasing and decreasing isoflurane level in the mouse visual cortex and the subiculum (from baseline at 0.7 to 2.5 vol % and reverse). Auditory evoked burst activity occurred in visual cortex after a transition during increase of anesthesia level. At the same time, auditory and visual evoked bursts occurred in the subiculum, even though the subiculum was unresponsive to both stimuli previous to the transition. This altered sensory excitability was linked to the presence of burst suppression activity in cortex, and to a regular slow burst suppression rhythm (∼0.2 Hz) in the subiculum. The effect disappeared during return to light anesthesia. The results show that pseudo-heteromodal sensory burst responses can appear in brain structures as an effect of an anesthesia induced state change.     

Auditory Stimuli Mimicking Ambient Sounds Drive Temporal “Delta-Brushes” in Premature Infants

In the premature infant, somatosensory and visual stimuli trigger an immature electroencephalographic (EEG) pattern, “delta-brushes,” in the corresponding sensory cortical areas. Whether auditory stimuli evoke delta-brushes in the premature auditory cortex has not been reported. Here, responses to auditory stimuli were studied in 46 premature infants without neurologic risk aged 31 to 38 postmenstrual weeks (PMW) during routine EEG recording. Stimuli consisted of either low-volume technogenic “clicks” near the background noise level of the neonatal care unit, or a human voice at conversational sound level. Stimuli were administrated pseudo-randomly during quiet and active sleep. In another protocol, the cortical response to a composite stimulus (“click” and voice) was manually triggered during EEG hypoactive periods of quiet sleep. Cortical responses were analyzed by event detection, power frequency analysis and stimulus locked averaging. Before 34 PMW, both voice and “click” stimuli evoked cortical responses with similar frequency-power topographic characteristics, namely a temporal negative slow-wave and rapid oscillations similar to spontaneous delta-brushes. Responses to composite stimuli also showed a maximal frequency-power increase in temporal areas before 35 PMW. From 34 PMW the topography of responses in quiet sleep was different for “click” and voice stimuli: responses to “clicks” became diffuse but responses to voice remained limited to temporal areas. After the age of 35 PMW auditory evoked delta-brushes progressively disappeared and were replaced by a low amplitude response in the same location. Our data show that auditory stimuli mimicking ambient sounds efficiently evoke delta-brushes in temporal areas in the premature infant before 35 PMW. Along with findings in other sensory modalities (visual and somatosensory), these findings suggest that sensory driven delta-brushes represent a ubiquitous feature of the human sensory cortex during fetal stages and provide a potential test of functional cortical maturation during fetal development.     

The modulation of somatosensory evoked potentials during the foreperiod of a forewarned reaction time task

During the foreperiod of a forewarned reaction time (RT) task reflexes in the executing limb increase to a lesser extent than those in the contralateral limb. This is possibly due to input modulation. The present study investigates the possibility of cutaneous sensory modulation during motor preparation by studying the amplitudes of somatosensory evoked potentials (SEPs). Eighteen subjects performed a forewarned RT task with the same fingers as the ones which were electrically stimulated. SEPs evoked during the 4 sec preparatory period were compared to those evoked during movement execution and during the resting period after the motor response respectively. During response execution most SEP components showed smaller amplitudes, i.e., they were gated, which agrees with other studies. In the first part of the foreperiod no SEP modulation was observed. Towards the end of the foreperiod, 500 msec before the response stimulus (RS), the amplitude of the contralateral parietal N70-P100 was significantly decreased, while the P45-N70 showed a similar tendency. However, at the same time the P100-N140 was increased in amplitude. The decrease of the intermediate latency components towards the end of the foreperiod is discussed in terms of gating, while the increase in the long latency component is discussed with respect to a decrease in RT on trials where the fingers were stimulated just before the RS, pointing to the role of attentional mechanisms.     

Attentional enhancement via selection and pooling of early sensory responses in human visual cortex

The computational processes by which attention improves behavioral performance were characterized by measuring visual cortical activity with functional magnetic resonance imaging as humans performed a contrast-discrimination task with focal and distributed attention. Focal attention yielded robust improvements in behavioral performance accompanied by increases in cortical responses. Quantitative analysis revealed that if performance were limited only by the sensitivity of the measured sensory signals, the improvements in behavioral performance would have corresponded to an unrealistically large reduction in response variability. Instead, behavioral performance was well characterized by a pooling and selection process for which the largest sensory responses, those most strongly modulated by attention, dominated the perceptual decision. This characterization predicts that high-contrast distracters that evoke large responses should negatively impact behavioral performance. We tested and confirmed this prediction. We conclude that attention enhanced behavioral performance predominantly by enabling efficient selection of the behaviorally relevant sensory signals.     

Different neuroplasticity for task targets and distractors

Adult learning-induced sensory cortex plasticity results in enhanced action potential rates in neurons that have the most relevant information for the task, or those that respond strongly to one sensory stimulus but weakly to its comparison stimulus. Current theories suggest this plasticity is caused when target stimulus evoked activity is enhanced by reward signals from neuromodulatory nuclei. Prior work has found evidence suggestive of nonselective enhancement of neural responses, and suppression of responses to task distractors, but the differences in these effects between detection and discrimination have not been directly tested. Using cortical implants, we defined physiological responses in macaque somatosensory cortex during serial, matched, detection and discrimination tasks. Nonselective increases in neural responsiveness were observed during detection learning. Suppression of responses to task distractors was observed during discrimination learning, and this suppression was specific to cortical locations that sampled responses to the task distractor before learning. Changes in receptive field size were measured as the area of skin that had a significant response to a constant magnitude stimulus, and these areal changes paralleled changes in responsiveness. From before detection learning until after discrimination learning, the enduring changes were selective suppression of cortical locations responsive to task distractors, and nonselective enhancement of responsiveness at cortical locations selective for target and control skin sites. A comparison of observations in prior studies with the observed plasticity effects suggests that the non-selective response enhancement and selective suppression suffice to explain known plasticity phenomena in simple spatial tasks. This work suggests that differential responsiveness to task targets and distractors in primary sensory cortex for a simple spatial detection and discrimination task arise from nonselective increases in response over a broad cortical locus that includes the representation of the task target, and selective suppression of responses to the task distractor within this locus.     

Motion detection in the presence and absence of background motion in anAnolis lizard

Anolis lizards respond to a moving object viewed in the periphery of their visual field by turning their eye to fixate the object with their central fovea. This paper describes the relative effectiveness of different patterns of motion of a small black lure in eliciting these eye movements and the way motion of a backdrop of vegetation affects the response. The stimulus was positioned 45 degrees from the animal's line of gaze and oscillated in the vertical axis at different frequencies between 0.5 and 10 Hz. At each frequency, the amplitude of the oscillation was increased until the lizard flicked its eye towards the stimulus. The minimum amplitude needed for response (0.22 degrees of visual angle) was independent of frequency and waveform. The probability of any response occurring was, however, lower at higher frequencies (7 and 10 Hz) and a 1.5 Hz square wave evoked the greatest proportion of responses. Sinusoidal oscillation of a background of vegetation at 1.6 Hz during or before motion of the stimulus lure reduced the probability of an eye flick but did not raise the minimum amplitude needed for a response. The suppressive effect was greatest when the lure was oscillated at frequencies close to that of the background. It is concluded that Anolis, which rely upon motion to detect objects in the periphery of the visual field, filter out irrelevant motion such as that of windblown vegetation by responding preferentially to particular patterns of motion and short term habituation to commonly present patterns of motion.     

A new visual area on the inferior wall of the cat cruciate sulcus

Properties of 187 neurons in the inferior wall of the cruciate sulcus, in an area where electrical stimulation evoked unidirectional saccadic eye movements, were investigated in waking cats. Of the total number 172 responded to visual stimulation. Neurons in the surface layers of the cortex responded to simple visual stimuli: light or dark spots or bars, both stationary and moving at speeds of around 30 deg/sec. These neurons showed no selectivity as regards stimulus orientation but sometimes behaved selectively toward the direction of their movements. In the intermediate layers the maximal neuronal response was obtained to a model of a bird flaping its wings. Neuronal responses in the depth of the cortex were characterized by selectivity to movement of stimuli toward or away from the animal in a certain part of the visual field, irrespective of whether a light stimulus was presented against a dark background or a dark stimulus against the light background. Responses to visual stimulation were exhibited only if the animal was in a state of activation, when the EEG showed desynchronization, and they were absent in a state of quite wakefulness. No responses were obtained to auditory or somatic stimulation. Responses to visual stimulation were not found in neurons of the medial wall of the brain beneath the cruciate sulcus, but responses were recorded to eye movements of definite size or orientation. It is postulated that at least two contiguous retinotopically organized zones exist in this part of the brain. Activity of one of them is connected with visual function, that of the other with eye movements.Institute for Problems in Information Transmission, Academy of Sciences of the USSR, Moscow. Translated from Neirofiziologiya, Vol. 16, No. 6, pp. 766–773, November–December, 1984.     

Neuronal assemblies: single cortical neurons are obedient members of a huge orchestra

Spontaneous cortical activity of single neurons is often either dismissed as noise, or is regarded as carrying no functional significance and hence is ignored. Our findings suggest that such concepts should be revised. We explored the coherent population activity of neuronal assemblies in primary sensory area in the absence of a sensory input. Recent advances in real-time optical imaging based on voltage-sensitive dyes (VSDI) have facilitated exploration of population activity and its intimate relationship to the activity of individual cortical neurons. It has been shown by in vivo intracellular recordings that the dye signal measures the sum of the membrane potential changes in all the neuronal elements in the imaged area, emphasizing subthreshold synaptic potentials and dendritic action potentials in neuronal arborizations originating from neurons in all cortical layers whose dendrites reach the superficial cortical layers. Thus, the VSDI has allowed us to image the rather illusive activity in neuronal dendrites that cannot be readily explored by single unit recordings. Surprisingly, we found that the amplitude of this type of ongoing subthreshold activity is of the same order of magnitude as evoked activity. We also found that this ongoing activity exhibited high synchronization over many millimeters of cortex. We then investigated the influence of ongoing activity on the evoked response, and showed that the two interact strongly. Furthermore, we found that cortical states that were previously associated only with evoked activity can actually be observed also in the absence of stimulation, for example, the cortical representation of a given orientation may appear without any visual input. This demonstration suggests that ongoing activity may also play a major role in other cortical function by providing a neuronal substrate for the dependence of sensory information processing on context, behavior, memory and other aspects of cognitive function.     

Ensemble cortical responses to rival visual stimuli: Effect of monocular transient

Binocular rivalry is a fascinating perceptual phenomenon that has been characterized extensively at the psychophysical level. However, the underlying neural mechanism remains poorly understood. In particular, the role of the early visual pathway remains controversial. In this study, we used voltage-sensitive dye imaging to measure the spatiotemporal activity patterns in cat area 18 evoked by dichoptic orthogonal grating stimuli. We found that after several seconds of monocular stimulation with an oriented grating, an orthogonal stimulus to the other eye evoked a reversal of the cortical response pattern, which may contribute to flash suppression in perception. Furthermore, after several seconds of rival binocular stimulation with unequal contrasts, transient increase in the contrast of the weak stimulus evoked a long-lasting cortical response. This transient-triggered response could contribute to the perceptual switch during binocular rivalry. Together, these results point to a significant contribution of early visual cortex to transient-triggered switch in perceptual dominance.     

Response dynamics of bullfrog ON-OFF RGCs to different stimulus durations

Stimulus duration is an important feature of visual stimulation. In the present study, response properties of bullfrog ON-OFF retinal ganglion cells (RGCs) in exposure to different visual stimulus durations were studied. By using a multi-electrode recording system, spike discharges from ON-OFF RGCs were simultaneously recorded, and the cells’ ON and OFF responses were analyzed. It was found that the ON response characteristics, including response latency, spike count, as well as correlated activity and relative latency between pair-wise cells, were modulated by different light OFF intervals, while the OFF response characteristics were modulated by different light ON durations. Stimulus information carried by the ON and OFF responses was then analyzed, and it was found that information about different light ON durations was more carried by transient OFF response, whereas information about different light OFF intervals were more carried by transient ON response. Meanwhile, more than 80 % information about stimulus durations was carried by firing rate. These results suggest that ON-OFF RGCs are sensitive to different stimulus durations, and they can efficiently encode the information about visual stimulus duration by firing rate.     

The local and non-local components of the local field potential in awake primate visual cortex

The Local Field Potential (LFP) is the analog signal recorded from a microelectrode inserted into cortex, typically in the frequency band of approximately 1 to 200 Hz. Here visual stimuli were flashed on in the receptive fields of primary visual cortical neurons in awake behaving macaques, and both isolated single units (neurons) and the LFP signal were recorded from the same unipolar microelectrode. The fall-off of single unit activity as a visual stimulus was moved from near the center to near the edge of the receptive field paralleled the fall-off of the stimulus-locked (evoked) LFP response. This suggests that the evoked LFP strongly reflects local neuronal activity. However, the evoked LFP could be significant even when the visual stimulus was completely outside the receptive field and the single unit response had fallen to zero, although this phenomenon was variable. Some of the non-local components of the LFP may be related to the slow distributed, or non-retinotopic, LFP signal previously observed in anesthetized animals. The induced (not time-locked to stimulus onset) component of the LFP showed significant increases only for stimuli within the receptive field of the single units. While the LFP primarily reflects local neuronal activity, it can also reflect neuronal activity at more distant sites, although these non-local components are typically more variable, slower, and weaker than the local components.     

Recovering the contents of consciousness in the noise of neuroimaging

A classical approach in the neurosciences is to study neural activity modulations induced by a stimulus, a task, etc. This approach is anchored in a behaviourist culture and has proven informative within certain limits. The present paper shows that this approach nonetheless neglects aspects of neural activity that can also contribute important information about brain function. Over the last years, the contributions with the strongest impact on progress in cognitive neuroscience have used other approaches that exploit a spatial or temporal variability of neural activity that standard analyses consider as noise and hence do not take into account. By applying multi-variate analyses, spatial variability of evoked responses has permitted decoding sensory and cognitive representations in the brain. Temporal variability of ongoing neural activity influences how stimuli are perceived trial by trial as well as the associated evoked responses which points out the importance of spontaneous brain activity for cognition. We describe these two kind of approaches based on experiments using functional neuroimaging but the conclusions generalize to other techniques applied in the neurosciences.     

Low response variability in simultaneously recorded retinal, thalamic, and cortical neurons

The response of a cortical cell to a repeated stimulus can be highly variable from one trial to the next. Much lower variability has been reported of retinal cells. We recorded visual responses simultaneously from three successive stages of the cat visual system: retinal ganglion cells (RGCs), thalamic (LGN) relay cells, and simple cells in layer 4 of primary visual cortex. Spike count variability was lower than that of a Poisson process at all three stages but increased at each stage. Absolute and relative refractory periods largely accounted for the reliability at all three stages. Our results show that cortical responses can be more reliable than previously thought. The differences in reliability in retina, LGN, and cortex can be explained by (1) decreasing firing rates and (2) decreasing absolute and relative refractory periods.