Temporal Sequence of Visuo-Auditory Interaction in Multiple Areas of the Guinea Pig Visual Cortex

Recent studies in humans and monkeys have reported that acoustic stimulation influences visual responses in the primary visual cortex (V1). Such influences can be generated in V1, either by direct auditory projections or by feedback projections from extrastriate cortices. To test these hypotheses, cortical activities were recorded using optical imaging at a high spatiotemporal resolution from multiple areas of the guinea pig visual cortex, to visual and/or acoustic stimulations. Visuo-auditory interactions were evaluated according to differences between responses evoked by combined auditory and visual stimulation, and the sum of responses evoked by separate visual and auditory stimulations. Simultaneous presentation of visual and acoustic stimulations resulted in significant interactions in V1, which occurred earlier than in other visual areas. When acoustic stimulation preceded visual stimulation, significant visuo-auditory interactions were detected only in V1. These results suggest that V1 is a cortical origin of visuo-auditory interaction.     

Mapping the organization of axis of motion selective features in human area MT using high-field fMRI

Functional magnetic resonance imaging (fMRI) at high magnetic fields has made it possible to investigate the columnar organization of the human brain in vivo with high degrees of accuracy and sensitivity. Until now, these results have been limited to the organization principles of early visual cortex (V1). While the middle temporal area (MT) has been the first identified extra-striate visual area shown to exhibit a columnar organization in monkeys, evidence of MT's columnar response properties and topographic layout in humans has remained elusive. Research using various approaches suggests similar response properties as in monkeys but failed to provide direct evidence for direction or axis of motion selectivity in human area MT. By combining state of the art pulse sequence design, high spatial resolution in all three dimensions (0.8 mm isotropic), optimized coil design, ultrahigh field magnets (7 Tesla) and novel high resolution cortical grid sampling analysis tools, we provide the first direct evidence for large-scale axis of motion selective feature organization in human area MT closely matching predictions from topographic columnar-level simulations.     

Nonmonotonic noise tuning of BOLD fMRI signal to natural images in the visual cortex of the anesthetized monkey

BACKGROUND: The perceptual ability of humans and monkeys to identify objects in the presence of noise varies systematically and monotonically as a function of how much noise is introduced to the visual display. That is, it becomes more and more difficult to identify an object with increasing noise. Here we examine whether the blood oxygen level-dependent functional magnetic resonance imaging (BOLD fMRI) signal in anesthetized monkeys also shows such monotonic tuning. We employed parametric stimulus sets containing natural images and noise patterns matched for spatial frequency and intensity as well as intermediate images generated by interpolation between natural images and noise patterns. Anesthetized monkeys provide us with the unique opportunity to examine visual processing largely in the absence of top-down cognitive modulations and can thus provide an important baseline against which work with awake monkeys and humans can be compared. RESULTS: We measured BOLD activity in occipital visual cortical areas as natural images and noise patterns, as well as intermediate interpolated patterns at three interpolation levels (25%, 50%, and 75%) were presented to anesthetized monkeys in a block paradigm. We observed reliable visual activity in occipital visual areas including V1, V2, V3, V3A, and V4 as well as the fundus and anterior bank of the superior temporal sulcus (STS). Natural images consistently elicited higher BOLD levels than noise patterns. For intermediate images, however, we did not observe monotonic tuning. Instead, we observed a characteristic V-shaped noise-tuning function in primary and extrastriate visual areas. BOLD signals initially decreased as noise was added to the stimulus but then increased again as the pure noise pattern was approached. We present a simple model based on the number of activated neurons and the strength of activation per neuron that can account for these results. CONCLUSIONS: We show that, for our parametric stimulus set, BOLD activity varied nonmonotonically as a function of how much noise was added to the visual stimuli, unlike the perceptual ability of humans and monkeys to identify such stimuli. This raises important caveats for interpreting fMRI data and demonstrates the importance of assessing not only which neural populations are activated by contrasting conditions during an fMRI study, but also the strength of this activation. This becomes particularly important when using the BOLD signal to make inferences about the relationship between neural activity and behavior.     

Evidence for a modified V3 with dorsal and ventral halves in macaque monkeys

Through more than 30 years of research, the nature of the third visual area, V3, and even its existence have been in question. Here, we used injections of up to five distinguishable tracers into both dorsal and ventral portions of V1 of macaque monkeys (representing the lower and upper visual quadrant, respectively) to provide compelling evidence for a V3 that is smaller than V2. This V3 includes both dorsal and ventral halves mirroring dorsal and ventral V2 in retinotopic organization. Of the approximately ten areas with V1 connections, V3 appears to account for about 20%.     

The representation of erroneously perceived stimuli in the primary visual cortex

In order to attain a correct interpretation of an ambiguous visual stimulus, the brain may have to elaborate on the sensory evidence. Are the neurons that carry the sensory evidence also involved in generating an interpretation? To address this question, we studied the activity of neurons in the primary visual cortex of macaque monkeys involved in a task in which they have to trace a curve mentally, without moving their eyes. On a percentage of trials, the monkeys made errors and traced the wrong curve. Here, we show that these errors are predicted by activity in area V1. Thus, neurons in the primary visual cortex do not only represent sensory events, but also the way in which they are interpreted by the monkey.     

Different processing phases for features, figures, and selective attention in the primary visual cortex

Our visual system imposes structure onto images that usually contain a diversity of surfaces, contours, and colors. Psychological theories propose that there are multiple steps in this process that occur in hierarchically organized regions of the cortex: early visual areas register basic features, higher areas bind them into objects, and yet higher areas select the objects that are relevant for behavior. Here we test these theories by recording from the primary visual cortex (area V1) of monkeys. We demonstrate that the V1 neurons first register the features (at a latency of 48 ms), then segregate figures from the background (after 57 ms), and finally select relevant figures over irrelevant ones (after 137 ms). We conclude that the psychological processing stages map onto distinct time episodes that unfold in the visual cortex after the presentation of a new stimulus, so that area V1 may contribute to all these processing steps.     

The role of the posterior parietal cortex in coordinate transformations for visual-motor integration

Lesion to the posterior parietal cortex in monkeys and humans produces spatial deficits in movement and perception. In recording experiments from area 7a, a cortical subdivision in the posterior parietal cortex in monkeys, we have found neurons whose responses are a function of both the retinal location of visual stimuli and the position of the eyes in the orbits. By combining these signals area 7 a neurons code the location of visual stimuli with respect to the head. However, these cells respond over only limited ranges of eye positions (eye-position-dependent coding). To code location in craniotopic space at all eye positions (eye-position-independent coding) an additional step in neural processing is required that uses information distributed across populations of area 7a neurons. We describe here a neural network model, based on back-propagation learning, that both demonstrates how spatial location could be derived from the population response of area 7a neurons and accurately accounts for the observed response properties of these neurons.     

Binocular Flash Suppression in the Primary Visual Cortex of Anesthetized and Awake Macaques

Primary visual cortex (V1) was implicated as an important candidate for the site of perceptual suppression in numerous psychophysical and imaging studies. However, neurophysiological results in awake monkeys provided evidence for competition mainly between neurons in areas beyond V1. In particular, only a moderate percentage of neurons in V1 were found to modulate in parallel with perception with magnitude substantially smaller than the physical preference of these neurons. It is yet unclear whether these small modulations are rooted from local circuits in V1 or influenced by higher cognitive states. To address this question we recorded multi-unit spiking activity and local field potentials in area V1 of awake and anesthetized macaque monkeys during the paradigm of binocular flash suppression. We found that a small but significant modulation was present in both the anesthetized and awake states during the flash suppression presentation. Furthermore, the relative amplitudes of the perceptual modulations were not significantly different in the two states. We suggest that these early effects of perceptual suppression might occur locally in V1, in prior processing stages or within early visual cortical areas in the absence of top-down feedback from higher cognitive stages that are suppressed under anesthesia.     

Responses of neurons in primary and inferior temporal visual cortices to natural scenes.

The primary visual cortex (V1) is the first cortical area to receive visual input, and inferior temporal (IT) areas are among the last along the ventral visual pathway. We recorded, in area V1 of anaesthetized cats and area IT of awake macaque monkeys, responses of neurons to videos of natural scenes. Responses were analysed to test various hypotheses concerning the nature of neural coding in these two regions. A variety of spike-train statistics were measured including spike-count distributions, interspike interval distributions, coefficients of variation, power spectra, Fano factors and different sparseness measures. All statistics showed non-Poisson characteristics and several revealed self-similarity of the spike trains. Spike-count distributions were approximately exponential in both visual areas for eight different videos and for counting windows ranging from 50 ms to 5 seconds. The results suggest that the neurons maximize their information carrying capacity while maintaining a fixed long-term-average firing rate, or equivalently, minimize their average firing rate for a fixed information carrying capacity.     

The "parahippocampal place area" responds preferentially to high spatial frequencies in humans and monkeys

Defining the exact mechanisms by which the brain processes visual objects and scenes remains an unresolved challenge. Valuable clues to this process have emerged from the demonstration that clusters of neurons ("modules") in inferior temporal cortex apparently respond selectively to specific categories of visual stimuli, such as places/scenes. However, the higher-order "category-selective" response could also reflect specific lower-level spatial factors. Here we tested this idea in multiple functional MRI experiments, in humans and macaque monkeys, by systematically manipulating the spatial content of geometrical shapes and natural images. These tests revealed that visual spatial discontinuities (as reflected by an increased response to high spatial frequencies) selectively activate a well-known place-selective region of visual cortex (the "parahippocampal place area") in humans. In macaques, we demonstrate a homologous cortical area, and show that it also responds selectively to higher spatial frequencies. The parahippocampal place area may use such information for detecting object borders and scene details during spatial perception and navigation.     

Discrimination strategies of humans and rhesus monkeys for complex visual displays

By learning to discriminate among visual stimuli, human observers can become experts at specific visual tasks. The same is true for Rhesus monkeys, the major animal model of human visual perception. Here, we systematically compare how humans and monkeys solve a simple visual task. We trained humans and monkeys to discriminate between the members of small natural-image sets. We employed the "Bubbles" procedure to determine the stimulus features used by the observers. On average, monkeys used image features drawn from a diagnostic region covering about 7% +/- 2% of the images. Humans were able to use image features drawn from a much larger diagnostic region covering on average 51% +/- 4% of the images. Similarly for the two species, however, about 2% of the image needed to be visible within the diagnostic region on any individual trial for correct performance. We characterize the low-level image properties of the diagnostic regions and discuss individual differences among the monkeys. Our results reveal that monkeys base their behavior on confined image patches and essentially ignore a large fraction of the visual input, whereas humans are able to gather visual information with greater flexibility from large image regions.     

A neurally plausible model of the dynamics of motion integration in smooth eye pursuit based on recursive Bayesian estimation

In this study, we describe a model of motion integration in smooth eye pursuit based on a recursive Bayesian estimation process, which displays a dynamic behaviour qualitatively similar to the dynamics of the motion integration process observed experimentally, both psychophysically in humans and monkeys, and physiologically in monkeys. By formulating the model as an approximate version of a Kalman filter algorithm, we have been able to show that it can be put into a neurally plausible, distributed recurrent form which coarsely corresponds to the recurrent circuitry of visual cortical areas V1 and MT. The model thus provides further support for the notion that the motion integration process is based on a form of Bayesian estimation, as has been suggested by many psychophysical studies, and moreover suggests that the observed dynamic properties of this process are the result of the recursive nature of the motion estimation.     

A map for horizontal disparity in monkey V2

The perception of visual depth is determined by integration of spatial disparities of inputs from the two eyes. Single cells in visual cortex of monkeys are known to respond to specific binocular disparities; however, little is known about their functional organization. We now show, using intrinsic signal optical imaging and single-unit physiology, that, in the thick stripe compartments of the second visual area (V2), there is a clustered organization of Near cells and Far cells, and moreover, there are topographic maps for Near to Far disparities within V2. Our findings suggest that maps for visual disparity are calculated in V2, and demonstrate parallels in functional organization between the thin, pale, and thick stripes of V2.     

Light-induced down-regulation of the rat class 1 dynein-associated protein robl/LC7-like gene in visual cortex

Dynein and kinesin are the main microtubule-dependent motors that mediate intracellular movement in eukaryotic organisms. We have cloned a full-length cDNA encoding rat dynein light chain protein, robl/LC7-like (class 1), from visual cortex. We found that rat robl/LC7-like gene is highly expressed in neocortex and displays the unusual feature of being rapidly down-regulated by sensory stimulation. This effect was seen at both mRNA and protein levels in visual cortex, being detectable in as little as 45 min after the onset of visual stimulation. Down-regulation by sensory stimulation was also found within ocular dominance columns of area V1 in monocularly deprived monkeys. Our results suggest a high turnover rate of the robl/LC7-like protein and the presence of a repressor mechanism in neurons that is tightly coupled to synaptic stimulation.     

Multisynaptic Inputs from the Medial Temporal Lobe to V4 in Macaques

Retrograde transsynaptic transport of rabies virus was employed to undertake the top-down projections from the medial temporal lobe (MTL) to visual area V4 of the occipitotemporal visual pathway in Japanese monkeys (Macaca fuscata). On day 3 after rabies injections into V4, neuronal labeling was observed prominently in the temporal lobe areas that have direct connections with V4, including area TF of the parahippocampal cortex. Furthermore, conspicuous neuron labeling appeared disynaptically in area TH of the parahippocampal cortex, and areas 35 and 36 of the perirhinal cortex. The labeled neurons were located predominantly in deep layers. On day 4 after the rabies injections, labeled neurons were found in the hippocampal formation, along with massive labeling in the parahippocampal and perirhinal cortices. In the hippocampal formation, the densest neuron labeling was seen in layer 5 of the entorhinal cortex, and a small but certain number of neurons were labeled in other regions, such as the subicular complex and CA1 and CA3 of the hippocampus proper. The present results indicate that V4 receives major input from the hippocampus proper via the entorhinal cortex, as well as “short-cut” pathways that bypass the entorhinal cortex. These multisynaptic pathways may define an anatomical basis for hippocampal-cortical interactions involving lower visual areas. The multisynaptic input from the MTL to V4 is likely to provide mnemonic information about object recognition that is accomplished through the occipitotemporal pathway.     

A specialized area in limbic cortex for fast analysis of peripheral vision

In primates, prostriata is a small area located between the primary visual cortex (V1) and the hippocampal formation. Prostriata sends connections to multisensory and high-order association areas in the temporal, parietal, cingulate, orbitofrontal, and frontopolar cortices. It is characterized by a relatively simple histological organization, alluding to an early origin in mammalian evolution. Here we show that prostriata neurons in marmoset monkeys exhibit a unique combination of response properties, suggesting a new pathway for rapid distribution of visual information in parallel with the traditionally recognized dorsal and ventral streams. Whereas the location and known connections of prostriata suggest a high-level association area, its response properties are unexpectedly simple, resembling those found in early stages of the visual processing: neurons have robust, nonadapting responses to simple stimuli, with latencies comparable to those found in V1, and are broadly tuned to stimulus orientation and spatiotemporal frequency. However, their receptive fields are enormous and form a unique topographic map that emphasizes the far periphery of the visual field. These results suggest a specialized circuit through which stimuli in peripheral vision can bypass the elaborate hierarchy of extrastriate visual areas and rapidly elicit coordinated motor and cognitive responses across multiple brain systems.     

Reaction times for hand movements made in response to visual versus vibratory cues

Reaction times were determined for monkeys and humans who made wrist flexion and extension movements in response to vibratory and visual cues. Humans initiated movements approximately 50 msec sooner in response to vibratory as compared to visual cues. For monkeys, this difference was approximately 100 msec. Mean daily reaction times for monkeys and humans improved with practice until they reached a steady level of performance. Increased differences between vibratory and visual reaction times were weakly correlated with increased age of humans. The increase in the differences appeared to result from decreased reaction times by older subjects for vibratory-cued movements; reaction times for visually cued movements did not consistently vary across the age range of subjects tested (19-36 years). The results obtained using this novel paradigm suggest that it may be a useful tool for simultaneously testing behavioral performance or neurological function during somatosensorimotor and visuomotor tasks.     

Reaction Times for Hand Movements Made in Response to Visual versus Vibratory Cues

Reaction times were determined for monkeys and humans who made wrist flexion and extension movements in response to vibratory and visual cues. Humans initiated movements approximately 50 msec sooner in response to vibratory as compared to visual cues. For monkeys, this difference was approximately 100 msec. Mean daily reaction times for monkeys and humans improved with practice until they reached a steady level of performance. Increased differences between vibratory and visual reaction times were weakly correlated with increased age of humans. The increase in the differences appeared to result from decreased reaction times by older subjects for vibratory-cued movements; reaction times for visually cued movements did not consistently vary across the age range of subjects tested (19-36 years). The results obtained using this novel paradigm suggest that it may be a useful tool for simultaneously testing behavioral performance or neurological function during somatosensorimotor and visuomotor tasks.     

Practicing coarse orientation discrimination improves orientation signals in macaque cortical area v4

Practice improves the performance in visual tasks, but mechanisms underlying this adult brain plasticity are unclear. Single-cell studies reported no [1], weak [2], or moderate [3, 4] perceptual learning-related changes in macaque visual areas V1 and V4, whereas none were found in middle temporal (MT) [5]. These conflicting results and modeling of human (e.g., [6, 7]) and monkey data [8] suggested that changes in the readout of visual cortical signals underlie perceptual learning, rather than changes in these signals. In the V4 learning studies, monkeys discriminated small differences in orientation, whereas in the MT study, the animals discriminated opponent motion directions. Analogous to the latter study, we trained monkeys to discriminate static orthogonal orientations masked by noise. V4 neurons showed robust increases in their capacity to discriminate the trained orientations during the course of the training. This effect was observed during discrimination and passive fixation but specifically for the trained orientations. The improvement in neural discrimination was due to decreased response variability and an increase of the difference between the mean responses for the two trained orientations. These findings demonstrate that perceptual learning in a coarse discrimination task indeed can change the response properties of a cortical sensory area.     

Visually induced plasticity of auditory spatial perception in macaques

When experiencing spatially disparate visual and auditory stimuli, a common percept is that the sound originates from the location of the visual stimulus, an illusion known as the ventriloquism effect. This illusion can persist for tens of minutes, a phenomenon termed the ventriloquism aftereffect. The underlying neuronal mechanisms of this rapidly induced plasticity remain unclear; indeed, it remains untested whether similar multimodal interactions occur in other species. We therefore tested whether macaque monkeys experience the ventriloquism aftereffect similar to the way humans do. The ability of two monkeys to determine which side of the midline a sound was presented from was tested before and after a period of 20-60 min in which the monkeys experienced either spatially identical or spatially disparate auditory and visual stimuli. In agreement with human studies, the monkeys did experience a shift in their auditory spatial perception in the direction of the spatially disparate visual stimulus, and the aftereffect did not transfer across sounds that differed in frequency by two octaves. These results show that macaque monkeys experience the ventriloquism aftereffect similar to the way humans do in all tested respects, indicating that these multimodal interactions are a basic phenomenon of the central nervous system.