Retinotopic maps, spatial tuning, and locations of human visual areas in surface coordinates characterized with multifocal and blocked FMRI designs

The localization of visual areas in the human cortex is typically based on mapping the retinotopic organization with functional magnetic resonance imaging (fMRI). The most common approach is to encode the response phase for a slowly moving visual stimulus and to present the result on an individual's reconstructed cortical surface. The main aims of this study were to develop complementary general linear model (GLM)-based retinotopic mapping methods and to characterize the inter-individual variability of the visual area positions on the cortical surface. We studied 15 subjects with two methods: a 24-region multifocal checkerboard stimulus and a blocked presentation of object stimuli at different visual field locations. The retinotopic maps were based on weighted averaging of the GLM parameter estimates for the stimulus regions. In addition to localizing visual areas, both methods could be used to localize multiple retinotopic regions-of-interest. The two methods yielded consistent retinotopic maps in the visual areas V1, V2, V3, hV4, and V3AB. In the higher-level areas IPS0, VO1, LO1, LO2, TO1, and TO2, retinotopy could only be mapped with the blocked stimulus presentation. The gradual widening of spatial tuning and an increase in the responses to stimuli in the ipsilateral visual field along the hierarchy of visual areas likely reflected the increase in the average receptive field size. Finally, after registration to Freesurfer's surface-based atlas of the human cerebral cortex, we calculated the mean and variability of the visual area positions in the spherical surface-based coordinate system and generated probability maps of the visual areas on the average cortical surface. The inter-individual variability in the area locations decreased when the midpoints were calculated along the spherical cortical surface compared with volumetric coordinates. These results can facilitate both analysis of individual functional anatomy and comparisons of visual cortex topology across studies.     

Long timescale fMRI neuronal adaptation effects in human amblyopic cortex

An investigation of long timescale (5 minutes) fMRI neuronal adaptation effects, based on retinotopic mapping and spatial frequency stimuli, is presented in this paper. A hierarchical linear model was developed to quantify the adaptation effects in the visual cortex. The analysis of data involved studying the retinotopic mapping and spatial frequency adaptation effects in the amblyopic cortex. Our results suggest that, firstly, there are many cortical regions, including V1, where neuronal adaptation effects are reduced in the cortex in response to amblyopic eye stimulation. Secondly, our results show the regional contribution is different, and it seems to start from V1 and spread to the extracortex regions. Thirdly, our results show that there is greater adaptation to broadband retinotopic mapping as opposed to narrowband spatial frequency stimulation of the amblyopic eye, and we find significant correlation between fMRI response and the magnitude of the adaptation effect, suggesting that the reduced adaptation may be a consequence of the reduced response to different stimuli reported for amblyopic eyes.     

Correction of Distortion in Flattened Representations of the Cortical Surface Allows Prediction of V1-V3 Functional Organization from Anatomy

Several domains of neuroscience offer map-like models that link location on the cortical surface to properties of sensory representation. Within cortical visual areas V1, V2, and V3, algebraic transformations can relate position in the visual field to the retinotopic representation on the flattened cortical sheet. A limit to the practical application of this structure-function model is that the cortex, while topologically a two-dimensional surface, is curved. Flattening of the curved surface to a plane unavoidably introduces local geometric distortions that are not accounted for in idealized models. Here, we show that this limitation is overcome by correcting the geometric distortion induced by cortical flattening. We use a mass-spring-damper simulation to create a registration between functional MRI retinotopic mapping data of visual areas V1, V2, and V3 and an algebraic model of retinotopy. This registration is then applied to the flattened cortical surface anatomy to create an anatomical template that is linked to the algebraic retinotopic model. This registered cortical template can be used to accurately predict the location and retinotopic organization of these early visual areas from cortical anatomy alone. Moreover, we show that prediction accuracy remains when extrapolating beyond the range of data used to inform the model, indicating that the registration reflects the retinotopic organization of visual cortex. We provide code for the mass-spring-damper technique, which has general utility for the registration of cortical structure and function beyond the visual cortex.     

Visual Function and Cortical Organization in Carriers of Blue Cone Monochromacy

Carriers of blue cone monochromacy have fewer cone photoreceptors than normal. Here we examine how this disruption at the level of the retina affects visual function and cortical organization in these individuals. Visual resolution and contrast sensitivity was measured at the preferred retinal locus of fixation and visual resolution was tested at two eccentric locations (2.5° and 8°) with spectacle correction only. Adaptive optics corrected resolution acuity and cone spacing were simultaneously measured at several locations within the central fovea with adaptive optics scanning laser ophthalmoscopy (AOSLO). Fixation stability was assessed by extracting eye motion data from AOSLO videos. Retinotopic mapping using fMRI was carried out to estimate the area of early cortical regions, including that of the foveal confluence. Without adaptive optics correction, BCM carriers appeared to have normal visual function, with normal contrast sensitivity and visual resolution, but with AO-correction, visual resolution was significantly worse than normal. This resolution deficit is not explained by cone loss alone and is suggestive of an associated loss of retinal ganglion cells. However, despite evidence suggesting a reduction in the number of retinal ganglion cells, retinotopic mapping showed no reduction in the cortical area of the foveal confluence. These results suggest that ganglion cell density may not govern the foveal overrepresentation in the cortex. We propose that it is not the number of afferents, but rather the content of the information relayed to the cortex from the retina across the visual field that governs cortical magnification, as under normal viewing conditions this information is similar in both BCM carriers and normal controls.     

Human brain activity during illusory visual jitter as revealed by functional magnetic resonance imaging

One central problem in vision is how to compensate for retinal slip. A novel illusion (visual jitter) suggests the compensation mechanism is based solely on retinal motion. Adaptation to visual noise attenuates the motion signals used by the compensation stage, producing illusory jitter due to the undercompensation of retinal slip. Here, we investigated the neural substrate of retinal slip compensation during this illusion using high-field fMRI and retinotopic mapping in flattened cortical format. When jitter perception occurred, MR signal decreased in lower stages of the visual system but increased prominently in area MT+. In conclusion, visual areas as early as V1 are responsible for the adaptation stage, and MT+ is involved in the compensation stage. The present finding suggests the pathway from V1 to MT+ has an important role in stabilizing the visual world.     

Extensive cochleotopic mapping of human auditory cortical fields obtained with phase-encoding FMRI

The primary sensory cortices are characterized by a topographical mapping of basic sensory features which is considered to deteriorate in higher-order areas in favor of complex sensory features. Recently, however, retinotopic maps were also discovered in the higher-order visual, parietal and prefrontal cortices. The discovery of these maps enabled the distinction between visual regions, clarified their function and hierarchical processing. Could such extension of topographical mapping to high-order processing regions apply to the auditory modality as well? This question has been studied previously in animal models but only sporadically in humans, whose anatomical and functional organization may differ from that of animals (e.g. unique verbal functions and Heschl''s gyrus curvature). Here we applied fMRI spectral analysis to investigate the cochleotopic organization of the human cerebral cortex. We found multiple mirror-symmetric novel cochleotopic maps covering most of the core and high-order human auditory cortex, including regions considered non-cochleotopic, stretching all the way to the superior temporal sulcus. These maps suggest that topographical mapping persists well beyond the auditory core and belt, and that the mirror-symmetry of topographical preferences may be a fundamental principle across sensory modalities.     

Functional parcellation of mouse visual cortex using statistical techniques reveals response-dependent clustering of cortical processing areas

The visual cortex of the mouse brain can be divided into ten or more areas that each contain complete or partial retinotopic maps of the contralateral visual field. It is generally assumed that these areas represent discrete processing regions. In contrast to the conventional input-output characterizations of neuronal responses to standard visual stimuli, here we asked whether six of the core visual areas have responses that are functionally distinct from each other for a given visual stimulus set, by applying machine learning techniques to distinguish the areas based on their activity patterns. Visual areas defined by retinotopic mapping were examined using supervised classifiers applied to responses elicited by a range of stimuli. Using two distinct datasets obtained using wide-field and two-photon imaging, we show that the area labels predicted by the classifiers were highly consistent with the labels obtained using retinotopy. Furthermore, the classifiers were able to model the boundaries of visual areas using resting state cortical responses obtained without any overt stimulus, in both datasets. With the wide-field dataset, clustering neuronal responses using a constrained semi-supervised classifier showed graceful degradation of accuracy. The results suggest that responses from visual cortical areas can be classified effectively using data-driven models. These responses likely reflect unique circuits within each area that give rise to activity with stronger intra-areal than inter-areal correlations, and their responses to controlled visual stimuli across trials drive higher areal classification accuracy than resting state responses.     

Spatiotopic coding of BOLD signal in human visual cortex depends on spatial attention

The neural substrate of the phenomenological experience of a stable visual world remains obscure. One possible mechanism would be to construct spatiotopic neural maps where the response is selective to the position of the stimulus in external space, rather than to retinal eccentricities, but evidence for these maps has been inconsistent. Here we show, with fMRI, that when human subjects perform concomitantly a demanding attentive task on stimuli displayed at the fovea, BOLD responses evoked by moving stimuli irrelevant to the task were mostly tuned in retinotopic coordinates. However, under more unconstrained conditions, where subjects could attend easily to the motion stimuli, BOLD responses were tuned not in retinal but in external coordinates (spatiotopic selectivity) in many visual areas, including MT, MST, LO and V6, agreeing with our previous fMRI study. These results indicate that spatial attention may play an important role in mediating spatiotopic selectivity.     

The Refinement of Ipsilateral Eye Retinotopic Maps Is Increased by Removing the Dominant Contralateral Eye in Adult Mice

Background

Shortly after eye opening, initially disorganized visual cortex circuitry is rapidly refined to form smooth retinotopic maps. This process asymptotes long before adulthood, but it is unknown whether further refinement is possible. Prior work from our lab has shown that the retinotopic map of the non-dominant ipsilateral eye develops faster when the dominant contralateral eye is removed. We examined whether input from the contralateral eye might also limit the ultimate refinement of the ipsilateral eye retinotopic map in adults. In addition, we examined whether the increased refinement involved the recruitment of adjacent cortical area.

Methodology/Principal Findings

By surgically implanting a chronic optical window over visual cortex in mice, we repeatedly measured the degree of retinotopic map refinement using quantitative intrinsic signal optical imaging over four weeks. We removed the contralateral eye and observed that the retinotopic map for the ipsilateral eye was further refined and the maximum magnitude of response increased. However, these changes were not accompanied by an increase in the area of responsive cortex.

Conclusions/Significance

Since the retinotopic map was functionally refined to a greater degree without taking over adjacent cortical area, we conclude that input from the contralateral eye limits the normal refinement of visual cortical circuitry in mice. These findings suggest that the refinement capacity of cortical circuitry is normally saturated.     

Representation of three-dimensional visual space in the cerebral cortex

This article reviews two issues relevant to the topic of how three-dimensional space is represented in the cerebral cortex. The first is the question of how individual neurons encode information that might contribute to stereoscopic estimation of visual depth. Particular attention is given to the current understanding of the neural representation of motion through three-dimensional space and to the complexities that arise in interpreting neuronal responses to this complex stimulus parameter. The second issue considered is the disorderlines that exists in the retinotopic mapping of the visual field in some cortical visual areas. Several extrastriate areas have been found to contain maps of the contralateral visual hemifield that are disorderly in the sense that the representation of various parts of the visual field are often misplaced or grossly over-or under-represented. It is suggested that this disorderlines may in some cases represent adaptations to facilitate certain types of visual functions.     

Multishot versus single-shot pulse sequences in very high field fMRI: a comparison using retinotopic mapping

High-resolution functional MRI is a leading application for very high field (7 Tesla) human MR imaging. Though higher field strengths promise improvements in signal-to-noise ratios (SNR) and BOLD contrast relative to fMRI at 3 Tesla, these benefits may be partially offset by accompanying increases in geometric distortion and other off-resonance effects. Such effects may be especially pronounced with the single-shot EPI pulse sequences typically used for fMRI at standard field strengths. As an alternative, one might consider multishot pulse sequences, which may lead to somewhat lower temporal SNR than standard EPI, but which are also often substantially less susceptible to off-resonance effects. Here we consider retinotopic mapping of human visual cortex as a practical test case by which to compare examples of these sequence types for high-resolution fMRI at 7 Tesla. We performed polar angle retinotopic mapping at each of 3 isotropic resolutions (2.0, 1.7, and 1.1 mm) using both accelerated single-shot 2D EPI and accelerated multishot 3D gradient-echo pulse sequences. We found that single-shot EPI indeed led to greater temporal SNR and contrast-to-noise ratios (CNR) than the multishot sequences. However, additional distortion correction in postprocessing was required in order to fully realize these advantages, particularly at higher resolutions. The retinotopic maps produced by both sequence types were qualitatively comparable, and showed equivalent test/retest reliability. Thus, when surface-based analyses are planned, or in other circumstances where geometric distortion is of particular concern, multishot pulse sequences could provide a viable alternative to single-shot EPI.     

Generalized spin models for coupled cortical feature maps obtained by coarse graining correlation based synaptic learning rules

We derive generalized spin models for the development of feedforward cortical architecture from a Hebbian synaptic learning rule in a two layer neural network with nonlinear weight constraints. Our model takes into account the effects of lateral interactions in visual cortex combining local excitation and long range effective inhibition. Our approach allows the principled derivation of developmental rules for low-dimensional feature maps, starting from high-dimensional synaptic learning rules. We incorporate the effects of smooth nonlinear constraints on net synaptic weight projected from units in the thalamic layer (the fan-out) and on the net synaptic weight received by units in the cortical layer (the fan-in). These constraints naturally couple together multiple feature maps such as orientation preference and retinotopic organization. We give a detailed illustration of the method applied to the development of the orientation preference map as a special case, in addition to deriving a model for joint pattern formation in cortical maps of orientation preference, retinotopic location, and receptive field width. We show that the combination of Hebbian learning and center-surround cortical interaction naturally leads to an orientation map development model that is closely related to the XY magnetic lattice model from statistical physics. The results presented here provide justification for phenomenological models studied in Cowan and Friedman (Advances in neural information processing systems 3, 1991), Thomas and Cowan (Phys Rev Lett 92(18):e188101, 2004) and provide a developmental model realizing the synaptic weight constraints previously assumed in Thomas and Cowan (Math Med Biol 23(2):119–138, 2006).     

Development of continuous and discrete neural maps

Two qualitatively different kinds of neural map have been described: continuous maps exemplified by the visual retinotopic map, and discrete maps exemplified by the olfactory glomerular map. Here, we review developmental mechanisms of retinotopic and olfactory glomerular mapping and discuss underlying commonalities that have emerged from recent studies. These include the use of molecular gradients, axon-axon interactions, and the interplay between labeling molecules and neuronal activity in establishing these maps. Since visual retinotopic and olfactory glomerular maps represent two ends of a continuum that includes many other types of neural map in between, these emerging general principles may be widely applicable to map formation throughout the nervous system.     

Development of precise maps in visual cortex requires patterned spontaneous activity in the retina

The visual cortex is organized into retinotopic maps that preserve an orderly representation of the visual world, achieved by topographically precise inputs from the lateral geniculate nucleus. We show here that geniculocortical mapping is imprecise when the waves of spontaneous activity in the retina during the first postnatal week are disrupted genetically. This anatomical mapping defect is present by postnatal day 8 and has functional consequences, as revealed by optical imaging and microelectrode recording in adults. Pharmacological disruption of these retinal waves during the first week phenocopies the mapping defect, confirming both the site and the timing of the disruption in neural activity responsible for the defect. Analysis shows that the geniculocortical miswiring is not a trivial or necessary consequence of the retinogeniculate defect. Our findings demonstrate that disrupting early spontaneous activity in the eye alters thalamic connections to the cortex.     

An overall description of retinotopic mapping in the cat's visual cortex areas 17, 18, and 19

Mathematical functions are derived which model the retinotopic mapping in the cat's visual cortical areas 17, 18, and 19. All three mappings are simple modifications of a complex power function with an exponent of 0.43. This function is decomposed so as to give an intermediate stage which is common to all three mappings and can be regarded as a model of the lateral geniculate nucleus mapping. The influence of retinotopic mapping on visual receptive fields was studied. The results show that a dependence of the receptive field properties on the position in the visual field is to be expected.     

Responses to lightness variations in early human visual cortex

Lightness is the apparent reflectance of a surface, and it depends not only on the actual luminance of the surface but also on the context in which the surface is viewed [1-10]. The cortical mechanisms of lightness processing are largely unknown, and the role of early cortical areas is still a matter of debate [11-17]. We studied the cortical responses to lightness variations in early stages of the human visual system with functional magnetic resonance imaging (fMRI) while observers were performing a demanding fixation task. The set of dynamically presented visual stimuli included the rectangular version of the classic Craik-O'Brien stimulus [3, 18, 19] and a variant that led to a weaker lightness effect, as well as a pattern with actual luminance variations. We found that the cortical activity in retinotopic areas, including the primary visual cortex (V1), is correlated with context-dependent lightness variations.     

The radial bias: a different slant on visual orientation sensitivity in human and nonhuman primates

It is generally assumed that sensitivity to different stimulus orientations is mapped in a globally equivalent fashion across primate visual cortex, at a spatial scale larger than that of orientation columns. However, some evidence predicts instead that radial orientations should produce higher activity than other orientations, throughout visual cortex. Here, this radial orientation bias was robustly confirmed using (1) human psychophysics, plus fMRI in (2) humans and (3) behaving monkeys. In visual cortex, fMRI activity was at least 20% higher in the retinotopic representations of polar angle which corresponded to the radial stimulus orientations (relative to tangential). In a global demonstration of this, we activated complementary retinotopic quadrants of visual cortex by simply changing stimulus orientation, without changing stimulus location in the visual field. This evidence reveals a neural link between orientation sensitivity and the cortical retinotopy, which have previously been considered independent.     

Individual differences among grapheme-color synesthetes: brain-behavior correlations

Grapheme-color synesthetes experience specific colors associated with specific number or letter characters. To determine the neural locus of this condition, we compared behavioral and fMRI responses in six grapheme-color synesthetes to control subjects. In our behavioral experiments, we found that a subject's synesthetic experience can aid in texture segregation (experiment 1) and reduce the effects of crowding (experiment 2). For synesthetes, graphemes produced larger fMRI responses in color-selective area human V4 than for control subjects (experiment 3). Importantly, we found a correlation within subjects between the behavioral and fMRI results; subjects with better performance on the behavioral experiments showed larger fMRI responses in early retinotopic visual areas (V1, V2, V3, and hV4). These results suggest that grapheme-color synesthesia is the result of cross-activation between grapheme-selective and color-selective brain areas. The correlation between the behavioral and fMRI results suggests that grapheme-color synesthetes may constitute a heterogeneous group.     

Spatial mapping in the primate sensory projection: Analytic structure and relevance to perception

The retinotopic mapping of the visual field to the surface of the striate cortex is characterized as a longarithmic conformal mapping. This summarizes in a concise way the observed curve of cortical magnification, the linear scaling of receptive field size with eccentricity, and the mapping of global visual field landmarks. It is shown that if this global structure is reiterated at the local level, then the sequence regularity of the simple cells of area 17 may be accounted for as well. Recently published data on the secondary visual area, the medial visual area, and the inferior pulvinar of the owl monkey suggests that same global logarithmic structure holds for these areas as well. The available data on the structure of the somatotopic mapping (areaS-1) supports a similar analysis. The possible relevance of the analytical form of the cortical receptotopic maps to perception is examined and a brief discussion of the developmental implications of these findings is presented.This work was supported by Grant No. 1 F32MH05367-01 from the USPHS, ADAMHA     

Modeling Magnification and Anisotropy in the Primate Foveal Confluence

A basic organizational principle of the primate visual system is that it maps the visual environment repeatedly and retinotopically onto cortex. Simple algebraic models can be used to describe the projection from visual space to cortical space not only for V1, but also for the complex of areas V1, V2 and V3. Typically a conformal (angle-preserving) projection ensuring local isotropy is regarded as ideal and primate visual cortex is often regarded as an approximation of this ideal. However, empirical data show systematic deviations from this ideal that are especially relevant in the foveal projection. The aims of this study were to map the nature of anisotropy predicted by existing models, to investigate the optimization targets faced by different types of retino-cortical maps, and finally to propose a novel map that better models empirical data than other candidates. The retino-cortical map can be optimized towards a space-conserving homogenous representation or a quasi-conformal mapping. The latter would require a significantly enlarged representation of specific parts of the cortical maps. In particular it would require significant enlargement of parafoveal V2 and V3 which is not supported by empirical data. Further, the recently published principal layout of the foveal singularity cannot be explained by existing models. We suggest a new model that accurately describes foveal data, minimizing cortical surface area in the periphery but suggesting that local isotropy dominates the most foveal part at the expense of additional cortical surface. The foveal confluence is an important example of the detailed trade-offs between the compromises required for the mapping of environmental space to a complex of neighboring cortical areas. Our models demonstrate that the organization follows clear morphogenetic principles that are essential for our understanding of foveal vision in daily life.