Abnormal FMRI adaptation to unfamiliar faces in a case of developmental prosopamnesia

In rare cases, damage to the temporal lobe causes a selective impairment in the ability to learn new faces, a condition known as prosopamnesia [1]. Here we present the case of an individual with prosopamnesia in the absence of any acquired structural lesion. "C" shows intact processing of simple and complex nonface objects, but her ability to learn new faces is severely impaired. We used a neural marker of perceptual learning known as repetition suppression to examine functioning within C's fusiform face area (FFA), a region of cortex involved in face perception [2]. For comparison, we examined repetition suppression in the scene-selective parahippocampal place area (PPA) [3]. As expected, normal controls showed significant region-specific attenuation of neural activity across repetitions of each stimulus class. C also showed normal attenuation within the PPA to familiar and unfamiliar scenes, and within the FFA to familiar faces. Critically, however, she failed to show any adaptive change within the FFA for repeated unfamiliar faces, despite a face-specific blood-oxygen-dependent response (BOLD) response in her FFA during viewing of face stimuli. Our findings suggest that in developmental prosopamnesia, the FFA cannot maintain stable representations of new faces for subsequent recall or recognition.     

Viewpoint-specific scene representations in human parahippocampal cortex

The "parahippocampal place area" (PPA) responds more strongly in functional magnetic resonance imaging (fMRI) to scenes than to faces, objects, or other visual stimuli. We used an event-related fMRI adaptation paradigm to test whether the PPA represents scenes in a viewpoint-specific or viewpoint-invariant manner. The PPA responded just as strongly to viewpoint changes that preserved intrinsic scene geometry as it did to complete scene changes, but less strongly to object changes within the scene. In contrast, lateral occipital cortex responded more strongly to object changes than to spatial changes. These results demonstrate that scene processing in the PPA is viewpoint specific and suggest that the PPA represents the relationship between the observer and the surfaces that define local space.     

Modulation of activity in human visual area V1 during memory masking

Neurons in the primary visual cortex, V1, are specialized for the processing of elemental features of the visual stimulus, such as orientation and spatial frequency. Recent fMRI evidence suggest that V1 neurons are also recruited in visual perceptual memory; a number of studies using multi-voxel pattern analysis have successfully decoded stimulus-specific information from V1 activity patterns during the delay phase in memory tasks. However, consistent fMRI signal modulations reflecting the memory process have not yet been demonstrated. Here, we report evidence, from three subjects, that the low V1 BOLD activity during retention of low-level visual features is caused by competing interactions between neural populations coding for different values along the spectrum of the dimension remembered. We applied a memory masking paradigm in which the memory representation of a masker stimulus interferes with a delayed spatial frequency discrimination task when its frequency differs from the discriminanda with ±1 octave and found that impaired behavioral performance due to masking is reflected in weaker V1 BOLD signals. This cross-channel inhibition in V1 only occurs with retinotopic overlap between the masker and the sample stimulus of the discrimination task. The results suggest that memory for spatial frequency is a local process in the retinotopically organized visual cortex.     

The neural basis of the behavioral face-inversion effect

Two of the most robust markers for "special" face processing are the behavioral face-inversion effect (FIE)-the disproportionate drop in recognition of upside-down (inverted) stimuli relative to upright faces-and the face-selective fMRI response in the fusiform face area (FFA). However, the relationship between these two face-selective markers is unknown. Here we report that the behavioral FIE is closely associated with the fMRI response in the FFA, but not in other face-selective or object-selective regions. The FFA and the face-selective region in the superior temporal sulcus (f_STS), but not the occipital face-selective region (OFA), showed a higher response to upright than inverted faces. However, only in the FFA was this fMRI-FIE positively correlated across subjects with the behavioral FIE. Second, the FFA, but not the f_STS, showed greater neural sensitivity to differences between faces when they were upright than inverted, suggesting a possible neural mechanism for the behavioral FIE. Although a similar trend was found in the occipital face area (OFA), it was less robust than the FFA. Taken together, our data suggest that among the face-selective and object-selective regions, the FFA is a primary neural source of the behavioral FIE.     

Separating Fusion from Rivalry

Visual fusion is the process in which differing but compatible binocular information is transformed into a unified percept. Even though this is at the basis of binocular vision, the underlying neural processes are, as yet, poorly understood. In our study we therefore aimed to investigate neural correlates of visual fusion. To this end, we presented binocularly compatible, fusible (BF), and incompatible, rivaling (BR) stimuli, as well as an intermediate stimulus type containing both binocularly fusible and monocular, incompatible elements (BFR). Comparing BFR stimuli with BF and BR stimuli, respectively, we were able to disentangle brain responses associated with either visual fusion or rivalry. By means of functional magnetic resonance imaging, we measured brain responses to these stimulus classes in the visual cortex, and investigated them in detail at various retinal eccentricities. Compared with BF stimuli, the response to BFR stimuli was elevated in visual cortical areas V1 and V2, but not in V3 and V4 – implying that the response to monocular stimulus features decreased from V1 to V4. Compared to BR stimuli, the response to BFR stimuli decreased with increasing eccentricity, specifically within V3 and V4. Taken together, it seems that although the processing of exclusively monocular information decreases from V1 to V4, the processing of binocularly fused information increases from earlier to later visual areas. Our findings suggest the presence of an inhibitory neural mechanism which, depending on the presence of fusion, acts differently on the processing of monocular information.     

Face inversion reduces the persistence of global form and its neural correlates

Face inversion produces a detrimental effect on face recognition. The extent to which the inversion of faces and other kinds of objects influences the perceptual binding of visual information into global forms is not known. We used a behavioral method and functional MRI (fMRI) to measure the effect of face inversion on visual persistence, a type of perceptual memory that reflects sustained awareness of global form. We found that upright faces persisted longer than inverted versions of the same images; we observed a similar effect of inversion on the persistence of animal stimuli. This effect of inversion on persistence was evident in sustained fMRI activity throughout the ventral visual hierarchy, including the lateral occipital area (LO), two face-selective visual areas--the fusiform face area (FFA) and the occipital face area (OFA)--and several early visual areas. V1 showed the same initial fMRI activation to upright and inverted forms but this activation lasted longer for upright stimuli. The inversion effect on persistence-related fMRI activity in V1 and other retinotopic visual areas demonstrates that higher-tier visual areas influence early visual processing via feedback. This feedback effect on figure-ground processing is sensitive to the orientation of the figure.     

Direct intracranial, FMRI, and lesion evidence for the causal role of left inferotemporal cortex in reading

Models of the "visual word form system" postulate that a left occipitotemporal region implements the automatic visual word recognition required for efficient reading. This theory was assessed in a patient in whom reading was explored with behavioral measures, fMRI, and intracranial local field potentials. Prior to surgery, when reading was normal, fMRI revealed a normal mosaic of ventral visual selectivity for words, faces, houses, and tools. Intracranial recordings demonstrated that the left occipitotemporal cortex responded with a short latency to conscious but also to subliminal words. Surgery removed a small portion of word-responsive occipitotemporal cortex overlapping with the word-specific fMRI activation. The patient developed a marked reading deficit, while recognition of other visual categories remained intact. Furthermore, in the post-surgery fMRI map of visual cortex, only word-specific activations disappeared. Altogether, these results provide direct evidence for the causal role of the left occipitotemporal cortex in the recognition of visual words.     

宽周边视视网膜皮层映射的核磁共振研究

目的:人类视觉皮层的组织方式是视网膜皮层映射组织,先前研究已经证实视觉皮层在中心视采用这种组织方式,本文主要研究宽周边视的视觉皮层组织方式.方法:本文采用一种可以在核磁共振室中使用的光纤设备,设计了30度、40度、50度、60度的类圆环block刺激,使用1.5T的功能性核磁共振仪器,T1高分辨率图像分辨率为1*1*5.5mm,T2加权图像分辨率为4*4*5.5mm,TR反应时间为60,矩阵大小为64*64.核磁共振数据分析使用了SPM2和Brain voyager软件.结果:通过对试验者的数据处理分析,周边视的刺激的反应区域在枕叶上,主要分布在枕叶的前部,刺激反应区域随着偏心率的增大而沿着距状沟从距状沟的后部向前部移动.结论:周边视的视网膜皮层映射组织特性和中心视的特性非常相似.     

Visual agnosia and posterior cerebral artery infarcts: an anatomical-clinical study

Background

To evaluate systematically the cognitive deficits following posterior cerebral artery (PCA) strokes, especially agnosic visual disorders, and to study anatomical-clinical correlations.

Methods and Findings

We investigated 31 patients at the chronic stage (mean duration of 29.1 months post infarct) with standardized cognitive tests. New experimental tests were used to assess visual impairments for words, faces, houses, and objects. Forty-one healthy subjects participated as controls. Brain lesions were normalized, combined, and related to occipitotemporal areas responsive to specific visual categories, including words (VWFA), faces (FFA and OFA), houses (PPA) and common objects (LOC). Lesions were located in the left hemisphere in 15 patients, in the right in 13, and bilaterally in 3. Visual field defects were found in 23 patients. Twenty patients had a visual disorder in at least one of the experimental tests (9 with faces, 10 with houses, 7 with phones, 3 with words). Six patients had a deficit just for a single category of stimulus. The regions of maximum overlap of brain lesions associated with a deficit for a given category of stimuli were contiguous to the peaks of the corresponding functional areas as identified in normal subjects. However, the strength of anatomical-clinical correlations was greater for words than for faces or houses, probably due to the stronger lateralization of the VWFA, as compared to the FFA or the PPA.

Conclusions

Agnosic visual disorders following PCA infarcts are more frequent than previously reported. Dedicated batteries of tests, such as those developed here, are required to identify such deficits, which may escape clinical notice. The spatial relationships of lesions and of regions activated in normal subjects predict the nature of the deficits, although individual variability and bilaterally represented systems may blur those correlations.     

Visual Interactions Conform to Pattern Decorrelation in Multiple Cortical Areas

Neural responses to visual stimuli are strongest in the classical receptive field, but they are also modulated by stimuli in a much wider region. In the primary visual cortex, physiological data and models suggest that such contextual modulation is mediated by recurrent interactions between cortical areas. Outside the primary visual cortex, imaging data has shown qualitatively similar interactions. However, whether the mechanisms underlying these effects are similar in different areas has remained unclear. Here, we found that the blood oxygenation level dependent (BOLD) signal spreads over considerable cortical distances in the primary visual cortex, further than the classical receptive field. This indicates that the synaptic activity induced by a given stimulus occurs in a surprisingly extensive network. Correspondingly, we found suppressive and facilitative interactions far from the maximum retinotopic response. Next, we characterized the relationship between contextual modulation and correlation between two spatial activation patterns. Regardless of the functional area or retinotopic eccentricity, higher correlation between the center and surround response patterns was associated with stronger suppressive interaction. In individual voxels, suppressive interaction was predominant when the center and surround stimuli produced BOLD signals with the same sign. Facilitative interaction dominated in the voxels with opposite BOLD signal signs. Our data was in unison with recently published cortical decorrelation model, and was validated against alternative models, separately in different eccentricities and functional areas. Our study provides evidence that spatial interactions among neural populations involve decorrelation of macroscopic neural activation patterns, and suggests that the basic design of the cerebral cortex houses a robust decorrelation mechanism for afferent synaptic input.     

Evidence for implication of primate area V1 in neural 3-D spatial localization processing.

We investigated the neural mechanisms underlying visual localization in 3-D space in area V1 of behaving monkeys. Three different sources of information, retinal disparity, viewing distance and gaze direction, that participate in these neural mechanisms are being reviewed. The way they interact with each other is studied by combining retinal and extraretinal signals. Interactions between retinal disparity and viewing distance have been shown in foveal V1; we have observed a strong modulation of the spontaneous activity and of the visual response of most V1 cells that was highly correlated with the vergence angle. As a consequence of these gain effects, neural horizontal disparity coding is favoured or refined for particular distances of fixation. Changing the gaze direction in the fronto-parallel plane also produces strong gains in the visual response of half of the cells in foveal V1. Cells tested for horizontal disparity and orientation selectivities show gain effects that occur coherently for the same spatial coordinates of the eyes. Shifts in preferred disparity also occurred in several neurons. Cells tested in calcarine V1 at retinal eccentricities larger than 10 degrees , show that horizontal disparity is encoded at least up to 20 degrees around both the horizontal and vertical meridians. At these large retinal eccentricities we found that vertical disparity is also encoded with tuning profiles similar to those of horizontal disparity coding. Combinations of horizontal and vertical disparity signals show that most cells encode both properties. In fact the expression of horizontal disparity coding depends on the vertical disparity signals that produce strong gain effects and frequent changes in peak selectivities. We conclude that the vertical disparity signal and the eye position signal serve to disambiguate the horizontal disparity signal to provide information on 3-D spatial coordinates in terms of distance, gaze direction and retinal eccentricity. We suggest that the relative weight among these different signals is the determining factor involved in the neural processing that gives information on 3-D spatial localization.     

Face perception: domain specific, not process specific

Evidence that face perception is mediated by special cognitive and neural mechanisms comes from fMRI studies of the fusiform face area (FFA) and behavioral studies of the face inversion effect. Here, we used these two methods to ask whether face perception mechanisms are stimulus specific, process specific, or both. Subjects discriminated pairs of upright or inverted faces or house stimuli that differed in either the spatial distance among parts (configuration) or the shape of the parts. The FFA showed a much higher response to faces than to houses, but no preference for the configuration task over the part task. Similarly, the behavioral inversion effect was as large in the part task as the configuration task for faces, but absent in both part and configuration tasks for houses. These findings indicate that face perception mechanisms are not process specific for parts or configuration but are domain specific for face stimuli per se.     

Sleep Deprivation Impairs Object-Selective Attention: A View from the Ventral Visual Cortex

Background

Most prior studies on selective attention in the setting of total sleep deprivation (SD) have focused on behavior or activation within fronto-parietal cognitive control areas. Here, we evaluated the effects of SD on the top-down biasing of activation of ventral visual cortex and on functional connectivity between cognitive control and other brain regions.

Methodology/Principal Findings

Twenty-three healthy young adult volunteers underwent fMRI after a normal night of sleep (RW) and after sleep deprivation in a counterbalanced manner while performing a selective attention task. During this task, pictures of houses or faces were randomly interleaved among scrambled images. Across different blocks, volunteers responded to house but not face pictures, face but not house pictures, or passively viewed pictures without responding. The appearance of task-relevant pictures was unpredictable in this paradigm. SD resulted in less accurate detection of target pictures without affecting the mean false alarm rate or response time. In addition to a reduction of fronto-parietal activation, attending to houses strongly modulated parahippocampal place area (PPA) activation during RW, but this attention-driven biasing of PPA activation was abolished following SD. Additionally, SD resulted in a significant decrement in functional connectivity between the PPA and two cognitive control areas, the left intraparietal sulcus and the left inferior frontal lobe.

Conclusions/Significance

SD impairs selective attention as evidenced by reduced selectivity in PPA activation. Further, reduction in fronto-parietal and ventral visual task-related activation suggests that it also affects sustained attention. Reductions in functional connectivity may be an important additional imaging parameter to consider in characterizing the effects of sleep deprivation on cognition.     

How distributed is visual category information in human occipito-temporal cortex? An fMRI study

We used fMRI to study the distribution of object category information in the ventral visual pathway. Extending the findings of, we find that categories of stimuli can be distinguished by the pattern of activation they elicit across this entire pathway, even when the stimuli within a category differ in viewpoint, exemplar, or image format. However, regions within the ventral visual pathway are neither interchangeable nor equipotential. Although the FFA and PPA permit excellent discrimination between preferred versus nonpreferred stimuli (e.g., faces-bottles and houses-bottles, respectively), we find that neither region alone permits accurate discrimination between pairs of nonpreferred stimuli (e.g., bottles-shoes). These findings indicate that the ventral visual pathway is not homogeneous, but contains some regions (including FFA and PPA) that are primarily involved in the analysis of a single class of stimulus.     

The role of the fusiform face area in social cognition: implications for the pathobiology of autism

A region in the lateral aspect of the fusiform gyrus (FG) is more engaged by human faces than any other category of image. It has come to be known as the 'fusiform face area' (FFA). The origin and extent of this specialization is currently a topic of great interest and debate. This is of special relevance to autism, because recent studies have shown that the FFA is hypoactive to faces in this disorder. In two linked functional magnetic resonance imaging (fMRI) studies of healthy young adults, we show here that the FFA is engaged by a social attribution task (SAT) involving perception of human-like interactions among three simple geometric shapes. The amygdala, temporal pole, medial prefrontal cortex, inferolateral frontal cortex and superior temporal sulci were also significantly engaged. Activation of the FFA to a task without faces challenges the received view that the FFA is restricted in its activities to the perception of faces. We speculate that abstract semantic information associated with faces is encoded in the FG region and retrieved for social computations. From this perspective, the literature on hypoactivation of the FFA in autism may be interpreted as a reflection of a core social cognitive mechanism underlying the disorder.     

Cortical responses to invisible faces: dissociating subsystems for facial-information processing

Perceiving faces is critical for social interaction. Evidence suggests that different neural pathways may be responsible for processing face identity and expression information. By using functional magnetic resonance imaging (fMRI), we measured brain responses when observers viewed neutral, fearful, and scrambled faces, either visible or rendered invisible through interocular suppression. The right fusiform face area (FFA), the right superior temporal sulcus (STS), and the amygdala responded strongly to visible faces. However, when face images became invisible, activity in FFA to both neutral and fearful faces was much reduced, although still measurable; activity in the STS was robust only to invisible fearful faces but not to neutral faces. Activity in the amygdala was equally strong in both the visible and invisible conditions to fearful faces but much weaker in the invisible condition for the neutral faces. In the invisible condition, amygdala activity was highly correlated with that of the STS but not with FFA. The results in the invisible condition support the existence of dissociable neural systems specialized for processing facial identity and expression information. When images are invisible, cortical responses may reflect primarily feed-forward visual-information processing and thus allow us to reveal the distinct functions of FFA and STS.     

The neuropsychology of face perception: beyond simple dissociations and functional selectivity

Face processing relies on a distributed, patchy network of cortical regions in the temporal and frontal lobes that respond disproportionately to face stimuli, other cortical regions that are not even primarily visual (such as somatosensory cortex), and subcortical structures such as the amygdala. Higher-level face perception abilities, such as judging identity, emotion and trustworthiness, appear to rely on an intact face-processing network that includes the occipital face area (OFA), whereas lower-level face categorization abilities, such as discriminating faces from objects, can be achieved without OFA, perhaps via the direct connections to the fusiform face area (FFA) from several extrastriate cortical areas. Some lesion, transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) findings argue against a strict feed-forward hierarchical model of face perception, in which the OFA is the principal and common source of input for other visual and non-visual cortical regions involved in face perception, including the FFA, face-selective superior temporal sulcus and somatosensory cortex. Instead, these findings point to a more interactive model in which higher-level face perception abilities depend on the interplay between several functionally and anatomically distinct neural regions. Furthermore, the nature of these interactions may depend on the particular demands of the task. We review the lesion and TMS literature on this topic and highlight the dynamic and distributed nature of face processing.     

Asymmetrical activation in the human brain during processing of fearful faces

Traditional split-field studies and patient research indicate a privileged role for the right hemisphere in emotional processing [1-7], but there has been little direct fMRI evidence for this, despite many studies on emotional-face processing [8-10](see Supplemental Background). With fMRI, we addressed differential hemispheric processing of fearful versus neutral faces by presenting subjects with faces bilaterally [11-13]and orthogonally manipulating whether each hemifield showed a fearful or neutral expression prior to presentation of a checkerboard target. Target discrimination in the left visual field was more accurate after a fearful face was presented there. Event-related fMRI showed right-lateralized brain activations for fearful minus neutral left-hemifield faces in right visual areas, as well as more activity in the right than in the left amygdala. These activations occurred regardless of the type of right-hemifield face shown concurrently, concordant with the behavioral effect. No analogous behavioral or fMRI effects were observed for fearful faces in the right visual field (left hemisphere). The amygdala showed enhanced functional coupling with right-middle and anterior-fusiform areas in the context of a left-hemifield fearful face. These data provide behavioral and fMRI evidence for right-lateralized emotional processing during bilateral stimulation involving enhanced coupling of the amygdala and right-hemispheric extrastriate cortex.     

The Perception of Dynamic and Static Facial Expressions of Happiness and Disgust Investigated by ERPs and fMRI Constrained Source Analysis

A recent functional magnetic resonance imaging (fMRI) study by our group demonstrated that dynamic emotional faces are more accurately recognized and evoked more widespread patterns of hemodynamic brain responses than static emotional faces. Based on this experimental design, the present study aimed at investigating the spatio-temporal processing of static and dynamic emotional facial expressions in 19 healthy women by means of multi-channel electroencephalography (EEG), event-related potentials (ERP) and fMRI-constrained regional source analyses. ERP analysis showed an increased amplitude of the LPP (late posterior positivity) over centro-parietal regions for static facial expressions of disgust compared to neutral faces. In addition, the LPP was more widespread and temporally prolonged for dynamic compared to static faces of disgust and happiness. fMRI constrained source analysis on static emotional face stimuli indicated the spatio-temporal modulation of predominantly posterior regional brain activation related to the visual processing stream for both emotional valences when compared to the neutral condition in the fusiform gyrus. The spatio-temporal processing of dynamic stimuli yielded enhanced source activity for emotional compared to neutral conditions in temporal (e.g., fusiform gyrus), and frontal regions (e.g., ventromedial prefrontal cortex, medial and inferior frontal cortex) in early and again in later time windows. The present data support the view that dynamic facial displays trigger more information reflected in complex neural networks, in particular because of their changing features potentially triggering sustained activation related to a continuing evaluation of those faces. A combined fMRI and EEG approach thus provides an advanced insight to the spatio-temporal characteristics of emotional face processing, by also revealing additional neural generators, not identifiable by the only use of an fMRI approach.     

The neural fate of consciously perceived and missed events in the attentional blink

Cognitive models of attention propose that visual perception is a product of two stages of visual processing: early operations permit rapid initial categorization of the visual world, while later attention-demanding capacity-limited stages are necessary for the conscious report of the stimuli. Here we used the attentional blink paradigm and fMRI to neurally distinguish these two stages of vision. Subjects detected a face target and a scene target presented rapidly among distractors at fixation. Although the second, scene target frequently went undetected by the subjects, it nonetheless activated regions of the medial temporal cortex involved in high-level scene representations, the parahippocampal place area (PPA). This PPA activation was amplified when the stimulus was consciously perceived. By contrast, the frontal cortex was activated only when scenes were successfully reported. These results suggest that medial temporal cortex permits rapid categorization of the visual input, while the frontal cortex is part of a capacity-limited attentional bottleneck to conscious report.