Subcortical face processing

Recent functional imaging, neuropsychological and electrophysiological studies on adults have provided evidence for a fast, low-spatial-frequency, subcortical face-detection pathway that modulates the responses of certain cortical areas to faces and other social stimuli. These findings shed light on an older literature on the face-detection abilities of newborn infants, and the hypothesis that these newborn looking preferences are generated by a subcortical route. Converging lines of evidence indicate that the subcortical face route provides a developmental foundation for what later becomes the adult cortical 'social brain' network, and that disturbances to this pathway might contribute to certain developmental disorders.     

Adults' awareness of faces follows newborns' looking preferences

From the first days of life, humans preferentially orient towards upright faces, likely reflecting innate subcortical mechanisms. Here, we show that binocular rivalry can reveal face detection mechanisms in adults that are surprisingly similar to inborn face detection mechanism. We used continuous flash suppression (CFS), a variant of binocular rivalry, to render stimuli invisible at the beginning of each trial and measured the time upright and inverted stimuli needed to overcome such interocular suppression. Critically, specific stimulus properties previously shown to modulate looking preferences in neonates similarly modulated adults' awareness of faces presented during CFS. First, the advantage of upright faces in overcoming CFS was strongly modulated by contrast polarity and direction of illumination. Second, schematic patterns consisting of three dark blobs were suppressed for shorter durations when the arrangement of these blobs respected the face-like configuration of the eyes and the mouth, and this effect was modulated by contrast polarity. No such effects were obtained in a binocular control experiment not involving CFS, suggesting a crucial role for face-sensitive mechanisms operating outside of conscious awareness. These findings indicate that visual awareness of faces in adults is governed by perceptual mechanisms that are sensitive to similar stimulus properties as those modulating newborns' face preferences.     

Face inversion reduces the persistence of global form and its neural correlates

Face inversion produces a detrimental effect on face recognition. The extent to which the inversion of faces and other kinds of objects influences the perceptual binding of visual information into global forms is not known. We used a behavioral method and functional MRI (fMRI) to measure the effect of face inversion on visual persistence, a type of perceptual memory that reflects sustained awareness of global form. We found that upright faces persisted longer than inverted versions of the same images; we observed a similar effect of inversion on the persistence of animal stimuli. This effect of inversion on persistence was evident in sustained fMRI activity throughout the ventral visual hierarchy, including the lateral occipital area (LO), two face-selective visual areas--the fusiform face area (FFA) and the occipital face area (OFA)--and several early visual areas. V1 showed the same initial fMRI activation to upright and inverted forms but this activation lasted longer for upright stimuli. The inversion effect on persistence-related fMRI activity in V1 and other retinotopic visual areas demonstrates that higher-tier visual areas influence early visual processing via feedback. This feedback effect on figure-ground processing is sensitive to the orientation of the figure.     

Early category-specific cortical activation revealed by visual stimulus inversion

Visual categorization may already start within the first 100-ms after stimulus onset, in contrast with the long-held view that during this early stage all complex stimuli are processed equally and that category-specific cortical activation occurs only at later stages. The neural basis of this proposed early stage of high-level analysis is however poorly understood. To address this question we used magnetoencephalography and anatomically-constrained distributed source modeling to monitor brain activity with millisecond-resolution while subjects performed an orientation task on the upright and upside-down presented images of three different stimulus categories: faces, houses and bodies. Significant inversion effects were found for all three stimulus categories between 70-100-ms after picture onset with a highly category-specific cortical distribution. Differential responses between upright and inverted faces were found in well-established face-selective areas of the inferior occipital cortex and right fusiform gyrus. In addition, early category-specific inversion effects were found well beyond visual areas. Our results provide the first direct evidence that category-specific processing in high-level category-sensitive cortical areas already takes place within the first 100-ms of visual processing, significantly earlier than previously thought, and suggests the existence of fast category-specific neocortical routes in the human brain.     

Infants' knowledge of their own species

Recognition of individuals at first sight is important for social species and can be achieved by attending to facial or body information. Previous research suggests that infants possess a perceptual template for evolutionarily relevant stimuli, which may include humans, dangerous animals (e.g. snakes), but not non-dangerous animals. To be effective, such a mechanism should result in a systematic preference for attending to humans over non-dangerous animals. Using a preferential looking paradigm, the present studies investigated the nature of infants' early representation of humans. We show that 3.5- and six-month-old infants attend more to human beings than non-human primates (a gorilla or monkey) which are examplars of non-dangerous animals. This occurred when infants were presented with head or body information in isolation, as well as when both are presented simultaneously. This early preference for humans by 3.5 months of age suggests that there is a basic representation for humans, which includes both head and/or body information. However, neonates demonstrated a preference only for human faces over non-human primate faces, not for humans over non-human primates when the stimuli were presented with both head and body simultaneously. The results show that although neonates display a preference for human faces over others, preference for the human body only develops later, in the first few months of life. This suggests that infants have acquired some knowledge about the human body at 3.5 months of age that may have developed from their privileged experience with other humans in the first few months of life, rather than an innate ability to detect humans in their entirety.     

It’s All in the Eyes: Subcortical and Cortical Activation during Grotesqueness Perception in Autism

Atypical face processing plays a key role in social interaction difficulties encountered by individuals with autism. In the current fMRI study, the Thatcher illusion was used to investigate several aspects of face processing in 20 young adults with high-functioning autism spectrum disorder (ASD) and 20 matched neurotypical controls. “Thatcherized” stimuli were modified at either the eyes or the mouth and participants discriminated between pairs of faces while cued to attend to either of these features in upright and inverted orientation. Behavioral data confirmed sensitivity to the illusion and intact configural processing in ASD. Directing attention towards the eyes vs. the mouth in upright faces in ASD led to (1) improved discrimination accuracy; (2) increased activation in areas involved in social and emotional processing; (3) increased activation in subcortical face-processing areas. Our findings show that when explicitly cued to attend to the eyes, activation of cortical areas involved in face processing, including its social and emotional aspects, can be enhanced in autism. This suggests that impairments in face processing in autism may be caused by a deficit in social attention, and that giving specific cues to attend to the eye-region when performing behavioral therapies aimed at improving social skills may result in a better outcome.     

Visual search for orientation of faces by a chimpanzee (<Emphasis Type="Italic">Pan troglodytes</Emphasis>): face-specific upright superiority and the role of facial configural properties

A previous experiment showed that a chimpanzee performed better in searching for a target human face that differed in orientation from distractors when the target had an upright orientation than when targets had inverted or horizontal orientation [Tomonaga (1999a) Primate Res 15:215–229]. This upright superiority effect was also seen when using chimpanzee faces as targets but not when using photographs of a house. The present study sought to extend these results and explore factors affecting the face-specific upright superiority effect. Upright superiority was shown in a visual search for orientation when caricaturized human faces and dog faces were used as stimuli for the chimpanzee but not when shapes of a hand and chairs were presented. Thus, the configural properties of facial features, which cause an inversion effect in face recognition in humans and chimpanzees, were thought to be a source of the upright superiority effect in the visual search process. To examine this possibility, various stimuli manipulations were introduced in subsequent experiments. The results clearly show that the configuration of facial features plays a critical role in the upright superiority effect, and strongly suggest similarity in face processing in humans and chimpanzees.     

The neuropsychology of face perception: beyond simple dissociations and functional selectivity

Face processing relies on a distributed, patchy network of cortical regions in the temporal and frontal lobes that respond disproportionately to face stimuli, other cortical regions that are not even primarily visual (such as somatosensory cortex), and subcortical structures such as the amygdala. Higher-level face perception abilities, such as judging identity, emotion and trustworthiness, appear to rely on an intact face-processing network that includes the occipital face area (OFA), whereas lower-level face categorization abilities, such as discriminating faces from objects, can be achieved without OFA, perhaps via the direct connections to the fusiform face area (FFA) from several extrastriate cortical areas. Some lesion, transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) findings argue against a strict feed-forward hierarchical model of face perception, in which the OFA is the principal and common source of input for other visual and non-visual cortical regions involved in face perception, including the FFA, face-selective superior temporal sulcus and somatosensory cortex. Instead, these findings point to a more interactive model in which higher-level face perception abilities depend on the interplay between several functionally and anatomically distinct neural regions. Furthermore, the nature of these interactions may depend on the particular demands of the task. We review the lesion and TMS literature on this topic and highlight the dynamic and distributed nature of face processing.     

The evolution of social orienting: evidence from chicks (Gallus gallus) and human newborns

Background

Converging evidence from different species indicates that some newborn vertebrates, including humans, have visual predispositions to attend to the head region of animate creatures. It has been claimed that newborn preferences for faces are domain-relevant and similar in different species. One of the most common criticisms of the work supporting domain-relevant face biases in human newborns is that in most studies they already have several hours of visual experience when tested. This issue can be addressed by testing newly hatched face-naïve chicks (Gallus gallus) whose preferences can be assessed prior to any other visual experience with faces.

Methods

In the present study, for the first time, we test the prediction that both newly hatched chicks and human newborns will demonstrate similar preferences for face stimuli over spatial frequency matched structured noise. Chicks and babies were tested using identical stimuli for the two species. Chicks underwent a spontaneous preference task, in which they have to approach one of two stimuli simultaneously presented at the ends of a runway. Human newborns participated in a preferential looking task.

Results and Significance

We observed a significant preference for orienting toward the face stimulus in both species. Further, human newborns spent more time looking at the face stimulus, and chicks preferentially approached and stood near the face-stimulus. These results confirm the view that widely diverging vertebrates possess similar domain-relevant biases toward faces shortly after hatching or birth and provide a behavioural basis for a comparison with neuroimaging studies using similar stimuli.     

Functional evidence for a dual route to amygdala

The amygdala plays a central role in evaluating the behavioral importance of sensory information. Anatomical subcortical pathways provide direct input to the amygdala from early sensory systems and may support an adaptively valuable rapid appraisal of salient information. However, the functional significance of these subcortical inputs remains controversial. We recorded magnetoencephalographic activity evoked by tones in the context of emotionally valent faces and tested two competing biologically motivated dynamic causal models against these data: the dual and cortical models. The dual model comprised two parallel (cortical and subcortical) routes to the amygdala, whereas the cortical model excluded the subcortical path. We found that neuronal responses elicited by salient information were better explained when a subcortical pathway was included. In keeping with its putative functional role of rapid stimulus appraisal, the subcortical pathway was most important early in stimulus processing. However, as often assumed, its action was not limited to the context of fear, pointing to a more widespread information processing role. Thus, our data supports the idea that an expedited evaluation of sensory input is best explained by an architecture that involves a subcortical path to the amygdala.     

Sensory competition in the face processing areas of the human brain

The concurrent presentation of multiple stimuli in the visual field may trigger mutually suppressive interactions throughout the ventral visual stream. While several studies have been performed on sensory competition effects among non-face stimuli relatively little is known about the interactions in the human brain for multiple face stimuli. In the present study we analyzed the neuronal basis of sensory competition in an event-related functional magnetic resonance imaging (fMRI) study using multiple face stimuli. We varied the ratio of faces and phase-noise images within a composite display with a constant number of peripheral stimuli, thereby manipulating the competitive interactions between faces. For contralaterally presented stimuli we observed strong competition effects in the fusiform face area (FFA) bilaterally and in the right lateral occipital area (LOC), but not in the occipital face area (OFA), suggesting their different roles in sensory competition. When we increased the spatial distance among pairs of faces the magnitude of suppressive interactions was reduced in the FFA. Surprisingly, the magnitude of competition depended on the visual hemifield of the stimuli: ipsilateral stimulation reduced the competition effects somewhat in the right LOC while it increased them in the left LOC. This suggests a left hemifield dominance of sensory competition. Our results support the sensory competition theory in the processing of multiple faces and suggests that sensory competition occurs in several cortical areas in both cerebral hemispheres.     

Face perception: domain specific, not process specific

Evidence that face perception is mediated by special cognitive and neural mechanisms comes from fMRI studies of the fusiform face area (FFA) and behavioral studies of the face inversion effect. Here, we used these two methods to ask whether face perception mechanisms are stimulus specific, process specific, or both. Subjects discriminated pairs of upright or inverted faces or house stimuli that differed in either the spatial distance among parts (configuration) or the shape of the parts. The FFA showed a much higher response to faces than to houses, but no preference for the configuration task over the part task. Similarly, the behavioral inversion effect was as large in the part task as the configuration task for faces, but absent in both part and configuration tasks for houses. These findings indicate that face perception mechanisms are not process specific for parts or configuration but are domain specific for face stimuli per se.     

Evidence against perceptual bias views for symmetry preferences in human faces

Symmetrical human faces are attractive. Two explanations have been proposed to account for symmetry preferences: (i) the evolutionary advantage view, which posits that symmetry advertises mate quality and (ii) the perceptual bias view, which posits that symmetry preferences are a consequence of greater ease of processing symmetrical images in the visual system. Here, we show that symmetry preferences are greater when face images are upright than when inverted. This is evidence against a simple perceptual bias view, which suggests symmetry preference should be constant across orientation about a vertical axis. We also show that symmetry is preferred even in familiar faces, a finding that is unexpected by perceptual bias views positing that symmetry is only attractive because it represents a familiar prototype of that particular class of stimuli.     

Eye-Catching Odors: Olfaction Elicits Sustained Gazing to Faces and Eyes in 4-Month-Old Infants

This study investigated whether an odor can affect infants'' attention to visually presented objects and whether it can selectively direct visual gaze at visual targets as a function of their meaning. Four-month-old infants (n = 48) were exposed to their mother''s body odors while their visual exploration was recorded with an eye-movement tracking system. Two groups of infants, who were assigned to either an odor condition or a control condition, looked at a scene composed of still pictures of faces and cars. As expected, infants looked longer at the faces than at the cars but this spontaneous preference for faces was significantly enhanced in presence of the odor. As expected also, when looking at the face, the infants looked longer at the eyes than at any other facial regions, but, again, they looked at the eyes significantly longer in the presence of the odor. Thus, 4-month-old infants are sensitive to the contextual effects of odors while looking at faces. This suggests that early social attention to faces is mediated by visual as well as non-visual cues.     

Subcortical discrimination of unperceived objects during binocular rivalry

Rapid identification of behaviorally relevant objects is important for survival. In humans, the neural computations for visually discriminating complex objects involve inferior temporal cortex (IT). However, less detailed but faster form processing may also occur in a phylogenetically older subcortical visual system that terminates in the amygdala. We used binocular rivalry to present stimuli without conscious awareness, thereby eliminating the IT object representation and isolating subcortical visual input to the amygdala. Functional magnetic resonance imaging revealed significant brain activation in the left amygdala but not in object-selective IT in response to unperceived fearful faces compared to unperceived nonface objects. These findings indicate that, for certain behaviorally relevant stimuli, a high-level cortical representation in IT is not required for object discrimination in the amygdala.     

A preference for contralateral stimuli in human object- and face-selective cortex

Visual input from the left and right visual fields is processed predominantly in the contralateral hemisphere. Here we investigated whether this preference for contralateral over ipsilateral stimuli is also found in high-level visual areas that are important for the recognition of objects and faces. Human subjects were scanned with functional magnetic resonance imaging (fMRI) while they viewed and attended faces, objects, scenes, and scrambled images in the left or right visual field. With our stimulation protocol, primary visual cortex responded only to contralateral stimuli. The contralateral preference was smaller in object- and face-selective regions, and it was smallest in the fusiform gyrus. Nevertheless, each region showed a significant preference for contralateral stimuli. These results indicate that sensitivity to stimulus position is present even in high-level ventral visual cortex.     

Orientation-contingent face aftereffects and implications for face-coding mechanisms

Humans have an impressive ability to discriminate between faces despite their similarity as visual patterns. This expertise relies on configural coding of spatial relations between face features and/or holistic coding of overall facial structure. These expert face-coding mechanisms appear to be engaged most effectively by upright faces, with inverted faces engaging primarily feature-coding mechanisms. We show that opposite figural aftereffects can be induced simultaneously for upright and inverted faces, demonstrating that distinct neural populations code upright and inverted faces. This result also suggests that expert (upright) face-coding mechanisms can be selectively adapted. These aftereffects occur for judgments of face normality and face gender and are robust to changes in face size, ruling out adaptation of low-level, retinotopically organized coding mechanisms. Our results suggest a resolution of a paradox in the face recognition literature. Neuroimaging studies have found surprisingly little orientation selectivity in the fusiform face area (FFA) despite evidence that this region plays a role in expert face coding and that expert face-coding mechanisms are selectively engaged by upright faces. Our results, demonstrating orientation-contingent adaptation of face-coding mechanisms, suggest that the FFA's apparent lack of orientation selectivity may be an artifact of averaging across distinct populations within the FFA that respond to upright and inverted faces.     

Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance

A subcortical pathway through the superior colliculus and pulvinar to the amygdala is commonly assumed to mediate the non-conscious processing of affective visual stimuli. We review anatomical and physiological data that argue against the notion that such a pathway plays a prominent part in processing affective visual stimuli in humans. Instead, we propose that the primary role of the amygdala in visual processing, like that of the pulvinar, is to coordinate the function of cortical networks during evaluation of the biological significance of affective visual stimuli. Under this revised framework, the cortex has a more important role in emotion processing than is traditionally assumed.     

Face Gender Influences the Looking Preference for Smiling Expressions in 3.5-Month-Old Human Infants

Young infants are typically thought to prefer looking at smiling expressions. Although some accounts suggest that the preference is automatic and universal, we hypothesized that it is not rigid and may be influenced by other face dimensions, most notably the face’s gender. Infants are sensitive to the gender of faces; for example, 3-month-olds raised by female caregivers typically prefer female over male faces. We presented neutral versus smiling pairs of faces from the same female or male individuals to 3.5-month-old infants (n = 25), controlling for low-level cues. Infants looked longer to the smiling face when faces were female but longer to the neutral face when faces were male, i.e., there was an effect of face gender on the looking preference for smiling. The results indicate that a preference for smiling in 3.5-month-olds is limited to female faces, possibly reflective of differential experience with male and female faces.