The Thatcher illusion in humans and monkeys

Primates possess the remarkable ability to differentiate faces of group members and to extract relevant information about the individual directly from the face. Recognition of conspecific faces is achieved by means of holistic processing, i.e. the processing of the face as an unparsed, perceptual whole, rather than as the collection of independent features (part-based processing). The most striking example of holistic processing is the Thatcher illusion. Local changes in facial features are hardly noticeable when the whole face is inverted (rotated 180°), but strikingly grotesque when the face is upright. This effect can be explained by a lack of processing capabilities for locally rotated facial features when the face is turned upside down. Recently, a Thatcher illusion was described in the macaque monkey analogous to that known from human investigations. Using a habituation paradigm combined with eye tracking, we address the critical follow-up questions raised in the aforementioned study to show the Thatcher illusion as a function of the observer''s species (humans and macaques), the stimulus'' species (humans and macaques) and the level of perceptual expertise (novice, expert).     

Individuation and holistic processing of faces in rhesus monkeys

Despite considerable evidence that neural activity in monkeys reflects various aspects of face perception, relatively little is known about monkeys' face processing abilities. Two characteristics of face processing observed in humans are a subordinate-level entry point, here, the default recognition of faces at the subordinate, rather than basic, level of categorization, and holistic effects, i.e. perception of facial displays as an integrated whole. The present study used an adaptation paradigm to test whether untrained rhesus macaques (Macaca mulatta) display these hallmarks of face processing. In experiments 1 and 2, macaques showed greater rebound from adaptation to conspecific faces than to other animals at the individual or subordinate level. In experiment 3, exchanging only the bottom half of a monkey face produced greater rebound in aligned than in misaligned composites, indicating that for normal, aligned faces, the new bottom half may have influenced the perception of the whole face. Scan path analysis supported this assertion: during rebound, fixation to the unchanged eye region was renewed, but only for aligned stimuli. These experiments show that macaques naturally display the distinguishing characteristics of face processing seen in humans and provide the first clear demonstration that holistic information guides scan paths for conspecific faces.     

Orientation-contingent face aftereffects and implications for face-coding mechanisms

Humans have an impressive ability to discriminate between faces despite their similarity as visual patterns. This expertise relies on configural coding of spatial relations between face features and/or holistic coding of overall facial structure. These expert face-coding mechanisms appear to be engaged most effectively by upright faces, with inverted faces engaging primarily feature-coding mechanisms. We show that opposite figural aftereffects can be induced simultaneously for upright and inverted faces, demonstrating that distinct neural populations code upright and inverted faces. This result also suggests that expert (upright) face-coding mechanisms can be selectively adapted. These aftereffects occur for judgments of face normality and face gender and are robust to changes in face size, ruling out adaptation of low-level, retinotopically organized coding mechanisms. Our results suggest a resolution of a paradox in the face recognition literature. Neuroimaging studies have found surprisingly little orientation selectivity in the fusiform face area (FFA) despite evidence that this region plays a role in expert face coding and that expert face-coding mechanisms are selectively engaged by upright faces. Our results, demonstrating orientation-contingent adaptation of face-coding mechanisms, suggest that the FFA's apparent lack of orientation selectivity may be an artifact of averaging across distinct populations within the FFA that respond to upright and inverted faces.     

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.     

Visual search for orientation of faces by a chimpanzee (<Emphasis Type="Italic">Pan troglodytes</Emphasis>): face-specific upright superiority and the role of facial configural properties

A previous experiment showed that a chimpanzee performed better in searching for a target human face that differed in orientation from distractors when the target had an upright orientation than when targets had inverted or horizontal orientation [Tomonaga (1999a) Primate Res 15:215–229]. This upright superiority effect was also seen when using chimpanzee faces as targets but not when using photographs of a house. The present study sought to extend these results and explore factors affecting the face-specific upright superiority effect. Upright superiority was shown in a visual search for orientation when caricaturized human faces and dog faces were used as stimuli for the chimpanzee but not when shapes of a hand and chairs were presented. Thus, the configural properties of facial features, which cause an inversion effect in face recognition in humans and chimpanzees, were thought to be a source of the upright superiority effect in the visual search process. To examine this possibility, various stimuli manipulations were introduced in subsequent experiments. The results clearly show that the configuration of facial features plays a critical role in the upright superiority effect, and strongly suggest similarity in face processing in humans and chimpanzees.     

Are faces of different species perceived categorically by human observers?

What are the species boundaries of face processing? Using a face-feature morphing algorithm, image series intermediate between human, monkey (macaque), and bovine faces were constructed. Forced-choice judgement of these images showed sharply bounded categories for upright face images of each species. These predicted the perceptual discrimination boundaries for upright monkey-cow and cow-human images, but not human-monkey images. Species categories were also well-judged for inverted face images, but these did not give sharpened discrimination (categorical perception) at the category boundaries. While categorical species judgements are made reliably, only the distinction between primate faces and cow faces appears to be categorically perceived, and only in upright faces. One inference is that humans may judge monkey faces in terms of human characteristics, albeit distinctive ones.     

The Composite Task Reveals Stronger Holistic Processing in Children than Adults for Child Faces

Background

While own-age faces have been reported to be better recognized than other-age faces, the underlying cause of this phenomenon remains unclear. One potential cause is holistic face processing, a special kind of perceptual and cognitive processing reserved for perceiving upright faces. Previous studies have indeed found that adults show stronger holistic processing when looking at adult faces compared to child faces, but whether a similar own-age bias exists in children remains to be shown.

Methodology/Principal Findings

Here we used the composite face task – a standard test of holistic face processing – to investigate if, for child faces, holistic processing is stronger for children than adults. Results showed child participants (8–13 years) had a larger composite effect than adult participants (22–65 years).

Conclusions/Significance

Our finding suggests that differences in strength of holistic processing may underlie the own-age bias on recognition memory. We discuss the origin of own-age biases in terms of relative experience, face-space tuning, and social categorization.     

Adults' awareness of faces follows newborns' looking preferences

From the first days of life, humans preferentially orient towards upright faces, likely reflecting innate subcortical mechanisms. Here, we show that binocular rivalry can reveal face detection mechanisms in adults that are surprisingly similar to inborn face detection mechanism. We used continuous flash suppression (CFS), a variant of binocular rivalry, to render stimuli invisible at the beginning of each trial and measured the time upright and inverted stimuli needed to overcome such interocular suppression. Critically, specific stimulus properties previously shown to modulate looking preferences in neonates similarly modulated adults' awareness of faces presented during CFS. First, the advantage of upright faces in overcoming CFS was strongly modulated by contrast polarity and direction of illumination. Second, schematic patterns consisting of three dark blobs were suppressed for shorter durations when the arrangement of these blobs respected the face-like configuration of the eyes and the mouth, and this effect was modulated by contrast polarity. No such effects were obtained in a binocular control experiment not involving CFS, suggesting a crucial role for face-sensitive mechanisms operating outside of conscious awareness. These findings indicate that visual awareness of faces in adults is governed by perceptual mechanisms that are sensitive to similar stimulus properties as those modulating newborns' face preferences.     

The neural basis of the behavioral face-inversion effect

Two of the most robust markers for "special" face processing are the behavioral face-inversion effect (FIE)-the disproportionate drop in recognition of upside-down (inverted) stimuli relative to upright faces-and the face-selective fMRI response in the fusiform face area (FFA). However, the relationship between these two face-selective markers is unknown. Here we report that the behavioral FIE is closely associated with the fMRI response in the FFA, but not in other face-selective or object-selective regions. The FFA and the face-selective region in the superior temporal sulcus (f_STS), but not the occipital face-selective region (OFA), showed a higher response to upright than inverted faces. However, only in the FFA was this fMRI-FIE positively correlated across subjects with the behavioral FIE. Second, the FFA, but not the f_STS, showed greater neural sensitivity to differences between faces when they were upright than inverted, suggesting a possible neural mechanism for the behavioral FIE. Although a similar trend was found in the occipital face area (OFA), it was less robust than the FFA. Taken together, our data suggest that among the face-selective and object-selective regions, the FFA is a primary neural source of the behavioral FIE.     

Inversion leads to quantitative, not qualitative, changes in face processing

Humans are remarkably adept at recognizing objects across a wide range of views. A notable exception to this general rule is that turning a face upside down makes it particularly difficult to recognize. This striking effect has prompted speculation that inversion qualitatively changes the way faces are processed. Researchers commonly assume that configural cues strongly influence the recognition of upright, but not inverted, faces. Indeed, the assumption is so well accepted that the inversion effect itself has been taken as a hallmark of qualitative processing differences. Here, we took a novel approach to understand the inversion effect. We used response classification to obtain a direct view of the perceptual strategies underlying face discrimination and to determine whether orientation effects can be explained by differential contributions of nonlinear processes. Inversion significantly impaired performance in our face discrimination task. However, surprisingly, observers utilized similar, local regions of faces for discrimination in both upright and inverted face conditions, and the relative contributions of nonlinear mechanisms to performance were similar across orientations. Our results suggest that upright and inverted face processing differ quantitatively, not qualitatively; information is extracted more efficiently from upright faces, perhaps as a by-product of orientation-dependent expertise.     

Discriminating grotesque from typical faces: evidence from the Thatcher illusion

The discrimination of thatcherized faces from typical faces was explored in two simultaneous alternative forced choice tasks. Reaction times (RTs) and errors were measured in a behavioural task. Brain activation was measured in an equivalent fMRI task. In both tasks, participants were tested with upright and inverted faces. Participants were also tested on churches in the behavioural task. The behavioural task confirmed the face specificity of the illusion (by comparing inversion effects for faces against churches) but also demonstrated that the discrimination was primarily, although not exclusively, driven by attending to eyes. The fMRI task showed that, relative to inverted faces, upright grotesque faces are discriminated via activation of a network of emotion/social evaluation processing areas. On the other hand, discrimination of inverted thatcherized faces was associated with increased activation of brain areas that are typically involved in perceptual processing of faces.     

It’s All in the Eyes: Subcortical and Cortical Activation during Grotesqueness Perception in Autism

Atypical face processing plays a key role in social interaction difficulties encountered by individuals with autism. In the current fMRI study, the Thatcher illusion was used to investigate several aspects of face processing in 20 young adults with high-functioning autism spectrum disorder (ASD) and 20 matched neurotypical controls. “Thatcherized” stimuli were modified at either the eyes or the mouth and participants discriminated between pairs of faces while cued to attend to either of these features in upright and inverted orientation. Behavioral data confirmed sensitivity to the illusion and intact configural processing in ASD. Directing attention towards the eyes vs. the mouth in upright faces in ASD led to (1) improved discrimination accuracy; (2) increased activation in areas involved in social and emotional processing; (3) increased activation in subcortical face-processing areas. Our findings show that when explicitly cued to attend to the eyes, activation of cortical areas involved in face processing, including its social and emotional aspects, can be enhanced in autism. This suggests that impairments in face processing in autism may be caused by a deficit in social attention, and that giving specific cues to attend to the eye-region when performing behavioral therapies aimed at improving social skills may result in a better outcome.     

Face inversion reduces the persistence of global form and its neural correlates

Face inversion produces a detrimental effect on face recognition. The extent to which the inversion of faces and other kinds of objects influences the perceptual binding of visual information into global forms is not known. We used a behavioral method and functional MRI (fMRI) to measure the effect of face inversion on visual persistence, a type of perceptual memory that reflects sustained awareness of global form. We found that upright faces persisted longer than inverted versions of the same images; we observed a similar effect of inversion on the persistence of animal stimuli. This effect of inversion on persistence was evident in sustained fMRI activity throughout the ventral visual hierarchy, including the lateral occipital area (LO), two face-selective visual areas--the fusiform face area (FFA) and the occipital face area (OFA)--and several early visual areas. V1 showed the same initial fMRI activation to upright and inverted forms but this activation lasted longer for upright stimuli. The inversion effect on persistence-related fMRI activity in V1 and other retinotopic visual areas demonstrates that higher-tier visual areas influence early visual processing via feedback. This feedback effect on figure-ground processing is sensitive to the orientation of the figure.     

Implicit Processing of the Eyes and Mouth: Evidence from Human Electrophysiology

The current study examined the time course of implicit processing of distinct facial features and the associate event-related potential (ERP) components. To this end, we used a masked priming paradigm to investigate implicit processing of the eyes and mouth in upright and inverted faces, using a prime duration of 33 ms. Two types of prime-target pairs were used: 1. congruent (e.g., open eyes only in both prime and target or open mouth only in both prime and target); 2. incongruent (e.g., open mouth only in prime and open eyes only in target or open eyes only in prime and open mouth only in target). The identity of the faces changed between prime and target. Participants pressed a button when the target face had the eyes open and another button when the target face had the mouth open. The behavioral results showed faster RTs for the eyes in upright faces than the eyes in inverted faces, the mouth in upright and inverted faces. Moreover they also revealed a congruent priming effect for the mouth in upright faces. The ERP findings showed a face orientation effect across all ERP components studied (P1, N1, N170, P2, N2, P3) starting at about 80 ms, and a congruency/priming effect on late components (P2, N2, P3), starting at about 150 ms. Crucially, the results showed that the orientation effect was driven by the eye region (N170, P2) and that the congruency effect started earlier (P2) for the eyes than for the mouth (N2). These findings mark the time course of the processing of internal facial features and provide further evidence that the eyes are automatically processed and that they are very salient facial features that strongly affect the amplitude, latency, and distribution of neural responses to faces.     

Famous faces demand attention due to reduced inhibitory processing

People have particular difficulty ignoring distractors that depict faces. This phenomenon has been attributed to the high level of biological significance that faces carry. The current study aimed to elucidate the mechanism by which faces gain processing priority. We used a focused attention paradigm that tracks the influence of a distractor over time and provides a measure of inhibitory processing. Upright famous faces served as test stimuli and inverted versions of the faces as well as upright non-face objects served as control stimuli. The results revealed that although all of the stimuli elicited similar levels of distraction, only inverted distractor faces and non-face objects elicited inhibitory effects. The lack of inhibitory effects for upright famous faces provides novel evidence that reduced inhibitory processing underlies the mandatory nature of face processing.     

Baboons (Papio papio) spontaneously process the first-order but not second-order configural properties of faces

A two-alternative forced-choice discrimination task was used to assess whether baboons (N=7) spontaneously process qualitative (i.e., first-order) or quantitative (i.e., second-order) variations in the configural arrangement of facial features. Experiment 1 used as test stimuli second-order pictorial faces of humans or baboons in which the mouth and the eyes were rotated upside down relative to the normal face. Baboons readily discriminated two different normal faces but did not discriminate a normal face from its second-order modified version. Experiment 2 used human or baboon faces for which the first-order configural properties had been distorted by reversing the location of the eyes and mouth within the face. Discrimination was prompt with these stimuli. Experiment 3 replicated some of the conditions and the results of experiment 1, thus ruling out possible effects of learning. It is concluded that baboons are more adept at spontaneously processing first- than second-order configural facial properties, similar to what is known in the human developmental literature.     

Higher-level mechanisms detect facial symmetry

The role of symmetry detection in early visual processing and the sensitivity of biological visual systems to symmetry across a wide range of organisms suggest that symmetry can be detected by low-level visual mechanisms. However, computational and functional considerations suggest that higher-level mechanisms may also play a role in facial symmetry detection. We tested this hypothesis by examining whether symmetry detection is better for faces than comparable patterns, which share low-level properties with faces. Symmetry detection was better for upright faces than for inverted faces (experiment 1) and contrast-reversed faces (experiment 2), implicating high-level mechanisms in facial symmetry detection. In addition, facial symmetry detection was sensitive to spatial scale, unlike low-level symmetry detection mechanisms (experiment 3), and showed greater sensitivity to a 45 degrees deviation from vertical than is found for other aspects of face perception (experiment 4). These results implicate specialized, higher-level mechanisms in the detection of facial symmetry. This specialization may reflect perceptual learning resulting from extensive experience detecting symmetry in faces or evolutionary selection pressures associated with the important role of facial symmetry in mate choice and 'mind-reading' or both.     

The hatching larva of the priapulid worm Halicryptus spinulosus

Background

Faces, as socially relevant stimuli, readily capture human visuospatial attention. Although faces also play important roles in the social lives of chimpanzees, the closest living species to humans, the way in which faces are attentionally processed remains unclear from a comparative-cognitive perspective. In the present study, three young chimpanzees (Pan troglodytes) were tested with a simple manual response task in which various kinds of photographs, including faces as non-informative cues, were followed by a target.

Results

When the target appeared at the location that had been occupied by the face immediately before target onset, response times were significantly faster than when the target appeared at the opposite location that had been by the other object. Such an advantage was not observed when a photograph of a banana was paired with the other object. Furthermore, this attentional capture was also observed when upright human faces were presented, indicating that this effect is not limited to own-species faces. On the contrary, when the participants were tested with inverted chimpanzee faces, this effect was rather weakened, suggesting the specificity to upright faces.

Conclusion

Chimpanzee's visuospatial attention was easily captured by the face stimuli. This effect was face specific and stronger for upright faces than inverted. These results are consistent with those from typically developing humans.     

Evidence against perceptual bias views for symmetry preferences in human faces

Symmetrical human faces are attractive. Two explanations have been proposed to account for symmetry preferences: (i) the evolutionary advantage view, which posits that symmetry advertises mate quality and (ii) the perceptual bias view, which posits that symmetry preferences are a consequence of greater ease of processing symmetrical images in the visual system. Here, we show that symmetry preferences are greater when face images are upright than when inverted. This is evidence against a simple perceptual bias view, which suggests symmetry preference should be constant across orientation about a vertical axis. We also show that symmetry is preferred even in familiar faces, a finding that is unexpected by perceptual bias views positing that symmetry is only attractive because it represents a familiar prototype of that particular class of stimuli.     

Do I Have My Attention? Speed of Processing Advantages for the Self-Face Are Not Driven by Automatic Attention Capture

We respond more quickly to our own face than to other faces, but there is debate over whether this is connected to attention-grabbing properties of the self-face. In two experiments, we investigate whether the self-face selectively captures attention, and the attentional conditions under which this might occur. In both experiments, we examined whether different types of face (self, friend, stranger) provide differential levels of distraction when processing self, friend and stranger names. In Experiment 1, an image of a distractor face appeared centrally – inside the focus of attention – behind a target name, with the faces either upright or inverted. In Experiment 2, distractor faces appeared peripherally – outside the focus of attention – in the left or right visual field, or bilaterally. In both experiments, self-name recognition was faster than other name recognition, suggesting a self-referential processing advantage. The presence of the self-face did not cause more distraction in the naming task compared to other types of face, either when presented inside (Experiment 1) or outside (Experiment 2) the focus of attention. Distractor faces had different effects across the two experiments: when presented inside the focus of attention (Experiment 1), self and friend images facilitated self and friend naming, respectively. This was not true for stranger stimuli, suggesting that faces must be robustly represented to facilitate name recognition. When presented outside the focus of attention (Experiment 2), no facilitation occurred. Instead, we report an interesting distraction effect caused by friend faces when processing strangers’ names. We interpret this as a “social importance” effect, whereby we may be tuned to pick out and pay attention to familiar friend faces in a crowd. We conclude that any speed of processing advantages observed in the self-face processing literature are not driven by automatic attention capture.