The importance of surface-based cues for face discrimination in non-human primates

Understanding how individual identity is processed from faces remains a complex problem. Contrast reversal, showing faces in photographic negative, impairs face recognition in humans and demonstrates the importance of surface-based information (shading and pigmentation) in face recognition. We tested the importance of contrast information for face encoding in chimpanzees and rhesus monkeys using a computerized face-matching task. Results showed that contrast reversal (positive to negative) selectively impaired face processing in these two species, although the impairment was greater for chimpanzees. Unlike chimpanzees, however, monkeys performed just as well matching negative to positive faces, suggesting that they retained some ability to extract identity information from negative faces. A control task showed that chimpanzees, but not rhesus monkeys, performed significantly better matching face parts compared with whole faces after a contrast reversal, suggesting that contrast reversal acts selectively on face processing, rather than general visual-processing mechanisms. These results confirm the importance of surface-based cues for face processing in chimpanzees and humans, while the results were less salient for rhesus monkeys. These findings make a significant contribution to understanding the evolution of cognitive specializations for face processing among primates, and suggest potential differences between monkeys and apes.     

The evolution of face processing in primates

The ability to recognize faces is an important socio-cognitive skill that is associated with a number of cognitive specializations in humans. While numerous studies have examined the presence of these specializations in non-human primates, species where face recognition would confer distinct advantages in social situations, results have been mixed. The majority of studies in chimpanzees support homologous face-processing mechanisms with humans, but results from monkey studies appear largely dependent on the type of testing methods used. Studies that employ passive viewing paradigms, like the visual paired comparison task, report evidence of similarities between monkeys and humans, but tasks that use more stringent, operant response tasks, like the matching-to-sample task, often report species differences. Moreover, the data suggest that monkeys may be less sensitive than chimpanzees and humans to the precise spacing of facial features, in addition to the surface-based cues reflected in those features, information that is critical for the representation of individual identity. The aim of this paper is to provide a comprehensive review of the available data from face-processing tasks in non-human primates with the goal of understanding the evolution of this complex cognitive skill.     

Individual recognition is associated with holistic face processing in Polistes paper wasps in a species-specific way

Most recognition is based on identifying features, but specialization for face recognition in primates relies on a different mechanism, termed ‘holistic processing’ where facial features are bound together into a gestalt which is more than the sum of its parts. Here, we test whether individual face recognition in paper wasps also involved holistic processing using a modification of the classic part-whole test in two related paper wasp species: Polistes fuscatus, which use facial patterns to individually identify conspecifics, and Polistes dominula, which lacks individual recognition. We show that P. fuscatus use holistic processing to discriminate between P. fuscatus face images but not P. dominula face images. By contrast, P. dominula do not rely on holistic processing to discriminate between conspecific or heterospecific face images. Therefore, P. fuscatus wasps have evolved holistic face processing, but this ability is highly specific and shaped by species-specific and stimulus-specific selective pressures. Convergence towards holistic face processing in distant taxa (primates, wasps) as well as divergence among closely related taxa with different recognition behaviour (P. dominula, P. fuscatus) suggests that holistic processing may be a universal adaptive strategy to facilitate expertise in face recognition.     

Taxon‐biased diet preference in the ‘generalist’ beetle‐hunting wasp Cerceris rubida provides insights on the evolution of prey specialization in apoid wasps

Opportunism and specialization appear to be widespread in apoid wasps, although the factors affecting the diet preference (and thus explaining the degree of specialization) are still largely unknown. Four hypotheses that stressed the importance of the size, sex, habitat, and taxonomic identity of prey of the beetle‐hunting digger wasp, Cerceris rubida, were formulated and tested. The wasp population hunted for phytophagous beetles belonging to abundant families around the wasp nesting site. In practice, the prey appeared to be hunted only in two cultivated fields, thus habitat accounted for a majority of the observed diet. The size of wasps was furthermore correlated with the size of their prey, and thus this also accounted for the frequencies of hunted prey and the strong individual specialization for both taxa and size. However, in the exploited habitat, some species were significantly over‐hunted than expected and some other significantly avoided by the wasps, causing an unexpected major role of prey taxon on the probability of being hunted, over the other explanatory variables (body size, body shape, sex, availability). This contrasts to that found in other wasp species, which appear to select prey basing essentially on their ecology and size or their relative abundance (opportunism). The results obtained in the present study show that even an apparent ‘generalist’ predator may turn out to be taxonomically specialized. Together with a re‐evaluation of previous studies, our results further suggest that the effect of size constraints and the developmental plan of prey (holometaboulous versus hemimetabolous) may have promoted either taxonomic opportunism or specialization in different lineages of apoid wasps. © 2010 The Linnean Society of London, Biological Journal of the Linnean Society, 2010, 99 , 544–558.     

Face processing limitation to own species in primates: a comparative study in brown capuchins, Tonkean macaques and humans

Most primates live in social groups which survival and stability depend on individuals' abilities to create strong social relationships with other group members. The existence of those groups requires to identify individuals and to assign to each of them a social status. Individual recognition can be achieved through vocalizations but also through faces. In humans, an efficient system for the processing of own species faces exists. This specialization is achieved through experience with faces of conspecifics during development and leads to the loss of ability to process faces from other primate species. We hypothesize that a similar mechanism exists in social primates. We investigated face processing in one Old World species (genus Macaca) and in one New World species (genus Cebus). Our results show the same advantage for own species face recognition for all tested subjects. This work suggests in all species tested the existence of a common trait inherited from the primate ancestor: an efficient system to identify individual faces of own species only.     

Adaptation improves discrimination of face identity

Whether face adaptation confers any advantages to perceptual processing remains an open question. We investigated whether face adaptation can enhance the ability to make fine discriminations in the vicinity of the adapted face. We compared face discrimination thresholds in three adapting conditions: (i) same-face: where adapting and test faces were the same, (ii) different-face: where adapting and test faces differed, and (iii) baseline: where the adapting stimulus was a blank. Discrimination thresholds for morphed identity changes involving the adapted face (same-face) improved compared with those from both the baseline (no-adaptation) and different-face conditions. Since adapting to a face did not alter discrimination performance for other faces, this effect is selective for the facial identity that is adapted. These results indicate a form of gain control to heighten perceptual sensitivity in the vicinity of a currently viewed face, analogous to forms of adaptive gain control at lower levels of the visual system.     

The Thatcher illusion in humans and monkeys

Primates possess the remarkable ability to differentiate faces of group members and to extract relevant information about the individual directly from the face. Recognition of conspecific faces is achieved by means of holistic processing, i.e. the processing of the face as an unparsed, perceptual whole, rather than as the collection of independent features (part-based processing). The most striking example of holistic processing is the Thatcher illusion. Local changes in facial features are hardly noticeable when the whole face is inverted (rotated 180°), but strikingly grotesque when the face is upright. This effect can be explained by a lack of processing capabilities for locally rotated facial features when the face is turned upside down. Recently, a Thatcher illusion was described in the macaque monkey analogous to that known from human investigations. Using a habituation paradigm combined with eye tracking, we address the critical follow-up questions raised in the aforementioned study to show the Thatcher illusion as a function of the observer''s species (humans and macaques), the stimulus'' species (humans and macaques) and the level of perceptual expertise (novice, expert).     

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.     

Assessing the potential information content of multicomponent visual signals: a machine learning approach

Careful investigation of the form of animal signals can offer novel insights into their function. Here, we deconstruct the face patterns of a tribe of primates, the guenons (Cercopithecini), and examine the information that is potentially available in the perceptual dimensions of their multicomponent displays. Using standardized colour-calibrated images of guenon faces, we measure variation in appearance both within and between species. Overall face pattern was quantified using the computer vision ‘eigenface’ technique, and eyebrow and nose-spot focal traits were described using computational image segmentation and shape analysis. Discriminant function analyses established whether these perceptual dimensions could be used to reliably classify species identity, individual identity, age and sex, and, if so, identify the dimensions that carry this information. Across the 12 species studied, we found that both overall face pattern and focal trait differences could be used to categorize species and individuals reliably, whereas correct classification of age category and sex was not possible. This pattern makes sense, as guenons often form mixed-species groups in which familiar conspecifics develop complex differentiated social relationships but where the presence of heterospecifics creates hybridization risk. Our approach should be broadly applicable to the investigation of visual signal function across the animal kingdom.     

Human face recognition in sheep: lack of configurational coding and right hemisphere advantage

Face recognition in sheep is qualitatively similar to that in humans in terms of its left visual field bias, and the effects of expertise and configural coding. The current study was designed to determine whether such effects are species specific by investigating the case of sheep recognising humans. It was found that the sheep could identify human faces and while they showed a small inversion-induced decline in discriminatory performance, this was significantly less than seen with sheep faces. In other aspects, there were qualitative differences with human face recognition compared with conspecific recognition. In contrast with sheep faces there was no left visual field advantage in the recognition of human faces and the internal features were not used at all as visual cues. The data suggest that these sheep, whilst being extensively exposed to interactions with humans, were unable to identify them with all the same 'expert' methods as were used to discriminate other sheep. This suggests that different neural systems may, to some extent, be used for recognition of sheep as opposed to human faces. The relative contribution to differential neural processing of the faces of the different species and the role of expertise are discussed.     

Individual differences in the ability to recognise facial identity are associated with social anxiety

Previous research has been concerned with the relationship between social anxiety and the recognition of face expression but the question of whether there is a relationship between social anxiety and the recognition of face identity has been neglected. Here, we report the first evidence that social anxiety is associated with recognition of face identity, across the population range of individual differences in recognition abilities. Results showed poorer face identity recognition (on the Cambridge Face Memory Test) was correlated with a small but significant increase in social anxiety (Social Interaction Anxiety Scale) but not general anxiety (State-Trait Anxiety Inventory). The correlation was also independent of general visual memory (Cambridge Car Memory Test) and IQ. Theoretically, the correlation could arise because correct identification of people, typically achieved via faces, is important for successful social interactions, extending evidence that individuals with clinical-level deficits in face identity recognition (prosopagnosia) often report social stress due to their inability to recognise others. Equally, the relationship could arise if social anxiety causes reduced exposure or attention to people's faces, and thus to poor development of face recognition mechanisms.     

The effect of real-world personal familiarity on the speed of face information processing

Background

Previous studies have explored the effects of familiarity on various kinds of visual face judgments, yet the role of familiarity in face processing is not fully understood. Across different face judgments and stimulus sets, the data is equivocal as to whether or not familiarity impacts recognition processes.

Methodology/Principal Findings

Here, we examine the effect of real-world personal familiarity in three simple delayed-match-to-sample tasks in which subjects were required to match faces on the basis of orientation (upright v. inverted), gender and identity. We find that subjects had a significant speed advantage with familiar faces in all three tasks, with large effects for the gender and identity matching tasks.

Conclusion/Significance

Our data indicates that real-world experience with a face exerts a powerful influence on face processing in tasks where identity information is irrelevant, even in tasks that could in principle be solved via low-level cues. These results underscore the importance of experience in shaping visual recognition processes.     

Stable face representations

Photographs are often used to establish the identity of an individual or to verify that they are who they claim to be. Yet, recent research shows that it is surprisingly difficult to match a photo to a face. Neither humans nor machines can perform this task reliably. Although human perceivers are good at matching familiar faces, performance with unfamiliar faces is strikingly poor. The situation is no better for automatic face recognition systems. In practical settings, automatic systems have been consistently disappointing. In this review, we suggest that failure to distinguish between familiar and unfamiliar face processing has led to unrealistic expectations about face identification in applied settings. We also argue that a photograph is not necessarily a reliable indicator of facial appearance, and develop our proposal that summary statistics can provide more stable face representations. In particular, we show that image averaging stabilizes facial appearance by diluting aspects of the image that vary between snapshots of the same person. We review evidence that the resulting images can outperform photographs in both behavioural experiments and computer simulations, and outline promising directions for future research.     

The development of face expertise

Recent neuroimaging studies in adults indicate that visual areas selective for recognition of faces can be recruited through expertise for nonface objects. This reflects a new emphasis on experience in theories of visual specialization. In addition, novel work infers differences between categories of nonface objects, allowing a re-interpretation of differences seen between recognition of faces and objects. Whether there are experience-independent precursors of face expertise remains unclear; indeed, parallels between literature for infants and adults suggest that methodological issues need to be addressed before strong conclusions can be drawn regarding the origins of face recognition.     

Familiar Face Detection in 180ms

The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180ms—very rapid saccades that are 30 to 70ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.     

Imagine Jane and identify John: face identity aftereffects induced by imagined faces

It is not known whether prolonged exposure to perceived and imagined complex visual images produces similar shifts in subsequent perception through selective adaptation. This question is important because a positive finding would suggest that perception and imagery of visual stimuli are mediated by shared neural networks. In this study, we used a selective adaptation procedure designed to induce high-level face-identity aftereffects--a phenomenon in which extended exposure to a particular face facilitates recognition of subsequent faces with opposite features while impairing recognition of all other faces. We report here that adaptation to either real or imagined faces produces a similar shift in perception and that identity boundaries represented in real and imagined faces are equivalent. Together, our results show that identity information contained in imagined and real faces produce similar behavioral outcomes. Our findings of high-level visual aftereffects induced by imagined stimuli can be taken as evidence for the involvement of shared neural networks that mediate perception and imagery of complex visual stimuli.     

Individuation and holistic processing of faces in rhesus monkeys

Despite considerable evidence that neural activity in monkeys reflects various aspects of face perception, relatively little is known about monkeys' face processing abilities. Two characteristics of face processing observed in humans are a subordinate-level entry point, here, the default recognition of faces at the subordinate, rather than basic, level of categorization, and holistic effects, i.e. perception of facial displays as an integrated whole. The present study used an adaptation paradigm to test whether untrained rhesus macaques (Macaca mulatta) display these hallmarks of face processing. In experiments 1 and 2, macaques showed greater rebound from adaptation to conspecific faces than to other animals at the individual or subordinate level. In experiment 3, exchanging only the bottom half of a monkey face produced greater rebound in aligned than in misaligned composites, indicating that for normal, aligned faces, the new bottom half may have influenced the perception of the whole face. Scan path analysis supported this assertion: during rebound, fixation to the unchanged eye region was renewed, but only for aligned stimuli. These experiments show that macaques naturally display the distinguishing characteristics of face processing seen in humans and provide the first clear demonstration that holistic information guides scan paths for conspecific faces.     

Object recognition: holistic representations in the monkey brain

Cognitive-psychological and neuropsychological studies suggest that the human brain processes facial information in a distinct manner, relying on mechanisms that are anatomically and functionally different from those underlying the recognition of other objects. Face recognition, for instance, can be disrupted selectively as a result of localized brain damage, and relies strongly on holistic information rather than on the mere processing of local features. Similarly, in the non-human primate, distinct neocortical and limbic structures have cell populations responding specifically to face stimuli and only weakly to other visual patterns. Moreover, such cells tend to respond to the entire configuration of a face rather than to individual facial features. But are faces the only objects represented in this way? Here I present some evidence suggesting that at least one aspect of facial processing, the processing of holistic information, may be employed by the primate brain when recognizing any arbitrary homogeneous class of even artificial objects, which the monkey has to individually learn, remember, and recognize again and again from among a large number of distractors sharing a number of common features with the target. Acquiring such an expertise can induce configurational selectivity in the response of neurons in the visual system. Our findings suggests that regarding their neural encoding faces are unlikely to be 'special', but they rather are the default 'special class' of the primate visual system.     

EVOLUTION OF IDENTITY SIGNALS: FREQUENCY‐DEPENDENT BENEFITS OF DISTINCTIVE PHENOTYPES USED FOR INDIVIDUAL RECOGNITION

Identifying broad‐scale evolutionary processes that maintain phenotypic polymorphisms has been a major goal of modern evolutionary biology. There are numerous mechanisms, such as negative frequency‐dependent selection, that may maintain polymorphisms, although it is unknown which mechanisms are prominent in nature. Traits used for individual recognition are strikingly variable and have evolved independently in numerous lineages, providing an excellent model to investigate which factors maintain ecologically relevant phenotypic polymorphisms. Theoretical models suggest that individuals may benefit by advertising their identities with distinctive, recognizable phenotypes. Here, we test the benefits of advertising one's identity with a distinctive phenotype. We manipulated the appearance of Polistes fuscatus paper wasp groups so that three individuals had the same appearance and one individual had a unique, easily recognizable appearance. We found that individuals with distinctive appearances received less aggression than individuals with nondistinctive appearances. Therefore, individuals benefit by advertising their identity with a unique phenotype. Our results provide a potential mechanism through which negative frequency‐dependent selection may maintain the polymorphic identity signals in P. fuscatus. Given that recognition is important for many social interactions, selection for distinctive identity signals may be an underappreciated and widespread mechanism underlying the evolution of phenotypic polymorphisms in social taxa.     

Complex social behaviour can select for variability in visual features: a case study in Polistes wasps

The ability to recognize individuals is common in animals; however, we know little about why the phenotypic variability necessary for individual recognition has evolved in some animals but not others. One possibility is that natural selection favours variability in some social contexts but not in others. Polistes fuscatus wasps have variable facial and abdominal markings used for individual recognition within their complex societies. Here, I explore whether social behaviour can select for variability by examining the relationship between social behaviour and variability in visual features (marking variability) across social wasp taxa. Analysis using a concentrated changes test demonstrates that marking variability is significantly associated with nesting strategy. Species with flexible nest-founding strategies have highly variable markings, whereas species without flexible nest-founding strategies have low marking variability. These results suggest that: (i) individual recognition may be widespread in the social wasps, and (ii) natural selection may play a role in the origin and maintenance of the variable distinctive markings. Theoretical and empirical evidence suggests that species with flexible nesting strategies have reproductive transactions, a type of complex social behaviour predicted to require individual recognition. Therefore, the reproductive transactions of flexible species may select for highly variable individuals who are easy to identify as individuals. Further, selection for distinctiveness may provide an alternative explanation for the evolution of phenotypic diversity.