Effects of Caricaturing in Shape or Color on Familiarity Decisions for Familiar and Unfamiliar Faces

Recent evidence suggests that while reflectance information (including color) may be more diagnostic for familiar face recognition, shape may be more diagnostic for unfamiliar face identity processing. Moreover, event-related potential (ERP) findings suggest an earlier onset for neural processing of facial shape compared to reflectance. In the current study, we aimed to explore specifically the roles of facial shape and color in a familiarity decision task using pre-experimentally familiar (famous) and unfamiliar faces that were caricatured either in shape-only, color-only, or both (full; shape + color) by 15%, 30%, or 45%. We recorded accuracies, mean reaction times, and face-sensitive ERPs. Performance data revealed that shape caricaturing facilitated identity processing for unfamiliar faces only. In the ERP data, such effects of shape caricaturing emerged earlier than those of color caricaturing. Unsurprisingly, ERP effects were accentuated for larger levels of caricaturing. Overall, our findings corroborate the importance of shape for identity processing of unfamiliar faces and demonstrate an earlier onset of neural processing for facial shape compared to color.     

Familiar Face Detection in 180ms

The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180ms—very rapid saccades that are 30 to 70ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.     

Identification and classification of facial familiarity in directed lying: an ERP study

Recognizing familiar faces is essential to social functioning, but little is known about how people identify human faces and classify them in terms of familiarity. Face identification involves discriminating familiar faces from unfamiliar faces, whereas face classification involves making an intentional decision to classify faces as "familiar" or "unfamiliar." This study used a directed-lying task to explore the differentiation between identification and classification processes involved in the recognition of familiar faces. To explore this issue, the participants in this study were shown familiar and unfamiliar faces. They responded to these faces (i.e., as familiar or unfamiliar) in accordance with the instructions they were given (i.e., to lie or to tell the truth) while their EEG activity was recorded. Familiar faces (regardless of lying vs. truth) elicited significantly less negative-going N400f in the middle and right parietal and temporal regions than unfamiliar faces. Regardless of their actual familiarity, the faces that the participants classified as "familiar" elicited more negative-going N400f in the central and right temporal regions than those classified as "unfamiliar." The P600 was related primarily with the facial identification process. Familiar faces (regardless of lying vs. truth) elicited more positive-going P600f in the middle parietal and middle occipital regions. The results suggest that N400f and P600f play different roles in the processes involved in facial recognition. The N400f appears to be associated with both the identification (judgment of familiarity) and classification of faces, while it is likely that the P600f is only associated with the identification process (recollection of facial information). Future studies should use different experimental paradigms to validate the generalizability of the results of this study.     

Prioritized Detection of Personally Familiar Faces

We investigated whether personally familiar faces are preferentially processed in conditions of reduced attentional resources and in the absence of conscious awareness. In the first experiment, we used Rapid Serial Visual Presentation (RSVP) to test the susceptibility of familiar faces and faces of strangers to the attentional blink. In the second experiment, we used continuous flash interocular suppression to render stimuli invisible and measured face detection time for personally familiar faces as compared to faces of strangers. In both experiments we found an advantage for detection of personally familiar faces as compared to faces of strangers. Our data suggest that the identity of faces is processed with reduced attentional resources and even in the absence of awareness. Our results show that this facilitated processing of familiar faces cannot be attributed to detection of low-level visual features and that a learned unique configuration of facial features can influence preconscious perceptual processing.     

Timing and Tuning for Familiarity of Cortical Responses to Faces

Different kinds of known faces activate brain areas to dissimilar degrees. However, the tuning to type of knowledge, and the temporal course of activation, of each area have not been well characterized. Here we measured, with functional magnetic resonance imaging, brain activity elicited by unfamiliar, visually familiar, and personally-familiar faces. We assessed response amplitude and duration using flexible hemodynamic response functions, as well as the tuning to face type, of regions within the face processing system. Core face processing areas (occipital and fusiform face areas) responded to all types of faces with only small differences in amplitude and duration. In contrast, most areas of the extended face processing system (medial orbito-frontal, anterior and posterior cingulate) had weak responses to unfamiliar and visually-familiar faces, but were highly tuned and exhibited prolonged responses to personally-familiar faces. This indicates that the neural processing of different types of familiar faces not only differs in degree, but is probably mediated by qualitatively distinct mechanisms.     

Stable face representations

Photographs are often used to establish the identity of an individual or to verify that they are who they claim to be. Yet, recent research shows that it is surprisingly difficult to match a photo to a face. Neither humans nor machines can perform this task reliably. Although human perceivers are good at matching familiar faces, performance with unfamiliar faces is strikingly poor. The situation is no better for automatic face recognition systems. In practical settings, automatic systems have been consistently disappointing. In this review, we suggest that failure to distinguish between familiar and unfamiliar face processing has led to unrealistic expectations about face identification in applied settings. We also argue that a photograph is not necessarily a reliable indicator of facial appearance, and develop our proposal that summary statistics can provide more stable face representations. In particular, we show that image averaging stabilizes facial appearance by diluting aspects of the image that vary between snapshots of the same person. We review evidence that the resulting images can outperform photographs in both behavioural experiments and computer simulations, and outline promising directions for future research.     

Abnormal FMRI adaptation to unfamiliar faces in a case of developmental prosopamnesia

In rare cases, damage to the temporal lobe causes a selective impairment in the ability to learn new faces, a condition known as prosopamnesia [1]. Here we present the case of an individual with prosopamnesia in the absence of any acquired structural lesion. "C" shows intact processing of simple and complex nonface objects, but her ability to learn new faces is severely impaired. We used a neural marker of perceptual learning known as repetition suppression to examine functioning within C's fusiform face area (FFA), a region of cortex involved in face perception [2]. For comparison, we examined repetition suppression in the scene-selective parahippocampal place area (PPA) [3]. As expected, normal controls showed significant region-specific attenuation of neural activity across repetitions of each stimulus class. C also showed normal attenuation within the PPA to familiar and unfamiliar scenes, and within the FFA to familiar faces. Critically, however, she failed to show any adaptive change within the FFA for repeated unfamiliar faces, despite a face-specific blood-oxygen-dependent response (BOLD) response in her FFA during viewing of face stimuli. Our findings suggest that in developmental prosopamnesia, the FFA cannot maintain stable representations of new faces for subsequent recall or recognition.     

Facial Recognition in a Group-Living Cichlid Fish

The theoretical underpinnings of the mechanisms of sociality, e.g. territoriality, hierarchy, and reciprocity, are based on assumptions of individual recognition. While behavioural evidence suggests individual recognition is widespread, the cues that animals use to recognise individuals are established in only a handful of systems. Here, we use digital models to demonstrate that facial features are the visual cue used for individual recognition in the social fish Neolamprologus pulcher. Focal fish were exposed to digital images showing four different combinations of familiar and unfamiliar face and body colorations. Focal fish attended to digital models with unfamiliar faces longer and from a further distance to the model than to models with familiar faces. These results strongly suggest that fish can distinguish individuals accurately using facial colour patterns. Our observations also suggest that fish are able to rapidly (≤ 0.5 sec) discriminate between familiar and unfamiliar individuals, a speed of recognition comparable to primates including humans.     

Investigating the Early Stages of Person Perception: The Asymmetry of Social Categorization by Sex vs. Age

Early perceptual operations are central components of the dynamics of social categorization. The wealth of information provided by facial cues presents challenges to our understanding of these early stages of person perception. The current study aimed to uncover the dynamics of processing multiply categorizable faces, notably as a function of their gender and age. Using a modified four-choice version of a mouse-tracking paradigm (which assesses the relative dominance of two categorical dimensions), the relative influence that sex and age have on each other during categorization of infant, younger adult, and older adult faces was investigated. Results of these experiments demonstrate that when sex and age dimensions are simultaneously categorized, only for infant faces does age influence sex categorization. In contrast, the sex of both young and older adults was shown to influence age categorization. The functional implications of these findings are discussed in light of previous person perception research.     

Effects of Gender and Personality on First Impression

The present study explores whether and to what extent individual differences (i.e., gender and personality traits of perceiver) predict inferences of trustworthiness from emotionally neutral unfamiliar faces and the related confidence in judgment. Four hundred and ten undergraduate students participated in the study. Personality was assessed using the Big Five model (i.e., Extraversion, Neuroticism, Conscientiousness, Agreeableness and Openness to experience) and measures of trait anxiety and aggression. The results suggest that trustworthiness judgments are affected by the gender of the perceiver, although this effect depends on the valence of the face. Women tend to judge trustworthy-looking faces as significantly more trustworthy than men do, and this is particularly pronounced for judgments of female faces. There were no gender differences for judgments of untrustworthy-looking or neutral faces. Gender also seems to affect the confidence in judgment. Specifically, women were generally less confident than men in judging trustworthiness of unfamiliar faces. Personality also affected judgment. Both low agreeable individuals and high trait aggressive individuals tend to perceive unfamiliar faces as less trustworthy. The present findings suggest that both gender and personality traits are relevant for understanding how people evaluate the trustworthiness of others. Whom we decide to trust is a function not only of their facial features but also of gender and individual differences in personality traits.     

The Thatcher illusion in humans and monkeys

Primates possess the remarkable ability to differentiate faces of group members and to extract relevant information about the individual directly from the face. Recognition of conspecific faces is achieved by means of holistic processing, i.e. the processing of the face as an unparsed, perceptual whole, rather than as the collection of independent features (part-based processing). The most striking example of holistic processing is the Thatcher illusion. Local changes in facial features are hardly noticeable when the whole face is inverted (rotated 180°), but strikingly grotesque when the face is upright. This effect can be explained by a lack of processing capabilities for locally rotated facial features when the face is turned upside down. Recently, a Thatcher illusion was described in the macaque monkey analogous to that known from human investigations. Using a habituation paradigm combined with eye tracking, we address the critical follow-up questions raised in the aforementioned study to show the Thatcher illusion as a function of the observer''s species (humans and macaques), the stimulus'' species (humans and macaques) and the level of perceptual expertise (novice, expert).     

Evidence against perceptual bias views for symmetry preferences in human faces

Symmetrical human faces are attractive. Two explanations have been proposed to account for symmetry preferences: (i) the evolutionary advantage view, which posits that symmetry advertises mate quality and (ii) the perceptual bias view, which posits that symmetry preferences are a consequence of greater ease of processing symmetrical images in the visual system. Here, we show that symmetry preferences are greater when face images are upright than when inverted. This is evidence against a simple perceptual bias view, which suggests symmetry preference should be constant across orientation about a vertical axis. We also show that symmetry is preferred even in familiar faces, a finding that is unexpected by perceptual bias views positing that symmetry is only attractive because it represents a familiar prototype of that particular class of stimuli.     

The development of face processing skills.

An early orientation to faces is followed by a gradual development of face processing skills. During the course of maturation, children acquire the ability to learn new faces and to deal with facial transformations. Some skills are achieved more quickly than others. Moreover, encoding ability in young children is somewhat different from that shown by older children. The younger groups fail to take advantage of increased inspection time and stimulus characteristics such as facial distinctiveness. They are also more likely to be confused by alterations in background context. Although with familiar faces they reveal very similar identity priming effects to older children and adults, younger children display a relative inefficiency in categorizing faces as being that of a target unless it is noticeably dissimilar. Young children are more likely than older people to prefer positive caricatures of certain faces, which is not consistent with the view that caricature effects are simple reflections of a general expertise with faces.     

Modelling face recognition.

Much early work in the psychology of face processing was hampered by a failure to think carefully about task demands. Recently our understanding of the processes involved in the recognition of familiar faces has been both encapsulated in, and guided by, functional models of the processes involved in processing and recognizing faces. The specification and predictive power of such theory has been increased with the development of an implemented model, based upon an 'interactive activation and competition' architecture. However, a major deficiency in most accounts of face processing is their failure to spell out the perceptual primitives that form the basis of our representations for faces. Possible representational schemes are discussed, and the potential role of three-dimensional representations of the face is emphasized.     

The 170ms Response to Faces as Measured by MEG (M170) Is Consistently Altered in Congenital Prosopagnosia

Modularity of face processing is still a controversial issue. Congenital prosopagnosia (cPA), a selective and lifelong impairment in familiar face recognition without evidence of an acquired cerebral lesion, offers a unique opportunity to support this fundamental hypothesis. However, in spite of the pronounced behavioural impairment, identification of a functionally relevant neural alteration in congenital prosopagnosia by electrophysiogical methods has not been achieved so far. Here we show that persons with congenital prosopagnosia can be distinguished as a group from unimpaired persons using magnetoencephalography. Early face-selective MEG-responses in the range of 140 to 200ms (the M170) showed prolonged latency and decreased amplitude whereas responses to another category (houses) were indistinguishable between subjects with congenital prosopagnosia and unimpaired controls. Latency and amplitude of face-selective EEG responses (the N170) which were simultaneously recorded were statistically indistinguishable between subjects with cPA and healthy controls which resolves heterogeneous and partly conflicting results from existing studies. The complementary analysis of categorical differences (evoked activity to faces minus evoked activity to houses) revealed that the early part of the 170ms response to faces is altered in subjects with cPA. This finding can be adequately explained in a common framework of holistic and part-based face processing. Whereas a significant brain-behaviour correlation of face recognition performance and the size of the M170 amplitude is found in controls a corresponding correlation is not seen in subjects with cPA. This indicates functional relevance of the alteration found for the 170ms response to faces in cPA and pinpoints the impairment of face processing to early perceptual stages.     

Neural representations of personally familiar and unfamiliar faces in the anterior inferior temporal cortex of monkeys

To investigate the neural representations of faces in primates, particularly in relation to their personal familiarity or unfamiliarity, neuronal activities were chronically recorded from the ventral portion of the anterior inferior temporal cortex (AITv) of macaque monkeys during the performance of a facial identification task using either personally familiar or unfamiliar faces as stimuli. By calculating the correlation coefficients between neuronal responses to the faces for all possible pairs of faces given in the task and then using the coefficients as neuronal population-based similarity measures between the faces in pairs, we analyzed the similarity/dissimilarity relationship between the faces, which were potentially represented by the activities of a population of the face-responsive neurons recorded in the area AITv. The results showed that, for personally familiar faces, different identities were represented by different patterns of activities of the population of AITv neurons irrespective of the view (e.g., front, 90° left, etc.), while different views were not represented independently of their facial identities, which was consistent with our previous report. In the case of personally unfamiliar faces, the faces possessing different identities but presented in the same frontal view were represented as similar, which contrasts with the results for personally familiar faces. These results, taken together, outline the neuronal representations of personally familiar and unfamiliar faces in the AITv neuronal population.     

Asymmetric Engagement of Amygdala and Its Gamma Connectivity in Early Emotional Face Processing

The amygdala has been regarded as a key substrate for emotion processing. However, the engagement of the left and right amygdala during the early perceptual processing of different emotional faces remains unclear. We investigated the temporal profiles of oscillatory gamma activity in the amygdala and effective connectivity of the amygdala with the thalamus and cortical areas during implicit emotion-perceptual tasks using event-related magnetoencephalography (MEG). We found that within 100 ms after stimulus onset the right amygdala habituated to emotional faces rapidly (with duration around 20–30 ms), whereas activity in the left amygdala (with duration around 50–60 ms) sustained longer than that in the right. Our data suggest that the right amygdala could be linked to autonomic arousal generated by facial emotions and the left amygdala might be involved in decoding or evaluating expressive faces in the early perceptual emotion processing. The results of effective connectivity provide evidence that only negative emotional processing engages both cortical and subcortical pathways connected to the right amygdala, representing its evolutional significance (survival). These findings demonstrate the asymmetric engagement of bilateral amygdala in emotional face processing as well as the capability of MEG for assessing thalamo-cortico-limbic circuitry.     

Effect of Familiarity on Reward Anticipation in Children with and without Autism Spectrum Disorders

Background

Previous research on the reward system in autism spectrum disorders (ASD) suggests that children with ASD anticipate and process social rewards differently than typically developing (TD) children—but has focused on the reward value of unfamiliar face stimuli. Children with ASD process faces differently than their TD peers. Previous research has focused on face processing of unfamiliar faces, but less is known about how children with ASD process familiar faces. The current study investigated how children with ASD anticipate rewards accompanied by familiar versus unfamiliar faces.

Methods

The stimulus preceding negativity (SPN) of the event-related potential (ERP) was utilized to measure reward anticipation. Participants were 6- to 10-year-olds with (N = 14) and without (N = 14) ASD. Children were presented with rewards accompanied by incidental face or non-face stimuli that were either familiar (caregivers) or unfamiliar. All non-face stimuli were composed of scrambled face elements in the shape of arrows, controlling for visual properties.

Results

No significant differences between familiar versus unfamiliar faces were found for either group. When collapsing across familiarity, TD children showed larger reward anticipation to face versus non-face stimuli, whereas children with ASD did not show differential responses to these stimulus types. Magnitude of reward anticipation to faces was significantly correlated with behavioral measures of social impairment in the ASD group.

Conclusions

The findings do not provide evidence for differential reward anticipation for familiar versus unfamiliar face stimuli in children with or without ASD. These findings replicate previous work suggesting that TD children anticipate rewards accompanied by social stimuli more than rewards accompanied by non-social stimuli. The results do not support the idea that familiarity normalizes reward anticipation in children with ASD. Our findings also suggest that magnitude of reward anticipation to faces is correlated with levels of social impairment for children with ASD.     

Context modulation of facial emotion perception differed by individual difference

Background

Certain facial configurations are believed to be associated with distinct affective meanings (i.e. basic facial expressions), and such associations are common across cultures (i.e. universality of facial expressions). However, recently, many studies suggest that various types of contextual information, rather than facial configuration itself, are important factor for facial emotion perception.

Methodology/Principal Findings

To examine systematically how contextual information influences individuals’ facial emotion perception, the present study estimated direct observers’ perceptual thresholds for detecting negative facial expressions via a forced-choice psychophysical procedure using faces embedded in various emotional contexts. We additionally measured the individual differences in affective information-processing tendency (BIS/BAS) as a possible factor that may determine the extent to which contextual information on facial emotion perception is used. It was found that contextual information influenced observers'' perceptual thresholds for facial emotion. Importantly, individuals’ affective-information tendencies modulated the extent to which they incorporated context information into their facial emotion perceptions.

Conclusions/Significance

The findings of this study suggest that facial emotion perception not only depends on facial configuration, but the context in which the face appears as well. This contextual influence appeared differently with individual’s characteristics of information processing. In summary, we conclude that individual character traits, as well as facial configuration and the context in which a face appears, need to be taken into consideration regarding facial emotional perception.