Spontaneous gender categorization in masking and priming studies: key for distinguishing Jane from John Doe but not Madonna from Sinatra

Facial recognition is key to social interaction, however with unfamiliar faces only generic information, in the form of facial stereotypes such as gender and age is available. Therefore is generic information more prominent in unfamiliar versus familiar face processing? In order to address the question we tapped into two relatively disparate stages of face processing. At the early stages of encoding, we employed perceptual masking to reveal that only perception of unfamiliar face targets is affected by the gender of the facial masks. At the semantic end; using a priming paradigm, we found that while to-be-ignored unfamiliar faces prime lexical decisions to gender congruent stereotypic words, familiar faces do not. Our findings indicate that gender is a more salient dimension in unfamiliar relative to familiar face processing, both in early perceptual stages as well as later semantic stages of person construal.     

Familiar Face Detection in 180ms

The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180ms—very rapid saccades that are 30 to 70ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.     

Abnormal FMRI adaptation to unfamiliar faces in a case of developmental prosopamnesia

In rare cases, damage to the temporal lobe causes a selective impairment in the ability to learn new faces, a condition known as prosopamnesia [1]. Here we present the case of an individual with prosopamnesia in the absence of any acquired structural lesion. "C" shows intact processing of simple and complex nonface objects, but her ability to learn new faces is severely impaired. We used a neural marker of perceptual learning known as repetition suppression to examine functioning within C's fusiform face area (FFA), a region of cortex involved in face perception [2]. For comparison, we examined repetition suppression in the scene-selective parahippocampal place area (PPA) [3]. As expected, normal controls showed significant region-specific attenuation of neural activity across repetitions of each stimulus class. C also showed normal attenuation within the PPA to familiar and unfamiliar scenes, and within the FFA to familiar faces. Critically, however, she failed to show any adaptive change within the FFA for repeated unfamiliar faces, despite a face-specific blood-oxygen-dependent response (BOLD) response in her FFA during viewing of face stimuli. Our findings suggest that in developmental prosopamnesia, the FFA cannot maintain stable representations of new faces for subsequent recall or recognition.     

The development of face processing skills.

An early orientation to faces is followed by a gradual development of face processing skills. During the course of maturation, children acquire the ability to learn new faces and to deal with facial transformations. Some skills are achieved more quickly than others. Moreover, encoding ability in young children is somewhat different from that shown by older children. The younger groups fail to take advantage of increased inspection time and stimulus characteristics such as facial distinctiveness. They are also more likely to be confused by alterations in background context. Although with familiar faces they reveal very similar identity priming effects to older children and adults, younger children display a relative inefficiency in categorizing faces as being that of a target unless it is noticeably dissimilar. Young children are more likely than older people to prefer positive caricatures of certain faces, which is not consistent with the view that caricature effects are simple reflections of a general expertise with faces.     

Lateralization of olfactory cognitive functions: effects of rhinal side of stimulation.

This study investigated differences in olfactory cognitive functions, in 40 healthy young right-handed participants, with respect to side of rhinal stimulation. The targeted functions were: perceived familiarity, episodic recognition memory, free identification and repetition priming in identification. The results showed that odors presented to the right nostril were rated as more familiar than odors presented to the left nostril and also showed significant effects of repetition priming in identification. However, no differences were found between nostrils in episodic recognition memory or free identification. These latter results indicate a rather extensive inter-hemispheric interaction in higher-order cognitive functions.     

Identification and classification of facial familiarity in directed lying: an ERP study

Recognizing familiar faces is essential to social functioning, but little is known about how people identify human faces and classify them in terms of familiarity. Face identification involves discriminating familiar faces from unfamiliar faces, whereas face classification involves making an intentional decision to classify faces as "familiar" or "unfamiliar." This study used a directed-lying task to explore the differentiation between identification and classification processes involved in the recognition of familiar faces. To explore this issue, the participants in this study were shown familiar and unfamiliar faces. They responded to these faces (i.e., as familiar or unfamiliar) in accordance with the instructions they were given (i.e., to lie or to tell the truth) while their EEG activity was recorded. Familiar faces (regardless of lying vs. truth) elicited significantly less negative-going N400f in the middle and right parietal and temporal regions than unfamiliar faces. Regardless of their actual familiarity, the faces that the participants classified as "familiar" elicited more negative-going N400f in the central and right temporal regions than those classified as "unfamiliar." The P600 was related primarily with the facial identification process. Familiar faces (regardless of lying vs. truth) elicited more positive-going P600f in the middle parietal and middle occipital regions. The results suggest that N400f and P600f play different roles in the processes involved in facial recognition. The N400f appears to be associated with both the identification (judgment of familiarity) and classification of faces, while it is likely that the P600f is only associated with the identification process (recollection of facial information). Future studies should use different experimental paradigms to validate the generalizability of the results of this study.     

Recognizing faces

Face recognition is an area where research has increased considerably in recent years, yet theoretical progress has been slow. Here it is argued that by considering the perception and recognition of familiar faces, as well as episodic memory for unfamiliar faces, a functional framework for face recognition can be developed. Experiments using faces, that include tasks analogous to 'visual search' and 'lexical decision' are described, and the processes in operation are compared with those occurring in word recognition. The results allow us to distinguish a number of possible subcomponents for a functional model of face recognition.     

Face Averages Enhance User Recognition for Smartphone Security

Our recognition of familiar faces is excellent, and generalises across viewing conditions. However, unfamiliar face recognition is much poorer. For this reason, automatic face recognition systems might benefit from incorporating the advantages of familiarity. Here we put this to the test using the face verification system available on a popular smartphone (the Samsung Galaxy). In two experiments we tested the recognition performance of the smartphone when it was encoded with an individual’s ‘face-average’ – a representation derived from theories of human face perception. This technique significantly improved performance for both unconstrained celebrity images (Experiment 1) and for real faces (Experiment 2): users could unlock their phones more reliably when the device stored an average of the user’s face than when they stored a single image. This advantage was consistent across a wide variety of everyday viewing conditions. Furthermore, the benefit did not reduce the rejection of imposter faces. This benefit is brought about solely by consideration of suitable representations for automatic face recognition, and we argue that this is just as important as development of matching algorithms themselves. We propose that this representation could significantly improve recognition rates in everyday settings.     

Rhesus monkeys see who they hear: spontaneous cross-modal memory for familiar conspecifics

Rhesus monkeys gather much of their knowledge of the social world through visual input and may preferentially represent this knowledge in the visual modality. Recognition of familiar faces is clearly advantageous, and the flexibility and utility of primate social memory would be greatly enhanced if visual memories could be accessed cross-modally either by visual or auditory stimulation. Such cross-modal access to visual memory would facilitate flexible retrieval of the knowledge necessary for adaptive social behavior. We tested whether rhesus monkeys have cross-modal access to visual memory for familiar conspecifics using a delayed matching-to-sample procedure. Monkeys learned visual matching of video clips of familiar individuals to photographs of those individuals, and generalized performance to novel videos. In crossmodal probe trials, coo-calls were played during the memory interval. The calls were either from the monkey just seen in the sample video clip or from a different familiar monkey. Even though the monkeys were trained exclusively in visual matching, the calls influenced choice by causing an increase in the proportion of errors to the picture of the monkey whose voice was heard on incongruent trials. This result demonstrates spontaneous cross-modal recognition. It also shows that viewing videos of familiar monkeys activates naturally formed memories of real monkeys, validating the use of video stimuli in studies of social cognition in monkeys.     

Dissociation of category versus item priming in face processing: an event-related potential study

The underlying specificity of visual object categorization and discrimination can be elucidated by studying different types of repetition priming. Here we focused on this issue in face processing. We investigated category priming (i.e. the prime and target stimuli represent different exemplars of the same object category) and item priming (i.e. the prime and target stimuli are exactly the same image), using an immediate repetition paradigm. Twenty-three subjects were asked to respond as fast and accurately as possible to categorize whether the target stimulus was a face or a building image, but to ignore the prime stimulus. We recorded event-related potentials (ERPs) and reaction times (RTs) simultaneously. The RT data showed significant effects of category priming in both face trials and building trials, as well as a significant effect of item priming in face trials. With respect to the ERPs, in face trials, no priming effect was observed at the P100 stage, whereas a category priming effect emerged at the N170 stage, and an item priming effect at the P200 stage. In contrast, in building trials, priming effects occurred already at the P100 stage. Our results indicated that distinct neural mechanisms underlie separable kinds of immediate repetition priming in face processing.     

Facial Recognition in a Group-Living Cichlid Fish

The theoretical underpinnings of the mechanisms of sociality, e.g. territoriality, hierarchy, and reciprocity, are based on assumptions of individual recognition. While behavioural evidence suggests individual recognition is widespread, the cues that animals use to recognise individuals are established in only a handful of systems. Here, we use digital models to demonstrate that facial features are the visual cue used for individual recognition in the social fish Neolamprologus pulcher. Focal fish were exposed to digital images showing four different combinations of familiar and unfamiliar face and body colorations. Focal fish attended to digital models with unfamiliar faces longer and from a further distance to the model than to models with familiar faces. These results strongly suggest that fish can distinguish individuals accurately using facial colour patterns. Our observations also suggest that fish are able to rapidly (≤ 0.5 sec) discriminate between familiar and unfamiliar individuals, a speed of recognition comparable to primates including humans.     

Timing and Tuning for Familiarity of Cortical Responses to Faces

Different kinds of known faces activate brain areas to dissimilar degrees. However, the tuning to type of knowledge, and the temporal course of activation, of each area have not been well characterized. Here we measured, with functional magnetic resonance imaging, brain activity elicited by unfamiliar, visually familiar, and personally-familiar faces. We assessed response amplitude and duration using flexible hemodynamic response functions, as well as the tuning to face type, of regions within the face processing system. Core face processing areas (occipital and fusiform face areas) responded to all types of faces with only small differences in amplitude and duration. In contrast, most areas of the extended face processing system (medial orbito-frontal, anterior and posterior cingulate) had weak responses to unfamiliar and visually-familiar faces, but were highly tuned and exhibited prolonged responses to personally-familiar faces. This indicates that the neural processing of different types of familiar faces not only differs in degree, but is probably mediated by qualitatively distinct mechanisms.     

Face pictures reduce behavioural, autonomic, endocrine and neural indices of stress and fear in sheep

Faces are highly emotive stimuli and we find smiling or familiar faces both attractive and comforting, even as young babies. Do other species with sophisticated face recognition skills, such as sheep, also respond to the emotional significance of familiar faces? We report that when sheep experience social isolation, the sight of familiar sheep face pictures compared with those of goats or inverted triangles significantly reduces behavioural (activity and protest vocalizations), autonomic (heart rate) and endocrine (cortisol and adrenaline) indices of stress. They also increase mRNA expression of activity-dependent genes (c-fos and zif/268) in brain regions specialized for processing faces (temporal and medial frontal cortices and basolateral amygdala) and for emotional control (orbitofrontal and cingulate cortex), and reduce their expression in regions associated with stress responses (hypothalamic paraventricular nucleus) and fear (central and lateral amygdala). Effects on face recognition, emotional control and fear centres are restricted to the right brain hemisphere. Results provide evidence that face pictures may be useful for relieving stress caused by unavoidable social isolation in sheep, and possibly other animal species, including humans. The finding that sheep, like humans, appear to have a right brain hemisphere involvement in the control of negative emotional experiences also suggests that functional lateralization of brain emotion systems may be a general feature in mammals.     

Human face recognition in sheep: lack of configurational coding and right hemisphere advantage

Face recognition in sheep is qualitatively similar to that in humans in terms of its left visual field bias, and the effects of expertise and configural coding. The current study was designed to determine whether such effects are species specific by investigating the case of sheep recognising humans. It was found that the sheep could identify human faces and while they showed a small inversion-induced decline in discriminatory performance, this was significantly less than seen with sheep faces. In other aspects, there were qualitative differences with human face recognition compared with conspecific recognition. In contrast with sheep faces there was no left visual field advantage in the recognition of human faces and the internal features were not used at all as visual cues. The data suggest that these sheep, whilst being extensively exposed to interactions with humans, were unable to identify them with all the same 'expert' methods as were used to discriminate other sheep. This suggests that different neural systems may, to some extent, be used for recognition of sheep as opposed to human faces. The relative contribution to differential neural processing of the faces of the different species and the role of expertise are discussed.     

Modelling face recognition.

Much early work in the psychology of face processing was hampered by a failure to think carefully about task demands. Recently our understanding of the processes involved in the recognition of familiar faces has been both encapsulated in, and guided by, functional models of the processes involved in processing and recognizing faces. The specification and predictive power of such theory has been increased with the development of an implemented model, based upon an 'interactive activation and competition' architecture. However, a major deficiency in most accounts of face processing is their failure to spell out the perceptual primitives that form the basis of our representations for faces. Possible representational schemes are discussed, and the potential role of three-dimensional representations of the face is emphasized.     

Do I Have My Attention? Speed of Processing Advantages for the Self-Face Are Not Driven by Automatic Attention Capture

We respond more quickly to our own face than to other faces, but there is debate over whether this is connected to attention-grabbing properties of the self-face. In two experiments, we investigate whether the self-face selectively captures attention, and the attentional conditions under which this might occur. In both experiments, we examined whether different types of face (self, friend, stranger) provide differential levels of distraction when processing self, friend and stranger names. In Experiment 1, an image of a distractor face appeared centrally – inside the focus of attention – behind a target name, with the faces either upright or inverted. In Experiment 2, distractor faces appeared peripherally – outside the focus of attention – in the left or right visual field, or bilaterally. In both experiments, self-name recognition was faster than other name recognition, suggesting a self-referential processing advantage. The presence of the self-face did not cause more distraction in the naming task compared to other types of face, either when presented inside (Experiment 1) or outside (Experiment 2) the focus of attention. Distractor faces had different effects across the two experiments: when presented inside the focus of attention (Experiment 1), self and friend images facilitated self and friend naming, respectively. This was not true for stranger stimuli, suggesting that faces must be robustly represented to facilitate name recognition. When presented outside the focus of attention (Experiment 2), no facilitation occurred. Instead, we report an interesting distraction effect caused by friend faces when processing strangers’ names. We interpret this as a “social importance” effect, whereby we may be tuned to pick out and pay attention to familiar friend faces in a crowd. We conclude that any speed of processing advantages observed in the self-face processing literature are not driven by automatic attention capture.     

The effect of real-world personal familiarity on the speed of face information processing

Background

Previous studies have explored the effects of familiarity on various kinds of visual face judgments, yet the role of familiarity in face processing is not fully understood. Across different face judgments and stimulus sets, the data is equivocal as to whether or not familiarity impacts recognition processes.

Methodology/Principal Findings

Here, we examine the effect of real-world personal familiarity in three simple delayed-match-to-sample tasks in which subjects were required to match faces on the basis of orientation (upright v. inverted), gender and identity. We find that subjects had a significant speed advantage with familiar faces in all three tasks, with large effects for the gender and identity matching tasks.

Conclusion/Significance

Our data indicates that real-world experience with a face exerts a powerful influence on face processing in tasks where identity information is irrelevant, even in tasks that could in principle be solved via low-level cues. These results underscore the importance of experience in shaping visual recognition processes.     

Face Recognition and the Social Individual

Face recognition depends upon the uniqueness of each human face. This is accomplished by the patterns formed by the unique relationship among face features. Unique face-patterns are produced by the intrusion of random factors into the process of biological growth and development. Processes are described which enable a unique face-pattern to be represented as a percept in the visual sensory system. The components of the face recognition system are analyzed as is the manner in which the precept is connected through microcircuits to a memory file so that the history of a perceiver’s encounters with a familiar face enables the perceiver to access a memory store that is a record of the outcome of past encounters with the perceived. The importance of the face recognition system in enabling humans to individuate members the social group is discussed, as well as the importance of face recognition in the development of the individual’s social identity and ability to be a collaborative member of the social groups to which it belongs. The role of prosopagnosia—the inability to recognize familiar faces—in furthering an understanding of the face recognition system is examined, as is its importance in demonstrating the crucial nature of face recognition in human social functions. It is proposed that human face recognition is not a unique phenomenon but is an elaboration of processes existing in nonhuman primates as well as in lower animals.     

Stable face representations

Photographs are often used to establish the identity of an individual or to verify that they are who they claim to be. Yet, recent research shows that it is surprisingly difficult to match a photo to a face. Neither humans nor machines can perform this task reliably. Although human perceivers are good at matching familiar faces, performance with unfamiliar faces is strikingly poor. The situation is no better for automatic face recognition systems. In practical settings, automatic systems have been consistently disappointing. In this review, we suggest that failure to distinguish between familiar and unfamiliar face processing has led to unrealistic expectations about face identification in applied settings. We also argue that a photograph is not necessarily a reliable indicator of facial appearance, and develop our proposal that summary statistics can provide more stable face representations. In particular, we show that image averaging stabilizes facial appearance by diluting aspects of the image that vary between snapshots of the same person. We review evidence that the resulting images can outperform photographs in both behavioural experiments and computer simulations, and outline promising directions for future research.     

Individuation and holistic processing of faces in rhesus monkeys

Despite considerable evidence that neural activity in monkeys reflects various aspects of face perception, relatively little is known about monkeys' face processing abilities. Two characteristics of face processing observed in humans are a subordinate-level entry point, here, the default recognition of faces at the subordinate, rather than basic, level of categorization, and holistic effects, i.e. perception of facial displays as an integrated whole. The present study used an adaptation paradigm to test whether untrained rhesus macaques (Macaca mulatta) display these hallmarks of face processing. In experiments 1 and 2, macaques showed greater rebound from adaptation to conspecific faces than to other animals at the individual or subordinate level. In experiment 3, exchanging only the bottom half of a monkey face produced greater rebound in aligned than in misaligned composites, indicating that for normal, aligned faces, the new bottom half may have influenced the perception of the whole face. Scan path analysis supported this assertion: during rebound, fixation to the unchanged eye region was renewed, but only for aligned stimuli. These experiments show that macaques naturally display the distinguishing characteristics of face processing seen in humans and provide the first clear demonstration that holistic information guides scan paths for conspecific faces.