How Well Do Computer-Generated Faces Tap Face Expertise?

The use of computer-generated (CG) stimuli in face processing research is proliferating due to the ease with which faces can be generated, standardised and manipulated. However there has been surprisingly little research into whether CG faces are processed in the same way as photographs of real faces. The present study assessed how well CG faces tap face identity expertise by investigating whether two indicators of face expertise are reduced for CG faces when compared to face photographs. These indicators were accuracy for identification of own-race faces and the other-race effect (ORE)–the well-established finding that own-race faces are recognised more accurately than other-race faces. In Experiment 1 Caucasian and Asian participants completed a recognition memory task for own- and other-race real and CG faces. Overall accuracy for own-race faces was dramatically reduced for CG compared to real faces and the ORE was significantly and substantially attenuated for CG faces. Experiment 2 investigated perceptual discrimination for own- and other-race real and CG faces with Caucasian and Asian participants. Here again, accuracy for own-race faces was significantly reduced for CG compared to real faces. However the ORE was not affected by format. Together these results signal that CG faces of the type tested here do not fully tap face expertise. Technological advancement may, in the future, produce CG faces that are equivalent to real photographs. Until then caution is advised when interpreting results obtained using CG faces.     

Adults scan own- and other-race faces differently

It is well established that individuals show an other-race effect (ORE) in face recognition: they recognize own-race faces better than other-race faces. The present study tested the hypothesis that individuals would also scan own- and other-race faces differently. We asked Chinese participants to remember Chinese and Caucasian faces and we tested their memory of the faces over five testing blocks. The participants' eye movements were recorded with the use of an eye tracker. The data were analyzed with an Area of Interest approach using the key AOIs of a face (eyes, nose, and mouth). Also, we used the iMap toolbox to analyze the raw data of participants' fixation on each pixel of the entire face. Results from both types of analyses strongly supported the hypothesis. When viewing target Chinese or Caucasian faces, Chinese participants spent a significantly greater proportion of fixation time on the eyes of other-race Caucasian faces than the eyes of own-race Chinese faces. In contrast, they spent a significantly greater proportion of fixation time on the nose and mouth of Chinese faces than the nose and mouth of Caucasian faces. This pattern of differential fixation, for own- and other-race eyes and nose in particular, was consistent even as participants became increasingly familiar with the target faces of both races. The results could not be explained by the perceptual salience of the Chinese nose or Caucasian eyes because these features were not differentially salient across the races. Our results are discussed in terms of the facial morphological differences between Chinese and Caucasian faces and the enculturation of mutual gaze norms in East Asian cultures.     

On the Other Side of the Fence: Effects of Social Categorization and Spatial Grouping on Memory and Attention for Own-Race and Other-Race Faces

The term “own-race bias” refers to the phenomenon that humans are typically better at recognizing faces from their own than a different race. The perceptual expertise account assumes that our face perception system has adapted to the faces we are typically exposed to, equipping it poorly for the processing of other-race faces. Sociocognitive theories assume that other-race faces are initially categorized as out-group, decreasing motivation to individuate them. Supporting sociocognitive accounts, a recent study has reported improved recognition for other-race faces when these were categorized as belonging to the participants'' in-group on a second social dimension, i.e., their university affiliation. Faces were studied in groups, containing both own-race and other-race faces, half of each labeled as in-group and out-group, respectively. When study faces were spatially grouped by race, participants showed a clear own-race bias. When faces were grouped by university affiliation, recognition of other-race faces from the social in-group was indistinguishable from own-race face recognition. The present study aimed at extending this singular finding to other races of faces and participants. Forty Asian and 40 European Australian participants studied Asian and European faces for a recognition test. Faces were presented in groups, containing an equal number of own-university and other-university Asian and European faces. Between participants, faces were grouped either according to race or university affiliation. Eye tracking was used to study the distribution of spatial attention to individual faces in the display. The race of the study faces significantly affected participants'' memory, with better recognition of own-race than other-race faces. However, memory was unaffected by the university affiliation of the faces and by the criterion for their spatial grouping on the display. Eye tracking revealed strong looking biases towards both own-race and own-university faces. Results are discussed in light of the theoretical accounts of the own-race bias.     

The Influence of Shyness on the Scanning of Own- and Other-Race Faces in Adults

The current study explored the relationship between shyness and face scanning patterns for own- and other-race faces in adults. Participants completed a shyness inventory and a face recognition task in which their eye movements were recorded by a Tobii 1750 eye tracker. We found that: (1) Participants’ shyness scores were negatively correlated with the fixation proportion on the eyes, regardless of the race of face they viewed. The shyer the participants were, the less time they spent fixating on the eye region; (2) High shyness participants tended to fixate significantly more than low shyness participants on the regions just below the eyes as if to avoid direct eye contact; (3) When participants were recognizing own-race faces, their shyness scores were positively correlated with the normalized criterion. The shyer they were, the more apt they were to judge the faces as novel, regardless of whether they were target or foil faces. The present results support an avoidance hypothesis of shyness, suggesting that shy individuals tend to avoid directly fixating on others’ eyes, regardless of face race.     

Attentional Prioritization of Infant Faces Is Limited to Own-Race Infants

Background

Recent evidence indicates that infant faces capture attention automatically, presumably to elicit caregiving behavior from adults and leading to greater probability of progeny survival. Elsewhere, evidence demonstrates that people show deficiencies in the processing of other-race relative to own-race faces. We ask whether this other-race effect impacts on attentional attraction to infant faces. Using a dot-probe task to reveal the spatial allocation of attention, we investigate whether other-race infants capture attention.

Principal Findings

South Asian and White participants (young adults aged 18–23 years) responded to a probe shape appearing in a location previously occupied by either an infant face or an adult face; across trials, the race (South Asian/White) of the faces was manipulated. Results indicated that participants were faster to respond to probes that appeared in the same location as infant faces than adult faces, but only on own-race trials.

Conclusions/Significance

Own-race infant faces attract attention, but other-race infant faces do not. Sensitivity to face-specific care-seeking cues in other-race kindenschema may be constrained by interracial contact and experience.     

Own-Race Faces Capture Attention Faster than Other-Race Faces: Evidence from Response Time and the N2pc

Studies have shown that people are better at recognizing human faces from their own-race than from other-races, an effect often termed the Own-Race Advantage. The current study investigates whether there is an Own-Race Advantage in attention and its neural correlates. Participants were asked to search for a human face among animal faces. Experiment 1 showed a classic Own-Race Advantage in response time both for Chinese and Black South African participants. Using event-related potentials (ERPs), Experiment 2 showed a similar Own-Race Advantage in response time for both upright faces and inverted faces. Moreover, the latency of N2pc for own-race faces was earlier than that for other-race faces. These results suggested that own-race faces capture attention more efficiently than other-race faces.     

The Effects of Prediction on the Perception for Own-Race and Other-Race Faces

Human beings do not passively perceive important social features about others such as race and age in social interactions. Instead, it is proposed that humans might continuously generate predictions about these social features based on prior similar experiences. Pre-awareness of racial information conveyed by others'' faces enables individuals to act in “culturally appropriate” ways, which is useful for interpersonal relations in different ethnicity groups. However, little is known about the effects of prediction on the perception for own-race and other-race faces. Here, we addressed this issue using high temporal resolution event-related potential techniques. In total, data from 24 participants (13 women and 11 men) were analyzed. It was found that the N170 amplitudes elicited by other-race faces, but not own-race faces, were significantly smaller in the predictable condition compared to the unpredictable condition, reflecting a switch to holistic processing of other-race faces when those faces were predictable. In this respect, top-down prediction about face race might contribute to the elimination of the other-race effect (one face recognition impairment). Furthermore, smaller P300 amplitudes were observed for the predictable than for unpredictable conditions, which suggested that the prediction of race reduced the neural responses of human brains.     

Eye-Catching Odors: Olfaction Elicits Sustained Gazing to Faces and Eyes in 4-Month-Old Infants

This study investigated whether an odor can affect infants'' attention to visually presented objects and whether it can selectively direct visual gaze at visual targets as a function of their meaning. Four-month-old infants (n = 48) were exposed to their mother''s body odors while their visual exploration was recorded with an eye-movement tracking system. Two groups of infants, who were assigned to either an odor condition or a control condition, looked at a scene composed of still pictures of faces and cars. As expected, infants looked longer at the faces than at the cars but this spontaneous preference for faces was significantly enhanced in presence of the odor. As expected also, when looking at the face, the infants looked longer at the eyes than at any other facial regions, but, again, they looked at the eyes significantly longer in the presence of the odor. Thus, 4-month-old infants are sensitive to the contextual effects of odors while looking at faces. This suggests that early social attention to faces is mediated by visual as well as non-visual cues.     

Perceptual training prevents the emergence of the other race effect during infancy

Experience plays a crucial role in the development of the face processing system. At 6 months of age infants can discriminate individual faces from their own and other races. By 9 months of age this ability to process other-race faces is typically lost, due to minimal experience with other-race faces, and vast exposure to own-race faces, for which infants come to manifest expertise [1]. This is known as the Other Race Effect. In the current study, we demonstrate that exposing Caucasian infants to Chinese faces through perceptual training via picture books for a total of one hour between 6 and 9 months allows Caucasian infants to maintain the ability to discriminate Chinese faces at 9 months of age. The development of the processing of face race can be modified by training, highlighting the importance of early experience in shaping the face representation.     

Sequential Effects in Judgements of Attractiveness: The Influences of Face Race and Sex

In perceptual decision-making, a person’s response on a given trial is influenced by their response on the immediately preceding trial. This sequential effect was initially demonstrated in psychophysical tasks, but has now been found in more complex, real-world judgements. The similarity of the current and previous stimuli determines the nature of the effect, with more similar items producing assimilation in judgements, while less similarity can cause a contrast effect. Previous research found assimilation in ratings of facial attractiveness, and here, we investigated whether this effect is influenced by the social categories of the faces presented. Over three experiments, participants rated the attractiveness of own- (White) and other-race (Chinese) faces of both sexes that appeared successively. Through blocking trials by race (Experiment 1), sex (Experiment 2), or both dimensions (Experiment 3), we could examine how sequential judgements were altered by the salience of different social categories in face sequences. For sequences that varied in sex alone, own-race faces showed significantly less opposite-sex assimilation (male and female faces perceived as dissimilar), while other-race faces showed equal assimilation for opposite- and same-sex sequences (male and female faces were not differentiated). For sequences that varied in race alone, categorisation by race resulted in no opposite-race assimilation for either sex of face (White and Chinese faces perceived as dissimilar). For sequences that varied in both race and sex, same-category assimilation was significantly greater than opposite-category. Our results suggest that the race of a face represents a superordinate category relative to sex. These findings demonstrate the importance of social categories when considering sequential judgements of faces, and also highlight a novel approach for investigating how multiple social dimensions interact during decision-making.     

Differences in Looking at Own- and Other-Race Faces Are Subtle and Analysis-Dependent: An Account of Discrepant Reports

The Other-Race Effect (ORE) is the robust and well-established finding that people are generally poorer at facial recognition of individuals of another race than of their own race. Over the past four decades, much research has focused on the ORE because understanding this phenomenon is expected to elucidate fundamental face processing mechanisms and the influence of experience on such mechanisms. Several recent studies of the ORE in which the eye-movements of participants viewing own- and other-race faces were tracked have, however, reported highly conflicting results regarding the presence or absence of differential patterns of eye-movements to own- versus other-race faces. This discrepancy, of course, leads to conflicting theoretical interpretations of the perceptual basis for the ORE. Here we investigate fixation patterns to own- versus other-race (African and Chinese) faces for Caucasian participants using different analysis methods. While we detect statistically significant, though subtle, differences in fixation pattern using an Area of Interest (AOI) approach, we fail to detect significant differences when applying a spatial density map approach. Though there were no significant differences in the spatial density maps, the qualitative patterns matched the results from the AOI analyses reflecting how, in certain contexts, Area of Interest (AOI) analyses can be more sensitive in detecting the differential fixation patterns than spatial density analyses, due to spatial pooling of data with AOIs. AOI analyses, however, also come with the limitation of requiring a priori specification. These findings provide evidence that the conflicting reports in the prior literature may be at least partially accounted for by the differences in the statistical sensitivity associated with the different analysis methods employed across studies. Overall, our results suggest that detection of differences in eye-movement patterns can be analysis-dependent and rests on the assumptions inherent in the given analysis.     

研究: 异族面孔分类中情绪的调节作用

人们对异族面孔的分类绩效比本族面孔更好,这称作异族分类优势.但面孔异族分类优势是否也和面孔异族效应一样受到情绪的调节作用,尚未可知.本文通过两个实验考察情绪对于面孔种族分类任务的影响.实验一要求40名大学生被试对不同表情面孔(中性,负性,正性)完成种族判断任务,结果发现,正性和负性情绪使年轻人对异族面孔分类变得更慢,削弱了面孔异族分类优势,而且正性情绪对异族分类效应影响更大.实验二以不同情绪加工特点的老年人为被试,发现老年人对负性异族面孔的分类绩效明显更差,负性情绪对异族分类优势的影响更大.这些结果为异族分类优势理论中,异族面孔分类和个体身份加工过程相互制约的潜在假设提供了进一步的支持.     

Non-Threatening Other-Race Faces Capture Visual Attention: Evidence from a Dot-Probe Task

Visual attentional biases towards other-race faces have been attributed to the perceived threat value of such faces. It is possible, however, that they reflect the relative visual novelty of other-race faces. Here we demonstrate an attentional bias to other-race faces in the absence of perceived threat. White participants rated female East Asian faces as no more threatening than female own-race faces. Nevertheless, using a new dot-probe paradigm that can distinguish attentional capture and hold effects, we found that these other-race faces selectively captured visual attention. Importantly, this demonstration challenges previous interpretations of attentional biases to other-race faces as threat responses. Future studies will need to determine whether perceived threat increases attentional biases to other-race faces, beyond the levels seen here.     

Identifiable Images of Bystanders Extracted from Corneal Reflections

Criminal investigations often use photographic evidence to identify suspects. Here we combined robust face perception and high-resolution photography to mine face photographs for hidden information. By zooming in on high-resolution face photographs, we were able to recover images of unseen bystanders from reflections in the subjects'' eyes. To establish whether these bystanders could be identified from the reflection images, we presented them as stimuli in a face matching task (Experiment 1). Accuracy in the face matching task was well above chance (50%), despite the unpromising source of the stimuli. Participants who were unfamiliar with the bystanders'' faces (n = 16) performed at 71% accuracy [t(15) = 7.64, p<.0001, d = 1.91], and participants who were familiar with the faces (n = 16) performed at 84% accuracy [t(15) = 11.15, p<.0001, d = 2.79]. In a test of spontaneous recognition (Experiment 2), observers could reliably name a familiar face from an eye reflection image. For crimes in which the victims are photographed (e.g., hostage taking, child sex abuse), reflections in the eyes of the photographic subject could help to identify perpetrators.     

Perceptual Other-Race Training Reduces Implicit Racial Bias

Background

Implicit racial bias denotes socio-cognitive attitudes towards other-race groups that are exempt from conscious awareness. In parallel, other-race faces are more difficult to differentiate relative to own-race faces – the “Other-Race Effect.” To examine the relationship between these two biases, we trained Caucasian subjects to better individuate other-race faces and measured implicit racial bias for those faces both before and after training.

Methodology/Principal Findings

Two groups of Caucasian subjects were exposed equally to the same African American faces in a training protocol run over 5 sessions. In the individuation condition, subjects learned to discriminate between African American faces. In the categorization condition, subjects learned to categorize faces as African American or not. For both conditions, both pre- and post-training we measured the Other-Race Effect using old-new recognition and implicit racial biases using a novel implicit social measure – the “Affective Lexical Priming Score” (ALPS). Subjects in the individuation condition, but not in the categorization condition, showed improved discrimination of African American faces with training. Concomitantly, subjects in the individuation condition, but not the categorization condition, showed a reduction in their ALPS. Critically, for the individuation condition only, the degree to which an individual subject''s ALPS decreased was significantly correlated with the degree of improvement that subject showed in their ability to differentiate African American faces.

Conclusions/Significance

Our results establish a causal link between the Other-Race Effect and implicit racial bias. We demonstrate that training that ameliorates the perceptual Other-Race Effect also reduces socio-cognitive implicit racial bias. These findings suggest that implicit racial biases are multifaceted, and include malleable perceptual skills that can be modified with relatively little training.     

Cues for early social skills: direct gaze modulates newborns' recognition of talking faces

Previous studies showed that, from birth, speech and eye gaze are two important cues in guiding early face processing and social cognition. These studies tested the role of each cue independently; however, infants normally perceive speech and eye gaze together. Using a familiarization-test procedure, we first familiarized newborn infants (n = 24) with videos of unfamiliar talking faces with either direct gaze or averted gaze. Newborns were then tested with photographs of the previously seen face and of a new one. The newborns looked longer at the face that previously talked to them, but only in the direct gaze condition. These results highlight the importance of both speech and eye gaze as socio-communicative cues by which infants identify others. They suggest that gaze and infant-directed speech, experienced together, are powerful cues for the development of early social skills.     

Dynamic Eye Tracking Based Metrics for Infant Gaze Patterns in the Face-Distractor Competition Paradigm

Objective

To develop new standardized eye tracking based measures and metrics for infants’ gaze dynamics in the face-distractor competition paradigm.

Method

Eye tracking data were collected from two samples of healthy 7-month-old (total n = 45), as well as one sample of 5-month-old infants (n = 22) in a paradigm with a picture of a face or a non-face pattern as a central stimulus, and a geometric shape as a lateral stimulus. The data were analyzed by using conventional measures of infants’ initial disengagement from the central to the lateral stimulus (i.e., saccadic reaction time and probability) and, additionally, novel measures reflecting infants gaze dynamics after the initial disengagement (i.e., cumulative allocation of attention to the central vs. peripheral stimulus).

Results

The results showed that the initial saccade away from the centrally presented stimulus is followed by a rapid re-engagement of attention with the central stimulus, leading to cumulative preference for the central stimulus over the lateral stimulus over time. This pattern tended to be stronger for salient facial expressions as compared to non-face patterns, was replicable across two independent samples of 7-month-old infants, and differentiated between 7 and 5 month-old infants.

Conclusion

The results suggest that eye tracking based assessments of infants’ cumulative preference for faces over time can be readily parameterized and standardized, and may provide valuable techniques for future studies examining normative developmental changes in preference for social signals.

Significance

Standardized measures of early developing face preferences may have potential to become surrogate biomarkers of neurocognitive and social development.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

Lipsmacking Imitation Skill in Newborn Macaques Is Predictive of Social Partner Discrimination

Newborn rhesus macaques imitate facial gestures even after a delay, revealing the flexible nature of their early communicative exchanges. In the present study we examined whether newborn macaques are also sensitive to the identities of the social partners with whom they are interacting. We measured infant monkeys'' (n = 90) lipsmacking and tongue protrusion gestures in a face-to-face interaction task with a human experimenter in the first week of life. After a one-minute delay, the same person who previously presented gestures or a different person returned and presented a still face to infants. We had two primary predictions: (1) infants would demonstrate higher rates of overall gesturing, and especially lipsmacking—an affiliative gesture—to a familiar person, compared to a novel person, and (2) infants'' imitative skills would positively correlate with gestures to familiar, but not unfamiliar, social partners, as both abilities may reflect a strong general social interest. We found that overall infants did not produce more gestures or more lipsmacking when approached by a familiar person compared to a novel person; however, we did find individual differences in infants'' social responsiveness: lipsmacking imitation was positively correlated with lipsmacking during the return period when the person was the same (p = .025), but not when the person was novel (p = .44). These findings are consistent with the notion that imitative skill is reflective of infants'' more general interest in social interactions.     

Super-Memorizers Are Not Super-Recognizers

Humans have a natural expertise in recognizing faces. However, the nature of the interaction between this critical visual biological skill and memory is yet unclear. Here, we had the unique opportunity to test two individuals who have had exceptional success in the World Memory Championships, including several world records in face-name association memory. We designed a range of face processing tasks to determine whether superior/expert face memory skills are associated with distinctive perceptual strategies for processing faces. Superior memorizers excelled at tasks involving associative face-name learning. Nevertheless, they were as impaired as controls in tasks probing the efficiency of the face system: face inversion and the other-race effect. Super memorizers did not show increased hippocampal volumes, and exhibited optimal generic eye movement strategies when they performed complex multi-item face-name associations. Our data show that the visual computations of the face system are not malleable and are robust to acquired expertise involving extensive training of associative memory.