Investigating the Early Stages of Person Perception: The Asymmetry of Social Categorization by Sex vs. Age

Early perceptual operations are central components of the dynamics of social categorization. The wealth of information provided by facial cues presents challenges to our understanding of these early stages of person perception. The current study aimed to uncover the dynamics of processing multiply categorizable faces, notably as a function of their gender and age. Using a modified four-choice version of a mouse-tracking paradigm (which assesses the relative dominance of two categorical dimensions), the relative influence that sex and age have on each other during categorization of infant, younger adult, and older adult faces was investigated. Results of these experiments demonstrate that when sex and age dimensions are simultaneously categorized, only for infant faces does age influence sex categorization. In contrast, the sex of both young and older adults was shown to influence age categorization. The functional implications of these findings are discussed in light of previous person perception research.     

Facial movement varies by sex and is related to attractiveness

Facial movement has received little attention in studies of human attractiveness, yet dynamic displays are an important aspect of courtship in many species. This experiment investigated whether facial movement could be used to identify sex, and whether the ease of identification was associated with attractiveness. We removed shape cues to sex by applying movement from individual faces to a standardised facial model. Participants were able to distinguish between male and female animations of this model at levels above chance. Furthermore, there was a positive association between ease of sex identification and attractiveness for female, but not male, faces. Analysis of facial movement suggested several behaviours that are more frequent in women than men (blinking, tilting, nodding, shaking, and amount of movement). Although some of these behaviours may be cues to sex identification, none alone was directly linked to attractiveness. Our findings suggest that feminine motion is attractive in female faces, but sexually recognisable movement has no clear influence on male attractiveness, in agreement with work on static faces employing composite images.     

Facial resemblance increases the attractiveness of same-sex faces more than other-sex faces

Our reactions to facial self-resemblance could reflect either specialized responses to cues of kinship or by-products of the general perceptual mechanisms of face encoding and mere exposure. The adaptive hypothesis predicts differences in reactions to self-resemblance in mating and prosocial contexts, while the by-product hypothesis does not. Using face images that were digitally transformed to resemble participants, I showed that the effects of resemblance on attractiveness judgements depended on both the sex of the judge and the sex of the face being judged: facial resemblance increased attractiveness judgements of same-sex faces more than other-sex faces, despite the use of identical procedures to manipulate resemblance. A control experiment indicated these effects were caused neither by lower resemblance of other-sex faces than same-sex faces, nor by an increased perception of averageness or familiarity of same-sex faces due to prototyping or mere exposure affecting only same-sex faces. The differential impact of self-resemblance on our perception of same-sex and other-sex faces supports the hypothesis that humans use facial resemblance as a cue of kinship.     

Holistic gaze strategy to categorize facial expression of varying intensities

Using faces representing exaggerated emotional expressions, recent behaviour and eye-tracking studies have suggested a dominant role of individual facial features in transmitting diagnostic cues for decoding facial expressions. Considering that in everyday life we frequently view low-intensity expressive faces in which local facial cues are more ambiguous, we probably need to combine expressive cues from more than one facial feature to reliably decode naturalistic facial affects. In this study we applied a morphing technique to systematically vary intensities of six basic facial expressions of emotion, and employed a self-paced expression categorization task to measure participants' categorization performance and associated gaze patterns. The analysis of pooled data from all expressions showed that increasing expression intensity would improve categorization accuracy, shorten reaction time and reduce number of fixations directed at faces. The proportion of fixations and viewing time directed at internal facial features (eyes, nose and mouth region), however, was not affected by varying levels of intensity. Further comparison between individual facial expressions revealed that although proportional gaze allocation at individual facial features was quantitatively modulated by the viewed expressions, the overall gaze distribution in face viewing was qualitatively similar across different facial expressions and different intensities. It seems that we adopt a holistic viewing strategy to extract expressive cues from all internal facial features in processing of naturalistic facial expressions.     

Looking the part: social status cues shape race perception

It is commonly believed that race is perceived through another's facial features, such as skin color. In the present research, we demonstrate that cues to social status that often surround a face systematically change the perception of its race. Participants categorized the race of faces that varied along White-Black morph continua and that were presented with high-status or low-status attire. Low-status attire increased the likelihood of categorization as Black, whereas high-status attire increased the likelihood of categorization as White; and this influence grew stronger as race became more ambiguous (Experiment 1). When faces with high-status attire were categorized as Black or faces with low-status attire were categorized as White, participants' hand movements nevertheless revealed a simultaneous attraction to select the other race-category response (stereotypically tied to the status cue) before arriving at a final categorization. Further, this attraction effect grew as race became more ambiguous (Experiment 2). Computational simulations then demonstrated that these effects may be accounted for by a neurally plausible person categorization system, in which contextual cues come to trigger stereotypes that in turn influence race perception. Together, the findings show how stereotypes interact with physical cues to shape person categorization, and suggest that social and contextual factors guide the perception of race.     

Facial shape provides a valid cue to sociosexuality in men but not women

Existing work suggests that observers' perceptions of sociosexuality from strangers' faces are positively associated with individuals' self-reported sociosexuality. However it is not clear what cues observers use to form these judgements. Over two studies we examined whether sociosexuality is reflected in faces, which cues contain information about sociosexuality, and whether observers' perceptions of sociosexuality from faces are positively associated with individuals' self-reported sociosexuality. In Study One, Geometric Morphometric Modelling (GMM) analysis of 103 Caucasian participants revealed that self-reported sociosexuality was predicted by facial morphology in male but not female faces. In Study Two, 65 Caucasian participants judged the sociosexuality of opposite sex faces (faces from Study One) at zero acquaintance. Perceived sociosexuality predicted self-reported sociosexuality for men, but not women. Participants were also presented with composites of faces of individuals with more unrestricted sociosexuality paired with composites of faces of individuals with more restricted sociosexuality and asked to indicate which was more unrestricted. Participants selected the more unrestricted sociosexuality male, but not female, facial composites at rates significantly above chance. GMM analyses also found that facial morphology statistically significantly predicted perceived sociosexuality in women's and, to a greater extent, in men's faces. Finally, facial shape mediated the relationship between perceived sociosexuality and self-reported sociosexuality in men's but not women's faces. Our results suggest that facial shape acts as a valid cue to sociosexuality in men's but not women's faces.     

Sequential Effects in Judgements of Attractiveness: The Influences of Face Race and Sex

In perceptual decision-making, a person’s response on a given trial is influenced by their response on the immediately preceding trial. This sequential effect was initially demonstrated in psychophysical tasks, but has now been found in more complex, real-world judgements. The similarity of the current and previous stimuli determines the nature of the effect, with more similar items producing assimilation in judgements, while less similarity can cause a contrast effect. Previous research found assimilation in ratings of facial attractiveness, and here, we investigated whether this effect is influenced by the social categories of the faces presented. Over three experiments, participants rated the attractiveness of own- (White) and other-race (Chinese) faces of both sexes that appeared successively. Through blocking trials by race (Experiment 1), sex (Experiment 2), or both dimensions (Experiment 3), we could examine how sequential judgements were altered by the salience of different social categories in face sequences. For sequences that varied in sex alone, own-race faces showed significantly less opposite-sex assimilation (male and female faces perceived as dissimilar), while other-race faces showed equal assimilation for opposite- and same-sex sequences (male and female faces were not differentiated). For sequences that varied in race alone, categorisation by race resulted in no opposite-race assimilation for either sex of face (White and Chinese faces perceived as dissimilar). For sequences that varied in both race and sex, same-category assimilation was significantly greater than opposite-category. Our results suggest that the race of a face represents a superordinate category relative to sex. These findings demonstrate the importance of social categories when considering sequential judgements of faces, and also highlight a novel approach for investigating how multiple social dimensions interact during decision-making.     

Cross-Cultural Agreement in Facial Attractiveness Preferences: The Role of Ethnicity and Gender

Previous work showed high agreement in facial attractiveness preferences within and across cultures. The aims of the current study were twofold. First, we tested cross-cultural agreement in the attractiveness judgements of White Scottish and Black South African students for own- and other-ethnicity faces. Results showed significant agreement between White Scottish and Black South African observers'' attractiveness judgements, providing further evidence of strong cross-cultural agreement in facial attractiveness preferences. Second, we tested whether cross-cultural agreement is influenced by the ethnicity and/or the gender of the target group. White Scottish and Black South African observers showed significantly higher agreement for Scottish than for African faces, presumably because both groups are familiar with White European facial features, but the Scottish group are less familiar with Black African facial features. Further work investigating this discordance in cross-cultural attractiveness preferences for African faces show that Black South African observers rely more heavily on colour cues when judging African female faces for attractiveness, while White Scottish observers rely more heavily on shape cues. Results also show higher cross-cultural agreement for female, compared to male faces, albeit not significantly higher. The findings shed new light on the factors that influence cross-cultural agreement in attractiveness preferences.     

Impaired Perception of Facial Motion in Autism Spectrum Disorder

Facial motion is a special type of biological motion that transmits cues for socio-emotional communication and enables the discrimination of properties such as gender and identity. We used animated average faces to examine the ability of adults with autism spectrum disorders (ASD) to perceive facial motion. Participants completed increasingly difficult tasks involving the discrimination of (1) sequences of facial motion, (2) the identity of individuals based on their facial motion and (3) the gender of individuals. Stimuli were presented in both upright and upside-down orientations to test for the difference in inversion effects often found when comparing ASD with controls in face perception. The ASD group’s performance was impaired relative to the control group in all three tasks and unlike the control group, the individuals with ASD failed to show an inversion effect. These results point to a deficit in facial biological motion processing in people with autism, which we suggest is linked to deficits in lower level motion processing we have previously reported.     

Facing aggression: cues differ for female versus male faces

The facial width-to-height ratio (face ratio), is a sexually dimorphic metric associated with actual aggression in men and with observers'' judgements of aggression in male faces. Here, we sought to determine if observers'' judgements of aggression were associated with the face ratio in female faces. In three studies, participants rated photographs of female and male faces on aggression, femininity, masculinity, attractiveness, and nurturing. In Studies 1 and 2, for female and male faces, judgements of aggression were associated with the face ratio even when other cues in the face related to masculinity were controlled statistically. Nevertheless, correlations between the face ratio and judgements of aggression were smaller for female than for male faces (F_1,36 = 7.43, p = 0.01). In Study 1, there was no significant relationship between judgements of femininity and of aggression in female faces. In Study 2, the association between judgements of masculinity and aggression was weaker in female faces than for male faces in Study 1. The weaker association in female faces may be because aggression and masculinity are stereotypically male traits. Thus, in Study 3, observers rated faces on nurturing (a stereotypically female trait) and on femininity. Judgements of nurturing were associated with femininity (positively) and masculinity (negatively) ratings in both female and male faces. In summary, the perception of aggression differs in female versus male faces. The sex difference was not simply because aggression is a gendered construct; the relationships between masculinity/femininity and nurturing were similar for male and female faces even though nurturing is also a gendered construct. Masculinity and femininity ratings are not associated with aggression ratings nor with the face ratio for female faces. In contrast, all four variables are highly inter-correlated in male faces, likely because these cues in male faces serve as “honest signals”.     

Facial Expression Training Optimises Viewing Strategy in Children and Adults

This study investigated whether training-related improvements in facial expression categorization are facilitated by spontaneous changes in gaze behaviour in adults and nine-year old children. Four sessions of a self-paced, free-viewing training task required participants to categorize happy, sad and fear expressions with varying intensities. No instructions about eye movements were given. Eye-movements were recorded in the first and fourth training session. New faces were introduced in session four to establish transfer-effects of learning. Adults focused most on the eyes in all sessions and increased expression categorization accuracy after training coincided with a strengthening of this eye-bias in gaze allocation. In children, training-related behavioural improvements coincided with an overall shift in gaze-focus towards the eyes (resulting in more adult-like gaze-distributions) and towards the mouth for happy faces in the second fixation. Gaze-distributions were not influenced by the expression intensity or by the introduction of new faces. It was proposed that training enhanced the use of a uniform, predominantly eyes-biased, gaze strategy in children in order to optimise extraction of relevant cues for discrimination between subtle facial expressions.     

Testosterone-mediated sex differences in the face shape during adolescence: subjective impressions and objective features

Sex identification of a face is essential for social cognition. Still, perceptual cues indicating the sex of a face, and mechanisms underlying their development, remain poorly understood. Previously, our group described objective age- and sex-related differences in faces of healthy male and female adolescents (12–18 years of age), as derived from magnetic resonance images (MRIs) of the adolescents' heads. In this study, we presented these adolescent faces to 60 female raters to determine which facial features most reliably predicted subjective sex identification. Identification accuracy correlated highly with specific MRI-derived facial features (e.g. broader forehead, chin, jaw, and nose). Facial features that most reliably cued male identity were associated with plasma levels of testosterone (above and beyond age). Perceptible sex differences in face shape are thus associated with specific facial features whose emergence may be, in part, driven by testosterone.     

Evidence for adaptive design in human gaze preference

Many studies have investigated the physical cues that influence face preferences. By contrast, relatively few studies have investigated the effects of facial cues to the direction and valence of others' social interest (i.e. gaze direction and facial expressions) on face preferences. Here we found that participants demonstrated stronger preferences for direct gaze when judging the attractiveness of happy faces than that of disgusted faces, and that this effect of expression on the strength of attraction to direct gaze was particularly pronounced for judgements of opposite-sex faces (study 1). By contrast, no such opposite-sex bias in preferences for direct gaze was observed when participants judged the same faces for likeability (study 2). Collectively, these findings for a context-sensitive opposite-sex bias in preferences for perceiver-directed smiles, but not perceiver-directed disgust, suggest gaze preference functions, at least in part, to facilitate efficient allocation of mating effort, and evince adaptive design in the perceptual mechanisms that underpin face preferences.     

Seeing emotion with your ears: emotional prosody implicitly guides visual attention to faces

Interpersonal communication involves the processing of multimodal emotional cues, particularly facial expressions (visual modality) and emotional speech prosody (auditory modality) which can interact during information processing. Here, we investigated whether the implicit processing of emotional prosody systematically influences gaze behavior to facial expressions of emotion. We analyzed the eye movements of 31 participants as they scanned a visual array of four emotional faces portraying fear, anger, happiness, and neutrality, while listening to an emotionally-inflected pseudo-utterance (Someone migged the pazing) uttered in a congruent or incongruent tone. Participants heard the emotional utterance during the first 1250 milliseconds of a five-second visual array and then performed an immediate recall decision about the face they had just seen. The frequency and duration of first saccades and of total looks in three temporal windows ([0-1250 ms], [1250-2500 ms], [2500-5000 ms]) were analyzed according to the emotional content of faces and voices. Results showed that participants looked longer and more frequently at faces that matched the prosody in all three time windows (emotion congruency effect), although this effect was often emotion-specific (with greatest effects for fear). Effects of prosody on visual attention to faces persisted over time and could be detected long after the auditory information was no longer present. These data imply that emotional prosody is processed automatically during communication and that these cues play a critical role in how humans respond to related visual cues in the environment, such as facial expressions.     

Similarities and differences in Chinese and Caucasian adults' use of facial cues for trustworthiness judgments

Background

All cultural groups in the world place paramount value on interpersonal trust. Existing research suggests that although accurate judgments of another''s trustworthiness require extensive interactions with the person, we often make trustworthiness judgments based on facial cues on the first encounter. However, little is known about what facial cues are used for such judgments and what the bases are on which individuals make their trustworthiness judgments.

Methodology/Principal Findings

In the present study, we tested the hypothesis that individuals may use facial attractiveness cues as a “shortcut” for judging another''s trustworthiness due to the lack of other more informative and in-depth information about trustworthiness. Using data-driven statistical models of 3D Caucasian faces, we compared facial cues used for judging the trustworthiness of Caucasian faces by Caucasian participants who were highly experienced with Caucasian faces, and the facial cues used by Chinese participants who were unfamiliar with Caucasian faces. We found that Chinese and Caucasian participants used similar facial cues to judge trustworthiness. Also, both Chinese and Caucasian participants used almost identical facial cues for judging trustworthiness and attractiveness.

Conclusions/Significance

The results suggest that without opportunities to interact with another person extensively, we use the less racially specific and more universal attractiveness cues as a “shortcut” for trustworthiness judgments.     

Sex-contingent face after-effects suggest distinct neural populations code male and female faces

Exposure to faces biases perceptions of subsequently viewed faces. Faces similar to those seen previously are judged more normal and attractive than they were prior to exposure. Here we show sex-contingent after-effects following adaptation to eye-spacing (experiment 1), facial identity (experiment 2) and masculinity (experiment 3). Viewing faces of one sex with increased eye-spacing and faces of the other sex with decreased eye-spacing simultaneously induced opposite after-effects for male and female faces (assessed by normality judgments). Viewing faces transformed in identity or masculinity increased preferences for novel faces with characteristics similar to those viewed only when the sex of the faces presented in the adaptation phase and in post-adaptation preference tests were congruent. Because after-effects reflect changes in responses of neural populations that code faces, our findings indicate that distinct neural populations code male and female faces.     

Depth generalization from stereo to motion parallax in the owl

Although many sources of three-dimensional information have been isolated and demonstrated to contribute independently, to depth vision in animal studies, it is not clear whether these distinct cues are perceived to be perceptually equivalent. Such ability is observed in humans and would seem to be advantageous for animals as well in coping with the often co-varying (or ambiguous) information about the layout of physical space. We introduce the expression primary-depth-cue equivalence to refer to the ability to perceive mutually consistent information about differences in depth from either stereopsis or motion-parallax. We found that owls trained to detect relative depth as a perceptual category (objects versus holes) when specified by binocular disparity alone (stereopsis), immediately transferred this discrimination to novel stimuli where the equivalent depth categories were available only through differences in motion information produced by head movements (observer-produced motion-parallax). Motion-parallax discrimination did occur under monocular viewing conditions and reliable performance depended heavily on the amplitude of side-to-side head movements. The presence of primary-depth-cue equivalence in the visual system of the owl provides further conformation of the hypothesis that neural systems evolved to detect differences in either disparity or motion information are likely to share similar processing mechanisms.     

Non-invasive evaluation of face and motion perception in humans

The neural mechanisms for the perception of face and motion were studied using psychophysical threshold measurements, event-related potentials (ERPs), and functional magnetic resonance imaging (fMRI). A face-specific ERP component, N170, was recorded over the posterior temporal cortex. Removal of the high-spatial-frequency components of the face altered the perception of familiar faces significantly, and familiarity can facilitate the cortico-cortical processing of facial perceptions. Similarly, the high-spatial-frequency components of the face seemed to be crucial for the recognition of facial expressions. Aging and visuospatial impairments affected motion perception significantly. Two distinct components of motion ERPs, N170 and P200, were recorded over the parietal region. The former was related to horizontal motion perception while the latter reflected the perception of radial optic flow motion. The results of fMRI showed that horizontal movements of objects and radial optic flow motion were perceived differently in the V5/MT and superior parietal lobe. We conclude that an integrated approach can provide useful information on spatial and temporal processing of face and motion non-invasively.     

Facial attractiveness: evolutionary based research

Face preferences affect a diverse range of critical social outcomes, from mate choices and decisions about platonic relationships to hiring decisions and decisions about social exchange. Firstly, we review the facial characteristics that influence attractiveness judgements of faces (e.g. symmetry, sexually dimorphic shape cues, averageness, skin colour/texture and cues to personality) and then review several important sources of individual differences in face preferences (e.g. hormone levels and fertility, own attractiveness and personality, visual experience, familiarity and imprinting, social learning). The research relating to these issues highlights flexible, sophisticated systems that support and promote adaptive responses to faces that appear to function to maximize the benefits of both our mate choices and more general decisions about other types of social partners.