Young infants' neural processing of objects is affected by eye gaze direction and emotional expression

Eye gaze is an important social cue which is used to determine another person's focus of attention and intention to communicate. In combination with a fearful facial expression eye gaze can also signal threat in the environment. The ability to detect and understand others' social signals is essential in order to avoid danger and enable social evaluation. It has been a matter of debate when infants are able to use gaze cues and emotional facial expressions in reference to external objects. Here we demonstrate that by 3 months of age the infant brain differentially responds to objects as a function of how other people are reacting to them. Using event-related electrical brain potentials (ERPs), we show that an indicator of infants' attention is enhanced by an adult's expression of fear toward an unfamiliar object. The infant brain showed an increased Negative central (Nc) component toward objects that had been previously cued by an adult's eye gaze and frightened facial expression. Our results further suggest that infants' sensitivity cannot be due to a general arousal elicited by a frightened face with eye gaze directed at an object. The neural attention system of 3 month old infants is sensitive to an adult's eye gaze direction in combination with a fearful expression. This early capacity may lay the foundation for the development of more sophisticated social skills such as social referencing, language, and theory of mind.     

Caucasian infants scan own- and other-race faces differently

Young infants are known to prefer own-race faces to other race faces and recognize own-race faces better than other-race faces. However, it is entirely unclear as to whether infants also attend to different parts of own- and other-race faces differently, which may provide an important clue as to how and why the own-race face recognition advantage emerges so early. The present study used eye tracking methodology to investigate whether 6- to 10-month-old Caucasian infants (N = 37) have differential scanning patterns for dynamically displayed own- and other-race faces. We found that even though infants spent a similar amount of time looking at own- and other-race faces, with increased age, infants increasingly looked longer at the eyes of own-race faces and less at the mouths of own-race faces. These findings suggest experience-based tuning of the infant''s face processing system to optimally process own-race faces that are different in physiognomy from other-race faces. In addition, the present results, taken together with recent own- and other-race eye tracking findings with infants and adults, provide strong support for an enculturation hypothesis that East Asians and Westerners may be socialized to scan faces differently due to each culture''s conventions regarding mutual gaze during interpersonal communication.     

Eye-Catching Odors: Olfaction Elicits Sustained Gazing to Faces and Eyes in 4-Month-Old Infants

This study investigated whether an odor can affect infants'' attention to visually presented objects and whether it can selectively direct visual gaze at visual targets as a function of their meaning. Four-month-old infants (n = 48) were exposed to their mother''s body odors while their visual exploration was recorded with an eye-movement tracking system. Two groups of infants, who were assigned to either an odor condition or a control condition, looked at a scene composed of still pictures of faces and cars. As expected, infants looked longer at the faces than at the cars but this spontaneous preference for faces was significantly enhanced in presence of the odor. As expected also, when looking at the face, the infants looked longer at the eyes than at any other facial regions, but, again, they looked at the eyes significantly longer in the presence of the odor. Thus, 4-month-old infants are sensitive to the contextual effects of odors while looking at faces. This suggests that early social attention to faces is mediated by visual as well as non-visual cues.     

Perception of Social Cues of Danger in Autism Spectrum Disorders

Intuitive grasping of the meaning of subtle social cues is particularly affected in autism spectrum disorders (ASD). Despite their relevance in social communication, the effect of averted gaze in fearful faces in conveying a signal of environmental threat has not been investigated using real face stimuli in adults with ASD. Here, using functional MRI, we show that briefly presented fearful faces with averted gaze, previously shown to be a strong communicative signal of environmental danger, produce different patterns of brain activation than fearful faces with direct gaze in a group of 26 normally intelligent adults with ASD compared with 26 matched controls. While implicit cue of threat produces brain activation in attention, emotion processing and mental state attribution networks in controls, this effect is absent in individuals with ASD. Instead, individuals with ASD show activation in the subcortical face-processing system in response to direct eye contact. An effect of differences in looking behavior was excluded in a separate eye tracking experiment. Our data suggest that individuals with ASD are more sensitive to direct eye contact than to social signals of danger conveyed by averted fearful gaze.     

Dynamic Eye Tracking Based Metrics for Infant Gaze Patterns in the Face-Distractor Competition Paradigm

Objective

To develop new standardized eye tracking based measures and metrics for infants’ gaze dynamics in the face-distractor competition paradigm.

Method

Eye tracking data were collected from two samples of healthy 7-month-old (total n = 45), as well as one sample of 5-month-old infants (n = 22) in a paradigm with a picture of a face or a non-face pattern as a central stimulus, and a geometric shape as a lateral stimulus. The data were analyzed by using conventional measures of infants’ initial disengagement from the central to the lateral stimulus (i.e., saccadic reaction time and probability) and, additionally, novel measures reflecting infants gaze dynamics after the initial disengagement (i.e., cumulative allocation of attention to the central vs. peripheral stimulus).

Results

The results showed that the initial saccade away from the centrally presented stimulus is followed by a rapid re-engagement of attention with the central stimulus, leading to cumulative preference for the central stimulus over the lateral stimulus over time. This pattern tended to be stronger for salient facial expressions as compared to non-face patterns, was replicable across two independent samples of 7-month-old infants, and differentiated between 7 and 5 month-old infants.

Conclusion

The results suggest that eye tracking based assessments of infants’ cumulative preference for faces over time can be readily parameterized and standardized, and may provide valuable techniques for future studies examining normative developmental changes in preference for social signals.

Significance

Standardized measures of early developing face preferences may have potential to become surrogate biomarkers of neurocognitive and social development.     

Gaze following in human infants depends on communicative signals

Humans are extremely sensitive to ostensive signals, like eye contact or having their name called, that indicate someone's communicative intention toward them [1-3]. Infants also pay attention to these signals [4-6], but it is unknown whether they appreciate their significance in the initiation of communicative acts. In two experiments, we employed video presentation of an actor turning toward one of two objects and recorded infants' gaze-following behavior [7-13] with eye-tracking techniques [11, 12]. We found that 6-month-old infants followed the adult's gaze (a potential communicative-referential signal) toward an object only when such an act is preceded by ostensive cues such as direct gaze (experiment 1) and infant-directed speech (experiment 2). Such a link between the presence of ostensive signals and gaze following suggests that this behavior serves a functional role in assisting infants to effectively respond to referential communication directed to them. Whereas gaze following in many nonhuman species supports social information gathering [14-18], in humans it initially appears to reflect the expectation of a more active, communicative role from the information source.     

Evidence for adaptive design in human gaze preference

Many studies have investigated the physical cues that influence face preferences. By contrast, relatively few studies have investigated the effects of facial cues to the direction and valence of others' social interest (i.e. gaze direction and facial expressions) on face preferences. Here we found that participants demonstrated stronger preferences for direct gaze when judging the attractiveness of happy faces than that of disgusted faces, and that this effect of expression on the strength of attraction to direct gaze was particularly pronounced for judgements of opposite-sex faces (study 1). By contrast, no such opposite-sex bias in preferences for direct gaze was observed when participants judged the same faces for likeability (study 2). Collectively, these findings for a context-sensitive opposite-sex bias in preferences for perceiver-directed smiles, but not perceiver-directed disgust, suggest gaze preference functions, at least in part, to facilitate efficient allocation of mating effort, and evince adaptive design in the perceptual mechanisms that underpin face preferences.     

Speaking and Listening with the Eyes: Gaze Signaling during Dyadic Interactions

Cognitive scientists have long been interested in the role that eye gaze plays in social interactions. Previous research suggests that gaze acts as a signaling mechanism and can be used to control turn-taking behaviour. However, early research on this topic employed methods of analysis that aggregated gaze information across an entire trial (or trials), which masks any temporal dynamics that may exist in social interactions. More recently, attempts have been made to understand the temporal characteristics of social gaze but little research has been conducted in a natural setting with two interacting participants. The present study combines a temporally sensitive analysis technique with modern eye tracking technology to 1) validate the overall results from earlier aggregated analyses and 2) provide insight into the specific moment-to-moment temporal characteristics of turn-taking behaviour in a natural setting. Dyads played two social guessing games (20 Questions and Heads Up) while their eyes were tracked. Our general results are in line with past aggregated data, and using cross-correlational analysis on the specific gaze and speech signals of both participants we found that 1) speakers end their turn with direct gaze at the listener and 2) the listener in turn begins to speak with averted gaze. Convergent with theoretical models of social interaction, our data suggest that eye gaze can be used to signal both the end and the beginning of a speaking turn during a social interaction. The present study offers insight into the temporal dynamics of live dyadic interactions and also provides a new method of analysis for eye gaze data when temporal relationships are of interest.     

Predicting Aggressive Tendencies by Visual Attention Bias Associated with Hostile Emotions

The goal of the current study is to clarify the relationship between social information processing (e.g., visual attention to cues of hostility, hostility attribution bias, and facial expression emotion labeling) and aggressive tendencies. Thirty adults were recruited in the eye-tracking study that measured various components in social information processing. Baseline aggressive tendencies were measured using the Buss-Perry Aggression Questionnaire (AQ). Visual attention towards hostile objects was measured as the proportion of eye gaze fixation duration on cues of hostility. Hostility attribution bias was measured with the rating results for emotions of characters in the images. The results show that the eye gaze duration on hostile characters was significantly inversely correlated with the AQ score and less eye contact with an angry face. The eye gaze duration on hostile object was not significantly associated with hostility attribution bias, although hostility attribution bias was significantly positively associated with the AQ score. Our findings suggest that eye gaze fixation time towards non-hostile cues may predict aggressive tendencies.     

Dogs' gaze following is tuned to human communicative signals

Recent evidence suggests that preverbal infants' gaze following can be triggered only if an actor's head turn is preceded by the expression of communicative intent [1]. Such connectedness between ostensive and referential signals may be uniquely human, enabling infants to effectively respond to referential communication directed to them. In the light of increasing evidence of dogs' social communicative skills [2], an intriguing question is whether dogs' responsiveness to human directional gestures [3] is associated with the situational context in an infant-like manner. Borrowing a method used in infant studies [1], dogs watched video presentations of a human actor turning toward one of two objects, and their eye-gaze patterns were recorded with an eye tracker. Results show a higher tendency of gaze following in dogs when the human's head turning was preceded by the expression of communicative intent (direct gaze, addressing). This is the first evidence to show that (1) eye-tracking techniques can be used for studying dogs' social skills and (2) the exploitation of human gaze cues depends on the communicatively relevant pattern of ostensive and referential signals in dogs. Our findings give further support to the existence of a functionally infant-analog social competence in this species.     

Differential sensitivity to conspecific and allospecific cues in chimpanzees and humans: a comparative eye-tracking study

Previous studies have shown that a variety of animals including humans are sensitive to social cues from others and shift their attention to the same objects attended to by others. However, little is known about how animals process conspecifics'' and another species'' actions, although primates recognize conspecific faces better than those of another species. In this study, using unrestrained eye-tracking techniques, we first demonstrated that conspecific social cues modulated looking behaviours of chimpanzees more than human cues, whereas human observers were equally sensitive to both species. Additionally, first pass gaze duration at the face indicates that chimpanzees looked at the chimpanzees'' face longer than the human face, suggesting that chimpanzees might extract more referential information from a conspecific face. These results also imply that a unique ability for extracting referential information from a variety of social objects has emerged during human evolution.     

Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis

As compared with other primates, humans have especially visible eyes (e.g., white sclera). One hypothesis is that this feature of human eyes evolved to make it easier for conspecifics to follow an individual's gaze direction in close-range joint attentional and communicative interactions, which would seem to imply especially cooperative (mututalistic) conspecifics. In the current study, we tested one aspect of this cooperative eye hypothesis by comparing the gaze following behavior of great apes to that of human infants. A human experimenter "looked" to the ceiling either with his eyes only, head only (eyes closed), both head and eyes, or neither. Great apes followed gaze to the ceiling based mainly on the human's head direction (although eye direction played some role as well). In contrast, human infants relied almost exclusively on eye direction in these same situations. These results demonstrate that humans are especially reliant on eyes in gaze following situations, and thus, suggest that eyes evolved a new social function in human evolution, most likely to support cooperative (mututalistic) social interactions.     

Lipsmacking Imitation Skill in Newborn Macaques Is Predictive of Social Partner Discrimination

Newborn rhesus macaques imitate facial gestures even after a delay, revealing the flexible nature of their early communicative exchanges. In the present study we examined whether newborn macaques are also sensitive to the identities of the social partners with whom they are interacting. We measured infant monkeys'' (n = 90) lipsmacking and tongue protrusion gestures in a face-to-face interaction task with a human experimenter in the first week of life. After a one-minute delay, the same person who previously presented gestures or a different person returned and presented a still face to infants. We had two primary predictions: (1) infants would demonstrate higher rates of overall gesturing, and especially lipsmacking—an affiliative gesture—to a familiar person, compared to a novel person, and (2) infants'' imitative skills would positively correlate with gestures to familiar, but not unfamiliar, social partners, as both abilities may reflect a strong general social interest. We found that overall infants did not produce more gestures or more lipsmacking when approached by a familiar person compared to a novel person; however, we did find individual differences in infants'' social responsiveness: lipsmacking imitation was positively correlated with lipsmacking during the return period when the person was the same (p = .025), but not when the person was novel (p = .44). These findings are consistent with the notion that imitative skill is reflective of infants'' more general interest in social interactions.     

线索有效性对社会性注意和外源性注意的影响

目的 眼睛注视、头朝向和生物运动方向等社会性线索,对人类的生存和社会交互极为重要.由于社会性线索和外周线索都具有反射性注意定向这一特点,社会性注意往往也被认为属于外源性注意.但是,外源性注意并不能完全解释所有的社会性注意现象.因此,两者是否具有相同的加工机制,尚存在争论.方法 本研究使用空间线索范式,系统考察了线索有效...     

Early cortical specialization for face-to-face communication in human infants

This study examined the brain bases of early human social cognitive abilities. Specifically, we investigated whether cortical regions implicated in adults' perception of facial communication signals are functionally active in early human development. Four-month-old infants watched two kinds of dynamic scenarios in which a face either established mutual gaze or averted its gaze, both of which were followed by an eyebrow raise with accompanying smile. Haemodynamic responses were measured by near-infrared spectroscopy, permitting spatial localization of brain activation (experiment 1), and gamma-band oscillatory brain activity was analysed from electroencephalography to provide temporal information about the underlying cortical processes (experiment 2). The results revealed that perceiving facial communication signals activates areas in the infant temporal and prefrontal cortex that correspond to the brain regions implicated in these processes in adults. In addition, mutual gaze itself, and the eyebrow raise with accompanying smile in the context of mutual gaze, produce similar cortical activations. This pattern of results suggests an early specialization of the cortical network involved in the perception of facial communication cues, which is essential for infants' interactions with, and learning from, others.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

眼睛注视线索对物体认知加工的影响及其机制

眼睛注视作为一种重要的非语言社会线索,不仅可以传达他人丰富的注意方向信息,并且能够诱发独特的社会性注意行为.近年来,研究者利用改编的社会性注意任务发现,眼睛注视线索还可以进一步影响我们对各种不同种类物体(用具、符号、面孔等)的感知觉加工,以及主观评价、记忆等其他高级认知加工过程.眼睛注视线索对物体加工的这种影响受到诸多因素的调节,如面孔属性、数量以及注视模式等.特别地,眼睛注视线索对物体加工的这一调制作用能够在无意识水平发生,具有一定的特异性.此外,针对这一调制作用背后机制的研究暗示心理理论和观点采择可能参与其中,但仍有待进一步探究.眼睛注视对物体加工影响的研究有助于我们深入理解社会互动的方式以及人类与环境的交互过程,因此具有重要的理论意义和社会应用价值.     

Shyness in Early Infancy: Approach-Avoidance Conflicts in Temperament and Hypersensitivity to Eyes during Initial Gazes to Faces

‘Infant shyness’, in which infants react shyly to adult strangers, presents during the third quarter of the first year. Researchers claim that shy children over the age of three years are experiencing approach-avoidance conflicts. Counter-intuitively, shy children do not avoid the eyes when scanning faces; rather, they spend more time looking at the eye region than non-shy children do. It is currently unknown whether young infants show this conflicted shyness and its corresponding characteristic pattern of face scanning. Here, using infant behavioral questionnaires and an eye-tracking system, we found that highly shy infants had high scores for both approach and fear temperaments (i.e., approach-avoidance conflict) and that they showed longer dwell times in the eye regions than less shy infants during their initial fixations to facial stimuli. This initial hypersensitivity to the eyes was independent of whether the viewed faces were of their mothers or strangers. Moreover, highly shy infants preferred strangers with an averted gaze and face to strangers with a directed gaze and face. This initial scanning of the eye region and the overall preference for averted gaze faces were not explained solely by the infants’ age or temperament (i.e., approach or fear). We suggest that infant shyness involves a conflict in temperament between the desire to approach and the fear of strangers, and this conflict is the psychological mechanism underlying infants’ characteristic behavior in face scanning.     

Visual Search for Human Gaze Direction by a Chimpanzee (Pan troglodytes)

Background

Humans detect faces with direct gazes among those with averted gazes more efficiently than they detect faces with averted gazes among those with direct gazes. We examined whether this “stare-in-the-crowd” effect occurs in chimpanzees (Pan troglodytes), whose eye morphology differs from that of humans (i.e., low-contrast eyes, dark sclera).

Methodology/Principal Findings

An adult female chimpanzee was trained to search for an odd-item target (front view of a human face) among distractors that differed from the target only with respect to the direction of the eye gaze. During visual-search testing, she performed more efficiently when the target was a direct-gaze face than when it was an averted-gaze face. This direct-gaze superiority was maintained when the faces were inverted and when parts of the face were scrambled. Subsequent tests revealed that gaze perception in the chimpanzee was controlled by the contrast between iris and sclera, as in humans, but that the chimpanzee attended only to the position of the iris in the eye, irrespective of head direction.

Conclusion/Significance

These results suggest that the chimpanzee can discriminate among human gaze directions and are more sensitive to direct gazes. However, limitations in the perception of human gaze by the chimpanzee are suggested by her inability to completely transfer her performance to faces showing a three-quarter view.