Facial-expression and gaze-selective responses in the monkey amygdala

The social behavior of both human and nonhuman primates relies on specializations for the recognition of individuals, their facial expressions, and their direction of gaze. A broad network of cortical and subcortical structures has been implicated in face processing, yet it is unclear whether co-occurring dimensions of face stimuli, such as expression and direction of gaze, are processed jointly or independently by anatomically and functionally segregated neural structures. Awake macaques were presented with a set of monkey faces displaying aggressive, neutral, and appeasing expressions with head and eyes either averted or directed. BOLD responses to these faces as compared to Fourier-phase-scrambled images revealed widespread activation of the superior temporal sulcus and inferotemporal cortex and included activity in the amygdala. The different dimensions of the face stimuli elicited distinct activation patterns among the amygdaloid nuclei. The basolateral amygdala, including the lateral, basal, and accessory basal nuclei, produced a stronger response for threatening than appeasing expressions. The central nucleus and bed nucleus of the stria terminalis responded more to averted than directed-gaze faces. Independent behavioral measures confirmed that faces with averted gaze were more arousing, suggesting the activity in the central nucleus may be related to attention and arousal.     

Social Interactions through the Eyes of Macaques and Humans

Group-living primates frequently interact with each other to maintain social bonds as well as to compete for valuable resources. Observing such social interactions between group members provides individuals with essential information (e.g. on the fighting ability or altruistic attitude of group companions) to guide their social tactics and choice of social partners. This process requires individuals to selectively attend to the most informative content within a social scene. It is unclear how non-human primates allocate attention to social interactions in different contexts, and whether they share similar patterns of social attention to humans. Here we compared the gaze behaviour of rhesus macaques and humans when free-viewing the same set of naturalistic images. The images contained positive or negative social interactions between two conspecifics of different phylogenetic distance from the observer; i.e. affiliation or aggression exchanged by two humans, rhesus macaques, Barbary macaques, baboons or lions. Monkeys directed a variable amount of gaze at the two conspecific individuals in the images according to their roles in the interaction (i.e. giver or receiver of affiliation/aggression). Their gaze distribution to non-conspecific individuals was systematically varied according to the viewed species and the nature of interactions, suggesting a contribution of both prior experience and innate bias in guiding social attention. Furthermore, the monkeys’ gaze behavior was qualitatively similar to that of humans, especially when viewing negative interactions. Detailed analysis revealed that both species directed more gaze at the face than the body region when inspecting individuals, and attended more to the body region in negative than in positive social interactions. Our study suggests that monkeys and humans share a similar pattern of role-sensitive, species- and context-dependent social attention, implying a homologous cognitive mechanism of social attention between rhesus macaques and humans.     

Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis

As compared with other primates, humans have especially visible eyes (e.g., white sclera). One hypothesis is that this feature of human eyes evolved to make it easier for conspecifics to follow an individual's gaze direction in close-range joint attentional and communicative interactions, which would seem to imply especially cooperative (mututalistic) conspecifics. In the current study, we tested one aspect of this cooperative eye hypothesis by comparing the gaze following behavior of great apes to that of human infants. A human experimenter "looked" to the ceiling either with his eyes only, head only (eyes closed), both head and eyes, or neither. Great apes followed gaze to the ceiling based mainly on the human's head direction (although eye direction played some role as well). In contrast, human infants relied almost exclusively on eye direction in these same situations. These results demonstrate that humans are especially reliant on eyes in gaze following situations, and thus, suggest that eyes evolved a new social function in human evolution, most likely to support cooperative (mututalistic) social interactions.     

Dogs Evaluate Threatening Facial Expressions by Their Biological Validity – Evidence from Gazing Patterns

Appropriate response to companions’ emotional signals is important for all social creatures. The emotional expressions of humans and non-human animals have analogies in their form and function, suggesting shared evolutionary roots, but very little is known about how animals other than primates view and process facial expressions. In primates, threat-related facial expressions evoke exceptional viewing patterns compared with neutral or positive stimuli. Here, we explore if domestic dogs (Canis familiaris) have such an attentional bias toward threatening social stimuli and whether observed emotional expressions affect dogs’ gaze fixation distribution among the facial features (eyes, midface and mouth). We recorded the voluntary eye gaze of 31 domestic dogs during viewing of facial photographs of humans and dogs with three emotional expressions (threatening, pleasant and neutral). We found that dogs’ gaze fixations spread systematically among facial features. The distribution of fixations was altered by the seen expression, but eyes were the most probable targets of the first fixations and gathered longer looking durations than mouth regardless of the viewed expression. The examination of the inner facial features as a whole revealed more pronounced scanning differences among expressions. This suggests that dogs do not base their perception of facial expressions on the viewing of single structures, but the interpretation of the composition formed by eyes, midface and mouth. Dogs evaluated social threat rapidly and this evaluation led to attentional bias, which was dependent on the depicted species: threatening conspecifics’ faces evoked heightened attention but threatening human faces instead an avoidance response. We propose that threatening signals carrying differential biological validity are processed via distinctive neurocognitive pathways. Both of these mechanisms may have an adaptive significance for domestic dogs. The findings provide a novel perspective on understanding the processing of emotional expressions and sensitivity to social threat in non-primates.     

线索有效性对社会性注意和外源性注意的影响

目的 眼睛注视、头朝向和生物运动方向等社会性线索,对人类的生存和社会交互极为重要.由于社会性线索和外周线索都具有反射性注意定向这一特点,社会性注意往往也被认为属于外源性注意.但是,外源性注意并不能完全解释所有的社会性注意现象.因此,两者是否具有相同的加工机制,尚存在争论.方法 本研究使用空间线索范式,系统考察了线索有效...     

Social orienting in gaze leading: a mechanism for shared attention

Here, we report a novel social orienting response that occurs after viewing averted gaze. We show, in three experiments, that when a person looks from one location to an object, attention then shifts towards the face of an individual who has subsequently followed the person''s gaze to that same object. That is, contrary to ‘gaze following’, attention instead orients in the opposite direction to observed gaze and towards the gazing face. The magnitude of attentional orienting towards a face that ‘follows’ the participant''s gaze is also associated with self-reported autism-like traits. We propose that this gaze leading phenomenon implies the existence of a mechanism in the human social cognitive system for detecting when one''s gaze has been followed, in order to establish ‘shared attention’ and maintain the ongoing interaction.     

Directional asymmetry in the forelimb of Macaca mulatta

Asymmetry was investigated in the forelimbs of 150 rhesus monkey (Macaca mulatta) skeletons using measurements of right and left humerii, radii, ulnae, second metacarpals, and femora. Seven of the ten forelimb dimensions were larger on the right than on the left side. Paired t-tests revealed that the mean of the right side was significantly larger than that for the left for two measurements of the ulna and two of the humerus. No measurement was significantly larger on the left than on the right side. These results indicate a small but significant asymmetry in the forelimb bones of rhesus monkeys and, as is the case for humans, the direction of asymmetry favors the right side. Our findings are consistent with an interpretation of hypertrophy of certain muscles and opens the question of whether rhesus monkeys preferentially use their right forelimbs for manipulative tasks that require manual dexterity, as is the case for humans. These forelimb skeletal asymmetries are discussed in light of the recent literature on cortical asymmetry and handedness in nonhuman primates.     

Social and nonsocial content differentially modulates visual attention and autonomic arousal in Rhesus macaques

The sophisticated analysis of gestures and vocalizations, including assessment of their emotional valence, helps group-living primates efficiently navigate their social environment. Deficits in social information processing and emotion regulation are important components of many human psychiatric illnesses, such as autism, schizophrenia and social anxiety disorder. Analyzing the neurobiology of social information processing and emotion regulation requires a multidisciplinary approach that benefits from comparative studies of humans and animal models. However, many questions remain regarding the relationship between visual attention and arousal while processing social stimuli. Using noninvasive infrared eye-tracking methods, we measured the visual social attention and physiological arousal (pupil diameter) of adult male rhesus monkeys (Macaca mulatta) as they watched social and nonsocial videos. We found that social videos, as compared to nonsocial videos, captured more visual attention, especially if the social signals depicted in the videos were directed towards the subject. Subject-directed social cues and nonsocial nature documentary footage, compared to videos showing conspecifics engaging in naturalistic social interactions, generated larger pupil diameters (indicating heightened sympathetic arousal). These findings indicate that rhesus monkeys will actively engage in watching videos of various kinds. Moreover, infrared eye tracking technology provides a mechanism for sensitively gauging the social interest of presented stimuli. Adult male rhesus monkeys' visual attention and physiological arousal do not always trend in the same direction, and are likely influenced by the content and novelty of a particular visual stimulus. This experiment creates a strong foundation for future experiments that will examine the neural network responsible for social information processing in nonhuman primates. Such studies may provide valuable information relevant to interpreting the neural deficits underlying human psychiatric illnesses such as autism, schizophrenia and social anxiety disorder.     

Patterns of Gazing in Orangutans (Pongo pygmaeus)

Eyes play an important role in communication amongst humans and animals. However, relatively little is known about specific differences in eye morphology amongst primates and how these features might be associated with social structure and direction of gaze. We present a detailed study of gazing and eye morphology—exposed sclera and surrounding features—in orangutans. We measured gazing in rehabilitating orangutans in two contexts: interspecific viewing of the experimenter (with video camera) and intraspecific gazing (between subjects). Our findings show that direct staring is avoided and social looking is limited to certain age/social categories: juveniles engage in more looking at other orangutans than do adults or infants. While orangutans use eye movements in social communication, they avoid the more prolonged mutual gaze that is characteristic of humans, and also apparent in chimpanzees and gorillas. Detailed frame-by-frame analysis of videotapes from field and zoo studies of orangutans revealed that they pay visual attention to both human observers and conspecifics by glancing sideways, with the head turned at an angle away from the subject being observed. Mutual gaze was extremely rare, and we have observed only two incidences of gaze following. Orangutans in captivity appear to use a more restricted pattern of gazes compared to free-living, rehabilitating ones, possibly suggesting the presence of a pathological condition (such as depression) in the captive subjects. Our findings have implications for further investigations of social communication and cognition in orangutans.     

Visual Search for Human Gaze Direction by a Chimpanzee (Pan troglodytes)

Background

Humans detect faces with direct gazes among those with averted gazes more efficiently than they detect faces with averted gazes among those with direct gazes. We examined whether this “stare-in-the-crowd” effect occurs in chimpanzees (Pan troglodytes), whose eye morphology differs from that of humans (i.e., low-contrast eyes, dark sclera).

Methodology/Principal Findings

An adult female chimpanzee was trained to search for an odd-item target (front view of a human face) among distractors that differed from the target only with respect to the direction of the eye gaze. During visual-search testing, she performed more efficiently when the target was a direct-gaze face than when it was an averted-gaze face. This direct-gaze superiority was maintained when the faces were inverted and when parts of the face were scrambled. Subsequent tests revealed that gaze perception in the chimpanzee was controlled by the contrast between iris and sclera, as in humans, but that the chimpanzee attended only to the position of the iris in the eye, irrespective of head direction.

Conclusion/Significance

These results suggest that the chimpanzee can discriminate among human gaze directions and are more sensitive to direct gazes. However, limitations in the perception of human gaze by the chimpanzee are suggested by her inability to completely transfer her performance to faces showing a three-quarter view.     

Racial group membership is associated to gaze-mediated orienting in Italy

Viewing a face with averted gaze results in a spatial shift of attention in the corresponding direction, a phenomenon defined as gaze-mediated orienting. In the present paper, we investigated whether this effect is influenced by social factors. Across three experiments, White and Black participants were presented with faces of White and Black individuals. A modified spatial cueing paradigm was used in which a peripheral target stimulus requiring a discrimination response was preceded by a noninformative gaze cue. Results showed that Black participants shifted attention to the averted gaze of both ingroup and outgroup faces, whereas White participants selectively shifted attention only in response to individuals of their same group. Interestingly, the modulatory effect of social factors was context-dependent and emerged only when group membership was situationally salient to participants. It was hypothesized that differences in the relative social status of the two groups might account for the observed asymmetry between White and Black participants. A final experiment ruled out an alternative explanation based on differences in perceptual familiarity with the face stimuli. Overall, these findings strengthen the idea that gaze-mediated orienting is a socially-connoted phenomenon.     

Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye

In order to clarify the morphological uniqueness of the human eye and to obtain cues to understanding its adaptive significance, we compared the external morphology of the primate eye by measuring nearly half of all extant primate species. The results clearly showed exceptional features of the human eye: (1) the exposed white sclera is void of any pigmentation, (2) humans possess the largest ratio of exposed sclera in the eye outline, and (3) the eye outline is extraordinarily elongated in the horizontal direction. The close correlation of the parameters reflecting (2) and (3) with habitat type or body size of the species examined suggested that these two features are adaptations for extending the visual field by eyeball movement, especially in the horizontal direction. Comparison of eye coloration and facial coloration around the eye suggested that the dark coloration of exposed sclera of nonhuman primates is an adaptation to camouflage the gaze direction against other individuals and/or predators, and that the white sclera of the human eye is an adaptation to enhance the gaze signal. The uniqueness of human eye morphology among primates illustrates the remarkable difference between human and other primates in the ability to communicate using gaze signals.     

Serum leptin in nonpregnant and pregnant women and in old and new world nonhuman primates

Leptin is a hormone that is produced during mammalian pregnancy in the placental trophoblast and other tissues, including! fetal and maternal adipocytes. Synthesis of the polypeptide and the presence of its specific receptors throughout the human maternal fetoplacental unit suggest direct effects on conceptus growth and development. However, both the physiologic roles of leptin and the mechanisms regulating leptin synthesis in human pregnancy differ from those in laboratory and domestic species, necessitating the development of non-human primate research models. Therefore, we compared serum leptin concentrations in nonpregnant and pregnant women with those in both old world nonhuman primates (i.e., baboon, rhesus monkey, cynomolgus monkey) and new world nonhuman primates (i.e., squirrel monkey, titi monkey). As expected, maternal leptin levels were elevated in human and baboon pregnancies (P < 0.05 and P < 0.001, respectively). Levels in both species of old world monkeys were also greatly enhanced (P < 0.001). Although maternal serum concentrations were slightly elevated compared to nonpregnant levels in both species of new world monkeys, overall concentrations were dramatically lower than for either old world primates or humans. Results provide comparisons of serum leptin concentrations in pregnant and nonpregnant humans and baboons with those in both old and new world monkeys and further characterize these nonhuman primates as models for the investigation of leptin dynamics in pregnancy.     

Rapid amygdala gamma oscillations in response to eye gaze

Background

The eye gaze of other individuals conveys important social information and can trigger multiple psychological activities; some of which, such as emotional reactions and attention orienting, occur very rapidly. Although some neuroscientific evidence has suggested that the amygdala may be involved in such rapid gaze processing, no evidence has been reported concerning the speed at which the amygdala responds to eye gaze.

Methodology/Principal Findings

To investigate this issue, we recorded electrical activity within the amygdala of six subjects using intracranial electrodes. Subjects observed images of eyes and mosaics pointing in averted and straight directions. The amygdala showed higher gamma-band oscillations for eye gaze than for mosaics, which peaked at 200 ms regardless of the direction of the gaze.

Conclusion

These results indicate that the human amygdala rapidly processes eye gaze.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

Facilitation of Visual Perception in Head Direction: Visual Attention Modulation Based on Head Direction

People usually see things using frontal viewing, and avoid lateral viewing (or eccentric gaze) where the directions of the head and eyes are largely different. Lateral viewing interferes with attentive visual search performance, probably because the head is directed away from the target and/or because the head and eyes are misaligned. In this study, we examined which of these factors is the primary one for interference by conducting a visual identification experiment where a target was presented in the peripheral visual field. The critical manipulation was the participants’ head direction and fixation position: the head was directed to the fixation location, the target position, or the opposite side of the fixation. The performance was highest when the head was directed to the target position even when there was misalignment of the head and eye, suggesting that visual perception can be influenced by both head direction and fixation position.     

Neural Signals Evoked by Stimuli of Increasing Social Scene Complexity Are Detectable at the Single-Trial Level and Right Lateralized

Classification of neural signals at the single-trial level and the study of their relevance in affective and cognitive neuroscience are still in their infancy. Here we investigated the neurophysiological correlates of conditions of increasing social scene complexity using 3D human models as targets of attention, which may also be important in autism research. Challenging single-trial statistical classification of EEG neural signals was attempted for detection of oddball stimuli with increasing social scene complexity. Stimuli had an oddball structure and were as follows: 1) flashed schematic eyes, 2) simple 3D faces flashed between averted and non-averted gaze (only eye position changing), 3) simple 3D faces flashed between averted and non-averted gaze (head and eye position changing), 4) animated avatar alternated its gaze direction to the left and to the right (head and eye position), 5) environment with 4 animated avatars all of which change gaze and one of which is the target of attention. We found a late (> 300 ms) neurophysiological oddball correlate for all conditions irrespective of their complexity as assessed by repeated measures ANOVA. We attempted single-trial detection of this signal with automatic classifiers and obtained a significant balanced accuracy classification of around 79%, which is noteworthy given the amount of scene complexity. Lateralization analysis showed a specific right lateralization only for more complex realistic social scenes. In sum, complex ecological animations with social content elicit neurophysiological events which can be characterized even at the single-trial level. These signals are right lateralized. These finding paves the way for neuroscientific studies in affective neuroscience based on complex social scenes, and given the detectability at the single trial level this suggests the feasibility of brain computer interfaces that can be applied to social cognition disorders such as autism.     

Natural gaze signaling in a social context

Evolutionary theory, augmented by a vast literature on gaze cuing and gaze following, suggests that the unique high-contrast morphology of the human eye evolved for rapid and silent communication between conspecifics. While this theory rests on the fundamental idea that humans use their eyes to signal information, empirical studies have focused exclusively on the effects of gaze cues on human receivers. In a series of three experiments we examined the other side of the communication dynamic by investigating if, and when, humans signal gaze information to other humans in a natural, but controlled, situation involving food consumption. First, we established that there is a normative behavior to look away when someone begins to bite. Second, we found that participants were significantly more likely to look down at their food before taking a bite when they were eating with another person versus alone. Lastly, we found that in pairs where a social connection has been established, when one person looks down signaling that a bite is forthcoming, the other person tends to look away. These results demonstrate that natural gaze signaling occurs in the context of eating, and it can, dependent on the relationship between the pair, trigger a gaze response that is different from gaze following. Our study shows that natural social attention between individuals is a two-way street, where each person can signal and read gaze information, consistent with the idea that human eye morphology evolved to facilitate communication between conspecifics.     

Generation of transgenic monkeys with human inherited genetic disease

Modeling human diseases using nonhuman primates including chimpanzee, rhesus, cynomolgus, marmoset and squirrel monkeys has been reported in the past decades. Due to the high similarity between nonhuman primates and humans, including genome constitution, cognitive behavioral functions, anatomical structure, metabolic, reproductive, and brain functions; nonhuman primates have played an important role in understanding physiological functions of the human body, clarifying the underlying mechanism of human diseases, and the development of novel treatments for human diseases. However, nonhuman primate research has been restricted to cognitive, behavioral, biochemical and pharmacological approaches of human diseases due to the limitation of gene transfer technology in nonhuman primates. The recent advancement in transgenic technology that has led to the generation of the first transgenic monkey in 2001 and a transgenic monkey model of Huntington’s disease (HD) in 2008 has changed that focus. The creation of transgenic HD monkeys that replicate key pathological features of human HD patients further suggests the crucial role of nonhuman primates in the future development of biomedicine. These successes have opened the door to genetic manipulation in nonhuman primates and a new era in modeling human inherited genetic disorders. We focused on the procedures in creating transgenic Huntington’s disease monkeys, but our work can be applied to transgenesis in other nonhuman primate species.     

Follow my eyes: the gaze of politicians reflexively captures the gaze of ingroup voters

Studies in human and non-human primates indicate that basic socio-cognitive operations are inherently linked to the power of gaze in capturing reflexively the attention of an observer. Although monkey studies indicate that the automatic tendency to follow the gaze of a conspecific is modulated by the leader-follower social status, evidence for such effects in humans is meager. Here, we used a gaze following paradigm where the directional gaze of right- or left-wing Italian political characters could influence the oculomotor behavior of ingroup or outgroup voters. We show that the gaze of Berlusconi, the right-wing leader currently dominating the Italian political landscape, potentiates and inhibits gaze following behavior in ingroup and outgroup voters, respectively. Importantly, the higher the perceived similarity in personality traits between voters and Berlusconi, the stronger the gaze interference effect. Thus, higher-order social variables such as political leadership and affiliation prepotently affect reflexive shifts of attention.