Social Interactions through the Eyes of Macaques and Humans

Group-living primates frequently interact with each other to maintain social bonds as well as to compete for valuable resources. Observing such social interactions between group members provides individuals with essential information (e.g. on the fighting ability or altruistic attitude of group companions) to guide their social tactics and choice of social partners. This process requires individuals to selectively attend to the most informative content within a social scene. It is unclear how non-human primates allocate attention to social interactions in different contexts, and whether they share similar patterns of social attention to humans. Here we compared the gaze behaviour of rhesus macaques and humans when free-viewing the same set of naturalistic images. The images contained positive or negative social interactions between two conspecifics of different phylogenetic distance from the observer; i.e. affiliation or aggression exchanged by two humans, rhesus macaques, Barbary macaques, baboons or lions. Monkeys directed a variable amount of gaze at the two conspecific individuals in the images according to their roles in the interaction (i.e. giver or receiver of affiliation/aggression). Their gaze distribution to non-conspecific individuals was systematically varied according to the viewed species and the nature of interactions, suggesting a contribution of both prior experience and innate bias in guiding social attention. Furthermore, the monkeys’ gaze behavior was qualitatively similar to that of humans, especially when viewing negative interactions. Detailed analysis revealed that both species directed more gaze at the face than the body region when inspecting individuals, and attended more to the body region in negative than in positive social interactions. Our study suggests that monkeys and humans share a similar pattern of role-sensitive, species- and context-dependent social attention, implying a homologous cognitive mechanism of social attention between rhesus macaques and humans.     

Separate coding of different gaze directions in the superior temporal sulcus and inferior parietal lobule

Electrophysiological recording in the anterior superior temporal sulcus (STS) of monkeys has demonstrated separate cell populations responsive to direct and averted gaze. Human functional imaging has demonstrated posterior STS activation in gaze processing, particularly in coding the intentions conveyed by gaze, but to date has provided no evidence of dissociable coding of different gaze directions. Because the spatial resolution typical of group-based fMRI studies (approximately 6-10 mm) exceeds the size of cellular patches sensitive to different facial characteristics (1-4 mm in monkeys), a more sensitive technique may be required. We therefore used fMRI adaptation, which is considered to offer superior resolution, to investigate whether the human anterior STS contains representations of different gaze directions, as suggested by non-human primate research. Subjects viewed probe faces gazing left, directly ahead, or right. Adapting to leftward gaze produced a reduction in BOLD response to left relative to right (and direct) gaze probes in the anterior STS and inferior parietal cortex; rightward gaze adaptation produced a corresponding reduction to right gaze probes. Consistent with these findings, averted gaze in the adapted direction was misidentified as direct. Our study provides the first human evidence of dissociable neural systems for left and right gaze.     

Young infants' neural processing of objects is affected by eye gaze direction and emotional expression

Eye gaze is an important social cue which is used to determine another person's focus of attention and intention to communicate. In combination with a fearful facial expression eye gaze can also signal threat in the environment. The ability to detect and understand others' social signals is essential in order to avoid danger and enable social evaluation. It has been a matter of debate when infants are able to use gaze cues and emotional facial expressions in reference to external objects. Here we demonstrate that by 3 months of age the infant brain differentially responds to objects as a function of how other people are reacting to them. Using event-related electrical brain potentials (ERPs), we show that an indicator of infants' attention is enhanced by an adult's expression of fear toward an unfamiliar object. The infant brain showed an increased Negative central (Nc) component toward objects that had been previously cued by an adult's eye gaze and frightened facial expression. Our results further suggest that infants' sensitivity cannot be due to a general arousal elicited by a frightened face with eye gaze directed at an object. The neural attention system of 3 month old infants is sensitive to an adult's eye gaze direction in combination with a fearful expression. This early capacity may lay the foundation for the development of more sophisticated social skills such as social referencing, language, and theory of mind.     

Social orienting in gaze leading: a mechanism for shared attention

Here, we report a novel social orienting response that occurs after viewing averted gaze. We show, in three experiments, that when a person looks from one location to an object, attention then shifts towards the face of an individual who has subsequently followed the person''s gaze to that same object. That is, contrary to ‘gaze following’, attention instead orients in the opposite direction to observed gaze and towards the gazing face. The magnitude of attentional orienting towards a face that ‘follows’ the participant''s gaze is also associated with self-reported autism-like traits. We propose that this gaze leading phenomenon implies the existence of a mechanism in the human social cognitive system for detecting when one''s gaze has been followed, in order to establish ‘shared attention’ and maintain the ongoing interaction.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

眼睛注视线索对物体认知加工的影响及其机制

眼睛注视作为一种重要的非语言社会线索，不仅可以传达他人丰富的注意方向信息，并且能够诱发独特的社会性注意行为. 近年来，研究者利用改编的社会性注意任务发现，眼睛注视线索还可以进一步影响我们对各种不同种类物体（用具、符号、面孔等）的感知觉加工，以及主观评价、记忆等其他高级认知加工过程. 眼睛注视线索对物体加工的这种影响受到诸多因素的调节，如面孔属性、数量以及注视模式等. 特别地，眼睛注视线索对物体加工的这一调制作用能够在无意识水平发生，具有一定的特异性. 此外，针对这一调制作用背后机制的研究暗示心理理论和观点采择可能参与其中，但仍有待进一步探究. 眼睛注视对物体加工影响的研究有助于我们深入理解社会互动的方式以及人类与环境的交互过程，因此具有重要的理论意义和社会应用价值.     

Perception of Individual and Joint Action in Infants and Adults

Infants and adults frequently observe actions performed jointly by more than one person. Research in action perception, however, has focused largely on actions performed by an individual person. Here, we explore how 9- and 12-month-old infants and adults perceive a block-stacking action performed by either one agent (individual condition) or two agents (joint condition). We used eye tracking to measure the latency of participants’ gaze shifts towards action goals. Adults anticipated goals in both conditions significantly faster than infants, and their gaze latencies did not differ between conditions. By contrast, infants showed faster anticipation of goals in the individual condition than in the joint condition. This difference was more pronounced in 9-month-olds. Further analyses of fixations examined the role of visual attention in action perception. These findings are cautiously interpreted in terms of low-level processing in infants and higher-level processing in adults. More precisely, our results suggest that adults are able to infer the overarching joint goal of two agents, whereas infants are not yet able to do so and might rely primarily on visual cues to infer the respective sub-goals. In conclusion, our findings indicate that the perception of joint action in infants develops differentially from that of individual action.     

Watch Out! Magnetoencephalographic Evidence for Early Modulation of Attention Orienting by Fearful Gaze Cueing

Others’ gaze and emotional facial expression are important cues for the process of attention orienting. Here, we investigated with magnetoencephalography (MEG) whether the combination of averted gaze and fearful expression may elicit a selectively early effect of attention orienting on the brain responses to targets. We used the direction of gaze of centrally presented fearful and happy faces as the spatial attention orienting cue in a Posner-like paradigm where the subjects had to detect a target checkerboard presented at gazed-at (valid trials) or non gazed-at (invalid trials) locations of the screen. We showed that the combination of averted gaze and fearful expression resulted in a very early attention orienting effect in the form of additional parietal activity between 55 and 70 ms for the valid versus invalid targets following fearful gaze cues. No such effect was obtained for the targets following happy gaze cues. This early cue-target validity effect selective of fearful gaze cues involved the left superior parietal region and the left lateral middle occipital region. These findings provide the first evidence for an effect of attention orienting induced by fearful gaze in the time range of C1. In doing so, they demonstrate the selective impact of combined gaze and fearful expression cues in the process of attention orienting.     

Gender and Facial Dominance in Gaze Cuing: Emotional Context Matters in the Eyes That We Follow

Gaze following is a socio-cognitive process that provides adaptive information about potential threats and opportunities in the individual’s environment. The aim of the present study was to investigate the potential interaction between emotional context and facial dominance in gaze following. We used the gaze cue task to induce attention to or away from the location of a target stimulus. In the experiment, the gaze cue either belonged to a (dominant looking) male face or a (non-dominant looking) female face. Critically, prior to the task, individuals were primed with pictures of threat or no threat to induce either a dangerous or safe environment. Findings revealed that the primed emotional context critically influenced the gaze cuing effect. While a gaze cue of the dominant male face influenced performance in both the threat and no-threat conditions, the gaze cue of the non-dominant female face only influenced performance in the no-threat condition. This research suggests an implicit, context-dependent follower bias, which carries implications for research on visual attention, social cognition, and leadership.     

The Impact of Perceived Social Power and Dangerous Context on Social Attention

Past research has shown that position in a social hierarchy modulates one''s social attention, as in the gaze cueing effect. While studies have manipulated the social status of others with whom the participants interact, we believe that a sense of one''s own social power is also a crucial factor affecting gaze following. In two experiments, we primed the social power of participants, using different approaches, to investigate the participants'' performance in a subsequent gaze cueing task. The results of Experiment 1 showed a stronger gaze cueing effect among participants who were primed with low social power, compared to those primed with high social power. Our predicted gender difference (i.e., women showing a stronger gaze cueing effect than men) was confirmed and this effect was found to be dominated by the lower social power condition. Experiment 2 manipulated the level of danger in the context and replicated the joint impact of gender and one''s perceived social power on gaze cueing effect, especially in the low danger context, in comparison to the high danger context. These findings demonstrate that one''s perceived social power has a concerted effect on social attention evoked by gaze, along with other factors such as gender and characteristics of the environment, and suggest the importance of further research on the complex relationship between an individual''s position in the social hierarchy and social attention.     

Familiarity accentuates gaze cuing in women but not men

Gaze cuing, the tendency to shift attention in the direction other individuals are looking, is hypothesized to depend on a distinct neural module. One expectation of such a module is that information processing should be encapsulated within it. Here, we tested whether familiarity, a type of social knowledge, penetrates the neural circuits governing gaze cuing. Male and female subjects viewed the face of an adult male looking left or right and then pressed a keypad to indicate the location of a target appearing randomly left or right. Responses were faster for targets congruent with gaze direction. Moreover, gaze cuing was stronger in females than males. Contrary to the modularity hypothesis, familiarity enhanced gaze cuing, but only in females. Sex differences in the effects of familiarity on gaze cuing may reflect greater adaptive significance of social information for females than males.     

Selective prefrontal cortex responses to joint attention in early infancy

The process by which two people share attention towards the same object or event is called joint attention. Joint attention and the underlying triadic representations between self, other person and object are thought to be unique to humans, supporting teaching, cooperation and language learning. Despite the progress that has been made in understanding the behavioural importance of joint attention during early social development, almost nothing is known about the brain substrate that supports joint attention in the developing infant. We examined responses in five-month-old infants'' prefrontal cortex during triadic social interactions using near-infrared spectroscopy. The results demonstrate that, even by the age of five months, infants are sensitive to triadic interactions and, like adults, they recruit a specific brain region localized in left dorsal prefrontal cortex when engaged in joint attention with another person. This suggests that the human infant is neurobiologically prepared for sharing attention with other humans, which may provide the basis for a wide variety of uniquely human social and cultural learning processes.     

Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour

Eye tracking has been used to investigate gaze behaviours in individuals with autism spectrum disorder (ASD). However, traditional analysis has yet to find behavioural characteristics shared by both children and adults with ASD. To distinguish core ASD gaze behaviours from those that change with development, we examined temporo-spatial gaze patterns in children and adults with and without ASD while they viewed video clips. We summarized the gaze patterns of 104 participants using multidimensional scaling so that participants with similar gaze patterns would cluster together in a two-dimensional plane. Control participants clustered in the centre, reflecting a standard gaze behaviour, whereas participants with ASD were distributed around the periphery. Moreover, children and adults were separated on the plane, thereby showing a clear effect of development on gaze behaviours. Post hoc frame-by-frame analyses revealed the following findings: (i) both ASD groups shifted their gaze away from a speaker earlier than the control groups; (ii) both ASD groups showed a particular preference for letters; and (iii) typical infants preferred to watch the mouth rather than the eyes during speech, a preference that reversed with development. These results highlight the importance of taking the effect of development into account when addressing gaze behaviours characteristic of ASD.     

Active gaze control improves optic flow-based segmentation and steering

An observer traversing an environment actively relocates gaze to fixate objects. Evidence suggests that gaze is frequently directed toward the center of an object considered as target but more likely toward the edges of an object that appears as an obstacle. We suggest that this difference in gaze might be motivated by specific patterns of optic flow that are generated by either fixating the center or edge of an object. To support our suggestion we derive an analytical model that shows: Tangentially fixating the outer surface of an obstacle leads to strong flow discontinuities that can be used for flow-based segmentation. Fixation of the target center while gaze and heading are locked without head-, body-, or eye-rotations gives rise to a symmetric expansion flow with its center at the point being approached, which facilitates steering toward a target. We conclude that gaze control incorporates ecological constraints to improve the robustness of steering and collision avoidance by actively generating flows appropriate to solve the task.     

The role of a midbrain network in competitive stimulus selection

A midbrain network interacts with the well-known frontoparietal forebrain network to select stimuli for gaze and spatial attention. The midbrain network, containing the superior colliculus (SC; optic tectum, OT, in non-mammalian vertebrates) and the isthmic nuclei, helps evaluate the relative priorities of competing stimuli and encodes them in a topographic map of space. Behavioral experiments in monkeys demonstrate an essential contribution of the SC to stimulus selection when the relative priorities of competing stimuli are similar. Neurophysiological results from the owl OT demonstrate a neural correlate of this essential contribution of the SC/OT. The multi-layered, spatiotopic organization of the midbrain network lends itself to the analysis and modeling of the mechanisms underlying stimulus selection for gaze and spatial attention.     

The role of observers' gaze behaviour when watching object manipulation tasks: predicting and evaluating the consequences of action

When watching an actor manipulate objects, observers, like the actor, naturally direct their gaze to each object as the hand approaches and typically maintain gaze on the object until the hand departs. Here, we probed the function of observers'' eye movements, focusing on two possibilities: (i) that observers'' gaze behaviour arises from processes involved in the prediction of the target object of the actor''s reaching movement and (ii) that this gaze behaviour supports the evaluation of mechanical events that arise from interactions between the actor''s hand and objects. Observers watched an actor reach for and lift one of two presented objects. The observers'' task was either to predict the target object or judge its weight. Proactive gaze behaviour, similar to that seen in self-guided action–observation, was seen in the weight judgement task, which requires evaluating mechanical events associated with lifting, but not in the target prediction task. We submit that an important function of gaze behaviour in self-guided action observation is the evaluation of mechanical events associated with interactions between the hand and object. By comparing predicted and actual mechanical events, observers, like actors, can gain knowledge about the world, including information about objects they may subsequently act upon.     

Mutation,selection, and ancestry in branching models: a variational approach

We consider the evolution of populations under the joint action of mutation and differential reproduction, or selection. The population is modelled as a finite-type Markov branching process in continuous time, and the associated genealogical tree is viewed both in the forward and the backward direction of time. The stationary type distribution of the reversed process, the so-called ancestral distribution, turns out as a key for the study of mutation–selection balance. This balance can be expressed in the form of a variational principle that quantifies the respective roles of reproduction and mutation for any possible type distribution. It shows that the mean growth rate of the population results from a competition for a maximal long-term growth rate, as given by the difference between the current mean reproduction rate, and an asymptotic decay rate related to the mutation process; this tradeoff is won by the ancestral distribution. We then focus on the case when the type is determined by a sequence of letters (like nucleotides or matches/mismatches relative to a reference sequence), and we ask how much of the above competition can still be seen by observing only the letter composition (as given by the frequencies of the various letters within the sequence). If mutation and reproduction rates can be approximated in a smooth way, the fitness of letter compositions resulting from the interplay of reproduction and mutation is determined in the limit as the number of sequence sites tends to infinity. Our main application is the quasispecies model of sequence evolution with mutation coupled to reproduction but independent across sites, and a fitness function that is invariant under permutation of sites. In this model, the fitness of letter compositions is worked out explicitly. In certain cases, their competition leads to a phase transition.      

What are birds looking at? Head movements and eye use in chickens

Using video recordings of hens, Gallus gallus domesticus, as they approached different kinds of objects, I examined how change in object distance is associated with a change from lateral to binocular viewing. The birds tended to view distant objects laterally while they preferentially viewed objects less than 20-30 cm away frontally; this was true whether they were looking at another bird or at an inanimate object. However, as well as switching between lateral and frontal viewing, the hens also swung their heads from side to side with movements so large that the same object appeared to be viewed with completely different parts of the retina, and even with different eyes, in rapid succession. When confronted with a novel object, the hens walked more slowly but continued to show large head movements. This suggests that, unlike mammals, which gaze fixedly at novel objects, hens investigate them by moving the head and looking at them with different, specialized, parts of their eyes. Many aspects of bird behaviour, such as search image formation, vigilance and visual discriminations, may be affected by the way they move the head and eyes. Copyright 2002 The Association for the Study of Animal Behaviour. Published by Elsevier Science Ltd. All rights reserved.     

Disambiguating ambiguous figures by a model of selective attention

Ambiguous figures are visual stimuli which are interpreted multiply by the human visual system. A model is proposed which disambiguates the ambiguous figures. The model was formulated based on the characteristics of visual information processing, accompanied with selective attention. In the ambiguous figure my husband and my father-in-law, it was necessary to simulate visual information processing so that attention was directed to the multiple features in the figure to disambiguate the ambiguous figure. Pictures, obtained from the model, were examined as to whether they were interpreted unambiguously or not. Results show that the model, simulated selective attention, can disambiguate the ambiguous figures. This suggests that the image per se, viewed through selective attention, becomes unambiguous before the figure is interpreted in the higher level. Results also show that the computer simulation of selective attention would make it possible to examine factors affecting the initial interpretation of the figure.     

Eye gaze is not coded by cardinal mechanisms alone

Gaze is an important social cue in regulating human and non-human interactions. In this study, we employed an adaptation paradigm to examine the mechanisms underlying the perception of another''s gaze. Previous research has shown that the interleaved presentation of leftwards and rightwards gazing adaptor stimuli results in observers judging a wider range of gaze deviations as being direct. We applied a similar paradigm to examine how human observers encode oblique (e.g. upwards and to the left) directions of gaze. We presented observers with interleaved gaze adaptors and examined whether adaptation differed between congruent (adaptor and test along same axis) and incongruent conditions. We find greater adaptation in congruent conditions along cardinal (horizontal and vertical) and non-cardinal (oblique) directions suggesting gaze is not coded alone by cardinal mechanisms. Our results suggest that the functional aspects of gaze processing might parallel that of basic visual features such as orientation.