Perception of Individual and Joint Action in Infants and Adults

Infants and adults frequently observe actions performed jointly by more than one person. Research in action perception, however, has focused largely on actions performed by an individual person. Here, we explore how 9- and 12-month-old infants and adults perceive a block-stacking action performed by either one agent (individual condition) or two agents (joint condition). We used eye tracking to measure the latency of participants’ gaze shifts towards action goals. Adults anticipated goals in both conditions significantly faster than infants, and their gaze latencies did not differ between conditions. By contrast, infants showed faster anticipation of goals in the individual condition than in the joint condition. This difference was more pronounced in 9-month-olds. Further analyses of fixations examined the role of visual attention in action perception. These findings are cautiously interpreted in terms of low-level processing in infants and higher-level processing in adults. More precisely, our results suggest that adults are able to infer the overarching joint goal of two agents, whereas infants are not yet able to do so and might rely primarily on visual cues to infer the respective sub-goals. In conclusion, our findings indicate that the perception of joint action in infants develops differentially from that of individual action.     

Do Domestic Dogs Understand Human Actions as Goal-Directed?

Understanding of other’s actions as goal-directed is considered a fundamental ability underlying cognitive and social development in human infants. A number of studies using the habituation-dishabituation paradigm have shown that the ability to discern intentional relations, in terms of goal-directedness of an action towards an object, appears around 5 months of age. The question of whether non-human species can perceive other’s actions as goal-directed has been more controversial, however there is mounting evidence that at least some primates species do. Recently domestic dogs have been shown to be particularly sensitive to human communicative cues and more so in cooperative and intentional contexts. Furthermore, they have been shown to imitate selectively. Taken together these results suggest that dogs may perceive others'' actions as goal-directed, however no study has investigated this issue directly. In the current study, adopting an infant habituation-dishabituation paradigm, we investigated whether dogs attribute intentions to an animate (a human) but not an inanimate (a black box) agent interacting with an object. Following an habituation phase in which the agent interacted always with one of two objects, two sets of 3 trials were presented: new side trials (in which the agent interacted with the same object as in the habituation trial but placed in a novel location) and new goal trials (in which the agent interacted with the other object placed in the old location). Dogs showed a similar pattern of response to that shown in infants, looking longer in the new goal than new side trials when they saw the human agent interact with the object. No such difference emerging with the inanimate agent (the black box). Results provide the first evidence that a non-primate species can perceive another individual’s actions as goal-directed. We discuss results in terms of the prevailing mentalisitic and non-mentalistic hypotheses regarding goal-attribution.     

Gaze following in human infants depends on communicative signals

Humans are extremely sensitive to ostensive signals, like eye contact or having their name called, that indicate someone's communicative intention toward them [1-3]. Infants also pay attention to these signals [4-6], but it is unknown whether they appreciate their significance in the initiation of communicative acts. In two experiments, we employed video presentation of an actor turning toward one of two objects and recorded infants' gaze-following behavior [7-13] with eye-tracking techniques [11, 12]. We found that 6-month-old infants followed the adult's gaze (a potential communicative-referential signal) toward an object only when such an act is preceded by ostensive cues such as direct gaze (experiment 1) and infant-directed speech (experiment 2). Such a link between the presence of ostensive signals and gaze following suggests that this behavior serves a functional role in assisting infants to effectively respond to referential communication directed to them. Whereas gaze following in many nonhuman species supports social information gathering [14-18], in humans it initially appears to reflect the expectation of a more active, communicative role from the information source.     

Dogs' gaze following is tuned to human communicative signals

Recent evidence suggests that preverbal infants' gaze following can be triggered only if an actor's head turn is preceded by the expression of communicative intent [1]. Such connectedness between ostensive and referential signals may be uniquely human, enabling infants to effectively respond to referential communication directed to them. In the light of increasing evidence of dogs' social communicative skills [2], an intriguing question is whether dogs' responsiveness to human directional gestures [3] is associated with the situational context in an infant-like manner. Borrowing a method used in infant studies [1], dogs watched video presentations of a human actor turning toward one of two objects, and their eye-gaze patterns were recorded with an eye tracker. Results show a higher tendency of gaze following in dogs when the human's head turning was preceded by the expression of communicative intent (direct gaze, addressing). This is the first evidence to show that (1) eye-tracking techniques can be used for studying dogs' social skills and (2) the exploitation of human gaze cues depends on the communicatively relevant pattern of ostensive and referential signals in dogs. Our findings give further support to the existence of a functionally infant-analog social competence in this species.     

Mirroring and the development of action understanding

The discovery of mirror neurons in the monkey motor cortex has inspired wide-ranging hypotheses about the potential relationship between action control and social cognition. In this paper, we consider the hypothesis that this relationship supports the early development of a critical aspect of social understanding, the ability to analyse others’ actions in terms of goals. Recent investigations of infant action understanding have revealed rich connections between motor development and the analysis of goals in others’ actions. In particular, infants’ own goal-directed actions influence their analysis of others’ goals. This evidence indicates that the cognitive systems that drive infants’ own actions contribute to their analysis of goals in others’ actions. These effects occur at a relatively abstract level of analysis both in terms of the structure infants perceive in others’ actions and relevant structure in infants’ own actions. Although the neural bases of these effects in infants are not yet well understood, current evidence indicates that connections between action production and action perception in infancy involve the interrelated neural systems at work in generating planned, intelligent action.     

Making Smart Social Judgments Takes Time: Infants' Recruitment of Goal Information When Generating Action Predictions

Previous research has shown that young infants perceive others'' actions as structured by goals. One open question is whether the recruitment of this understanding when predicting others'' actions imposes a cognitive challenge for young infants. The current study explored infants'' ability to utilize their knowledge of others'' goals to rapidly predict future behavior in complex social environments and distinguish goal-directed actions from other kinds of movements. Fifteen-month-olds (N = 40) viewed videos of an actor engaged in either a goal-directed (grasping) or an ambiguous (brushing the back of her hand) action on a Tobii eye-tracker. At test, critical elements of the scene were changed and infants'' predictive fixations were examined to determine whether they relied on goal information to anticipate the actor''s future behavior. Results revealed that infants reliably generated goal-based visual predictions for the grasping action, but not for the back-of-hand behavior. Moreover, response latencies were longer for goal-based predictions than for location-based predictions, suggesting that goal-based predictions are cognitively taxing. Analyses of areas of interest indicated that heightened attention to the overall scene, as opposed to specific patterns of attention, was the critical indicator of successful judgments regarding an actor''s future goal-directed behavior. These findings shed light on the processes that support “smart” social behavior in infants, as it may be a challenge for young infants to use information about others'' intentions to inform rapid predictions.     

Early Social Experience Predicts Referential Communicative Adjustments in Five-Year-Old Children

A large body of work has focused on children’s ability to attribute mental states to other people, and whether these abilities are influenced by the extent and nature of children’s social interactions. However, it remains largely unknown which developmental factors shape children’s ability to influence the mental states of others. Building on the suggestion that collaborative experiences early in life might be crucial for the emergence of mental coordination abilities, here we assess the relative contribution of social exposure to familial and non-familial agents on children’s communicative adjustments to their mental model of an addressee (‘audience design’). During an online interactive game, five-year-olds spontaneously organized their non-verbal communicative behaviors according to their beliefs about an interlocutor. The magnitude of these communicative adjustments was predicted by the time spent at daycare, from birth until four years of age, over and above effects of familial social environment. These results suggest that the degree of non-familial social interaction early in life modulates the influence that children’s beliefs have on their referential communicative behavior.     

Joint Attention without Gaze Following: Human Infants and Their Parents Coordinate Visual Attention to Objects through Eye-Hand Coordination

The coordination of visual attention among social partners is central to many components of human behavior and human development. Previous research has focused on one pathway to the coordination of looking behavior by social partners, gaze following. The extant evidence shows that even very young infants follow the direction of another''s gaze but they do so only in highly constrained spatial contexts because gaze direction is not a spatially precise cue as to the visual target and not easily used in spatially complex social interactions. Our findings, derived from the moment-to-moment tracking of eye gaze of one-year-olds and their parents as they actively played with toys, provide evidence for an alternative pathway, through the coordination of hands and eyes in goal-directed action. In goal-directed actions, the hands and eyes of the actor are tightly coordinated both temporally and spatially, and thus, in contexts including manual engagement with objects, hand movements and eye movements provide redundant information about where the eyes are looking. Our findings show that one-year-olds rarely look to the parent''s face and eyes in these contexts but rather infants and parents coordinate looking behavior without gaze following by attending to objects held by the self or the social partner. This pathway, through eye-hand coupling, leads to coordinated joint switches in visual attention and to an overall high rate of looking at the same object at the same time, and may be the dominant pathway through which physically active toddlers align their looking behavior with a social partner.     

Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis

As compared with other primates, humans have especially visible eyes (e.g., white sclera). One hypothesis is that this feature of human eyes evolved to make it easier for conspecifics to follow an individual's gaze direction in close-range joint attentional and communicative interactions, which would seem to imply especially cooperative (mututalistic) conspecifics. In the current study, we tested one aspect of this cooperative eye hypothesis by comparing the gaze following behavior of great apes to that of human infants. A human experimenter "looked" to the ceiling either with his eyes only, head only (eyes closed), both head and eyes, or neither. Great apes followed gaze to the ceiling based mainly on the human's head direction (although eye direction played some role as well). In contrast, human infants relied almost exclusively on eye direction in these same situations. These results demonstrate that humans are especially reliant on eyes in gaze following situations, and thus, suggest that eyes evolved a new social function in human evolution, most likely to support cooperative (mututalistic) social interactions.     

Detecting agents

This paper reviews a recent set of behavioural studies that examine the scope and nature of the representational system underlying theory-of-mind development. Studies with typically developing infants, adults and children with autism all converge on the claim that there is a specialized input system that uses not only morphological cues, but also behavioural cues to categorize novel objects as agents. Evidence is reviewed in which 12- to 15-month-old infants treat certain non-human objects as if they have perceptual/attentional abilities, communicative abilities and goal-directed behaviour. They will follow the attentional orientation of an amorphously shaped novel object if it interacts contingently with them or with another person. They also seem to use a novel object's environmentally directed behaviour to determine its perceptual/attentional orientation and object-oriented goals. Results from adults and children with autism are strikingly similar, despite adults' contradictory beliefs about the objects in question and the failure of children with autism to ultimately develop more advanced theory-of-mind reasoning. The implications for a general theory-of-mind development are discussed.     

Humans but Not Chimpanzees Vary Face-Scanning Patterns Depending on Contexts during Action Observation

Human and nonhuman primates comprehend the actions of other individuals by detecting social cues, including others’ goal-directed motor actions and faces. However, little is known about how this information is integrated with action understanding. Here, we present the ontogenetic and evolutionary foundations of this capacity by comparing face-scanning patterns of chimpanzees and humans as they viewed goal-directed human actions within contexts that differ in whether or not the predicted goal is achieved. Human adults and children attend to the actor’s face during action sequences, and this tendency is particularly pronounced in adults when observing that the predicted goal is not achieved. Chimpanzees rarely attend to the actor’s face during the goal-directed action, regardless of whether the predicted action goal is achieved or not. These results suggest that in humans, but not chimpanzees, attention to actor’s faces conveying referential information toward the target object indicates the process of observers making inferences about the intentionality of an action. Furthermore, this remarkable predisposition to observe others’ actions by integrating the prediction of action goals and the actor’s intention is developmentally acquired.     

Are Dogs Able to Communicate with Their Owners about a Desirable Food in a Referential and Intentional Way?

The ability of dogs to use human communicative signals has been exhaustively studied. However, few studies have focused on the production of communicative signals by dogs. The current study investigated if dogs are able to communicate by using directional signals towards some desirable object in the environment and also if they show an apparent intention to manipulate their owner’s behavior in order to receive it. Some operational criteria were used to investigate referential and intentional communication: the signal should be influenced by the audience and by the recipient’s direction of visual attention; the sender should display gaze alternations between the recipient and the object and attention-getting behaviors, and, finally, the sender should persist and elaborate the communication when attempts to manipulate the recipient failed. Aiming to investigate these criteria in dogs, 29 subjects were tested using an experimental set up in which they could see a desirable but unreachable food and they needed the cooperation of their owners in order to receive it. This study found evidence of all operational criteria, especially for gaze alternation between the owner and the food, which suggested that some dogs’ communicative behaviors could be functionally referential and intentional. Nevertheless, similar to other studies about social cognition in animals, it is not possible to distinguish if the dog’s behaviors are based on simple mechanisms or on a theory of mind about their owners.     

Looking Ahead: Anticipatory Gaze and Motor Ability in Infancy

The present study asks when infants are able to selectively anticipate the goals of observed actions, and how this ability relates to infants’ own abilities to produce those specific actions. Using eye-tracking technology to measure on-line anticipation, 6-, 8- and 10-month-old infants and a control group of adults were tested while observing an adult reach with a whole hand grasp, a precision grasp or a closed fist towards one of two different sized objects. The same infants were also given a comparable action production task. All infants showed proactive gaze to the whole hand grasps, with increased degrees of proactivity in the older groups. Gaze proactivity to the precision grasps, however, was present from 8 months of age. Moreover, the infants’ ability in performing precision grasping strongly predicted their ability in using the actor’s hand shape cues to differentially anticipate the goal of the observed action, even when age was partialled out. The results are discussed in terms of the specificity of action anticipation, and the fine-grained relationship between action production and action perception.     

Social cognition: hi there! here's something interesting

A new study of gaze following shows that human infants are highly sensitive to the communicative intent of the person they are interacting with.     

What experimental experience affects dogs’ comprehension of human communicative actions?

Studies of dogs report that individuals reliably respond to the goal-directed communicative actions (e.g., pointing) of human experimenters. All of these studies use some version of a multi-trial approach, thereby allowing for the possibility of rapid learning within an experimental session. The experiments reported here ask whether dogs can respond correctly to a communicative action based on only a single presentation, thereby eliminating the possibility of learning within the experimental context. We tested 173 dogs. For each dog reaching our test criteria, we used a single presentation of six different goal-directed actions within a session, asking whether they correctly follow to a target goal (container with concealed food) a (1) distal hand point, (2) step toward one container, (3) hand point to one container followed by step toward the other, (4) step toward one container and point to the other, (5) distal foot point with the experimenter's hands free, and (6) distal foot point with the experimenter's hands occupied. Given only a single presentation, dogs selected the correct container when the experimenter hand pointed, foot pointed with hands occupied, or stepped closer to the target container, but failed on the other actions, despite using the same method. The fact that dogs correctly followed foot pointing with hands occupied, but not hands free, suggests that they are sensitive to environmental constraints, and use this information to infer rational, goal-directed action. We discuss these results in light of the role of experience in recognizing communicative gestures, as well as the significance of coding criteria for studies of canine competence.     

How Lovebirds Maneuver Rapidly Using Super-Fast Head Saccades and Image Feature Stabilization

Diurnal flying animals such as birds depend primarily on vision to coordinate their flight path during goal-directed flight tasks. To extract the spatial structure of the surrounding environment, birds are thought to use retinal image motion (optical flow) that is primarily induced by motion of their head. It is unclear what gaze behaviors birds perform to support visuomotor control during rapid maneuvering flight in which they continuously switch between flight modes. To analyze this, we measured the gaze behavior of rapidly turning lovebirds in a goal-directed task: take-off and fly away from a perch, turn on a dime, and fly back and land on the same perch. High-speed flight recordings revealed that rapidly turning lovebirds perform a remarkable stereotypical gaze behavior with peak saccadic head turns up to 2700 degrees per second, as fast as insects, enabled by fast neck muscles. In between saccades, gaze orientation is held constant. By comparing saccade and wingbeat phase, we find that these super-fast saccades are coordinated with the downstroke when the lateral visual field is occluded by the wings. Lovebirds thus maximize visual perception by overlying behaviors that impair vision, which helps coordinate maneuvers. Before the turn, lovebirds keep a high contrast edge in their visual midline. Similarly, before landing, the lovebirds stabilize the center of the perch in their visual midline. The perch on which the birds land swings, like a branch in the wind, and we find that retinal size of the perch is the most parsimonious visual cue to initiate landing. Our observations show that rapidly maneuvering birds use precisely timed stereotypic gaze behaviors consisting of rapid head turns and frontal feature stabilization, which facilitates optical flow based flight control. Similar gaze behaviors have been reported for visually navigating humans. This finding can inspire more effective vision-based autopilots for drones.     

The evolution of social cognition: goal familiarity shapes monkeys' action understanding

What is the evolutionary origin of the human ability to understand and predict the behavior of others? Recent studies suggest that human infants' early capacity for understanding others' goal-directed actions relies on nonmentalistic strategies [1-8]. However, there is no consensus about the nature of the mechanisms underpinning these strategies and their evolutionary history. Comparative studies can shed light on these controversial issues. We carried out three preferential looking-time experiments on macaques, modeled on previous work on human infants [1-5], to test whether macaques are sensitive to the functional efficacy of familiar goal-related hand motor acts performed by an experimenter in a given context and to examine to which extent this sensitivity also is present when observing non-goal-related or unusual goal-related motor acts. We demonstrate that macaque monkeys, similar to human infants, do indeed detect action efficacy by gazing longer at less efficient actions. However, they do so only when the observed behavior is directed to a perceptible and familiar goal. Our results show that the direct detection of the functional fitness of action, in relation to goals that have become familiar through previous experience, is the phylogenetic precursor of intentional understanding.     

Revealing non-analytic kinematic shifts in smooth goal-directed behaviour

How do biological agents plan and organise a smooth accurate path to shift from one smooth mode of behaviour to another as part of graceful movement that is both plastic and controlled? This paper addresses the question in conducting a novel shape analysis of approach and adjustment phases in rapid voluntary target aiming and 2-D reaching hand actions. A number of mode changing experiments are reported that investigate these actions under a range of goals and conditions. After a typically roughly aimed approach, regular projective adjustment is observed that has height and velocity kinematic profiles that are scaled copies of one another. This empirical property is encapsulated as a novel self-similar shift function. The mathematics shows that the biological shifts consist of continual deviation from their full Taylor series everywhere throughout their interval, which is a deep form of plasticity not described before. The experimental results find the same approach and adjustment strategy to occur with behavioural trajectories over the full and varied range of tested goals and conditions. The trajectory shapes have a large degree of predictability through using the shift function to handle extensive variation in the trajectories’ adjustment across individual behaviours and subjects. We provide connections between the behavioural features and results and various neural studies to show how the methodology may be exploited. The conclusion is that a roughly aimed approach followed by a specific highly plastic shift adjustment can provide a regular basis for fast and accurate goal-directed motion in a simple and generalisable way.     

Teleological reasoning in 4-month-old infants: pupil dilations and contextual constraints

Four-month-old infants were presented with feeding actions performed in a rational or irrational manner. Infants reacted to the irrational feeding actions by dilating their pupils, but only in the presence of rich contextual constraints. The study demonstrates that teleological processes are online at 4 months of age and illustrates the usefulness of pupil dilations as a measure of social cognitive processes early in infancy.     

Modifying the object-choice task: Is the way you look important for ravens?

Most animals seem to have difficulties in using gaze cues to find hidden food in object-choice tasks. For instance, chimpanzees usually fail in these tests, even though they are capable of following other's gaze geometrically behind barriers. Similar to chimpanzees, common ravens are skilled in tracking other's gaze but fail in object-choice tasks. We here explored whether procedural modifications, which had been used successfully in chimpanzees, would also yield positive results in ravens. In our modifications (a) the experimenter approached the cup while gazing at it, (b) the gaze cue was accompanied by a sound and (c) the experimenter could actually see the food while giving the gaze cue. Two out of seven birds performed above chance level in some of these conditions. However, we ascribe this improvement to the individuals' learning ability rather than to an understanding of the communicative nature of the task. This interpretation is further supported by results of a follow-up experiment suggesting that ravens may not rely on conspecifics' gaze cues for finding food caches in a natural foraging context. In sum, our results suggest that ravens may not transfer their gaze follow abilities to foraging situations involving hidden food.