Multimodal communication and language origins: integrating gestures and vocalizations

The presence of divergent and independent research traditions in the gestural and vocal domains of primate communication has resulted in major discrepancies in the definition and operationalization of cognitive concepts. However, in recent years, accumulating evidence from behavioural and neurobiological research has shown that both human and non‐human primate communication is inherently multimodal. It is therefore timely to integrate the study of gestural and vocal communication. Herein, we review evidence demonstrating that there is no clear difference between primate gestures and vocalizations in the extent to which they show evidence for the presence of key language properties: intentionality, reference, iconicity and turn‐taking. We also find high overlap in the neurobiological mechanisms producing primate gestures and vocalizations, as well as in ontogenetic flexibility. These findings confirm that human language had multimodal origins. Nonetheless, we note that in great apes, gestures seem to fulfil a carrying (i.e. predominantly informative) role in close‐range communication, whereas the opposite holds for face‐to‐face interactions of humans. This suggests an evolutionary shift in the carrying role from the gestural to the vocal stream, and we explore this transition in the carrying modality. Finally, we suggest that future studies should focus on the links between complex communication, sociality and cooperative tendency to strengthen the study of language origins.     

Language: Origins, definitions and chimpanzees

Language and its evolutionary origins are examined in the light of empirical data from studies on artificial language acquisition, human language acquisition in the chimpanzee and the definitional problems surrounding language. Rather than providing solutions, questions are raised in regard to the various approaches to the problems of language origin and definitions of language.     

The origins of gestures and language: history,current advances and proposed theories

Investigating in depth the mechanisms underlying human and non‐human primate intentional communication systems (involving gestures, vocalisations, facial expressions and eye behaviours) can shed light on the evolutionary roots of language. Reports on non‐human primates, particularly great apes, suggest that gestural communication would have been a crucial prerequisite for the emergence of language, mainly based on the evidence of large communication repertoires and their associated multifaceted nature of intentionality that are key properties of language. Such research fuels important debates on the origins of gestures and language. We review here three non‐mutually exclusive processes that can explain mainly great apes' gestural acquisition and development: phylogenetic ritualisation, ontogenetic ritualisation, and learning via social negotiation. We hypothesise the following scenario for the evolutionary origins of gestures: gestures would have appeared gradually through evolution via signal ritualisation following the principle of derived activities, with the key involvement of emotional expression and processing. The increasing level of complexity of socioecological lifestyles and associated daily manipulative activities might then have enabled the acquisition and development of different interactional strategies throughout the life cycle. Many studies support a multimodal origin of language. However, we stress that the origins of language are not only multimodal, but more broadly multicausal. We propose a multicausal theory of language origins which better explains current findings. It postulates that primates' communicative signalling is a complex trait continually shaped by a cost–benefit trade‐off of signal production and processing of interactants in relation to four closely interlinked categories of evolutionary and life cycle factors: species, individual and context‐related characteristics as well as behaviour and its characteristics. We conclude by suggesting directions for future research to improve our understanding of the evolutionary roots of gestures and language.     

Primate vocal communication: a useful tool for understanding human speech and language evolution?

Language is a uniquely human trait, and questions of how and why it evolved have been intriguing scientists for years. Nonhuman primates (primates) are our closest living relatives, and their behavior can be used to estimate the capacities of our extinct ancestors. As humans and many primate species rely on vocalizations as their primary mode of communication, the vocal behavior of primates has been an obvious target for studies investigating the evolutionary roots of human speech and language. By studying the similarities and differences between human and primate vocalizations, comparative research has the potential to clarify the evolutionary processes that shaped human speech and language. This review examines some of the seminal and recent studies that contribute to our knowledge regarding the link between primate calls and human language and speech. We focus on three main aspects of primate vocal behavior: functional reference, call combinations, and vocal learning. Studies in these areas indicate that despite important differences, primate vocal communication exhibits some key features characterizing human language. They also indicate, however, that some critical aspects of speech, such as vocal plasticity, are not shared with our primate cousins. We conclude that comparative research on primate vocal behavior is a very promising tool for deepening our understanding of the evolution of human speech and language, but much is still to be done as many aspects of monkey and ape vocalizations remain largely unexplored.     

Chimpanzee vocal signaling points to a multimodal origin of human language

The evolutionary origin of human language and its neurobiological foundations has long been the object of intense scientific debate. Although a number of theories have been proposed, one particularly contentious model suggests that human language evolved from a manual gestural communication system in a common ape-human ancestor. Consistent with a gestural origins theory are data indicating that chimpanzees intentionally and referentially communicate via manual gestures, and the production of manual gestures, in conjunction with vocalizations, activates the chimpanzee Broca's area homologue--a region in the human brain that is critical for the planning and execution of language. However, it is not known if this activity observed in the chimpanzee Broca's area is the result of the chimpanzees producing manual communicative gestures, communicative sounds, or both. This information is critical for evaluating the theory that human language evolved from a strictly manual gestural system. To this end, we used positron emission tomography (PET) to examine the neural metabolic activity in the chimpanzee brain. We collected PET data in 4 subjects, all of whom produced manual communicative gestures. However, 2 of these subjects also produced so-called attention-getting vocalizations directed towards a human experimenter. Interestingly, only the two subjects that produced these attention-getting sounds showed greater mean metabolic activity in the Broca's area homologue as compared to a baseline scan. The two subjects that did not produce attention-getting sounds did not. These data contradict an exclusive "gestural origins" theory for they suggest that it is vocal signaling that selectively activates the Broca's area homologue in chimpanzees. In other words, the activity observed in the Broca's area homologue reflects the production of vocal signals by the chimpanzees, suggesting that this critical human language region was involved in vocal signaling in the common ancestor of both modern humans and chimpanzees.     

Stone tools, language and the brain in human evolution

Long-standing speculations and more recent hypotheses propose a variety of possible evolutionary connections between language, gesture and tool use. These arguments have received important new support from neuroscientific research on praxis, observational action understanding and vocal language demonstrating substantial functional/anatomical overlap between these behaviours. However, valid reasons for scepticism remain as well as substantial differences in detail between alternative evolutionary hypotheses. Here, we review the current status of alternative 'gestural' and 'technological' hypotheses of language origins, drawing on current evidence of the neural bases of speech and tool use generally, and on recent studies of the neural correlates of Palaeolithic technology specifically.     

The Evolution of Language: A Comparative Review

For many years the evolution of language has been seen as a disreputable topic, mired in fanciful “just so stories” about language origins. However, in the last decade a new synthesis of modern linguistics, cognitive neuroscience and neo-Darwinian evolutionary theory has begun to make important contributions to our understanding of the biology and evolution of language. I review some of this recent progress, focusing on the value of the comparative method, which uses data from animal species to draw inferences about language evolution. Discussing speech first, I show how data concerning a wide variety of species, from monkeys to birds, can increase our understanding of the anatomical and neural mechanisms underlying human spoken language, and how bird and whale song provide insights into the ultimate evolutionary function of language. I discuss the “descended larynx” of humans, a peculiar adaptation for speech that has received much attention in the past, which despite earlier claims is not uniquely human. Then I will turn to the neural mechanisms underlying spoken language, pointing out the difficulties animals apparently experience in perceiving hierarchical structure in sounds, and stressing the importance of vocal imitation in the evolution of a spoken language. Turning to ultimate function, I suggest that communication among kin (especially between parents and offspring) played a crucial but neglected role in driving language evolution. Finally, I briefly discuss phylogeny, discussing hypotheses that offer plausible routes to human language from a non-linguistic chimp-like ancestor. I conclude that comparative data from living animals will be key to developing a richer, more interdisciplinary understanding of our most distinctively human trait: language.     

On the Evolutionary Foundations of Language

New data on the cognitive capacities of other primates requires a reevaluation of our position on the nature of human language and the factors that led to its development. Pressures on the limited display system of the social primates may have made changes in the vocal tract anatomy of man associated with the development of upright posture of great selective importance. Human vocal tract anatomy may be at least as important as brain capacity in accounting for the origins of human language. An apparent upper age limit on efficient language acquisition in man leads to the "foreign accent" phenomenon. This may have been adoptively significant as a device which helped in the maintenance of a population structure in which rapid genetic change was possible. Embedding in language may represent a cognitive ability that is also reflected in the capacity for cultural variation, and may be extremely important in maintaining efficient population structure and in selecting for increasing intelligence.     

Language, Handedness, and Primate Brains: Did the Australopithecines Sign?

Evidence from comparative primate neuroanatomy, archaeology, and studies of vocalization systems of nonhuman primates suggests that human vocal language has a long evolutionary history and that there is continuity between our early primate ancestors' call systems and human speech. Old World monkeys exhibit cerebral asymmetries similar to those that appear related to human language. If arboreal monkeylike ancestors of humans were also characterized by cerebral asymmetry, then the fundamental asymmetry that forms the neurological substrate for human language may have been established through selection for simple "discrete" call systems in an arboreal habitat and would have occurred much longer ago than previously thought. The eventual shift from an arboreal to a terrestrial habitat was accompanied by increased complexity ("gradation") of vocal communication systems. The archaeological record of tools suggests that communication systems became still more complex under the selective pressures that led to bipedalism and that language had been selected for by the time that bipedalism was achieved. Contrary to the gestural hypothesis, right-handedness (which could not have preceded freeing of the hands) succeeded speech and may have been due to selective pressures for increased complexity of communication, causing a Field Effect upon the brain. [australopithecine, cerebral asymmetry, language, primate brains, right-handedness]     

Social learning of a communicative signal in captive chimpanzees

The acquisition of linguistic competency from more experienced social partners is a fundamental aspect of human language. However, there is little evidence that non-human primates learn to use their vocalizations from social partners. Captive chimpanzees (Pan troglodytes) produce idiosyncratic vocal signals that are used intentionally to capture the attention of a human experimenter. Interestingly, not all apes produce these sounds, and it is unclear what factors explain this difference. We tested the hypothesis that these attention-getting (AG) sounds are socially learned via transmission between mothers and their offspring. We assessed 158 chimpanzees to determine if they produced AG sounds. A significant association was found between mother and offspring sound production. This association was attributable to individuals who were raised by their biological mother-as opposed to those raised by humans in a nursery environment. These data support the hypothesis that social learning plays a role in the acquisition and use of communicative vocal signals in chimpanzees.     

Approche paléontologique de l’évolution du langage : un état des lieux

One of the most influential paleoanthropological approaches to the question of language origins has been the attempt to reconstruct the supralaryngeal vocal tract (SVT) in fossil humans. In particular, the low placement of the larynx was considered to be a uniquely human feature and was interpreted as a specific adaptation to produce human speech. Nevertheless, based on the anatomy of the basicranium and the hyoid bone, various researchers reached different conclusions regarding the placement of the larynx in human fossils, especially in Neandertals. Further, the recent finding of a low placement of the larynx in chimpanzees, calls into question the basic premise on which much of this research has been based. To overcome this, we have proposed and developed a new line of research into the question of speech capabilities in fossil specimens which is focused not on the ability to produce the sounds of spoken language, but on the capacity to perceive them. The modern human auditory pattern is unique among primates in showing a relatively heightened sensitivity to the midrange frequencies between 2-4 kHz, a frequency range which coincides with that of spoken language. Our analysis shows that the preserved skeletal anatomy of the outer and middle ear in the Middle Pleistocene hominids from the site of the Sima de los Huesos is compatible with human-like auditory capacities, and is clearly different from chimpanzees in the midrange frequencies. These results strongly suggest that the anatomical structures which support the modern hum and pattern of intraspecific communication were already present in these human ancestors. Further, the presence of a common condition in both the modern human and Neandertal evolutionary lineages suggests this represents an ancient adaptation within the genus Homo.     

Symbols are not uniquely human

Modern semiotics is a branch of logics that formally defines symbol-based communication. In recent years, the semiotic classification of signs has been invoked to support the notion that symbols are uniquely human. Here we show that alarm-calls such as those used by African vervet monkeys (Cercopithecus aethiops), logically satisfy the semiotic definition of symbol. We also show that the acquisition of vocal symbols in vervet monkeys can be successfully simulated by a computer program based on minimal semiotic and neurobiological constraints. The simulations indicate that learning depends on the tutor-predator ratio, and that apprentice-generated auditory mistakes in vocal symbol interpretation have little effect on the learning rates of apprentices (up to 80% of mistakes are tolerated). In contrast, just 10% of apprentice-generated visual mistakes in predator identification will prevent any vocal symbol to be correctly associated with a predator call in a stable manner. Tutor unreliability was also deleterious to vocal symbol learning: a mere 5% of "lying" tutors were able to completely disrupt symbol learning, invariably leading to the acquisition of incorrect associations by apprentices. Our investigation corroborates the existence of vocal symbols in a non-human species, and indicates that symbolic competence emerges spontaneously from classical associative learning mechanisms when the conditioned stimuli are self-generated, arbitrary and socially efficacious. We propose that more exclusive properties of human language, such as syntax, may derive from the evolution of higher-order domains for neural association, more removed from both the sensory input and the motor output, able to support the gradual complexification of grammatical categories into syntax.     

The function and mechanism of vocal accommodation in humans and other primates

The study of non‐human animals, in particular primates, can provide essential insights into language evolution. A critical element of language is vocal production learning, i.e. learning how to produce calls. In contrast to other lineages such as songbirds, vocal production learning of completely new signals is strikingly rare in non‐human primates. An increasing body of research, however, suggests that various species of non‐human primates engage in vocal accommodation and adjust the structure of their calls in response to environmental noise or conspecific vocalizations. To date it is unclear what role vocal accommodation may have played in language evolution, in particular because it summarizes a variety of heterogeneous phenomena which are potentially achieved by different mechanisms. In contrast to non‐human primates, accommodation research in humans has a long tradition in psychology and linguistics. Based on theoretical models from these research traditions, we provide a new framework which allows comparing instances of accommodation across species, and studying them according to their underlying mechanism and ultimate biological function. We found that at the mechanistic level, many cases of accommodation can be explained with an automatic perception–production link, but some instances arguably require higher levels of vocal control. Functionally, both human and non‐human primates use social accommodation to signal social closeness or social distance to a partner or social group. Together, this indicates that not only some vocal control, but also the communicative function of vocal accommodation to signal social closeness and distance must have evolved prior to the emergence of language, rather than being the result of it. Vocal accommodation as found in other primates has thus endowed our ancestors with pre‐adaptations that may have paved the way for language evolution.     

Age- and sex-dependent contact call usage in Japanese macaques

The question of the flexibility of nonhuman primate vocal communication remains open today, especially due to early evidence of innately guided vocal production. However, socially determined flexibility can be found when the debate is moved from vocal structure to vocal usage. While increasing evidence shows that the audience quality influences the vocal behaviour of nonhuman primates, the impact of the caller’s characteristics has been far less studied. Here, we tested the influence of an individual’s sex and age on the usage style of contact calls. We recorded contact calls of male and female Japanese macaques and compared the vocal usage styles of approximately 1-year-old juveniles with those of adults at various ages. We found, first, important differences in call usage style between juveniles and adults, the latter forming temporally ruled vocal exchanges respecting an interindividual turntaking principle. Moreover, sex differences were substantial in adults but nonexistent in juveniles. Finally, age continued to influence female vocal behaviour during adulthood, whereas dominance rank explained differences between adult males. Two nonexclusive mechanisms can explain this phenomenon, that is, a socially guided development of the appropriate form of calling versus an emotional maturation to control call emission, opening new lines of research on nonhuman primate vocal development of appropriate usages.     

非人灵长类声音通讯的研究进展

声音通讯是非人灵长类研究一个重要的研究领域,有助于了解非人灵长类的社会行为、个体关系、行为进化和社会演化等,甚至对探究人类语言起源和进化等方面也具有十分重要的意义.本文通过对非人灵长类声音通讯的研究内容、影响因素和研究方法等进行了梳理,探讨非人灵长类声音通讯研究的前景和展望,旨在进一步推动国内非人灵长类声音通讯研究的深...     

Vertical transmission of learned signatures in a wild parrot

Learned birdsong is a widely used animal model for understanding the acquisition of human speech. Male songbirds often learn songs from adult males during sensitive periods early in life, and sing to attract mates and defend territories. In presumably all of the 350+ parrot species, individuals of both sexes commonly learn vocal signals throughout life to satisfy a wide variety of social functions. Despite intriguing parallels with humans, there have been no experimental studies demonstrating learned vocal production in wild parrots. We studied contact call learning in video-rigged nests of a well-known marked population of green-rumped parrotlets (Forpus passerinus) in Venezuela. Both sexes of naive nestlings developed individually unique contact calls in the nest, and we demonstrate experimentally that signature attributes are learned from both primary care-givers. This represents the first experimental evidence for the mechanisms underlying the transmission of a socially acquired trait in a wild parrot population.     

Derived vocalizations of geladas (Theropithecus gelada) and the evolution of vocal complexity in primates

Primates are intensely social and exhibit extreme variation in social structure, making them particularly well suited for uncovering evolutionary connections between sociality and vocal complexity. Although comparative studies find a correlation between social and vocal complexity, the function of large vocal repertoires in more complex societies remains unclear. We compared the vocal complexity found in primates to both mammals in general and human language in particular and found that non-human primates are not unusual in the complexity of their vocal repertoires. To better understand the function of vocal complexity within primates, we compared two closely related primates (chacma baboons and geladas) that differ in their ecology and social structures. A key difference is that gelada males form long-term bonds with the 2-12 females in their harem-like reproductive unit, while chacma males primarily form temporary consortships with females. We identified homologous and non-homologous calls and related the use of the derived non-homologous calls to specific social situations. We found that the socially complex (but ecologically simple) geladas have larger vocal repertoires. Derived vocalizations of geladas were primarily used by leader males in affiliative interactions with 'their' females. The derived calls were frequently used following fights within the unit suggesting that maintaining cross-sex bonds within a reproductive unit contributed to this instance of evolved vocal complexity. Thus, our comparison highlights the utility of using closely related species to better understand the function of vocal complexity.     

Evolution of protolinguistic abilities as a by-product of learning to forage in structured environments

The skills required for the learning and use of language are the focus of extensive research, and their evolutionary origins are widely debated. Using agent-based simulations in a range of virtual environments, we demonstrate that challenges of foraging for food can select for cognitive mechanisms supporting complex, hierarchical, sequential learning, the need for which arises in language acquisition. Building on previous work, where we explored the conditions under which reinforcement learning is out-competed by seldom-reinforced continuous learning that constructs a network model of the environment, we now show that realistic features of the foraging environment can select for two critical advances: (i) chunking of meaningful sequences found in the data, leading to representations composed of units that better fit the prevalent statistical patterns in the environment; and (ii) generalization across units based on their contextual similarity. Importantly, these learning processes, which in our framework evolved for making better foraging decisions, had been earlier shown to reproduce a range of findings in language learning in humans. Thus, our results suggest a possible evolutionary trajectory that may have led from basic learning mechanisms to complex hierarchical sequential learning that can support advanced cognitive abilities of the kind needed for language acquisition.     

Animal vocal sequences: not the Markov chains we thought they were

Many animals produce vocal sequences that appear complex. Most researchers assume that these sequences are well characterized as Markov chains (i.e. that the probability of a particular vocal element can be calculated from the history of only a finite number of preceding elements). However, this assumption has never been explicitly tested. Furthermore, it is unclear how language could evolve in a single step from a Markovian origin, as is frequently assumed, as no intermediate forms have been found between animal communication and human language. Here, we assess whether animal taxa produce vocal sequences that are better described by Markov chains, or by non-Markovian dynamics such as the ‘renewal process’ (RP), characterized by a strong tendency to repeat elements. We examined vocal sequences of seven taxa: Bengalese finches Lonchura striata domestica, Carolina chickadees Poecile carolinensis, free-tailed bats Tadarida brasiliensis, rock hyraxes Procavia capensis, pilot whales Globicephala macrorhynchus, killer whales Orcinus orca and orangutans Pongo spp. The vocal systems of most of these species are more consistent with a non-Markovian RP than with the Markovian models traditionally assumed. Our data suggest that non-Markovian vocal sequences may be more common than Markov sequences, which must be taken into account when evaluating alternative hypotheses for the evolution of signalling complexity, and perhaps human language origins.