The role of auditory feedback in vocal learning and maintenance

Auditory experience is critical for the acquisition and maintenance of learned vocalizations in both humans and songbirds. Despite the central role of auditory feedback in vocal learning and maintenance, where and how auditory feedback affects neural circuits important to vocal control remain poorly understood. Recent studies of singing birds have uncovered neural mechanisms by which feedback perturbations affect vocal plasticity and also have identified feedback-sensitive neurons at or near sites of auditory and vocal motor interaction. Additionally, recent studies in marmosets have underscored that even in the absence of vocal learning, vocalization remains flexible in the face of changing acoustical environments, pointing to rapid interactions between auditory and vocal motor systems. Finally, recent studies show that a juvenile songbird's initial auditory experience of a song model has long-lasting effects on sensorimotor neurons important to vocalization, shedding light on how auditory memories and feedback interact to guide vocal learning.     

At the interface of the auditory and vocal motor systems: NIf and its role in vocal processing,production and learning

Communication between auditory and vocal motor nuclei is essential for vocal learning. In songbirds, the nucleus interfacialis of the nidopallium (NIf) is part of a sensorimotor loop, along with auditory nucleus avalanche (Av) and song system nucleus HVC, that links the auditory and song systems. Most of the auditory information comes through this sensorimotor loop, with the projection from NIf to HVC representing the largest single source of auditory information to the song system. In addition to providing the majority of HVC’s auditory input, NIf is also the primary driver of spontaneous activity and premotor-like bursting during sleep in HVC. Like HVC and RA, two nuclei critical for song learning and production, NIf exhibits behavioral-state dependent auditory responses and strong motor bursts that precede song output. NIf also exhibits extended periods of fast gamma oscillations following vocal production. Based on the converging evidence from studies of physiology and functional connectivity it would be reasonable to expect NIf to play an important role in the learning, maintenance, and production of song. Surprisingly, however, lesions of NIf in adult zebra finches have no effect on song production or maintenance. Only the plastic song produced by juvenile zebra finches during the sensorimotor phase of song learning is affected by NIf lesions. In this review, we carefully examine what is known about NIf at the anatomical, physiological, and behavioral levels. We reexamine conclusions drawn from previous studies in the light of our current understanding of the song system, and establish what can be said with certainty about NIf’s involvement in song learning, maintenance, and production. Finally, we review recent theories of song learning integrating possible roles for NIf within these frameworks and suggest possible parallels between NIf and sensorimotor areas that form part of the neural circuitry for speech processing in humans.     

Common features of neural activity during singing and sleep periods in a basal ganglia nucleus critical for vocal learning in a juvenile songbird

Reactivations of waking experiences during sleep have been considered fundamental neural processes for memory consolidation. In songbirds, evidence suggests the importance of sleep-related neuronal activity in song system motor pathway nuclei for both juvenile vocal learning and maintenance of adult song. Like those in singing motor nuclei, neurons in the basal ganglia nucleus Area X, part of the basal ganglia-thalamocortical circuit essential for vocal plasticity, exhibit singing-related activity. It is unclear, however, whether Area X neurons show any distinctive spiking activity during sleep similar to that during singing. Here we demonstrate that, during sleep, Area X pallidal neurons exhibit phasic spiking activity, which shares some firing properties with activity during singing. Shorter interspike intervals that almost exclusively occurred during singing in awake periods were also observed during sleep. The level of firing variability was consistently higher during singing and sleep than during awake non-singing states. Moreover, deceleration of firing rate, which is considered to be an important firing property for transmitting signals from Area X to the thalamic nucleus DLM, was observed mainly during sleep as well as during singing. These results suggest that songbird basal ganglia circuitry may be involved in the off-line processing potentially critical for vocal learning during sensorimotor learning phase.     

View-Invariant Visuomotor Processing in Computational Mirror Neuron System for Humanoid

Mirror neurons are visuo-motor neurons found in primates and thought to be significant for imitation learning. The proposition that mirror neurons result from associative learning while the neonate observes his own actions has received noteworthy empirical support. Self-exploration is regarded as a procedure by which infants become perceptually observant to their own body and engage in a perceptual communication with themselves. We assume that crude sense of self is the prerequisite for social interaction. However, the contribution of mirror neurons in encoding the perspective from which the motor acts of others are seen have not been addressed in relation to humanoid robots. In this paper we present a computational model for development of mirror neuron system for humanoid based on the hypothesis that infants acquire MNS by sensorimotor associative learning through self-exploration capable of sustaining early imitation skills. The purpose of our proposed model is to take into account the view-dependency of neurons as a probable outcome of the associative connectivity between motor and visual information. In our experiment, a humanoid robot stands in front of a mirror (represented through self-image using camera) in order to obtain the associative relationship between his own motor generated actions and his own visual body-image. In the learning process the network first forms mapping from each motor representation onto visual representation from the self-exploratory perspective. Afterwards, the representation of the motor commands is learned to be associated with all possible visual perspectives. The complete architecture was evaluated by simulation experiments performed on DARwIn-OP humanoid robot.     

Molecular mapping of movement-associated areas in the avian brain: a motor theory for vocal learning origin

Vocal learning is a critical behavioral substrate for spoken human language. It is a rare trait found in three distantly related groups of birds-songbirds, hummingbirds, and parrots. These avian groups have remarkably similar systems of cerebral vocal nuclei for the control of learned vocalizations that are not found in their more closely related vocal non-learning relatives. These findings led to the hypothesis that brain pathways for vocal learning in different groups evolved independently from a common ancestor but under pre-existing constraints. Here, we suggest one constraint, a pre-existing system for movement control. Using behavioral molecular mapping, we discovered that in songbirds, parrots, and hummingbirds, all cerebral vocal learning nuclei are adjacent to discrete brain areas active during limb and body movements. Similar to the relationships between vocal nuclei activation and singing, activation in the adjacent areas correlated with the amount of movement performed and was independent of auditory and visual input. These same movement-associated brain areas were also present in female songbirds that do not learn vocalizations and have atrophied cerebral vocal nuclei, and in ring doves that are vocal non-learners and do not have cerebral vocal nuclei. A compilation of previous neural tracing experiments in songbirds suggests that the movement-associated areas are connected in a network that is in parallel with the adjacent vocal learning system. This study is the first global mapping that we are aware for movement-associated areas of the avian cerebrum and it indicates that brain systems that control vocal learning in distantly related birds are directly adjacent to brain systems involved in movement control. Based upon these findings, we propose a motor theory for the origin of vocal learning, this being that the brain areas specialized for vocal learning in vocal learners evolved as a specialization of a pre-existing motor pathway that controls movement.     

A species-specific acoustic cue for selective song learning in the white-crowned sparrow

Song learning in birds is paradoxical. Without tutoring, songbirds do not develop normal songs. Yet despite this inability, birds possess extensive foreknowledge, in a mechanistic sense, about the normal song of their species. When given a choice of tape recordings, young, n?ive songbirds select sounds of their own species for imitation. We tape-tutored white-crowned sparrows, Zonotrichia leucophrys oriantha, with a set of manipulated songs to investigate whether the introductory whistle universally present in white-crowned sparrow song guides selective song learning in this species. Our results confirm that this whistle serves as a cue for song learning, enabling acquisition of normally rejected sounds of other species, including hermit thrush, Catharus guttatus, notes, which have a sound quality distinct from that of natural white-crowned sparrow phrases. Our results support the conclusion that sensory mechanisms rather than motor constraints are primarily responsible for the selectivity seen in song learning. Copyright 2000 The Association for the Study of Animal Behaviour.     

Hormonal acceleration of song development illuminates motor control mechanism in canaries

In songbirds, the ontogeny of singing behavior shows strong parallels with human speech learning. As in humans, development of learned vocal behavior requires exposure to an acoustic model of species‐typical vocalizations, and, subsequently, a sensorimotor practice period after which the vocalization is produced in a stereotyped manner. This requires mastering motor instructions driving the vocal organ and the respiratory system. Recently, it was shown that, in the case of canaries (Serinus canaria), the diverse syllables, constituting the song, are generated with air sac pressure patterns with characteristic shapes, remarkably, those belonging to a very specific mathematical family. Here, we treated juvenile canaries with testosterone at the onset of the sensorimotor practice period. This hormone exposure accelerated the development of song into stereotyped adultlike song. After 20 days of testosterone treatment, subsyringeal air sac pressure patterns of song resembled those produced by adults, while those of untreated control birds of the same age did not. Detailed temporal structure and modulation patterns emerged rapidly with testosterone treatment, and all previously identified categories of adult song were observed. This research shows that the known effect of testosterone on the neural circuits gives rise to the stereotyped categories of respiratory motor gestures. Extensive practice of these motor patterns during the sensorimotor phase is not required for their expression. © 2010 Wiley Periodicals, Inc. Develop Neurobiol 70: 943–960, 2010     

Dynamic expression of cadherins regulates vocal development in a songbird

Background

Since, similarly to humans, songbirds learn their vocalization through imitation during their juvenile stage, they have often been used as model animals to study the mechanisms of human verbal learning. Numerous anatomical and physiological studies have suggested that songbirds have a neural network called ‘song system’ specialized for vocal learning and production in their brain. However, it still remains unknown what molecular mechanisms regulate their vocal development. It has been suggested that type-II cadherins are involved in synapse formation and function. Previously, we found that type-II cadherin expressions are switched in the robust nucleus of arcopallium from cadherin-7-positive to cadherin-6B-positive during the phase from sensory to sensorimotor learning stage in a songbird, the Bengalese finch. Furthermore, in vitro analysis using cultured rat hippocampal neurons revealed that cadherin-6B enhanced and cadherin-7 suppressed the frequency of miniature excitatory postsynaptic currents via regulating dendritic spine morphology.

Methodology/Principal Findings

To explore the role of cadherins in vocal development, we performed an in vivo behavioral analysis of cadherin function with lentiviral vectors. Overexpression of cadherin-7 in the juvenile and the adult stages resulted in severe defects in vocal production. In both cases, harmonic sounds typically seen in the adult Bengalese finch songs were particularly affected.

Conclusions/Significance

Our results suggest that cadherins control vocal production, particularly harmonic sounds, probably by modulating neuronal morphology of the RA nucleus. It appears that the switching of cadherin expressions from sensory to sensorimotor learning stage enhances vocal production ability to make various types of vocalization that is essential for sensorimotor learning in a trial and error manner.     

Compromised neural selectivity for song in birds with impaired sensorimotor learning

Anterior forebrain (AF) neurons become selective for song as songbirds learn to produce a copy of a memorized tutor song. We report that development of selectivity is compromised when birds are prevented from matching their output to the tutor song. Finches with denervated vocal organs developed stable song, but it usually did not resemble the tutor song. In those birds, numerous neurons in Area X responded selectively to both tutor and bird's own song (BOS), indicating the importance of both in shaping AF responses. The degree of selectivity for BOS was less, however, than that of normal adults. In contrast, neurons in denervated birds that successfully mimicked tutor song exhibited normal adult selectivity for BOS. Thus, during sensorimotor learning, selectivity for complex stimuli may be influenced by how well motor output matches internal sensory models.     

Social modulation of learned behavior by dopamine in the basal ganglia: Insights from songbirds

Dysfunction of the dopaminergic system leads to motor, cognitive, and motivational symptoms in brain disorders such as Parkinson’s disease. The basal ganglia (BG) are involved in sensorimotor learning and receive a strong dopaminergic signal, shown to play an important role in social interactions. The function of the dopaminergic input to the BG in the integration of social cues during sensorimotor learning remains however largely unexplored. Songbirds use learned vocalizations to communicate during courtship and aggressive behaviors. Like language learning in humans, song learning strongly depends on social interactions. In songbirds, a specialized BG–thalamo-cortical loop devoted to song is particularly tractable for elucidating the signals carried by dopamine in the BG, and the function of dopamine signaling in mediating social cues during skill learning and execution. Here, I review experimental findings uncovering the physiological effects and function of the dopaminergic signal in the songbird BG, in light of our knowledge of the BG–dopamine interactions in mammals. Interestingly, the compact nature of the striato-pallidal circuits in birds led to new insight on the physiological effects of the dopaminergic input on the BG network as a whole. In singing birds, D1-like receptor agonist and antagonist can modulate the spectral variability of syllables bi-directionally, suggesting that social context-dependent changes in spectral variability are triggered by dopaminergic input through D1-like receptors. As variability is crucial for exploration during motor learning, but must be reduced after learning to optimize performance, I propose that, the dopaminergic input to the BG could be responsible for the social-dependent regulation of the exploration/exploitation balance in birdsong, and possibly in learned skills in other vertebrates.     

Development of Auditory-Vocal Perceptual Skills in Songbirds

Songbirds are one of the few groups of animals that learn the sounds used for vocal communication during development. Like humans, songbirds memorize vocal sounds based on auditory experience with vocalizations of adult “tutors”, and then use auditory feedback of self-produced vocalizations to gradually match their motor output to the memory of tutor sounds. In humans, investigations of early vocal learning have focused mainly on perceptual skills of infants, whereas studies of songbirds have focused on measures of vocal production. In order to fully exploit songbirds as a model for human speech, understand the neural basis of learned vocal behavior, and investigate links between vocal perception and production, studies of songbirds must examine both behavioral measures of perception and neural measures of discrimination during development. Here we used behavioral and electrophysiological assays of the ability of songbirds to distinguish vocal calls of varying frequencies at different stages of vocal learning. The results show that neural tuning in auditory cortex mirrors behavioral improvements in the ability to make perceptual distinctions of vocal calls as birds are engaged in vocal learning. Thus, separate measures of neural discrimination and behavioral perception yielded highly similar trends during the course of vocal development. The timing of this improvement in the ability to distinguish vocal sounds correlates with our previous work showing substantial refinement of axonal connectivity in cortico-basal ganglia pathways necessary for vocal learning.     

Sensorimotor Learning Biases Choice Behavior: A Learning Neural Field Model for Decision Making

According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject''s learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations.     

Songbird: a unique animal model for studying the molecular basis of disorders of vocal development and communication

Like humans, songbirds are one of the few animal groups that learn vocalization. Vocal learning requires coordination of auditory input and vocal output using auditory feedback to guide one’s own vocalizations during a specific developmental stage known as the critical period. Songbirds are good animal models for understand the neural basis of vocal learning, a complex form of imitation, because they have many parallels to humans with regard to the features of vocal behavior and neural circuits dedicated to vocal learning. In this review, we will summarize the behavioral, neural, and genetic traits of birdsong. We will also discuss how studies of birdsong can help us understand how the development of neural circuits for vocal learning and production is driven by sensory input (auditory information) and motor output (vocalization).     

The interplay of within-species perceptual predispositions and experience during song ontogeny in zebra finches (Taeniopygia guttata)

Vocal acquisition in songbirds and humans shows many similarities, one of which is that both involve a combination of experience and perceptual predispositions. Among languages some speech sounds are shared, while others are not. This could reflect a predisposition in young infants for learning some speech sounds over others, which combines with exposure-based learning. Similarly, in songbirds, some sounds are common across populations, while others are more specific to populations or individuals. We examine whether this is also due to perceptual preferences for certain within-species element types in naive juvenile male birds, and how such preferences interact with exposure to guide subsequent song learning. We show that young zebra finches lacking previous song exposure perceptually prefer songs with more common zebra finch song element types over songs with less common elements. Next, we demonstrate that after subsequent tutoring, birds prefer tutor songs regardless of whether these contain more common or less common elements. In adulthood, birds tutored with more common elements showed a higher song similarity to their tutor song, indicating that the early bias influenced song learning. Our findings help to understand the maintenance of similarities and the presence of differences among birds'' songs, their dialects and human languages.     

Vocal experimentation in the juvenile songbird requires a basal ganglia circuit

Songbirds learn their songs by trial-and-error experimentation, producing highly variable vocal output as juveniles. By comparing their own sounds to the song of a tutor, young songbirds gradually converge to a stable song that can be a remarkably good copy of the tutor song. Here we show that vocal variability in the learning songbird is induced by a basal-ganglia-related circuit, the output of which projects to the motor pathway via the lateral magnocellular nucleus of the nidopallium (LMAN). We found that pharmacological inactivation of LMAN dramatically reduced acoustic and sequence variability in the songs of juvenile zebra finches, doing so in a rapid and reversible manner. In addition, recordings from LMAN neurons projecting to the motor pathway revealed highly variable spiking activity across song renditions, showing that LMAN may act as a source of variability. Lastly, pharmacological blockade of synaptic inputs from LMAN to its target premotor area also reduced song variability. Our results establish that, in the juvenile songbird, the exploratory motor behavior required to learn a complex motor sequence is dependent on a dedicated neural circuit homologous to cortico-basal ganglia circuits in mammals.     

Neural mechanisms of birdsong memory

The process through which young male songbirds learn the characteristics of the songs of an adult male of their own species has strong similarities with speech acquisition in human infants. Both involve two phases: a period of auditory memorization followed by a period during which the individual develops its own vocalizations. The avian 'song system', a network of brain nuclei, is the probable neural substrate for the second phase of sensorimotor learning. By contrast, the neural representation of song memory acquired in the first phase is localized outside the song system, in different regions of the avian equivalent of the human auditory association cortex.     

Territory establishment,song learning strategies and survival in song sparrows

In most songbirds, the processes of song learning and territory establishment overlap in the early life and a young bird usually winds up with songs matching those of his territorial neighbors in his first breeding season. In the present study, we examined the relationships among the timing of territory establishment, the pattern of song learning and territorial success in a sedentary population of song sparrows (Melospiza melodia). Males in this population tend to learn their songs from their neighbors and consequently they show high song sharing with neighbors and use these shared songs preferentially in interactions with them. Males also show significant variation in the timing of territory establishment, ranging from their natal summer to the next spring. Using a three-year dataset, we found that the timing of territory establishment did not systematically affect the composition of the song repertoire of the tutee: early establishers and late establishers learned equally as much from their primary tutors and had a similar number of tutors and similar repertoire sizes, nor did timing of territory establishment affect subsequent survival on territory. Therefore, the song-learning program of song sparrows seems versatile enough to lead to high song sharing even for birds that establish territories relatively late.     

Memory in the making: localized brain activation related to song learning in young songbirds

Songbird males learn to sing their songs from an adult ‘tutor’ early in life, much like human infants learn to speak. Similar to humans, in the songbird brain there are separate neural substrates for vocal production and for auditory memory. In adult songbirds, the caudal pallium, the avian equivalent of the auditory association cortex, has been proposed to contain the neural substrate of tutor song memory, while the song system is involved in song production as well as sensorimotor learning. If this hypothesis is correct, there should be neuronal activation in the caudal pallium, and not in the song system, while the young bird is hearing the tutor song. We found increased song-induced molecular neuronal activation, measured as the expression of an immediate early gene, in the caudal pallium of juvenile zebra finch males that were in the process of learning to sing their songs. No such activation was found in the song system. Molecular neuronal activation was significantly greater in response to tutor song than to novel song or silence in the medial part of the caudomedial nidopallium (NCM). In the caudomedial mesopallium, there was significantly greater molecular neuronal activation in response to tutor song than to silence. In addition, in the NCM there was a significant positive correlation between spontaneous molecular neuronal activation and the strength of song learning during sleep. These results suggest that the caudal pallium contains the neural substrate for tutor song memory, which is activated during sleep when the young bird is in the process of learning its song. The findings provide insight into the formation of auditory memories that guide vocal production learning, a process fundamental for human speech acquisition.     

新纹状体巨细胞核外侧部（LMAN）与鸣禽鸣唱学习可塑性

鸣禽鸣唱控制系统的前端脑通路（anterior forebrain pathway, AFP）在鸣唱学习中发挥着重要作用。新纹状体巨细胞核外侧部（lateral magnocellular nucleus of the anterior neostriatum, LMAN）是AFP的最后一级输出核团,AFP中的信号通过LMAN传导到弓状皮质栎核（robust nucleus of the arcopallium, RA）,与高级发声中枢（high vocal centre,HVC）共同调节RA的活动,从而影响鸣禽的发声行为。LMAN可能通过其与RA的单突触连接来影响鸣唱可塑性。文章对近年来LMAN在鸣唱学习可塑性方面的研究进行综述。