The role of premotor cortex in speech perception: evidence from fMRI and rTMS.

This article discusses recent functional magnetic resonance imaging (fMRI) and repetitive Transcranial Magnetic Stimulation (rTMS) data that suggest a direct involvement of premotor cortical areas in speech perception. These new data map well onto psychological theories advocating an active role of motor structures in the perception of speech sounds. It is proposed that the perception of speech is enabled--at least in part--by a process that simulates speech production.     

Automatic stimulus-induced medial premotor cortex activation without perception or action

Who has ever been surprised to return to the bowl of salted peanuts without realizing it, even after having eating a moderate number and deciding to stop? Using rapid event-related functional magnetic resonance imaging (fMRI) in healthy volunteers, we investigated the neural correlates of automatic processes induced by subliminal stimuli. We demonstrated that the automatic activation of motor programs elicited unconsciously in the medial premotor cortex was normally restricted to specific contexts set by the environment, but can occur below the threshold of awareness even when no movement was executed. This novel finding expands our view on brain mechanisms underlying unconscious motor control and provides new evidence that activation of the motor preparation system and consciousness are not obligatory linked.     

The role of ventral premotor cortex in action execution and action understanding

The human ventral premotor cortex overlaps, at least in part, with Broca's region in the dominant cerebral hemisphere, that is known to mediate the production of language and contributes to language comprehension. This region is constituted of Brodmann's areas 44 and 45 in the inferior frontal gyrus. We summarize the evidence that the motor related part of Broca's region is localized in the opercular portion of the inferior frontal cortex, mainly in area 44 of Brodmann. According to our own data, there seems to be a homology between Brodmann area 44 in humans and the monkey area F5. The non-language related motor functions of Broca's region comprise complex hand movements, associative sensorimotor learning and sensorimotor integration. Brodmann's area 44 is also a part of a specialized parieto-premotor network and interacts significantly with the neighbouring premotor areas. In the ventral premotor area F5 of monkeys, the so called mirror neurons have been found which discharge both when the animal performs a goal-directed hand action and when it observes another individual performing the same or a similar action. More recently, in the same area mirror neurons responding not only to the observation of mouth actions, but also to sounds characteristic to actions have been found. In humans, through an fMRI study, it has been shown that the observation of actions performed with the hand, the mouth and the foot leads to the activation of different sectors of Broca's area and premotor cortex, according to the effector involved in the observed action, following a somatotopic pattern which resembles the classical motor cortex homunculus. On the other hand the evidence is growing that human ventral premotor cortex, especially Brodmann's area 44, is involved in polymodal action processing. These results strongly support the existence of an execution-observation matching system (mirror neuron system). It has been proposed that this system is involved in polymodal action recognition and might represent a precursor of language processing. Experimental evidence in favour of this hypothesis both in the monkey and humans is shortly reviewed.     

Functionally specific reorganization in human premotor cortex

After unilateral stroke, the dorsal premotor cortex (PMd) in the intact hemisphere is often more active during movement of an affected limb. Whether this contributes to motor recovery is unclear. Functional magnetic resonance imaging (fMRI) was used to investigate short-term reorganization in right PMd after transcranial magnetic stimulation (TMS) disrupted the dominant left PMd, which is specialized for action selection. Even when 1 Hz left PMd TMS had no effect on behavior, there was a compensatory increase in activity in right PMd and connected medial premotor areas. This activity was specific to task periods of action selection as opposed to action execution. Compensatory activation changes were both functionally specific and anatomically specific: the same pattern was not seen after TMS of left sensorimotor cortex. Subsequent TMS of the reorganized right PMd did disrupt performance. Thus, this pattern of functional reorganization has a causal role in preserving behavior after neuronal challenge.     

The essential role of centrosomal NDE1 in human cerebral cortex neurogenesis

We investigated three families whose offspring had extreme microcephaly at birth and profound mental retardation. Brain scans and postmortem data showed that affected individuals had brains less than 10% of expected size (≤10 standard deviation) and that in addition to a massive reduction in neuron production they displayed partially deficient cortical lamination (microlissencephaly). Other body systems were apparently unaffected and overall growth was normal. We found two distinct homozygous mutations of NDE1, c.83+1G>T (p.Ala29GlnfsX114) in a Turkish family and c.684_685del (p.Pro229TrpfsX85) in two families of Pakistani origin. Using patient cells, we found that c.83+1G>T led to the use of a novel splice site and to a frameshift after NDE1 exon 2. Transfection of tagged NDE1 constructs showed that the c.684_685del mutation resulted in a NDE1 that was unable to localize to the centrosome. By staining a patient-derived cell line that carried the c.83+1G>T mutation, we found that this endogeneously expressed mutated protein equally failed to localize to the centrosome. By examining human and mouse embryonic brains, we determined that NDE1 is highly expressed in neuroepithelial cells of the developing cerebral cortex, particularly at the centrosome. We show that NDE1 accumulates on the mitotic spindle of apical neural precursors in early neurogenesis. Thus, NDE1 deficiency causes both a severe failure of neurogenesis and a deficiency in cortical lamination. Our data further highlight the importance of the centrosome in multiple aspects of neurodevelopment.     

The human premotor cortex is 'mirror' only for biological actions

Previous work has shown that both human adults and children attend to grasping actions performed by another person but not necessarily to those made by a mechanical device. According to recent neurophysiological data, the monkey premotor cortex contains "mirror" neurons that discharge both when the monkey performs specific manual grasping actions and when it observes another individual performing the same or similar actions. However, when a human model uses tools to perform grasping actions, the mirror neurons are not activated. A similar "mirror" system has been described in humans, but whether or not it is also tuned specifically to biological actions has never been tested. Here we show that when subjects observed manual grasping actions performed by a human model a significant neural response was elicited in the left premotor cortex. This activation was not evident for the observation of grasping actions performed by a robot model commanded by an experimenter. This result indicates for the first time that in humans the mirror system is biologically tuned. This system appears to be the neural substrate for biological preference during action coding.     

Cross-modal prediction in speech perception

Speech perception often benefits from vision of the speaker's lip movements when they are available. One potential mechanism underlying this reported gain in perception arising from audio-visual integration is on-line prediction. In this study we address whether the preceding speech context in a single modality can improve audiovisual processing and whether this improvement is based on on-line information-transfer across sensory modalities. In the experiments presented here, during each trial, a speech fragment (context) presented in a single sensory modality (voice or lips) was immediately continued by an audiovisual target fragment. Participants made speeded judgments about whether voice and lips were in agreement in the target fragment. The leading single sensory context and the subsequent audiovisual target fragment could be continuous in either one modality only, both (context in one modality continues into both modalities in the target fragment) or neither modalities (i.e., discontinuous). The results showed quicker audiovisual matching responses when context was continuous with the target within either the visual or auditory channel (Experiment 1). Critically, prior visual context also provided an advantage when it was cross-modally continuous (with the auditory channel in the target), but auditory to visual cross-modal continuity resulted in no advantage (Experiment 2). This suggests that visual speech information can provide an on-line benefit for processing the upcoming auditory input through the use of predictive mechanisms. We hypothesize that this benefit is expressed at an early level of speech analysis.     

Emotional speech perception unfolding in time: the role of the basal ganglia

The basal ganglia (BG) have repeatedly been linked to emotional speech processing in studies involving patients with neurodegenerative and structural changes of the BG. However, the majority of previous studies did not consider that (i) emotional speech processing entails multiple processing steps, and the possibility that (ii) the BG may engage in one rather than the other of these processing steps. In the present study we investigate three different stages of emotional speech processing (emotional salience detection, meaning-related processing, and identification) in the same patient group to verify whether lesions to the BG affect these stages in a qualitatively different manner. Specifically, we explore early implicit emotional speech processing (probe verification) in an ERP experiment followed by an explicit behavioral emotional recognition task. In both experiments, participants listened to emotional sentences expressing one of four emotions (anger, fear, disgust, happiness) or neutral sentences. In line with previous evidence patients and healthy controls show differentiation of emotional and neutral sentences in the P200 component (emotional salience detection) and a following negative-going brain wave (meaning-related processing). However, the behavioral recognition (identification stage) of emotional sentences was impaired in BG patients, but not in healthy controls. The current data provide further support that the BG are involved in late, explicit rather than early emotional speech processing stages.     

Echoes of the spoken past: how auditory cortex hears context during speech perception

What do we hear when someone speaks and what does auditory cortex (AC) do with that sound? Given how meaningful speech is, it might be hypothesized that AC is most active when other people talk so that their productions get decoded. Here, neuroimaging meta-analyses show the opposite: AC is least active and sometimes deactivated when participants listened to meaningful speech compared to less meaningful sounds. Results are explained by an active hypothesis-and-test mechanism where speech production (SP) regions are neurally re-used to predict auditory objects associated with available context. By this model, more AC activity for less meaningful sounds occurs because predictions are less successful from context, requiring further hypotheses be tested. This also explains the large overlap of AC co-activity for less meaningful sounds with meta-analyses of SP. An experiment showed a similar pattern of results for non-verbal context. Specifically, words produced less activity in AC and SP regions when preceded by co-speech gestures that visually described those words compared to those words without gestures. Results collectively suggest that what we ‘hear’ during real-world speech perception may come more from the brain than our ears and that the function of AC is to confirm or deny internal predictions about the identity of sounds.     

Temporal evolution of a decision-making process in medial premotor cortex

The events linking sensory discrimination to motor action remain unclear. It is not known, for example, whether the motor areas of the frontal lobe receive the result of the discrimination process from other areas or whether they actively participate in it. To investigate this, we trained monkeys to discriminate between two mechanical vibrations applied sequentially to the fingertips; here subjects had to recall the first vibration, compare it to the second one, and indicate with a hand/arm movement which of the two vibrations had the higher frequency. We recorded the activity of single neurons in medial premotor cortex (MPC) and found that their responses correlate with the diverse stages of the discrimination process. Thus, activity in MPC reflects the temporal evolution of the decision-making process leading to action selection during this perceptual task.     

A theory of speech perception

A theory of speech perception based on evolutionary adaptive postulates is suggested. The principles are grouped around two categories: (a) the physical properties of the stimulus energy and its distributions in the environment; (b) the tendency of the sensory powers to become optimum in order to aid the survival of the species. The construction of the theory and the experiments performed to test its basic predictions are summarized. The theory is examined rather thoroughly with respect to basic vowel space. A line of generalization for the treatment of consonants is indicated.     

Neuronal correlates of a perceptual decision in ventral premotor cortex

The ventral premotor cortex (VPC) is involved in the transformation of sensory information into action, although the exact neuronal operation is not known. We addressed this problem by recording from single neurons in VPC while trained monkeys report a decision based on the comparison of two mechanical vibrations applied sequentially to the fingertips. Here we report that the activity of VPC neurons reflects current and remembered sensory inputs, their comparison, and motor commands expressing the result; that is, the entire processing cascade linking the evaluation of sensory stimuli with a motor report. These findings provide a fairly complete panorama of the neural dynamics that underlies the transformation of sensory information into an action and emphasize the role of VPC in perceptual decisions.     

Neurons controlling voluntary vocalization in the macaque ventral premotor cortex

The voluntary control of phonation is a crucial achievement in the evolution of speech. In humans, ventral premotor cortex (PMv) and Broca's area are known to be involved in voluntary phonation. In contrast, no neurophysiological data are available about the role of the oro-facial sector of nonhuman primates PMv in this function. In order to address this issue, we recorded PMv neurons from two monkeys trained to emit coo-calls. Results showed that a population of motor neurons specifically fire during vocalization. About two thirds of them discharged before sound onset, while the remaining were time-locked with it. The response of vocalization-selective neurons was present only during conditioned (voluntary) but not spontaneous (emotional) sound emission. These data suggest that the control of vocal production exerted by PMv neurons constitutes a newly emerging property in the monkey lineage, shedding light on the evolution of phonation-based communication from a nonhuman primate species.     

Somatotopic representation of action words in human motor and premotor cortex

Since the early days of research into language and the brain, word meaning was assumed to be processed in specific brain regions, which most modern neuroscientists localize to the left temporal lobe. Here we use event-related fMRI to show that action words referring to face, arm, or leg actions (e.g., to lick, pick, or kick), when presented in a passive reading task, differentially activated areas along the motor strip that either were directly adjacent to or overlapped with areas activated by actual movement of the tongue, fingers, or feet. These results demonstrate that the referential meaning of action words has a correlate in the somatotopic activation of motor and premotor cortex. This rules out a unified "meaning center" in the human brain and supports a dynamic view according to which words are processed by distributed neuronal assemblies with cortical topographies that reflect word semantics.     

Lipreading and audio-visual speech perception.

This paper reviews progress in understanding the psychology of lipreading and audio-visual speech perception. It considers four questions. What distinguishes better from poorer lipreaders? What are the effects of introducing a delay between the acoustical and optical speech signals? What have attempts to produce computer animations of talking faces contributed to our understanding of the visual cues that distinguish consonants and vowels? Finally, how should the process of audio-visual integration in speech perception be described; that is, how are the sights and sounds of talking faces represented at their conflux?     

Single neurons in M1 and premotor cortex directly reflect behavioral interference

Some motor tasks, if learned together, interfere with each other's consolidation and subsequent retention, whereas other tasks do not. Interfering tasks are said to employ the same internal model whereas noninterfering tasks use different models. The division of function among internal models, as well as their possible neural substrates, are not well understood. To investigate these questions, we compared responses of single cells in the primary motor cortex and premotor cortex of primates to interfering and noninterfering tasks. The interfering tasks were visuomotor rotation followed by opposing visuomotor rotation. The noninterfering tasks were visuomotor rotation followed by an arbitrary association task. Learning two noninterfering tasks led to the simultaneous formation of neural activity typical of both tasks, at the level of single neurons. In contrast, and in accordance with behavioral results, after learning two interfering tasks, only the second task was successfully reflected in motor cortical single cell activity. These results support the hypothesis that the representational capacity of motor cortical cells is the basis of behavioral interference and division between internal models.     

Auditory perception and the evolution of speech

Among topics related to the evolution of language, the evolution of speech is particularly fascinating. Early theorists believed that it was the ability to produce articulate speech that set the stage for the evolution of the «special» speech processing abilities that exist in modern-day humans. Prior to the evolution of speech production, speech processing abilities were presumed not to exist. The data reviewed here support a different view. Two lines of evidence, one from young human infants and the other from infrahuman species, neither of whom can produce articulate speech, show that in the absence of speech production capabilities, the perception of speech sounds is robust and sophisticated. Human infants and non-human animals evidence auditory perceptual categories that conform to those defined by the phonetic categories of language. These findings suggest the possibility that in evolutionary history the ability to perceive rudimentary speech categories preceded the ability to produce articulate speech. This in turn suggests that it may be audition that structured, at least initially, the formation of phonetic categories.