Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex

The embodied cognition hypothesis suggests that motor and premotor areas are automatically and necessarily involved in understanding action language, as word conceptual representations are embodied. This transcranial magnetic stimulation (TMS) study explores the role of the left primary motor cortex in action-verb processing. TMS-induced motor-evoked potentials from right-hand muscles were recorded as a measure of M1 activity, while participants were asked either to judge explicitly whether a verb was action-related (semantic task) or to decide on the number of syllables in a verb (syllabic task). TMS was applied in three different experiments at 170, 350 and 500 ms post-stimulus during both tasks to identify when the enhancement of M1 activity occurred during word processing. The delays between stimulus onset and magnetic stimulation were consistent with electrophysiological studies, suggesting that word recognition can be differentiated into early (within 200 ms) and late (within 400 ms) lexical-semantic stages, and post-conceptual stages. Reaction times and accuracy were recorded to measure the extent to which the participants'' linguistic performance was affected by the interference of TMS with M1 activity. No enhancement of M1 activity specific for action verbs was found at 170 and 350 ms post-stimulus, when lexical-semantic processes are presumed to occur (Experiments 1–2). When TMS was applied at 500 ms post-stimulus (Experiment 3), processing action verbs, compared with non-action verbs, increased the M1-activity in the semantic task and decreased it in the syllabic task. This effect was specific for hand-action verbs and was not observed for action-verbs related to other body parts. Neither accuracy nor RTs were affected by TMS. These findings suggest that the lexical-semantic processing of action verbs does not automatically activate the M1. This area seems to be rather involved in post-conceptual processing that follows the retrieval of motor representations, its activity being modulated (facilitated or inhibited), in a top-down manner, by the specific demand of the task.     

Dynamics of the semantic priming shift: behavioral experiments and cortical network model

Multiple semantic priming processes between several related and/or unrelated words are at work during the processing of sequences of words. Multiple priming generates rich dynamics of effects depending on the relationship between the target word and the first and/or second prime previously presented. The experimental literature suggests that during the on-line processing of the primes, the activation can shift from associates to the first prime to associates to the second prime. Though the semantic priming shift is central to the on-line and rapid updating of word meanings in the working memory, its precise dynamics are still poorly understood and it is still a challenge to model how it functions in the cerebral cortex. Four multiple priming experiments are proposed that cross-manipulate delays and association strength between the primes and the target. Results show for the first time that association strength determines complex dynamics of the semantic priming shift, ranging from an absence of a shift to a complete shift. A cortical network model of spike frequency adaptive neuron populations is proposed to account for the non-continuous evolution of the priming shift over time. It allows linking the dynamics of the priming shift assessed at the behavioral level to the non-linear dynamics of the firing rates of neurons populations.     

Grip Force Reveals the Context Sensitivity of Language-Induced Motor Activity during “Action Words” Processing: Evidence from Sentential Negation

Background

Studies demonstrating the involvement of motor brain structures in language processing typically focus on time windows beyond the latencies of lexical-semantic access. Consequently, such studies remain inconclusive regarding whether motor brain structures are recruited directly in language processing or through post-linguistic conceptual imagery. In the present study, we introduce a grip-force sensor that allows online measurements of language-induced motor activity during sentence listening. We use this tool to investigate whether language-induced motor activity remains constant or is modulated in negative, as opposed to affirmative, linguistic contexts.

Methodology/Principal Findings

Participants listened to spoken action target words in either affirmative or negative sentences while holding a sensor in a precision grip. The participants were asked to count the sentences containing the name of a country to ensure attention. The grip force signal was recorded continuously. The action words elicited an automatic and significant enhancement of the grip force starting at approximately 300 ms after target word onset in affirmative sentences; however, no comparable grip force modulation was observed when these action words occurred in negative contexts.

Conclusions/Significance

Our findings demonstrate that this simple experimental paradigm can be used to study the online crosstalk between language and the motor systems in an ecological and economical manner. Our data further confirm that the motor brain structures that can be called upon during action word processing are not mandatorily involved; the crosstalk is asymmetrically governed by the linguistic context and not vice versa.     

Behavioral correlates of cortical semantic representations modeled by word vectors

The quantitative modeling of semantic representations in the brain plays a key role in understanding the neural basis of semantic processing. Previous studies have demonstrated that word vectors, which were originally developed for use in the field of natural language processing, provide a powerful tool for such quantitative modeling. However, whether semantic representations in the brain revealed by the word vector-based models actually capture our perception of semantic information remains unclear, as there has been no study explicitly examining the behavioral correlates of the modeled brain semantic representations. To address this issue, we compared the semantic structure of nouns and adjectives in the brain estimated from word vector-based brain models with that evaluated from human behavior. The brain models were constructed using voxelwise modeling to predict the functional magnetic resonance imaging (fMRI) response to natural movies from semantic contents in each movie scene through a word vector space. The semantic dissimilarity of brain word representations was then evaluated using the brain models. Meanwhile, data on human behavior reflecting the perception of semantic dissimilarity between words were collected in psychological experiments. We found a significant correlation between brain model- and behavior-derived semantic dissimilarities of words. This finding suggests that semantic representations in the brain modeled via word vectors appropriately capture our perception of word meanings.     

Suggestion-Induced Modulation of Semantic Priming during Functional Magnetic Resonance Imaging

Using functional magnetic resonance imaging during a primed visual lexical decision task, we investigated the neural and functional mechanisms underlying modulations of semantic word processing through hypnotic suggestions aimed at altering lexical processing of primes. The priming task was to discriminate between target words and pseudowords presented 200 ms after the prime word which was semantically related or unrelated to the target. In a counterbalanced study design, each participant performed the task once at normal wakefulness and once after the administration of hypnotic suggestions to perceive the prime as a meaningless symbol of a foreign language. Neural correlates of priming were defined as significantly lower activations upon semantically related compared to unrelated trials. We found significant suggestive treatment-induced reductions in neural priming, albeit irrespective of the degree of suggestibility. Neural priming was attenuated upon suggestive treatment compared with normal wakefulness in brain regions supporting automatic (fusiform gyrus) and controlled semantic processing (superior and middle temporal gyri, pre- and postcentral gyri, and supplementary motor area). Hence, suggestions reduced semantic word processing by conjointly dampening both automatic and strategic semantic processes.     

The Brain Network of Naming: A Lesson from Primary Progressive Aphasia

Objective

Word finding depends on the processing of semantic and lexical information, and it involves an intermediate level for mapping semantic-to-lexical information which also subserves lexical-to-semantic mapping during word comprehension. However, the brain regions implementing these components are still controversial and have not been clarified via a comprehensive lesion model encompassing the whole range of language-related cortices. Primary progressive aphasia (PPA), for which anomia is thought to be the most common sign, provides such a model, but the exploration of cortical areas impacting naming in its three main variants and the underlying processing mechanisms is still lacking.

Methods

We addressed this double issue, related to language structure and PPA, with thirty patients (11 semantic, 12 logopenic, 7 agrammatic variant) using a picture-naming task and voxel-based morphometry for anatomo-functional correlation. First, we analyzed correlations for each of the three variants to identify the regions impacting naming in PPA and to disentangle the core regions of word finding. We then combined the three variants and correlation analyses for naming (semantic-to-lexical mapping) and single-word comprehension (lexical-to-semantic mapping), predicting an overlap zone corresponding to a bidirectional lexical-semantic hub.

Results and Conclusions

Our results showed that superior portions of the left temporal pole and left posterior temporal cortices impact semantic and lexical naming mechanisms in semantic and logopenic PPA, respectively. In agrammatic PPA naming deficits were rare, and did not correlate with any cortical region. Combined analyses revealed a cortical overlap zone in superior/middle mid-temporal cortices, distinct from the two former regions, impacting bidirectional binding of lexical and semantic information. Altogether, our findings indicate that lexical/semantic word processing depends on an anterior-posterior axis within lateral-temporal cortices, including an anatomically intermediate hub dedicated to lexical-semantic integration. Within this axis our data reveal the underpinnings of anomia in the PPA variants, which is of relevance for both diagnosis and future therapy strategies.     

Words and Melody Are Intertwined in Perception of Sung Words: EEG and Behavioral Evidence

Language and music, two of the most unique human cognitive abilities, are combined in song, rendering it an ecological model for comparing speech and music cognition. The present study was designed to determine whether words and melodies in song are processed interactively or independently, and to examine the influence of attention on the processing of words and melodies in song. Event-Related brain Potentials (ERPs) and behavioral data were recorded while non-musicians listened to pairs of sung words (prime and target) presented in four experimental conditions: same word, same melody; same word, different melody; different word, same melody; different word, different melody. Participants were asked to attend to either the words or the melody, and to perform a same/different task. In both attentional tasks, different word targets elicited an N400 component, as predicted based on previous results. Most interestingly, different melodies (sung with the same word) elicited an N400 component followed by a late positive component. Finally, ERP and behavioral data converged in showing interactions between the linguistic and melodic dimensions of sung words. The finding that the N400 effect, a well-established marker of semantic processing, was modulated by musical melody in song suggests that variations in musical features affect word processing in sung language. Implications of the interactions between words and melody are discussed in light of evidence for shared neural processing resources between the phonological/semantic aspects of language and the melodic/harmonic aspects of music.     

Narrative event segmentation in the cortical reservoir

Recent research has revealed that during continuous perception of movies or stories, humans display cortical activity patterns that reveal hierarchical segmentation of event structure. Thus, sensory areas like auditory cortex display high frequency segmentation related to the stimulus, while semantic areas like posterior middle cortex display a lower frequency segmentation related to transitions between events. These hierarchical levels of segmentation are associated with different time constants for processing. Likewise, when two groups of participants heard the same sentence in a narrative, preceded by different contexts, neural responses for the groups were initially different and then gradually aligned. The time constant for alignment followed the segmentation hierarchy: sensory cortices aligned most quickly, followed by mid-level regions, while some higher-order cortical regions took more than 10 seconds to align. These hierarchical segmentation phenomena can be considered in the context of processing related to comprehension. In a recently described model of discourse comprehension word meanings are modeled by a language model pre-trained on a billion word corpus. During discourse comprehension, word meanings are continuously integrated in a recurrent cortical network. The model demonstrates novel discourse and inference processing, in part because of two fundamental characteristics: real-world event semantics are represented in the word embeddings, and these are integrated in a reservoir network which has an inherent gradient of functional time constants due to the recurrent connections. Here we demonstrate how this model displays hierarchical narrative event segmentation properties beyond the embeddings alone, or their linear integration. The reservoir produces activation patterns that are segmented by a hidden Markov model (HMM) in a manner that is comparable to that of humans. Context construction displays a continuum of time constants across reservoir neuron subsets, while context forgetting has a fixed time constant across these subsets. Importantly, virtual areas formed by subgroups of reservoir neurons with faster time constants segmented with shorter events, while those with longer time constants preferred longer events. This neurocomputational recurrent neural network simulates narrative event processing as revealed by the fMRI event segmentation algorithm provides a novel explanation of the asymmetry in narrative forgetting and construction. The model extends the characterization of online integration processes in discourse to more extended narrative, and demonstrates how reservoir computing provides a useful model of cortical processing of narrative structure.     

Bilingual and multilingual language processing

This chapter addresses the interesting question on the neurolinguistics of bilingualism and the representation of language in the brain in bilingual and multilingual subjects. A fundamental issue is whether the cerebral representation of language in bi- and multilinguals differs from that of monolinguals, and if so, in which specific way. This is an interdisciplinary question which needs to identify and differentiate different levels involved in the neural representation of languages, such as neuroanatomical, neurofunctional, biochemical, psychological and linguistic levels. Furthermore, specific factors such as age, manner of acquisition and environmental factors seem to affect the neural representation. We examined the question whether verbal memory processing in two unrelated languages is mediated by a common neural system or by distinct cortical areas. Subjects were Finnish-English adult multilinguals who had acquired the second language after the age of ten. They were PET-scanned whilst either encoding or retrieving word pairs in their mother tongue (Finnish) or in a foreign language (English). Within each language, subjects had to encode and retrieve four sets of 12 visually presented paired word associates which were not semantically related. Two sets consisted of highly imaginable words and the other two sets of abstract words. Presentation of pseudo-words served as a reference condition. An emission scan was recorded after each intravenous administration of O-15 water. Encoding was associated with prefrontal and hippocampal activation. During memory retrieval, precuneus showed a consistent activation in both languages and for both highly imaginable and abstract words. Differential activations were found in Broca's area and in the cerebellum as well as in the angular/supramarginal gyri according to the language used. The findings advance our understanding of the neural representation that underlies multiple language functions. Further studies are needed to elucidate the neuronal mechanisms of bi/multilingual language processing. A promising perspective for future bi/multilingual research is an integrative approach using brain imaging studies with a high spatial resolution such as fMRI, combined with techniques with a high temporal resolution, such as magnetoencephalography (MEG).     

Theoretical analysis of word production deficits in adult aphasia

The cognitive analysis of adult language disorders continues to draw heavily on linguistic theory, but increasingly it reflects the influence of connectionist, spreading activation models of cognition. In the area of spoken word production, ‘localist’ connectionist models represent a natural evolution from the psycholingistic theories of earlier decades. By contrast, the parallel distributed processing framework forces more radical rethinking of aphasic impairments. This paper exemplifies these multiple influences in contemporary cognitive aphasiology. Topics include (i) what aphasia reveals about semantic-phonological interaction in lexical access; (ii) controversies surrounding the interpretation of semantic errors and (iii) a computational account of the relationship between naming and word repetition in aphasia. Several of these topics have been addressed using case series methods, including computational simulation of the individual, quantitative error patterns of diverse groups of patients and analysis of brain lesions that correlate with error rates and patterns. Efforts to map the lesion correlates of nonword errors in naming and repetition highlight the involvement of sensorimotor areas in the brain and suggest the need to better integrate models of word production with models of speech and action.     

Concurrent word generation and motor performance: further evidence for language-motor interaction

Embodied/modality-specific theories of semantic memory propose that sensorimotor representations play an important role in perception and action. A large body of evidence supports the notion that concepts involving human motor action (i.e., semantic-motor representations) are processed in both language and motor regions of the brain. However, most studies have focused on perceptual tasks, leaving unanswered questions about language-motor interaction during production tasks. Thus, we investigated the effects of shared semantic-motor representations on concurrent language and motor production tasks in healthy young adults, manipulating the semantic task (motor-related vs. nonmotor-related words) and the motor task (i.e., standing still and finger-tapping). In Experiment 1 (n = 20), we demonstrated that motor-related word generation was sufficient to affect postural control. In Experiment 2 (n = 40), we demonstrated that motor-related word generation was sufficient to facilitate word generation and finger tapping. We conclude that engaging semantic-motor representations can have a reciprocal influence on motor and language production. Our study provides additional support for functional language-motor interaction, as well as embodied/modality-specific theories.     

Right Inferior Frontal Gyrus Activation Is Associated with Memory Improvement in Patients with Left Frontal Low-Grade Glioma Resection

Patients with low-grade glioma (LGG) have been studied as a model of functional brain reorganization due to their slow-growing nature. However, there is no information regarding which brain areas are involved during verbal memory encoding after extensive left frontal LGG resection. In addition, it remains unknown whether these patients can improve their memory performance after instructions to apply efficient strategies. The neural correlates of verbal memory encoding were investigated in patients who had undergone extensive left frontal lobe (LFL) LGG resections and healthy controls using fMRI both before and after directed instructions were given for semantic organizational strategies. Participants were scanned during the encoding of word lists under three different conditions before and after a brief period of practice. The conditions included semantically unrelated (UR), related-non-structured (RNS), and related-structured words (RS), allowing for different levels of semantic organization. All participants improved on memory recall and semantic strategy application after the instructions for the RNS condition. Healthy subjects showed increased activation in the left inferior frontal gyrus (IFG) and middle frontal gyrus (MFG) during encoding for the RNS condition after the instructions. Patients with LFL excisions demonstrated increased activation in the right IFG for the RNS condition after instructions were given for the semantic strategies. Despite extensive damage in relevant areas that support verbal memory encoding and semantic strategy applications, patients that had undergone resections for LFL tumor could recruit the right-sided contralateral homologous areas after instructions were given and semantic strategies were practiced. These results provide insights into changes in brain activation areas typically implicated in verbal memory encoding and semantic processing.     

Written production of English compounds: effects of morphology and semantic transparency

The results of research on the processing of morphologically complex words are consistent with a lexical system that activates both whole-word and constituent representations during word recognition. In this study, we focus on written production and examine whether semantically priming the first constituent of a compound influences the ease of producing a compound (as measured by typing latencies), and whether any such priming effect depends on the semantic transparency of the compound’s constituents. We found that semantic transparency of the constituents affects whether semantic priming results in changes to processing. However, it is not only the semantic transparency of the primed constituent that exerts an influence—for example, the semantic transparency of the head affects whether semantically priming the modifier results in a change in typing times. We discuss these effects in terms of competition among the various representations as the compound is output, such that overall performance is a combination of facilitation and inhibition that changes over the course of the output.     

Lexical–semantic priming effects during infancy

When and how do infants develop a semantic system of words that are related to each other? We investigated word–word associations in early lexical development using an adaptation of the inter-modal preferential looking task where word pairs (as opposed to single target words) were used to direct infants’ attention towards a target picture. Two words (prime and target) were presented in quick succession after which infants were presented with a picture pair (target and distracter). Prime–target word pairs were either semantically and associatively related or unrelated; the targets were either named or unnamed. Experiment 1 demonstrated a lexical–semantic priming effect for 21-month olds but not for 18-month olds: unrelated prime words interfered with linguistic target identification for 21-month olds. Follow-up experiments confirmed the interfering effects of unrelated prime words and identified the existence of repetition priming effects as young as 18 months of age. The results of these experiments indicate that infants have begun to develop semantic–associative links between lexical items as early as 21 months of age.     

Semantic commitments as a mode of non-programmable computation in the brain.

The natural language processor in the brain can cope with non-programmable computation. The average number of different lexical meanings per word serves as a quantitative figure in terms of which the extent of being non-programmable can be evaluated. The possible maximum average number of different lexical meanings per word that the brain of the subject reading the text can cope with while comprehending the context is found to be 3.3 with its standard deviation 0.15, beyond which the brain can no more succeed in comprehending the context. In contrast, the maximum average number of different lexical meanings per word that would make lexical disambiguation programmable is e = 2.718. Natural language processing in the brain is non-programmable in the sense that the manageable average number of different meanings per word is greater than e, but does not exceed roughly 3.3.     

Memory for semantically related and unrelated declarative information: the benefit of sleep, the cost of wake

Numerous studies have examined sleep's influence on a range of hippocampus-dependent declarative memory tasks, from text learning to spatial navigation. In this study, we examined the impact of sleep, wake, and time-of-day influences on the processing of declarative information with strong semantic links (semantically related word pairs) and information requiring the formation of novel associations (unrelated word pairs). Participants encoded a set of related or unrelated word pairs at either 9 am or 9 pm, and were then tested after an interval of 30 min, 12 hr, or 24 hr. The time of day at which subjects were trained had no effect on training performance or initial memory of either word pair type. At 12 hr retest, memory overall was superior following a night of sleep compared to a day of wakefulness. However, this performance difference was a result of a pronounced deterioration in memory for unrelated word pairs across wake; there was no sleep-wake difference for related word pairs. At 24 hr retest, with all subjects having received both a full night of sleep and a full day of wakefulness, we found that memory was superior when sleep occurred shortly after learning rather than following a full day of wakefulness. Lastly, we present evidence that the rate of deterioration across wakefulness was significantly diminished when a night of sleep preceded the wake period compared to when no sleep preceded wake, suggesting that sleep served to stabilize the memories against the deleterious effects of subsequent wakefulness. Overall, our results demonstrate that 1) the impact of 12 hr of waking interference on memory retention is strongly determined by word-pair type, 2) sleep is most beneficial to memory 24 hr later if it occurs shortly after learning, and 3) sleep does in fact stabilize declarative memories, diminishing the negative impact of subsequent wakefulness.     

How do we use language? Shared patterns in the frequency of word use across 17 world languages

We present data from 17 languages on the frequency with which a common set of words is used in everyday language. The languages are drawn from six language families representing 65 per cent of the world's 7000 languages. Our data were collected from linguistic corpora that record frequencies of use for the 200 meanings in the widely used Swadesh fundamental vocabulary. Our interest is to assess evidence for shared patterns of language use around the world, and for the relationship of language use to rates of lexical replacement, defined as the replacement of a word by a new unrelated or non-cognate word. Frequencies of use for words in the Swadesh list range from just a few per million words of speech to 191 000 or more. The average inter-correlation among languages in the frequency of use across the 200 words is 0.73 (p < 0.0001). The first principal component of these data accounts for 70 per cent of the variance in frequency of use. Elsewhere, we have shown that frequently used words in the Indo-European languages tend to be more conserved, and that this relationship holds separately for different parts of speech. A regression model combining the principal factor loadings derived from the worldwide sample along with their part of speech predicts 46 per cent of the variance in the rates of lexical replacement in the Indo-European languages. This suggests that Indo-European lexical replacement rates might be broadly representative of worldwide rates of change. Evidence for this speculation comes from using the same factor loadings and part-of-speech categories to predict a word's position in a list of 110 words ranked from slowest to most rapidly evolving among 14 of the world's language families. This regression model accounts for 30 per cent of the variance. Our results point to a remarkable regularity in the way that human speakers use language, and hint that the words for a shared set of meanings have been slowly evolving and others more rapidly evolving throughout human history.     

Incorporating Linguistic Knowledge for Learning Distributed Word Representations

Combined with neural language models, distributed word representations achieve significant advantages in computational linguistics and text mining. Most existing models estimate distributed word vectors from large-scale data in an unsupervised fashion, which, however, do not take rich linguistic knowledge into consideration. Linguistic knowledge can be represented as either link-based knowledge or preference-based knowledge, and we propose knowledge regularized word representation models (KRWR) to incorporate these prior knowledge for learning distributed word representations. Experiment results demonstrate that our estimated word representation achieves better performance in task of semantic relatedness ranking. This indicates that our methods can efficiently encode both prior knowledge from knowledge bases and statistical knowledge from large-scale text corpora into a unified word representation model, which will benefit many tasks in text mining.     

Language proficiency modulates the recruitment of non-classical language areas in bilinguals

Bilingualism provides a unique opportunity for understanding the relative roles of proficiency and order of acquisition in determining how the brain represents language. In a previous study, we combined magnetoencephalography (MEG) and magnetic resonance imaging (MRI) to examine the spatiotemporal dynamics of word processing in a group of Spanish-English bilinguals who were more proficient in their native language. We found that from the earliest stages of lexical processing, words in the second language evoke greater activity in bilateral posterior visual regions, while activity to the native language is largely confined to classical left hemisphere fronto-temporal areas. In the present study, we sought to examine whether these effects relate to language proficiency or order of language acquisition by testing Spanish-English bilingual subjects who had become dominant in their second language. Additionally, we wanted to determine whether activity in bilateral visual regions was related to the presentation of written words in our previous study, so we presented subjects with both written and auditory words. We found greater activity for the less proficient native language in bilateral posterior visual regions for both the visual and auditory modalities, which started during the earliest word encoding stages and continued through lexico-semantic processing. In classical left fronto-temporal regions, the two languages evoked similar activity. Therefore, it is the lack of proficiency rather than secondary acquisition order that determines the recruitment of non-classical areas for word processing.