The Yin and the Yang of Prediction: An fMRI Study of Semantic Predictive Processing

Probabilistic prediction plays a crucial role in language comprehension. When predictions are fulfilled, the resulting facilitation allows for fast, efficient processing of ambiguous, rapidly-unfolding input; when predictions are not fulfilled, the resulting error signal allows us to adapt to broader statistical changes in this input. We used functional Magnetic Resonance Imaging to examine the neuroanatomical networks engaged in semantic predictive processing and adaptation. We used a relatedness proportion semantic priming paradigm, in which we manipulated the probability of predictions while holding local semantic context constant. Under conditions of higher (versus lower) predictive validity, we replicate previous observations of reduced activity to semantically predictable words in the left anterior superior/middle temporal cortex, reflecting facilitated processing of targets that are consistent with prior semantic predictions. In addition, under conditions of higher (versus lower) predictive validity we observed significant differences in the effects of semantic relatedness within the left inferior frontal gyrus and the posterior portion of the left superior/middle temporal gyrus. We suggest that together these two regions mediated the suppression of unfulfilled semantic predictions and lexico-semantic processing of unrelated targets that were inconsistent with these predictions. Moreover, under conditions of higher (versus lower) predictive validity, a functional connectivity analysis showed that the left inferior frontal and left posterior superior/middle temporal gyrus were more tightly interconnected with one another, as well as with the left anterior cingulate cortex. The left anterior cingulate cortex was, in turn, more tightly connected to superior lateral frontal cortices and subcortical regions—a network that mediates rapid learning and adaptation and that may have played a role in switching to a more predictive mode of processing in response to the statistical structure of the wider environmental context. Together, these findings highlight close links between the networks mediating semantic prediction, executive function and learning, giving new insights into how our brains are able to flexibly adapt to our environment.     

Activation of the Left Inferior Frontal Gyrus in the First 200 ms of Reading: Evidence from Magnetoencephalography (MEG)

Background

It is well established that the left inferior frontal gyrus plays a key role in the cerebral cortical network that supports reading and visual word recognition. Less clear is when in time this contribution begins. We used magnetoencephalography (MEG), which has both good spatial and excellent temporal resolution, to address this question.

Methodology/Principal Findings

MEG data were recorded during a passive viewing paradigm, chosen to emphasize the stimulus-driven component of the cortical response, in which right-handed participants were presented words, consonant strings, and unfamiliar faces to central vision. Time-frequency analyses showed a left-lateralized inferior frontal gyrus (pars opercularis) response to words between 100–250 ms in the beta frequency band that was significantly stronger than the response to consonant strings or faces. The left inferior frontal gyrus response to words peaked at ∼130 ms. This response was significantly later in time than the left middle occipital gyrus, which peaked at ∼115 ms, but not significantly different from the peak response in the left mid fusiform gyrus, which peaked at ∼140 ms, at a location coincident with the fMRI–defined visual word form area (VWFA). Significant responses were also detected to words in other parts of the reading network, including the anterior middle temporal gyrus, the left posterior middle temporal gyrus, the angular and supramarginal gyri, and the left superior temporal gyrus.

Conclusions/Significance

These findings suggest very early interactions between the vision and language domains during visual word recognition, with speech motor areas being activated at the same time as the orthographic word-form is being resolved within the fusiform gyrus. This challenges the conventional view of a temporally serial processing sequence for visual word recognition in which letter forms are initially decoded, interact with their phonological and semantic representations, and only then gain access to a speech code.     

Dissociating memory retrieval processes using fMRI: evidence that priming does not support recognition memory

We employed event-related fMRI to constrain cognitive accounts of memory retrieval. Studies of explicit retrieval reveal that lateral and medial parietal, dorsal middle frontal gyrus, and anterior prefrontal cortex respond more for studied than new words, reflecting a correlate of "retrieval success." Studies of implicit memory suggest left temporal cortex, ventral and dorsal inferior frontal gyrus respond less for studied than new words, reflecting a correlate of "conceptual priming." In the present study, responses for old and new items were compared during performance on explicit recognition (old/new judgement) and semantic (abstract/concrete judgement) tasks. Regions associated with priming were only modulated during the semantic task, whereas regions associated with retrieval success were modulated during both tasks. These findings constrain functional-anatomic accounts of the networks, suggesting that processes associated with priming do not support explicit recognition judgments.     

Implicit Target Substitution and Sequencing for Lexical Tone Production in Chinese: An fMRI Study

In this study, we examine the neural substrates underlying Tone 3 sandhi and tone sequencing in Mandarin Chinese using fMRI. Tone 3 sandhi is traditionally described as the substitution of Tone 3 with Tone 2 when followed by another Tone 3 (i.e., 33→23). According to current speech production models, target substitution is expected to engage the posterior inferior frontal gyrus. Since Tone 3 sandhi is, to some extent, independent of segments, which makes it more similar to singing, right-lateralized activation in this region was predicted. As for tone sequencing, based on studies in sequencing, we expected the involvement of the supplementary motor area. In the experiments, participants were asked to produce twelve four-syllable sequences with the same tone assignment (the repeated sequences) or a different tone assignment (the mixed sequences). We found right-lateralized posterior inferior frontal gyrus activation for the sequence 3333 (Tone 3 sandhi) and left-lateralized activation in the supplementary motor area for the mixed sequences (tone sequencing). We proposed that tones and segments could be processed in parallel in the left and right hemispheres, but their integration, or the product of their integration, is hosted in the left hemisphere.     

Form and content: dissociating syntax and semantics in sentence comprehension

The distinction between syntax (sentence form) and semantics (sentence meaning) is fundamental to our thinking about language. Whether and where this distinction is represented at the neural level is still a matter of considerable debate. In the present fMRI study, we examined the neural correlates of syntactic and semantic functions using an innovative activation paradigm specifically designed to unequivocally disentangle syntactic from lexicosemantic aspects of sentence processing. Our findings strongly indicate that a part of Broca's area (BA 44, pars opercularis) is critically implicated in processing syntactic information, whereas the lower portion of the left inferior frontal gyrus (BA 47, pars orbitalis) is selectively involved in processing the semantic aspects of a sentence.     

汉字字形认知研究的刺激源设计及在fMRI研究中的应用

目的:评估汉字字形刺激源在汉字认知fMRI研究中的有效性,并对参与汉字处理的脑皮层区域进行定位及初步的量化分析。方法:选择母语为汉语、经利手测试后为右利手且裸眼视力正常(大于等于1．0)的在校大学生10例(男6例,女4例)作为被试。试验任务采用组块设计,将汉字(非字、假字、真字)投射到屏幕上,受试者接受汉字字形图片的视觉刺激,按非字-假字-真字-非字-假字-真字顺序呈现,共6个block。数据处理及统计分析采用国际通用的AFNI软件。结果:左额叶上、中、下回(包括Broca's area)、左中央前回(BA6)、左顶上小叶及顶下小叶(包括缘上回及角回)及双侧枕叶、楔前叶显著激活;左颞叶梭状回(BA37)、右额下回及双侧颞中、上回及扣带回显著激活,左大脑半球的激活体积明显大于右侧大脑半球。结论:本研究设计的汉字字形刺激源结合功能磁共振成像技术可以对汉字处理的相关大脑皮层区域进行定位,为研究人脑加工处理汉字的神经机制提供了一种有效的无创性影像学方法,并应用fMRI技术进一步证实其优势半球为左半球,且需要多种脑区共同参与完成。本试验模式可望成为一种对语言障碍病人进行脑功能检查的有效手段,从而为指导临床治疗和评价预后提供更丰富的信息。     

An fMRI Study of Grammatical Morpheme Processing Associated with Nouns and Verbs in Chinese

This study examined whether the degree of complexity of a grammatical component in a language would impact on its representation in the brain through identifying the neural correlates of grammatical morpheme processing associated with nouns and verbs in Chinese. In particular, the processing of Chinese nominal classifiers and verbal aspect markers were investigated in a sentence completion task and a grammaticality judgment task to look for converging evidence. The Chinese language constitutes a special case because it has no inflectional morphology per se and a larger classifier than aspect marker inventory, contrary to the pattern of greater verbal than nominal paradigmatic complexity in most European languages. The functional imaging results showed BA47 and left supplementary motor area and superior medial frontal gyrus more strongly activated for classifier processing, and the left posterior middle temporal gyrus more responsive to aspect marker processing. We attributed the activation in the left prefrontal cortex to greater processing complexity during classifier selection, analogous to the accounts put forth for European languages, and the left posterior middle temporal gyrus to more demanding verb semantic processing. The overall findings significantly contribute to cross-linguistic observations of neural substrates underlying processing of grammatical morphemes from an analytic and a classifier language, and thereby deepen our understanding of neurobiology of human language.     

Hearing and seeing meaning in speech and gesture: insights from brain and behaviour

As we speak, we use not only the arbitrary form–meaning mappings of the speech channel but also motivated form–meaning correspondences, i.e. iconic gestures that accompany speech (e.g. inverted V-shaped hand wiggling across gesture space to demonstrate walking). This article reviews what we know about processing of semantic information from speech and iconic gestures in spoken languages during comprehension of such composite utterances. Several studies have shown that comprehension of iconic gestures involves brain activations known to be involved in semantic processing of speech: i.e. modulation of the electrophysiological recording component N400, which is sensitive to the ease of semantic integration of a word to previous context, and recruitment of the left-lateralized frontal–posterior temporal network (left inferior frontal gyrus (IFG), medial temporal gyrus (MTG) and superior temporal gyrus/sulcus (STG/S)). Furthermore, we integrate the information coming from both channels recruiting brain areas such as left IFG, posterior superior temporal sulcus (STS)/MTG and even motor cortex. Finally, this integration is flexible: the temporal synchrony between the iconic gesture and the speech segment, as well as the perceived communicative intent of the speaker, modulate the integration process. Whether these findings are special to gestures or are shared with actions or other visual accompaniments to speech (e.g. lips) or other visual symbols such as pictures are discussed, as well as the implications for a multimodal view of language.     

Right Inferior Frontal Gyrus Activation Is Associated with Memory Improvement in Patients with Left Frontal Low-Grade Glioma Resection

Patients with low-grade glioma (LGG) have been studied as a model of functional brain reorganization due to their slow-growing nature. However, there is no information regarding which brain areas are involved during verbal memory encoding after extensive left frontal LGG resection. In addition, it remains unknown whether these patients can improve their memory performance after instructions to apply efficient strategies. The neural correlates of verbal memory encoding were investigated in patients who had undergone extensive left frontal lobe (LFL) LGG resections and healthy controls using fMRI both before and after directed instructions were given for semantic organizational strategies. Participants were scanned during the encoding of word lists under three different conditions before and after a brief period of practice. The conditions included semantically unrelated (UR), related-non-structured (RNS), and related-structured words (RS), allowing for different levels of semantic organization. All participants improved on memory recall and semantic strategy application after the instructions for the RNS condition. Healthy subjects showed increased activation in the left inferior frontal gyrus (IFG) and middle frontal gyrus (MFG) during encoding for the RNS condition after the instructions. Patients with LFL excisions demonstrated increased activation in the right IFG for the RNS condition after instructions were given for the semantic strategies. Despite extensive damage in relevant areas that support verbal memory encoding and semantic strategy applications, patients that had undergone resections for LFL tumor could recruit the right-sided contralateral homologous areas after instructions were given and semantic strategies were practiced. These results provide insights into changes in brain activation areas typically implicated in verbal memory encoding and semantic processing.     

带状疱疹后遗神经痛患者脑基础活动改变的功能核磁共振研究

带状疱疹后遗神经痛(postherpetic neuralgia,PHN)是临床上一种慢性顽固性神经病理性疼痛,然而,对于其潜在的中枢机制还知之甚少.为了进一步探讨带状疱疹后遗神经痛患者的相关脑区活动,利用功能核磁共振成像低频振幅振荡(ALFF)技术观察带状疱疹后遗神经痛患者的基础脑区活动.8名带状疱疹后遗神经痛患者与8名性别、年龄相匹配的健康者行静息态功能磁共振(f MRI)成像扫描,用SPM8中的多重回归分析,在控制被试年龄、性别、教育年限的影响下,将每个体素的ALFF值同每个被试的病程、视觉模拟评分(visual analog scale,VAS)进行相关分析.与健康志愿者相比,PHN组与VAS评分相关的ALFF值增高的脑区有:右侧小脑后叶、前额叶背外侧区域(BA11/46/47)、右侧顶叶(BA40)、右侧舌回(BA17/18/19);与VAS评分相关的ALFF值降低的脑区有:右侧颞中回(BA21)、左侧舌回(BA17/18)、右侧小脑前叶、左侧后扣带回(BA30/19)和右侧中央前回(BA3/4/6);PHN组与病程相关的ALFF值增高的脑区有:右侧小脑后叶、前额叶背外侧区域(BA9/10/11/47)、左侧颞上回(BA38)、右侧顶叶和右侧舌回(BA17/18/19);与病程相关ALFF值降低的脑区有:左侧海马旁回(BA28)、右侧小脑前叶、左侧扣带回(BA24)、右侧颞上回(BA13)、左侧中央前回和右侧顶下小叶(BA39/40).研究结果提示,涉及疼痛的情绪、警觉行为、注意的脑区在带状疱疹后遗痛慢性疼痛的产生和维持中发挥重要作用.     

Large Scale Brain Functional Networks Support Sentence Comprehension: Evidence from Both Explicit and Implicit Language Tasks

Previous studies have indicated that sentences are comprehended via widespread brain regions in the fronto-temporo-parietal network in explicit language tasks (e.g., semantic congruency judgment tasks), and through restricted temporal or frontal regions in implicit language tasks (e.g., font size judgment tasks). This discrepancy has raised questions regarding a common network for sentence comprehension that acts regardless of task effect and whether different tasks modulate network properties. To this end, we constructed brain functional networks based on 27 subjects’ fMRI data that was collected while performing explicit and implicit language tasks. We found that network properties and network hubs corresponding to the implicit language task were similar to those associated with the explicit language task. We also found common hubs in occipital, temporal and frontal regions in both tasks. Compared with the implicit language task, the explicit language task resulted in greater global efficiency and increased integrated betweenness centrality of the left inferior frontal gyrus, which is a key region related to sentence comprehension. These results suggest that brain functional networks support both explicit and implicit sentence comprehension; in addition, these two types of language tasks may modulate the properties of brain functional networks.     

Left inferior frontal activations depending on the canonicity determined by the argument structures of ditransitive sentences: an MEG study

To elucidate the relationships between syntactic and semantic processes, one interesting question is how syntactic structures are constructed by the argument structure of a verb, where each argument corresponds to a semantic role of each noun phrase (NP). Here we examined the effects of possessivity [sentences with or without a possessor] and canonicity [canonical or noncanonical word orders] using Japanese ditransitive sentences. During a syntactic decision task, the syntactic structure of each sentence would be constructed in an incremental manner based on the predicted argument structure of the ditransitive verb in a verb-final construction. Using magnetoencephalography, we found a significant canonicity effect on the current density in the left inferior frontal gyrus (IFG) at 530-550 ms after the verb onset. This effect was selective to canonical sentences, and significant even when the precedent NP was physically identical. We suggest that the predictive effects associated with syntactic processing became larger for canonical sentences, where the NPs and verb were merged with a minimum structural distance, leading to the left IFG activations. For monotransitive and intransitive verbs, in which structural computation of the sentences was simpler than that of ditransitive sentences, we observed a significant effect selective to noncanonical sentences in the temporoparietal regions during 480-670 ms. This effect probably reflects difficulty in semantic processing of noncanonical sentences. These results demonstrate that the left IFG plays a predictive role in syntactic processing, which depends on the canonicity determined by argument structures, whereas other temporoparietal regions would subserve more semantic aspects of sentence processing.     

High Gamma Oscillations in Medial Temporal Lobe during Overt Production of Speech and Gestures

The study of the production of co-speech gestures (CSGs), i.e., meaningful hand movements that often accompany speech during everyday discourse, provides an important opportunity to investigate the integration of language, action, and memory because of the semantic overlap between gesture movements and speech content. Behavioral studies of CSGs and speech suggest that they have a common base in memory and predict that overt production of both speech and CSGs would be preceded by neural activity related to memory processes. However, to date the neural correlates and timing of CSG production are still largely unknown. In the current study, we addressed these questions with magnetoencephalography and a semantic association paradigm in which participants overtly produced speech or gesture responses that were either meaningfully related to a stimulus or not. Using spectral and beamforming analyses to investigate the neural activity preceding the responses, we found a desynchronization in the beta band (15–25 Hz), which originated 900 ms prior to the onset of speech and was localized to motor and somatosensory regions in the cortex and cerebellum, as well as right inferior frontal gyrus. Beta desynchronization is often seen as an indicator of motor processing and thus reflects motor activity related to the hand movements that gestures add to speech. Furthermore, our results show oscillations in the high gamma band (50–90 Hz), which originated 400 ms prior to speech onset and were localized to the left medial temporal lobe. High gamma oscillations have previously been found to be involved in memory processes and we thus interpret them to be related to contextual association of semantic information in memory. The results of our study show that high gamma oscillations in medial temporal cortex play an important role in the binding of information in human memory during speech and CSG production.     

Neural responses during Valsalva maneuvers in obstructive sleep apnea syndrome.

The repetitive upper airway muscle atonic episodes and cardiovascular sequelae of obstructive sleep apnea (OSA) suggest dysfunction of specific neural sites that integrate afferent airway signals with autonomic and somatic outflow. We determined neural responses to the Valsalva maneuver by using functional magnetic resonance imaging. Images were collected during a baseline and three Valsalva maneuvers in 8 drug-free OSA patients and 15 controls. Multiple cortical, midbrain, pontine, and medullary regions in both groups showed intensity changes correlated to airway pressure. In OSA subjects, the left inferior parietal cortex, superior temporal gyrus, posterior insular cortex, cerebellar cortex, fastigial nucleus, and hippocampus showed attenuated signal changes compared with controls. Enhanced responses emerged in the left lateral precentral gyrus, left anterior cingulate, and superior frontal cortex of OSA patients. The anterior cingulate, cerebellar cortex, and posterior insula exhibited altered response timing patterns between control and OSA subjects. The response patterns in OSA subjects suggest deficits in particular neural pathways that normally mediate the Valsalva maneuver and compensatory actions in other structures.     

Neural substrates of processing syntax and semantics in music

Growing evidence indicates that syntax and semantics are basic aspects of music. After the onset of a chord, initial music-syntactic processing can be observed at about 150-400 ms and processing of musical semantics at about 300-500 ms. Processing of musical syntax activates inferior frontolateral cortex, ventrolateral premotor cortex and presumably the anterior part of the superior temporal gyrus. These brain structures have been implicated in sequencing of complex auditory information, identification of structural relationships, and serial prediction. Processing of musical semantics appears to activate posterior temporal regions. The processes and brain structures involved in the perception of syntax and semantics in music have considerable overlap with those involved in language perception, underlining intimate links between music and language in the human brain.     

Resting-State Functional Connectivity Patterns Predict Chinese Word Reading Competency

Resting-state functional connectivity (RSFC) offers a novel approach to reveal the temporal synchronization of functionally related brain regions. Recent studies have identified several RSFCs whose strength was associated with reading competence in alphabetic languages. In the present study, we examined the role of intrinsic functional relations for reading a non-alphabetic language – Chinese – by correlating RSFC maps of nine Chinese reading-related seed regions and reaction time in the single-character reading task. We found that Chinese reading efficiency was positively correlated with the connection between left inferior occipital gyrus and left superior parietal lobule, between right posterior fusiform gyrus and right superior parietal lobule, and between left inferior temporal gyrus and left inferior parietal lobule. These results could not be attributed to inter-individual differences arising from the peripheral processes of the reading task such as visual input detection and articulation. The observed RSFC-reading correlation relationships are discussed in the framework of Chinese character reading, including visuospatial analyses and semantic/phonological processes.     

Early Prefrontal Brain Responses to the Hedonic Quality of Emotional Words – A Simultaneous EEG and MEG Study

The hedonic meaning of words affects word recognition, as shown by behavioral, functional imaging, and event-related potential (ERP) studies. However, the spatiotemporal dynamics and cognitive functions behind are elusive, partly due to methodological limitations of previous studies. Here, we account for these difficulties by computing combined electro-magnetoencephalographic (EEG/MEG) source localization techniques. Participants covertly read emotionally high-arousing positive and negative nouns, while EEG and MEG were recorded simultaneously. Combined EEG/MEG current-density reconstructions for the P1 (80–120 ms), P2 (150–190 ms) and EPN component (200–300 ms) were computed using realistic individual head models, with a cortical constraint. Relative to negative words, the P1 to positive words predominantly involved language-related structures (left middle temporal and inferior frontal regions), and posterior structures related to directed attention (occipital and parietal regions). Effects shifted to the right hemisphere in the P2 component. By contrast, negative words received more activation in the P1 time-range only, recruiting prefrontal regions, including the anterior cingulate cortex (ACC). Effects in the EPN were not statistically significant. These findings show that different neuronal networks are active when positive versus negative words are processed. We account for these effects in terms of an “emotional tagging” of word forms during language acquisition. These tags then give rise to different processing strategies, including enhanced lexical processing of positive words and a very fast language-independent alert response to negative words. The valence-specific recruitment of different networks might underlie fast adaptive responses to both approach- and withdrawal-related stimuli, be they acquired or biological.     

Neural coding of cooperative vs. affective human interactions: 150 ms to code the action's purpose

The timing and neural processing of the understanding of social interactions was investigated by presenting scenes in which 2 people performed cooperative or affective actions. While the role of the human mirror neuron system (MNS) in understanding actions and intentions is widely accepted, little is known about the time course within which these aspects of visual information are automatically extracted. Event-Related Potentials were recorded in 35 university students perceiving 260 pictures of cooperative (e.g., 2 people dragging a box) or affective (e.g., 2 people smiling and holding hands) interactions. The action's goal was automatically discriminated at about 150-170 ms, as reflected by occipito/temporal N170 response. The swLORETA inverse solution revealed the strongest sources in the right posterior cingulate cortex (CC) for affective actions and in the right pSTS for cooperative actions. It was found a right hemispheric asymmetry that involved the fusiform gyrus (BA37), the posterior CC, and the medial frontal gyrus (BA10/11) for the processing of affective interactions, particularly in the 155-175 ms time window. In a later time window (200-250 ms) the processing of cooperative interactions activated the left post-central gyrus (BA3), the left parahippocampal gyrus, the left superior frontal gyrus (BA10), as well as the right premotor cortex (BA6). Women showed a greater response discriminative of the action's goal compared to men at P300 and anterior negativity level (220-500 ms). These findings might be related to a greater responsiveness of the female vs. male MNS. In addition, the discriminative effect was bilateral in women and was smaller and left-sided in men. Evidence was provided that perceptually similar social interactions are discriminated on the basis of the agents' intentions quite early in neural processing, differentially activating regions devoted to face/body/action coding, the limbic system and the MNS.     

Spatiotemporal dynamics of modality-specific and supramodal word processing

The ability of written and spoken words to access the same semantic meaning provides a test case for the multimodal convergence of information from sensory to associative areas. Using anatomically constrained magnetoencephalography (aMEG), the present study investigated the stages of word comprehension in real time in the auditory and visual modalities, as subjects participated in a semantic judgment task. Activity spread from the primary sensory areas along the respective ventral processing streams and converged in anterior temporal and inferior prefrontal regions, primarily on the left at around 400 ms. Comparison of response patterns during repetition priming between the two modalities suggest that they are initiated by modality-specific memory systems, but that they are eventually elaborated mainly in supramodal areas.