Inside the Syntactic Box: The Neural Correlates of the Functional and Positional Level in Covert Sentence Production

The aim of the present fMRI study was to investigate the neural circuits of two stages of grammatical encoding in sentence production. Participants covertly produced sentences on the basis of three words (one verb and two nouns). In the functional level condition both nouns were animate and so were potential competitors for the grammatical function of subject. In the positional level condition the first noun was animate whereas the second was inanimate. We found activation of Broca''s and adjacent areas, previously indicated as responsible for syntactic processing. Additionally, a later onset of the activation in three brain areas in the functional level condition suggests that there is indeed a competition for assignment of subjecthood. The results constrain theories of grammatical encoding, which differ in whether they assume two separate processing levels or only one.     

Left inferior frontal activations depending on the canonicity determined by the argument structures of ditransitive sentences: an MEG study

To elucidate the relationships between syntactic and semantic processes, one interesting question is how syntactic structures are constructed by the argument structure of a verb, where each argument corresponds to a semantic role of each noun phrase (NP). Here we examined the effects of possessivity [sentences with or without a possessor] and canonicity [canonical or noncanonical word orders] using Japanese ditransitive sentences. During a syntactic decision task, the syntactic structure of each sentence would be constructed in an incremental manner based on the predicted argument structure of the ditransitive verb in a verb-final construction. Using magnetoencephalography, we found a significant canonicity effect on the current density in the left inferior frontal gyrus (IFG) at 530-550 ms after the verb onset. This effect was selective to canonical sentences, and significant even when the precedent NP was physically identical. We suggest that the predictive effects associated with syntactic processing became larger for canonical sentences, where the NPs and verb were merged with a minimum structural distance, leading to the left IFG activations. For monotransitive and intransitive verbs, in which structural computation of the sentences was simpler than that of ditransitive sentences, we observed a significant effect selective to noncanonical sentences in the temporoparietal regions during 480-670 ms. This effect probably reflects difficulty in semantic processing of noncanonical sentences. These results demonstrate that the left IFG plays a predictive role in syntactic processing, which depends on the canonicity determined by argument structures, whereas other temporoparietal regions would subserve more semantic aspects of sentence processing.     

The Relation between Thematic Role Computing and Semantic Relatedness Processing during On-Line Sentence Comprehension

Sentence comprehension involves timely computing different types of relations between its verbs and noun arguments, such as morphosyntactic, semantic, and thematic relations. Here, we used EEG technique to investigate the potential differences in thematic role computing and lexical-semantic relatedness processing during on-line sentence comprehension, and the interaction between these two types of processes. Mandarin Chinese sentences were used as materials. The basic structure of those sentences is “Noun+Verb+‘le’+a two-character word”, with the Noun being the initial argument. The verb disambiguates the initial argument as an agent or a patient. Meanwhile, the initial argument and the verb are highly or lowly semantically related. The ERPs at the verbs revealed that: relative to the agent condition, the patient condition evoked a larger N400 only when the argument and verb were lowly semantically related; however, relative to the high-relatedness condition, the low-relatedness condition elicited a larger N400 regardless of the thematic relation; although both thematic role variation and semantic relatedness variation elicited N400 effects, the N400 effect elicited by the former was broadly distributed and reached maximum over the frontal electrodes, and the N400 effect elicited by the latter had a posterior distribution. In addition, the brain oscillations results showed that, although thematic role variation (patient vs. agent) induced power decreases around the beta frequency band (15–30 Hz), semantic relatedness variation (low-relatedness vs. high-relatedness) induced power increases in the theta frequency band (4–7 Hz). These results suggested that, in the sentence context, thematic role computing is modulated by the semantic relatedness between the verb and its argument; semantic relatedness processing, however, is in some degree independent from the thematic relations. Moreover, our results indicated that, during on-line sentence comprehension, thematic role computing and semantic relatedness processing are mediated by distinct neural systems.     

Processing coordinate structures in Chinese: evidence from eye movements

This article reports the results of an eye-tracking experiment that investigated the processing of coordinate structures in Chinese sentence comprehension. The study tracked the eye movements of native Chinese readers as they read sentences consisting of two independent clauses connected by the word huo zhe. The data strongly confirmed readers' preference for an initial noun phrase (NP)-coordination parsing in Chinese coordination structure. When huo zhe was absent from the beginning of a sentence, we identified a cost associated with abandoning the NP-coordination analysis, which was evident with regard to the second NP when the coordination was unambiguous. Otherwise, this cost was evident with regard to the verb, the syntactically disambiguating region, when the coordination was ambiguous. However, the presence of a sentence-initial huo zhe reduced reading times and regressions in the huo zhe NP and the verb regions. We believe that the word huo zhe at the beginning of a sentence helps the reader predict that the sentence contains a parallel structure. Before the corresponding phrases appear, the readers can use the word huo zhe and the language structure thereafter to predicatively construct the syntactic structure. Such predictive capability can eliminate the reader's preference for NP-coordination analysis. Implications for top-down parsing theory and models of initial syntactic analysis and reanalysis are discussed.     

How Distance Affects Semantic Integration in Discourse: Evidence from Event-Related Potentials

Event-related potentials were used to investigate whether semantic integration in discourse is influenced by the number of intervening sentences between the endpoints of integration. Readers read discourses in which the last sentence contained a critical word that was either congruent or incongruent with the information introduced in the first sentence. Furthermore, for the short discourses, the first and last sentence were intervened by only one sentence while for the long discourses, they were intervened by three sentences. We found that the incongruent words elicited an N400 effect for both the short and long discourses. However, a P600 effect was only observed for the long discourses, but not for the short ones. These results suggest that although readers can successfully integrate upcoming words into the existing discourse representation, the effort required for this integration process is modulated by the number of intervening sentences. Thus, discourse distance as measured by the number of intervening sentences should be taken as an important factor for semantic integration in discourse.     

Working Memory Is Partially Preserved during Sleep

Although several cognitive processes, including speech processing, have been studied during sleep, working memory (WM) has never been explored up to now. Our study assessed the capacity of WM by testing speech perception when the level of background noise and the sentential semantic length (SSL) (amount of semantic information required to perceive the incongruence of a sentence) were modulated. Speech perception was explored with the N400 component of the event-related potentials recorded to sentence final words (50% semantically congruent with the sentence, 50% semantically incongruent). During sleep stage 2 and paradoxical sleep: (1) without noise, a larger N400 was observed for (short and long SSL) sentences ending with a semantically incongruent word compared to a congruent word (i.e. an N400 effect); (2) with moderate noise, the N400 effect (observed at wake with short and long SSL sentences) was attenuated for long SSL sentences. Our results suggest that WM for linguistic information is partially preserved during sleep with a smaller capacity compared to wake.     

Re-Examination of Chinese Semantic Processing and Syntactic Processing: Evidence from Conventional ERPs and Reconstructed ERPs by Residue Iteration Decomposition (RIDE)

A number of studies have explored the time course of Chinese semantic and syntactic processing. However, whether syntactic processing occurs earlier than semantics during Chinese sentence reading is still under debate. To further explore this issue, an event-related potentials (ERPs) experiment was conducted on 21 native Chinese speakers who read individually-presented Chinese simple sentences (NP1+VP+NP2) word-by-word for comprehension and made semantic plausibility judgments. The transitivity of the verbs was manipulated to form three types of stimuli: congruent sentences (CON), sentences with a semantically violated NP2 following a transitive verb (semantic violation, SEM), and sentences with a semantically violated NP2 following an intransitive verb (combined semantic and syntactic violation, SEM+SYN). The ERPs evoked from the target NP2 were analyzed by using the Residue Iteration Decomposition (RIDE) method to reconstruct the ERP waveform blurred by trial-to-trial variability, as well as by using the conventional ERP method based on stimulus-locked averaging. The conventional ERP analysis showed that, compared with the critical words in CON, those in SEM and SEM+SYN elicited an N400–P600 biphasic pattern. The N400 effects in both violation conditions were of similar size and distribution, but the P600 in SEM+SYN was bigger than that in SEM. Compared with the conventional ERP analysis, RIDE analysis revealed a larger N400 effect and an earlier P600 effect (in the time window of 500–800 ms instead of 570–810ms). Overall, the combination of conventional ERP analysis and the RIDE method for compensating for trial-to-trial variability confirmed the non-significant difference between SEM and SEM+SYN in the earlier N400 time window. Converging with previous findings on other Chinese structures, the current study provides further precise evidence that syntactic processing in Chinese does not occur earlier than semantic processing.     

Specialization in the left prefrontal cortex for sentence comprehension

Using functional magnetic resonance imaging (fMRI), we examined cortical activation under syntactic decision tasks and a short-term memory task for sentences, focusing on essential properties of syntactic processing. By comparing activation in these tasks with a short-term memory task for word lists, we found that two regions in the left prefrontal cortex showed selective activation for syntactic processing: the dorsal prefrontal cortex (DPFC) and the inferior frontal gyrus (IFG). Moreover, the left DPFC showed more prominent activation under the short-term memory task for sentences than that for word lists, which cannot be explained by general cognitive factors such as task difficulty and verbal short-term memory. These results support the proposal of specialized systems for sentence comprehension in the left prefrontal cortex.     

Grip Force Reveals the Context Sensitivity of Language-Induced Motor Activity during “Action Words” Processing: Evidence from Sentential Negation

Background

Studies demonstrating the involvement of motor brain structures in language processing typically focus on time windows beyond the latencies of lexical-semantic access. Consequently, such studies remain inconclusive regarding whether motor brain structures are recruited directly in language processing or through post-linguistic conceptual imagery. In the present study, we introduce a grip-force sensor that allows online measurements of language-induced motor activity during sentence listening. We use this tool to investigate whether language-induced motor activity remains constant or is modulated in negative, as opposed to affirmative, linguistic contexts.

Methodology/Principal Findings

Participants listened to spoken action target words in either affirmative or negative sentences while holding a sensor in a precision grip. The participants were asked to count the sentences containing the name of a country to ensure attention. The grip force signal was recorded continuously. The action words elicited an automatic and significant enhancement of the grip force starting at approximately 300 ms after target word onset in affirmative sentences; however, no comparable grip force modulation was observed when these action words occurred in negative contexts.

Conclusions/Significance

Our findings demonstrate that this simple experimental paradigm can be used to study the online crosstalk between language and the motor systems in an ecological and economical manner. Our data further confirm that the motor brain structures that can be called upon during action word processing are not mandatorily involved; the crosstalk is asymmetrically governed by the linguistic context and not vice versa.     

Integration of Sentence-Level Semantic Information in Parafovea: Evidence from the RSVP-Flanker Paradigm

During text reading, the parafoveal word was usually presented between 2° and 5° from the point of fixation. Whether semantic information of parafoveal words can be processed during sentence reading is a critical and long-standing issue. Recently, studies using the RSVP-flanker paradigm have shown that the incongruent parafoveal word, presented as right flanker, elicited a more negative N400 compared with the congruent parafoveal word. This suggests that the semantic information of parafoveal words can be extracted and integrated during sentence reading, because the N400 effect is a classical index of semantic integration. However, as most previous studies did not control the word-pair congruency of the parafoveal and the foveal words that were presented in the critical triad, it is still unclear whether such integration happened at the sentence level or just at the word-pair level. The present study addressed this question by manipulating verbs in Chinese sentences to yield either a semantically congruent or semantically incongruent context for the critical noun. In particular, the interval between the critical nouns and verbs was controlled to be 4 or 5 characters. Thus, to detect the incongruence of the parafoveal noun, participants had to integrate it with the global sentential context. The results revealed that the N400 time-locked to the critical triads was more negative in incongruent than in congruent sentences, suggesting that parafoveal semantic information can be integrated at the sentence level during Chinese reading.     

Dogs cannot bark: event-related brain responses to true and false negated statements as indicators of higher-order conscious processing

The present study investigated event-related brain potentials elicited by true and false negated statements to evaluate if discrimination of the truth value of negated information relies on conscious processing and requires higher-order cognitive processing in healthy subjects across different levels of stimulus complexity. The stimulus material consisted of true and false negated sentences (sentence level) and prime-target expressions (word level). Stimuli were presented acoustically and no overt behavioral response of the participants was required. Event-related brain potentials to target words preceded by true and false negated expressions were analyzed both within group and at the single subject level. Across the different processing conditions (word pairs and sentences), target words elicited a frontal negativity and a late positivity in the time window from 600-1000 msec post target word onset. Amplitudes of both brain potentials varied as a function of the truth value of the negated expressions. Results were confirmed at the single-subject level. In sum, our results support recent suggestions according to which evaluation of the truth value of a negated expression is a time- and cognitively demanding process that cannot be solved automatically, and thus requires conscious processing. Our paradigm provides insight into higher-order processing related to language comprehension and reasoning in healthy subjects. Future studies are needed to evaluate if our paradigm also proves sensitive for the detection of consciousness in non-responsive patients.     

Working Memory Updating Function Training Influenced Brain Activity

Recent studies demonstrated that working memory could be improved by training. We recruited healthy adult participants and used adaptive running working memory training tasks with a double-blind design, combined with the event-related potentials (ERPs) approach, to explore the influence of updating function training on brain activity. Participants in the training group underwent training for 20 days. Compared with the control group, the training group''s accuracy (ACC) in the two-back working memory task had no significant differences after training, but reaction time (RT) was reduced significantly. Besides, the amplitudes of N160 and P300 increased significantly whereas that of P200 decreased significantly. The results suggest that training could have improved the participants'' capacity on both inhibitory and updating.     

Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex

The embodied cognition hypothesis suggests that motor and premotor areas are automatically and necessarily involved in understanding action language, as word conceptual representations are embodied. This transcranial magnetic stimulation (TMS) study explores the role of the left primary motor cortex in action-verb processing. TMS-induced motor-evoked potentials from right-hand muscles were recorded as a measure of M1 activity, while participants were asked either to judge explicitly whether a verb was action-related (semantic task) or to decide on the number of syllables in a verb (syllabic task). TMS was applied in three different experiments at 170, 350 and 500 ms post-stimulus during both tasks to identify when the enhancement of M1 activity occurred during word processing. The delays between stimulus onset and magnetic stimulation were consistent with electrophysiological studies, suggesting that word recognition can be differentiated into early (within 200 ms) and late (within 400 ms) lexical-semantic stages, and post-conceptual stages. Reaction times and accuracy were recorded to measure the extent to which the participants'' linguistic performance was affected by the interference of TMS with M1 activity. No enhancement of M1 activity specific for action verbs was found at 170 and 350 ms post-stimulus, when lexical-semantic processes are presumed to occur (Experiments 1–2). When TMS was applied at 500 ms post-stimulus (Experiment 3), processing action verbs, compared with non-action verbs, increased the M1-activity in the semantic task and decreased it in the syllabic task. This effect was specific for hand-action verbs and was not observed for action-verbs related to other body parts. Neither accuracy nor RTs were affected by TMS. These findings suggest that the lexical-semantic processing of action verbs does not automatically activate the M1. This area seems to be rather involved in post-conceptual processing that follows the retrieval of motor representations, its activity being modulated (facilitated or inhibited), in a top-down manner, by the specific demand of the task.     

Neural Correlates of the In-Group Memory Advantage on the Encoding and Recognition of Faces

People have a memory advantage for faces that belong to the same group, for example, that attend the same university or have the same personality type. Faces from such in-group members are assumed to receive more attention during memory encoding and are therefore recognized more accurately. Here we use event-related potentials related to memory encoding and retrieval to investigate the neural correlates of the in-group memory advantage. Using the minimal group procedure, subjects were classified based on a bogus personality test as belonging to one of two personality types. While the electroencephalogram was recorded, subjects studied and recognized faces supposedly belonging to the subject’s own and the other personality type. Subjects recognized in-group faces more accurately than out-group faces but the effect size was small. Using the individual behavioral in-group memory advantage in multivariate analyses of covariance, we determined neural correlates of the in-group advantage. During memory encoding (300 to 1000 ms after stimulus onset), subjects with a high in-group memory advantage elicited more positive amplitudes for subsequently remembered in-group than out-group faces, showing that in-group faces received more attention and elicited more neural activity during initial encoding. Early during memory retrieval (300 to 500 ms), frontal brain areas were more activated for remembered in-group faces indicating an early detection of group membership. Surprisingly, the parietal old/new effect (600 to 900 ms) thought to indicate recollection processes differed between in-group and out-group faces independent from the behavioral in-group memory advantage. This finding suggests that group membership affects memory retrieval independent of memory performance. Comparisons with a previous study on the other-race effect, another memory phenomenon influenced by social classification of faces, suggested that the in-group memory advantage is dominated by top-down processing whereas the other-race effect is also influenced by extensive perceptual experience.     

Neural signatures of syntactic variation in speech planning

Planning to speak is a challenge for the brain, and the challenge varies between and within languages. Yet, little is known about how neural processes react to these variable challenges beyond the planning of individual words. Here, we examine how fundamental differences in syntax shape the time course of sentence planning. Most languages treat alike (i.e., align with each other) the 2 uses of a word like “gardener” in “the gardener crouched” and in “the gardener planted trees.” A minority keeps these formally distinct by adding special marking in 1 case, and some languages display both aligned and nonaligned expressions. Exploiting such a contrast in Hindi, we used electroencephalography (EEG) and eye tracking to suggest that this difference is associated with distinct patterns of neural processing and gaze behavior during early planning stages, preceding phonological word form preparation. Planning sentences with aligned expressions induces larger synchronization in the theta frequency band, suggesting higher working memory engagement, and more visual attention to agents than planning nonaligned sentences, suggesting delayed commitment to the relational details of the event. Furthermore, plain, unmarked expressions are associated with larger desynchronization in the alpha band than expressions with special markers, suggesting more engagement in information processing to keep overlapping structures distinct during planning. Our findings contrast with the observation that the form of aligned expressions is simpler, and they suggest that the global preference for alignment is driven not by its neurophysiological effect on sentence planning but by other sources, possibly by aspects of production flexibility and fluency or by sentence comprehension. This challenges current theories on how production and comprehension may affect the evolution and distribution of syntactic variants in the world’s languages.

Little is known about the neural processes involved in planning to speak. This study uses eye-tracking and EEG to show that speakers prepare sentence structures in different ways and rely on alpha and theta oscillations differently when planning sentences with and without agent case marking, challenging theories on how production and comprehension affect language evolution.     

Effect of empathy trait on attention to faces: an event-related potential (ERP) study

Background

Empathy is deeply linked with the ability to adapt to human social environments. The present study investigated the relationship between the empathy trait and attention elicited by discriminating facial expressions.

Methods

Event-related potentials were measured while 32 participants (17 men and 15 women) discriminated facial expressions (happy or angry) and colors of flowers (yellow or purple) under an oddball paradigm. The empathy trait of participants was measured using the Interpersonal Reactivity Index (Davis, 1980).

Results

The empathy trait correlated positively with both the early portion (300 to 600 ms after stimulus onset) and late portion (600 to 800 ms after stimulus onset) of late positive potential (LPP) amplitude elicited by faces, but not with LPP elicited by flowers.

Conclusions

This result suggests that, compared to people with low empathy, people with high empathy pay more attention when discriminating facial expressions. The present study suggests that differences exist in methods of adapting to social environments between people with high and low empathy.     

Applauding with Closed Hands: Neural Signature of Action-Sentence Compatibility Effects

Background

Behavioral studies have provided evidence for an action–sentence compatibility effect (ACE) that suggests a coupling of motor mechanisms and action-sentence comprehension. When both processes are concurrent, the action sentence primes the actual movement, and simultaneously, the action affects comprehension. The aim of the present study was to investigate brain markers of bidirectional impact of language comprehension and motor processes.

Methodology/Principal Findings

Participants listened to sentences describing an action that involved an open hand, a closed hand, or no manual action. Each participant was asked to press a button to indicate his/her understanding of the sentence. Each participant was assigned a hand-shape, either closed or open, which had to be used to activate the button. There were two groups (depending on the assigned hand-shape) and three categories (compatible, incompatible and neutral) defined according to the compatibility between the response and the sentence. ACEs were found in both groups. Brain markers of semantic processing exhibited an N400-like component around the Cz electrode position. This component distinguishes between compatible and incompatible, with a greater negative deflection for incompatible. Motor response elicited a motor potential (MP) and a re-afferent potential (RAP), which are both enhanced in the compatible condition.

Conclusions/Significance

The present findings provide the first ACE cortical measurements of semantic processing and the motor response. N400-like effects suggest that incompatibility with motor processes interferes in sentence comprehension in a semantic fashion. Modulation of motor potentials (MP and RAP) revealed a multimodal semantic facilitation of the motor response. Both results provide neural evidence of an action-sentence bidirectional relationship. Our results suggest that ACE is not an epiphenomenal post-sentence comprehension process. In contrast, motor-language integration occurring during the verb onset supports a genuine and ongoing brain motor-language interaction.     

Effect of Different Parthenogenetic Activation Methods on the Developmental Competence of in vitro Matured Porcine Oocytes

The aim of this study was to investigate the effect of electrical pulse, ethanol, and ionomycin combined with cycloheximide (CHX), cytochalasin B (CB), and 6-dimethylaminopurine (6-DMAP) on parthenogenetic developmental competence of in vitro matured porcine oocytes. In experiment 1, oocytes were treated with direct current electrical pulse (DC pulse) and then incubated in the NCSU-23 medium supplemented with CHX, 6-DMAP, CB + CHX, and CB + 6-DMAP for 6 h, respectively. The rate of blastocyst development in DC pulse + CB + 6-DMAP group was significantly higher than those in other groups (42.4% vs 23.9% ～ 35.8%; P < 0.05); however, there were no differences in both of the cleavage rate and the cell number of blastocysts among four groups. In experiment 2, oocytes were treated with NCSU-23 medium containing 20 μM ionomycin for 40 min and then incubated in the NCSU-23 medium supplemented with CHX, 6-DMAP, CB + CHX and CB + 6-DMAP for 6 h, respectively. The rates of cleavage and blastocyst development in ionomycin + 6-DMAP group were higher than those obtained in other groups (66.2% vs 46.3% ～ 57.3%; 22.3% vs 7.4% ～ 16.1%; P < 0.05). In experiment 3, the activation effects of ethanol combined with 6-DMAP, CHX, CB + 6-DMAP and CB + CHX were investigated. The rates of cleavage and blastocyst development in ethanol + CB + 6-DMAP group were significantly higher than those in other groups (55.5% vs 42% ～ 46.2%; 18.0% vs 7.1% ～ 11.9%; P < 0.05). In experiment 4, the optimal activation protocols in each group plus DC pulse + ionomycin + 6-DMAP were compared. The results showed the rates of cleavage in DC pulse + CB + 6-DMAP group and ionomycin + 6-DMAP were higher than those in ethanol + CB + 6-DMAP and DC pulse + ionomycin + 6-DMAP (73.8–74.4% vs 56.5–57.5%; P < 0.05), but the blastocyst development only in DC pulse + CB + 6-DMAP group was significantly higher than that in other groups (34.1% vs 13.4% ～ 22.3%; P < 0.05). Total cell number of blastocysts in the group of DC pulse + ionomycin + 6-DMAP was higher than that in other groups (34.1 vs 25.3–27.2; P < 0.05). In conclusion, DC pulse, ethanol, CB, and 6-DMAP all affected the parthenogenesis of porcine oocytes matured in vitro, but their combination of DC pulse + CB + 6-DMAP showed the best result in both of cleavage and blastocyst development.     

Finding simplicity in complexity: general principles of biological and nonbiological organization

What differentiates the living from the nonliving? What is life? These are perennial questions that have occupied minds since the beginning of cultures. The search for a clear demarcation between animate and inanimate is a reflection of the human tendency to create borders, not only physical but also conceptual. It is obvious that what we call a living creature, either bacteria or organism, has distinct properties from those of the normally called nonliving. However, searching beyond dichotomies and from a global, more abstract, perspective on natural laws, a clear partition of matter into animate and inanimate becomes fuzzy. Based on concepts from a variety of fields of research, the emerging notion is that common principles of biological and nonbiological organization indicate that natural phenomena arise and evolve from a central theme captured by the process of information exchange. Thus, a relatively simple universal logic that rules the evolution of natural phenomena can be unveiled from the apparent complexity of the natural world.     

A DNA assembly model of sentence generation

Recent results of corpus-based linguistics demonstrate that context-appropriate sentences can be generated by a stochastic constraint satisfaction process. Exploiting the similarity of constraint satisfaction and DNA self-assembly, we explore a DNA assembly model of sentence generation. The words and phrases in a language corpus are encoded as DNA molecules to build a language model of the corpus. Given a seed word, the new sentences are constructed by a parallel DNA assembly process based on the probability distribution of the word and phrase molecules. Here, we present our DNA code word design and report on successful demonstration of their feasibility in wet DNA experiments of a small scale.