Semantic Processing Persists despite Anomalous Syntactic Category: ERP Evidence from Chinese Passive Sentences

The syntax-first model and the parallel/interactive models make different predictions regarding whether syntactic category processing has a temporal and functional primacy over semantic processing. To further resolve this issue, an event-related potential experiment was conducted on 24 Chinese speakers reading Chinese passive sentences with the passive marker BEI (NP₁ + BEI + NP₂ + Verb). This construction was selected because it is the most-commonly used Chinese passive and very much resembles German passives, upon which the syntax-first hypothesis was primarily based. We manipulated semantic consistency (consistent vs. inconsistent) and syntactic category (noun vs. verb) of the critical verb, yielding four conditions: CORRECT (correct sentences), SEMANTIC (semantic anomaly), SYNTACTIC (syntactic category anomaly), and COMBINED (combined anomalies). Results showed both N400 and P600 effects for sentences with semantic anomaly, with syntactic category anomaly, or with combined anomalies. Converging with recent findings of Chinese ERP studies on various constructions, our study provides further evidence that syntactic category processing does not precede semantic processing in reading Chinese.     

Left inferior frontal activations depending on the canonicity determined by the argument structures of ditransitive sentences: an MEG study

To elucidate the relationships between syntactic and semantic processes, one interesting question is how syntactic structures are constructed by the argument structure of a verb, where each argument corresponds to a semantic role of each noun phrase (NP). Here we examined the effects of possessivity [sentences with or without a possessor] and canonicity [canonical or noncanonical word orders] using Japanese ditransitive sentences. During a syntactic decision task, the syntactic structure of each sentence would be constructed in an incremental manner based on the predicted argument structure of the ditransitive verb in a verb-final construction. Using magnetoencephalography, we found a significant canonicity effect on the current density in the left inferior frontal gyrus (IFG) at 530-550 ms after the verb onset. This effect was selective to canonical sentences, and significant even when the precedent NP was physically identical. We suggest that the predictive effects associated with syntactic processing became larger for canonical sentences, where the NPs and verb were merged with a minimum structural distance, leading to the left IFG activations. For monotransitive and intransitive verbs, in which structural computation of the sentences was simpler than that of ditransitive sentences, we observed a significant effect selective to noncanonical sentences in the temporoparietal regions during 480-670 ms. This effect probably reflects difficulty in semantic processing of noncanonical sentences. These results demonstrate that the left IFG plays a predictive role in syntactic processing, which depends on the canonicity determined by argument structures, whereas other temporoparietal regions would subserve more semantic aspects of sentence processing.     

Neural bases of syntax–semantics interface processing

The binding problem—question of how information between the modules of the linguistic system is integrated during language processing—is as yet unresolved. The remarkable speed of language processing and comprehension (Pulvermüller et al. 2009) suggests that at least coarse semantic information (e.g. noun animacy) and syntactically-relevant information (e.g. verbal template) are integrated rapidly to allow for coarse comprehension. This EEG study investigated syntax–semantics interface processing during word-by-word sentence reading. As alpha-band neural activity serves as an inhibition mechanism for local networks, we used topographical distribution of alpha power to help identify the timecourse of the binding process. We manipulated the syntactic parameter of verbal event structure, and semantic parameter of noun animacy in reduced relative clauses (RRCs, e.g. “The witness/mansion seized/protected by the agent was in danger”), to investigate the neural bases of interaction between syntactic and semantic networks during sentence processing. The word-by-word stimulus presentation method in the present experiment required manipulation of both syntactic structure and semantic features in the working memory. The results demonstrated a gradient distribution of early components (biphasic posterior P1–N2 and anterior N1–P2) over function words “by” and “the”, and the verb, corresponding to facilitation or conflict resulting from the syntactic (telicity) and semantic (animacy) cues in the preceding portion of the sentence. This was followed by assimilation of power distribution in the α band at the second noun. The flattened distribution of α power during the mental manipulation with high demand on working memory—thematic role re-assignment—demonstrates a state of α equilibrium with strong functional coupling between posterior and anterior regions. These results demonstrate that the processing of semantic and syntactic features during sentence comprehension proceeds in highly integrated fashion using gating of attentional resources to facilitate rapid comprehension, with attentional suppression of global alpha power to facilitate interaction of local networks.     

Role of the corpus callosum in speech comprehension: interfacing syntax and prosody

The role of the corpus callosum (CC) in the interhemispheric interaction of prosodic and syntactic information during speech comprehension was investigated in patients with lesions in the CC, and in healthy controls. The event-related brain potential experiment examined the effect of prosodic phrase structure on the processing of a verb whose argument structure matched or did not match the prior prosody-induced syntactic structure. While controls showed an N400-like effect for prosodically mismatching verb argument structures, thus indicating a stable interplay between prosody and syntax, patients with lesions in the posterior third of the CC did not show this effect. Because these patients displayed a prosody-independent semantic N400 effect, the present data indicate that the posterior third of the CC is the crucial neuroanatomical structure for the interhemispheric interplay of suprasegmental prosodic information and syntactic information.     

A psycholinguistic model of natural language parsing implemented in simulated neurons

A natural language parser implemented entirely in simulated neurons is described. It produces a semantic representation based on frames. It parses solely using simulated fatiguing Leaky Integrate and Fire neurons, that are a relatively accurate biological model that is simulated efficiently. The model works on discrete cycles that simulate 10 ms of biological time, so the parser has a simple mapping to psychological parsing time. Comparisons to human parsing studies show that the parser closely approximates this data. The parser makes use of Cell Assemblies and the semantics of lexical items is represented by overlapping hierarchical Cell Assemblies so that semantically related items share neurons. This semantic encoding is used to resolve prepositional phrase attachment ambiguities encountered during parsing. Consequently, the parser provides a neurally-based cognitive model of parsing.     

Re-Examination of Chinese Semantic Processing and Syntactic Processing: Evidence from Conventional ERPs and Reconstructed ERPs by Residue Iteration Decomposition (RIDE)

A number of studies have explored the time course of Chinese semantic and syntactic processing. However, whether syntactic processing occurs earlier than semantics during Chinese sentence reading is still under debate. To further explore this issue, an event-related potentials (ERPs) experiment was conducted on 21 native Chinese speakers who read individually-presented Chinese simple sentences (NP1+VP+NP2) word-by-word for comprehension and made semantic plausibility judgments. The transitivity of the verbs was manipulated to form three types of stimuli: congruent sentences (CON), sentences with a semantically violated NP2 following a transitive verb (semantic violation, SEM), and sentences with a semantically violated NP2 following an intransitive verb (combined semantic and syntactic violation, SEM+SYN). The ERPs evoked from the target NP2 were analyzed by using the Residue Iteration Decomposition (RIDE) method to reconstruct the ERP waveform blurred by trial-to-trial variability, as well as by using the conventional ERP method based on stimulus-locked averaging. The conventional ERP analysis showed that, compared with the critical words in CON, those in SEM and SEM+SYN elicited an N400–P600 biphasic pattern. The N400 effects in both violation conditions were of similar size and distribution, but the P600 in SEM+SYN was bigger than that in SEM. Compared with the conventional ERP analysis, RIDE analysis revealed a larger N400 effect and an earlier P600 effect (in the time window of 500–800 ms instead of 570–810ms). Overall, the combination of conventional ERP analysis and the RIDE method for compensating for trial-to-trial variability confirmed the non-significant difference between SEM and SEM+SYN in the earlier N400 time window. Converging with previous findings on other Chinese structures, the current study provides further precise evidence that syntactic processing in Chinese does not occur earlier than semantic processing.     

How Is Sentence Processing Affected by External Semantic and Syntactic Information? Evidence from Event-Related Potentials

Background

A crucial question for understanding sentence comprehension is the openness of syntactic and semantic processes for other sources of information. Using event-related potentials in a dual task paradigm, we had previously found that sentence processing takes into consideration task relevant sentence-external semantic but not syntactic information. In that study, internal and external information both varied within the same linguistic domain—either semantic or syntactic. Here we investigated whether across-domain sentence-external information would impact within-sentence processing.

Methodology

In one condition, adjectives within visually presented sentences of the structure [Det]-[Noun]-[Adjective]-[Verb] were semantically correct or incorrect. Simultaneously with the noun, auditory adjectives were presented that morphosyntactically matched or mismatched the visual adjectives with respect to gender.

Findings

As expected, semantic violations within the sentence elicited N400 and P600 components in the ERP. However, these components were not modulated by syntactic matching of the sentence-external auditory adjective. In a second condition, syntactic within-sentence correctness-variations were combined with semantic matching variations between the auditory and the visual adjective. Here, syntactic within-sentence violations elicited a LAN and a P600 that did not interact with semantic matching of the auditory adjective. However, semantic mismatching of the latter elicited a frontocentral positivity, presumably related to an increase in discourse level complexity.

Conclusion

The current findings underscore the open versus algorithmic nature of semantic and syntactic processing, respectively, during sentence comprehension.     

Information Structure Influences Depth of Syntactic Processing: Event-Related Potential Evidence for the Chomsky Illusion

Information structure facilitates communication between interlocutors by highlighting relevant information. It has previously been shown that information structure modulates the depth of semantic processing. Here we used event-related potentials to investigate whether information structure can modulate the depth of syntactic processing. In question-answer pairs, subtle (number agreement) or salient (phrase structure) syntactic violations were placed either in focus or out of focus through information structure marking. P600 effects to these violations reflect the depth of syntactic processing. For subtle violations, a P600 effect was observed in the focus condition, but not in the non-focus condition. For salient violations, comparable P600 effects were found in both conditions. These results indicate that information structure can modulate the depth of syntactic processing, but that this effect depends on the salience of the information. When subtle violations are not in focus, they are processed less elaborately. We label this phenomenon the Chomsky illusion.     

Processing Interrogative Sentence Mood at the Semantic-Syntactic Interface: An Electrophysiological Research in Chinese,German, and Polish

Background

Languages differ in the marking of the sentence mood of a polar interrogative (yes/no question). For instance, the interrogative mood is marked at the beginning of the surface structure in Polish, whereas the marker appears at the end in Chinese. In order to generate the corresponding sentence frame, the syntactic specification of the interrogative mood is early in Polish and late in Chinese. In this respect, German belongs to an interesting intermediate class. The yes/no question is expressed by a shift of the finite verb from its final position in the underlying structure into the utterance initial position, a move affecting, hence, both the sentence''s final and the sentence''s initial constituents. The present study aimed to investigate whether during generation of the semantic structure of a polar interrogative, i.e., the processing preceding the grammatical formulation, the interrogative mood is encoded according to its position in the syntactic structure at distinctive time points in Chinese, German, and Polish.

Methodology/Principal Findings

In a two-choice go/nogo experimental design, native speakers of the three languages responded to pictures by pressing buttons and producing utterances in their native language while their brain potentials were recorded. The emergence and latency of lateralized readiness potentials (LRP) in nogo conditions, in which speakers asked a yes/no question, should indicate the time point of processing the interrogative mood. The results revealed that Chinese, German, and Polish native speakers did not differ from each other in the electrophysiological indicator.

Conclusions/Significance

The findings suggest that the semantic encoding of the interrogative mood is temporally consistent across languages despite its disparate syntactic specification. The consistent encoding may be ascribed to economic processing of interrogative moods at various sentential positions of the syntactic structures in languages or, more generally, to the overarching status of sentence mood in the semantic structure.     

Polite plurals and adjective agreement

When an agreement controller such as a subject NP is a hybrid of contrasting syntactic and semantic features, the choice of syntactic versus semantic agreement depends on both the type of agreement target and the type of agreement controller. Two types of controller are contrasted: hybrid pronouns such as polite uses of the second person plural to refer to one addressee; and hybrid common nouns such as plurale tante. In some languages the pronoun type triggers singular on a predicate adjective and plural on the verb, while the common noun type triggers plural on both adjectives and verbs. The former pattern is explained in terms of underspecification of the pronoun: it is unspecified for the Concord number feature, to which adjectives are sensitive; but it carries a number feature on its referential Index, to which finite verbs are sensitive. An Agreement Marking Principle is proposed, according to which an agreement target checks the trigger for a syntactic phi feature, assigning that feature’s semantic interpretation to the trigger denotation if no syntactic feature is found.     

The Semantic Representation of Event Information Depends on the Cue Modality: An Instance of Meaning-Based Retrieval

The semantic content, or the meaning, is the essence of autobiographical memories. In comparison to previous research, which has mainly focused on the phenomenological experience and the age distribution of retrieved events, the present study provides a novel view on the retrieval of event information by quantifying the information as semantic representations. We investigated the semantic representation of sensory cued autobiographical events and studied the modality hierarchy within the multimodal retrieval cues. The experiment comprised a cued recall task, where the participants were presented with visual, auditory, olfactory or multimodal retrieval cues and asked to recall autobiographical events. The results indicated that the three different unimodal retrieval cues generate significantly different semantic representations. Further, the auditory and the visual modalities contributed the most to the semantic representation of the multimodally retrieved events. Finally, the semantic representation of the multimodal condition could be described as a combination of the three unimodal conditions. In conclusion, these results suggest that the meaning of the retrieved event information depends on the modality of the retrieval cues.     

A histological and ultrastructural analysis of developmental defects produced by the mutation,lethal(1)myospheroid,in Drosophila melanogaster

The recessive embryonic lethal, lethal(1)myospheroid, is located at 21.7 map units on the X chromosome in Drosophila melanogaster. Embryos hemizygous for this mutation appear to develop normally until the time of the first muscular contractions. Due to the physical stress of these initial contractions, dramatic tissue separations occur, which characterize the phenotype of this mutation. The dorsal suture separates with the herniation of midgut and nervous tissue, and the somatic and visceral muscles retract from their sites of attachment. An ultrastructural examination of the development of the muscle attachment sites in these embryos indicates that in 1(1)mys embryos there is a delay in the formation of normal cell-cell attachments. At the muscle-tendon cell junction, the deposition of the apparently normal extracellular matrix of this desmosomal attachment occurs considerably later in development than normal. The 1(1)mys locus apparently makes a product which is either defective, made more slowly, or produced in smaller amounts than normal. The 1(1)mys product is probably necessary for the production of a component of the extracellular matrix of cell-cell attachments.     

MASCOT HTML and XML parser: an implementation of a novel object model for protein identification data

Protein identification using MS is an important technique in proteomics as well as a major generator of proteomics data. We have designed the protein identification data object model (PDOM) and developed a parser based on this model to facilitate the analysis and storage of these data. The parser works with HTML or XML files saved or exported from MASCOT MS/MS ions search in peptide summary report or MASCOT PMF search in protein summary report. The program creates PDOM objects, eliminates redundancy in the input file, and has the capability to output any PDOM object to a relational database. This program facilitates additional analysis of MASCOT search results and aids the storage of protein identification information. The implementation is extensible and can serve as a template to develop parsers for other search engines. The parser can be used as a stand-alone application or can be driven by other Java programs. It is currently being used as the front end for a system that loads HTML and XML result files of MASCOT searches into a relational database. The source code is freely available at http://www.ccbm.jhu.edu and the program uses only free and open-source Java libraries.     

Absence of cue-recruitment for extrinsic signals: sounds, spots, and swirling dots fail to influence perceived 3D rotation direction after training

The visual system can learn to use information in new ways to construct appearance. Thus, signals such as the location or translation direction of an ambiguously rotating wire frame cube, which are normally uninformative, can be learned as cues to determine the rotation direction. This perceptual learning occurs when the formerly uninformative signal is statistically associated with long-trusted visual cues (such as binocular disparity) that disambiguate appearance during training. In previous demonstrations, the newly learned cue was intrinsic to the perceived object, in that the signal was conveyed by the same image elements as the object itself. Here we used extrinsic new signals and observed no learning. We correlated three new signals with long-trusted cues in the rotating cube paradigm: one crossmodal (an auditory signal) and two within modality (visual). Cue recruitment did not occur in any of these conditions, either in single sessions or in ten sessions across as many days. These results suggest that the intrinsic/extrinsic distinction is important for the perceptual system in determining whether it can learn and use new information from the environment to construct appearance. Extrinsic cues do have perceptual effects (e.g. the "bounce-pass" illusion and McGurk effect), so we speculate that extrinsic signals must be recruited for perception, but only if certain conditions are met. These conditions might specify the age of the observer, the strength of the long-trusted cues, or the amount of exposure to the correlation.     

Distinguishing Neurocognitive Processes Reflected by P600 Effects: Evidence from ERPs and Neural Oscillations

Research on language comprehension using event-related potentials (ERPs) reported distinct ERP components reliably related to the processing of semantic (N400) and syntactic information (P600). Recent ERP studies have challenged this well-defined distinction by showing P600 effects for semantic and pragmatic anomalies. So far, it is still unresolved whether the P600 reflects specific or rather common processes. The present study addresses this question by investigating ERPs in response to a syntactic and pragmatic (irony) manipulation, as well as a combined syntactic and pragmatic manipulation. For the syntactic condition, a morphosyntactic violation was applied, whereas for the pragmatic condition, such as “That is rich”, either an ironic or literal interpretation was achieved, depending on the prior context. The ERPs at the critical word showed a LAN-P600 pattern for syntactically incorrect sentences relative to correct ones. For ironic compared to literal sentences, ERPs showed a P200 effect followed by a P600 component. In comparison of the syntax-related P600 to the irony-related P600, distributional differences were found. Moreover, for the P600 time window (i.e., 500–900 ms), different changes in theta power between the syntax and pragmatics effects were found, suggesting that different patterns of neural activity contributed to each respective effect. Thus, both late positivities seem to be differently sensitive to these two types of linguistic information, and might reflect distinct neurocognitive processes, such as reanalysis of the sentence structure versus pragmatic reanalysis.     

How the speed of working memory updating influences the on-line thematic processing of simple sentences in Mandarin Chinese

This ERP study used electrophysiological technique to examine how individual differences in the speed of working memory updating influence the use of syntactic and semantic information during on-line sentence argument interpretation, and the time course of that working memory updating effect. The basic structure of the experimental sentences was “Noun + Verb + adverb + ‘le’ + a two-character word”, with the Noun being the sentence initial argument. This initial argument is animate or inanimate and the following verb disambiguates it as an agent or patient. The results at the initial argument revealed that, the quick-updating group elicited a larger positivity over the frontal cortex (within 500–800 ms post-noun onset) as compared with the slow-updating group. At the following disambiguating verb, the slow-updating group only showed a word order effect, indicating that the patient-first condition elicited a larger P600 (within 500–1,000 ms post-verb onset) than the agent-first one; for the quick-updating group, at the early stage of processing, the patient-first sentences elicited a larger N400 (within 300–500 ms post-verb onset) than the agent-first ones only when the initial argument was inanimate; however, at the late stage, the patient-first sentences elicited an enhanced P600 (within 800–1,000 ms post-verb onset) only when the initial argument was animate. These results suggested that the speed of working memory updating not only influences the maintenance of sentence argument when the contents of working memory change but also influences the efficiency of integrating that argument with the verb at a late time point. When integrating the argument with the disambiguating verb, individuals with quick-updating ability can combine multiple sources of information (both noun animacy and word order), and conduct rapid and fine-grained two-stage processing; individuals with slow-updating ability, however, only rely on one dominant source of information types (word order), and conducted slow and course-grained processing.     

Vestibular facilitation of optic flow parsing

Simultaneous object motion and self-motion give rise to complex patterns of retinal image motion. In order to estimate object motion accurately, the brain must parse this complex retinal motion into self-motion and object motion components. Although this computational problem can be solved, in principle, through purely visual mechanisms, extra-retinal information that arises from the vestibular system during self-motion may also play an important role. Here we investigate whether combining vestibular and visual self-motion information improves the precision of object motion estimates. Subjects were asked to discriminate the direction of object motion in the presence of simultaneous self-motion, depicted either by visual cues alone (i.e. optic flow) or by combined visual/vestibular stimuli. We report a small but significant improvement in object motion discrimination thresholds with the addition of vestibular cues. This improvement was greatest for eccentric heading directions and negligible for forward movement, a finding that could reflect increased relative reliability of vestibular versus visual cues for eccentric heading directions. Overall, these results are consistent with the hypothesis that vestibular inputs can help parse retinal image motion into self-motion and object motion components.     

Effects of Visual Cues of Object Density on Perception and Anticipatory Control of Dexterous Manipulation

Anticipatory force planning during grasping is based on visual cues about the object’s physical properties and sensorimotor memories of previous actions with grasped objects. Vision can be used to estimate object mass based on the object size to identify and recall sensorimotor memories of previously manipulated objects. It is not known whether subjects can use density cues to identify the object’s center of mass (CM) and create compensatory moments in an anticipatory fashion during initial object lifts to prevent tilt. We asked subjects (n = 8) to estimate CM location of visually symmetric objects of uniform densities (plastic or brass, symmetric CM) and non-uniform densities (mixture of plastic and brass, asymmetric CM). We then asked whether subjects can use density cues to scale fingertip forces when lifting the visually symmetric objects of uniform and non-uniform densities. Subjects were able to accurately estimate an object’s center of mass based on visual density cues. When the mass distribution was uniform, subjects could scale their fingertip forces in an anticipatory fashion based on the estimation. However, despite their ability to explicitly estimate CM location when object density was non-uniform, subjects were unable to scale their fingertip forces to create a compensatory moment and prevent tilt on initial lifts. Hefting object parts in the hand before the experiment did not affect this ability. This suggests a dichotomy between the ability to accurately identify the object’s CM location for objects with non-uniform density cues and the ability to utilize this information to correctly scale their fingertip forces. These results are discussed in the context of possible neural mechanisms underlying sensorimotor integration linking visual cues and anticipatory control of grasping.     

Unichrom, a novel nuclear matrix protein, binds to the Ars insulator and canonical MARs

Eukaryotic genomic DNA is organized into loop structures by attachments to the nuclear matrix. These attachments to the nuclear matrix have been supposed to form the boundaries of chromosomal DNA. Insulators or boundary elements are defined by two characteristics: they interrupt promoter-enhancer communications when inserted between them, and they suppress the silencing of transgenes stably integrated into inactive chromosomal domains. We recently identified an insulator element in the upstream region of the sea urchin arylsulfatase (HpArs) gene that shows both enhancer blocking and suppression of position effects. Here, we report that Unichrom, originally identified by its G-stretch DNA binding capability, is a nuclear matrix protein that binds to the Ars insulator and canonical nuclear matrix attachment regions (MARs). We also show that Unichrom recognizes the minor groove of the AT-rich region within the Ars insulator, which may have a base-unpairing property, as well as the G-stretch DNA. Furthermore, Unichrom selectively interacts with poly(dG).poly(dC), poly(dA).poly(dT) and poly(dAT).poly(dAT), but not with poly(dGC).poly(dGC). Unichrom also shows high affinity for single-stranded G- and C-stretches. We discuss the DNA binding motif of Unichrom and the function of Unichrom in the nuclear matrix.