CDP++.Italian: Modelling Sublexical and Supralexical Inconsistency in a Shallow Orthography

Most models of reading aloud have been constructed to explain data in relatively complex orthographies like English and French. Here, we created an Italian version of the Connectionist Dual Process Model of Reading Aloud (CDP++) to examine the extent to which the model could predict data in a language which has relatively simple orthography-phonology relationships but is relatively complex at a suprasegmental (word stress) level. We show that the model exhibits good quantitative performance and accounts for key phenomena observed in naming studies, including some apparently contradictory findings. These effects include stress regularity and stress consistency, both of which have been especially important in studies of word recognition and reading aloud in Italian. Overall, the results of the model compare favourably to an alternative connectionist model that can learn non-linear spelling-to-sound mappings. This suggests that CDP++ is currently the leading computational model of reading aloud in Italian, and that its simple linear learning mechanism adequately captures the statistical regularities of the spelling-to-sound mapping both at the segmental and supra-segmental levels.     

Both Lexical and Non-Lexical Characters Are Processed during Saccadic Eye Movements

On average our eyes make 3–5 saccadic movements per second when we read, although their neural mechanism is still unclear. It is generally thought that saccades help redirect the retinal fovea to specific characters and words but that actual discrimination of information only occurs during periods of fixation. Indeed, it has been proposed that there is active and selective suppression of information processing during saccades to avoid experience of blurring due to the high-speed movement. Here, using a paradigm where a string of either lexical (Chinese) or non-lexical (alphabetic) characters are triggered by saccadic eye movements, we show that subjects can discriminate both while making saccadic eye movement. Moreover, discrimination accuracy is significantly better for characters scanned during the saccadic movement to a fixation point than those not scanned beyond it. Our results showed that character information can be processed during the saccade, therefore saccades during reading not only function to redirect the fovea to fixate the next character or word but allow pre-processing of information from the ones adjacent to the fixation locations to help target the next most salient one. In this way saccades can not only promote continuity in reading words but also actively facilitate reading comprehension.     

Word Boundaries Affect Visual Attention in Chinese Reading

In two experiments, we explored attention deployment during the reading of Chinese words using a probe detection task. In both experiments, Chinese readers saw four simplified Chinese characters briefly, and then a probe was presented at one of the character positions. The four characters constituted either one word or two words of two characters each. Reaction time was shorter when the probe was at the character 2 position than the character 3 position in the two-word condition, but not in the one-word condition. In Experiment 2, there were more trials and the materials were more carefully controlled, and the results replicated that of Experiment 1. These results suggest that word boundary information affects attentional deployment in Chinese reading.     

单个汉字阅读过程中的双线路机制

因为汉字具有与拼音字母语言不同的方形书写结构以及字型映射规则,已有很多研究关注这两种语言是否存在着不同的阅读机制,但还在争论中.本研究通过功能磁共振技术,采用汉字和英文两种语言的真字(词),假字(词)以及非字(词)作为刺激材料来进一步研究此问题.研究结果显示:在高频字(词)条件下,汉字和英文具有相似的阅读机制,但在阅读假字(词)时,它们的阅读机制差异很大.具体表现为英文假词激活了左脑缘上回,而汉字假词激活了左脑额中回.研究结果说明:1)汉英双语者可能采用了两种不同的双线路机制来读取汉字和英文单词.2)汉英双语者在阅读英文假词时,须借助缘上回脑区进行字型转换.而在阅读汉字假字时,则需通过额中回进行笔画分析.     

Rapid Extraction of Lexical Tone Phonology in Chinese Characters: A Visual Mismatch Negativity Study

Background

In alphabetic languages, emerging evidence from behavioral and neuroimaging studies shows the rapid and automatic activation of phonological information in visual word recognition. In the mapping from orthography to phonology, unlike most alphabetic languages in which there is a natural correspondence between the visual and phonological forms, in logographic Chinese, the mapping between visual and phonological forms is rather arbitrary and depends on learning and experience. The issue of whether the phonological information is rapidly and automatically extracted in Chinese characters by the brain has not yet been thoroughly addressed.

Methodology/Principal Findings

We continuously presented Chinese characters differing in orthography and meaning to adult native Mandarin Chinese speakers to construct a constant varying visual stream. In the stream, most stimuli were homophones of Chinese characters: The phonological features embedded in these visual characters were the same, including consonants, vowels and the lexical tone. Occasionally, the rule of phonology was randomly violated by characters whose phonological features differed in the lexical tone.

Conclusions/Significance

We showed that the violation of the lexical tone phonology evoked an early, robust visual response, as revealed by whole-head electrical recordings of the visual mismatch negativity (vMMN), indicating the rapid extraction of phonological information embedded in Chinese characters. Source analysis revealed that the vMMN was involved in neural activations of the visual cortex, suggesting that the visual sensory memory is sensitive to phonological information embedded in visual words at an early processing stage.     

Background Speech Effects on Sentence Processing during Reading: An Eye Movement Study

Effects of background speech on reading were examined by playing aloud different types of background speech, while participants read long, syntactically complex and less complex sentences embedded in text. Readers’ eye movement patterns were used to study online sentence comprehension. Effects of background speech were primarily seen in rereading time. In Experiment 1, foreign-language background speech did not disrupt sentence processing. Experiment 2 demonstrated robust disruption in reading as a result of semantically and syntactically anomalous scrambled background speech preserving normal sentence-like intonation. Scrambled speech that was constructed from the text to-be read did not disrupt reading more than scrambled speech constructed from a different, semantically unrelated text. Experiment 3 showed that scrambled speech exacerbated the syntactic complexity effect more than coherent background speech, which also interfered with reading. Experiment 4 demonstrated that both semantically and syntactically anomalous speech produced no more disruption in reading than semantically anomalous but syntactically correct background speech. The pattern of results is best explained by a semantic account that stresses the importance of similarity in semantic processing, but not similarity in semantic content, between the reading task and background speech.     

Als ‘A’ niet meer als ‘a’ wordt herkend. Een analyse van verworven woordblindheid

A right-handed patient, aged 72, manifested alexia without agraphia, a right homonymous hemianopia and an impaired ability to identify visually presented objects. He was completely unable to read words aloud and severely deficient in naming visually presented letters. He responded to orthographic familiarity in the lexical decision tasks of the Psycholinguistic Assessments of Language Processing in Aphasia (PALPA) rather than to the lexicality of the letter strings. He was impaired at deciding whether two letters of different case (e.g., A, a) are the same, though he could detect real letters from made-up ones or from their mirror image. Consequently, his core deficit in reading was posited at the level of the abstract letter identifiers. When asked to trace a letter with his right index finger, kinesthetic facilitation enabled him to read letters and words aloud. Though he could use intact motor representations of letters in order to facilitate recognition and reading, the slow, sequential and error-prone process of reading letter by letter made him abandon further training.     

Early Electrophysiological Basis of Experience-Associated Holistic Processing of Chinese Characters

Recent studies have found holistic processing to be a marker of expertise for perception of words in alphabetic (e.g., English) and non-alphabetic (e.g., Chinese) writing systems, consistent with what has been found for faces and other objects of face-like expertise. It is unknown, however, whether holistic processing of words occurs in an early, perceptual stage as it does for faces. We examined how early holistic processing of Chinese characters emerges by recording the event-related potentials (ERPs) in an adaptation paradigm. Participants judged if the top parts of two sequentially presented characters were the same or different while ignoring the bottom part. An early potential (P1) at the posterior channels was smaller when the attended top parts were the same compared with when they are different, indicating an adaptation effect. Critically, for trials with identical top parts, P1 was larger when the irrelevant bottom parts were different, indicating a release of adaptation. This effect was present only when the two character parts were aligned but not misaligned, and only for characters but not for pseudocharacters. The finding of early sensitivity to all parts of a Chinese character suggests that Chinese characters are represented holistically at a perceptual level.     

Word learning and the cerebral hemispheres: from serial to parallel processing of written words

Reading familiar words differs from reading unfamiliar non-words in two ways. First, word reading is faster and more accurate than reading of unfamiliar non-words. Second, effects of letter length are reduced for words, particularly when they are presented in the right visual field in familiar formats. Two experiments are reported in which right-handed participants read aloud non-words presented briefly in their left and right visual fields before and after training on those items. The non-words were interleaved with familiar words in the naming tests. Before training, naming was slow and error prone, with marked effects of length in both visual fields. After training, fewer errors were made, naming was faster, and the effect of length was much reduced in the right visual field compared with the left. We propose that word learning creates orthographic word forms in the mid-fusiform gyrus of the left cerebral hemisphere. Those word forms allow words to access their phonological and semantic representations on a lexical basis. But orthographic word forms also interact with more posterior letter recognition systems in the middle/inferior occipital gyri, inducing more parallel processing of right visual field words than is possible for any left visual field stimulus, or for unfamiliar non-words presented in the right visual field.     

Analysis and classification of speech imagery EEG for BCI

Electroencephalogram (EEG) is generally used in brain–computer interface (BCI), including motor imagery, mental task, steady-state evoked potentials (SSEPs) and P300. In order to complement existing motor-based control paradigms, this paper proposed a novel imagery mode: speech imagery. Chinese characters are monosyllabic and one Chinese character can express one meaning. Thus, eight Chinese subjects were required to read two Chinese characters in mind in this experiment. There were different shapes, pronunciations and meanings between two Chinese characters. Feature vectors of EEG signals were extracted by common spatial patterns (CSP), and then these vectors were classified by support vector machine (SVM). The accuracy between two characters was not superior. However, it was still effective to distinguish whether subjects were reading one character in mind, and the accuracies were between 73.65% and 95.76%. The results were better than vowel speech imagery, and they were suitable for asynchronous BCI. BCI systems will be also extended from motor imagery to combine motor imagery and speech imagery in the future.     

Resting-State Functional Connectivity Patterns Predict Chinese Word Reading Competency

Resting-state functional connectivity (RSFC) offers a novel approach to reveal the temporal synchronization of functionally related brain regions. Recent studies have identified several RSFCs whose strength was associated with reading competence in alphabetic languages. In the present study, we examined the role of intrinsic functional relations for reading a non-alphabetic language – Chinese – by correlating RSFC maps of nine Chinese reading-related seed regions and reaction time in the single-character reading task. We found that Chinese reading efficiency was positively correlated with the connection between left inferior occipital gyrus and left superior parietal lobule, between right posterior fusiform gyrus and right superior parietal lobule, and between left inferior temporal gyrus and left inferior parietal lobule. These results could not be attributed to inter-individual differences arising from the peripheral processes of the reading task such as visual input detection and articulation. The observed RSFC-reading correlation relationships are discussed in the framework of Chinese character reading, including visuospatial analyses and semantic/phonological processes.     

Form–meaning links in the development of visual word recognition

Learning to read takes time and it requires explicit instruction. Three decades of research has taught us a good deal about how children learn about the links between orthography and phonology during word reading development. However, we have learned less about the links that children build between orthographic form and meaning. This is surprising given that the goal of reading development must be for children to develop an orthographic system that allows meanings to be accessed quickly, reliably and efficiently from orthography. This review considers whether meaning-related information is used when children read words aloud, and asks what we know about how and when children make connections between form and meaning during the course of reading development.     

Stress Priming in Reading and the Selective Modulation of Lexical and Sub-Lexical Pathways

Four experiments employed a priming methodology to investigate different mechanisms of stress assignment and how they are modulated by lexical and sub-lexical mechanisms in reading aloud in Italian. Lexical stress is unpredictable in Italian, and requires lexical look-up. The most frequent stress pattern (Dominant) is on the penultimate syllable [laVOro (work)], while stress on the antepenultimate syllable [MAcchina (car)] is relatively less frequent (non-Dominant). Word and pseudoword naming responses primed by words with non-dominant stress – which require whole-word knowledge to be read correctly – were compared to those primed by nonwords. Percentage of errors to words and percentage of dominant stress responses to nonwords were measured. In Experiments 1 and 2 stress errors increased for non-dominant stress words primed by nonwords, as compared to when they were primed by words. The results could be attributed to greater activation of sub-lexical codes, and an associated tendency to assign the dominant stress pattern by default in the nonword prime condition. Alternatively, they may have been the consequence of prosodic priming, inducing more errors on trials in which the stress pattern of primes and targets was not congruent. The two interpretations were investigated in Experiments 3 and 4. The results overall suggested a limited role of the default metrical pattern in word pronunciation, and showed clear effect of prosodic priming, but only when the sub-lexical mechanism prevailed.     

The Characteristics of Chinese Orthographic Neighborhood Size Effect for Developing Readers

Orthographic neighborhood size (N size) effect in Chinese character naming has been studied in adults. In the present study, we aimed to explore the developmental characteristics of Chinese N size effect. One hundred and seventeen students (40 from the 3^rd grade with mean age of 9 years; 40 from the 5^th grade with mean age of 11 years; 37 from the 7^th grade with mean age of 13 years) were recruited in the study. A naming task of Chinese characters was adopted to elucidate N-size- effect development. Reaction times and error rates were recorded. Results showed that children in the 3^rd grade named characters from large neighborhoods faster than named those from small neighborhoods, revealing a facilitatory N size effect; the 5^th graders showed null N size effect; while the 7^th graders showed an inhibitory N size effect, with longer reaction times for the characters from large neighborhoods than for those from small neighborhoods. The change from facilitation to inhibition of neighborhood size effect across grades suggested the transition from broadly tuned to finely tuned lexical representation in reading development, and the possible inhibition from higher frequency neighbors for higher graders.     

Reading comprehension without phonological mediation: Further evidence from a Chinese aphasic individual

Abstrct  An important issue in visual word comprehension literature is whether or not semantic access is mediated by phonological processing. In this paper, we present a Chinese individual, YGA, who provides converging evidence to directly address this issue. YGA has sustained damage to the left posterior superior and middle temporal lobe, and shows difficulty in orally name pictures and reading printed words aloud. He makes phonological errors on these tasks and also semantic errors on picture naming, indicating a deficit at accessing the phonological representations for output. However, he is intact at understanding the meaning of visually presented words. Such a profile challenges the hypothesis that semantic access in reading is phonologically mediated and provides further evidence for the universal principle of direct semantic access in reading. Supported by Grants PCSIRT (IRT0710), National Natural Science Foundation of China (Grant Nos. 30770715, 30700224), Beijing Natural Science Foundation (Grant No.7082051).     

Language Differences in the Brain Network for Reading in Naturalistic Story Reading and Lexical Decision

Differences in how writing systems represent language raise important questions about whether there could be a universal functional architecture for reading across languages. In order to study potential language differences in the neural networks that support reading skill, we collected fMRI data from readers of alphabetic (English) and morpho-syllabic (Chinese) writing systems during two reading tasks. In one, participants read short stories under conditions that approximate natural reading, and in the other, participants decided whether individual stimuli were real words or not. Prior work comparing these two writing systems has overwhelmingly used meta-linguistic tasks, generally supporting the conclusion that the reading system is organized differently for skilled readers of Chinese and English. We observed that language differences in the reading network were greatly dependent on task. In lexical decision, a pattern consistent with prior research was observed in which the Middle Frontal Gyrus (MFG) and right Fusiform Gyrus (rFFG) were more active for Chinese than for English, whereas the posterior temporal sulcus was more active for English than for Chinese. We found a very different pattern of language effects in a naturalistic reading paradigm, during which significant differences were only observed in visual regions not typically considered specific to the reading network, and the middle temporal gyrus, which is thought to be important for direct mapping of orthography to semantics. Indeed, in areas that are often discussed as supporting distinct cognitive or linguistic functions between the two languages, we observed interaction. Specifically, language differences were most pronounced in MFG and rFFG during the lexical decision task, whereas no language differences were observed in these areas during silent reading of text for comprehension.     

The Genetic and Environmental Foundation of the Simple View of Reading in Chinese

The Simple View of Reading (SVR) in Chinese was examined in a genetically sensitive design. A total of 270 pairs of Chinese twins (190 pairs of monozygotic twins and 80 pairs of same-sex dizygotic twins) were tested on Chinese vocabulary and word reading at the mean age 7.8 years and reading comprehension of sentences and passages one year later. Results of behavior-genetic analyses showed that both vocabulary and word reading had significant independent genetic influences on reading comprehension, and the two factors together accounted for most but not all of the genetic influences on reading comprehension. In addition, sentence comprehension had a stronger genetic correlation with word reading while passage comprehension showed a trend of stronger genetic overlap with vocabulary. These findings suggest that the genetic foundation of the SVR in Chinese is largely supported in that language comprehension and decoding are two core skills for reading comprehension in nonalphabetic as well as alphabetic written languages.     

A genome-wide association study identifies a new variant associated with word reading fluency in Chinese children

Reading disability exhibited defects in different cognitive domains, including word reading fluency, word reading accuracy, phonological awareness, rapid automatized naming and morphological awareness. To identify the genetic basis of Chinese reading disability, we conducted a genome-wide association study (GWAS) of the cognitive traits related to Chinese reading disability in 2284 unrelated Chinese children. Among the traits analyzed in the present GWAS, we detected one genome-wide significant association (p < 5 × 10⁻⁸) on word reading fluency for one SNP on 4p16.2, within EVC genes (rs6446395, p = 7.33 × 10⁻¹⁰). Rs6446395 also showed significant association with Chinese character reading accuracy (p = 2.95 × 10⁻⁴), phonological awareness (p = 7.11 × 10⁻³) and rapid automatized naming (p = 4.71 × 10⁻³), implying multiple effects of this variant. The eQTL data showed that rs6446395 affected EVC expression in the cerebellum. Gene-based analyses identified a gene (PRDM10) to be associated with word reading fluency at the genome-wide level. Our study discovered a new candidate susceptibility variant for reading ability and provided new insights into the genetics of developmental dyslexia in Chinese children.