Visual Word Recognition in Deaf Readers: Lexicality Is Modulated by Communication Mode

Evidence indicates that adequate phonological abilities are necessary to develop proficient reading skills and that later in life phonology also has a role in the covert visual word recognition of expert readers. Impairments of acoustic perception, such as deafness, can lead to atypical phonological representations of written words and letters, which in turn can affect reading proficiency. Here, we report an experiment in which young adults with different levels of acoustic perception (i.e., hearing and deaf individuals) and different modes of communication (i.e., hearing individuals using spoken language, deaf individuals with a preference for sign language, and deaf individuals using the oral modality with less or no competence in sign language) performed a visual lexical decision task, which consisted of categorizing real words and consonant strings. The lexicality effect was restricted to deaf signers who responded faster to real words than consonant strings, showing over-reliance on whole word lexical processing of stimuli. No effect of stimulus type was found in deaf individuals using the oral modality or in hearing individuals. Thus, mode of communication modulates the lexicality effect. This suggests that learning a sign language during development shapes visuo-motor representations of words, which are tuned to the actions used to express them (phono-articulatory movements vs. hand movements) and to associated perceptions. As these visuo-motor representations are elicited during on-line linguistic processing and can overlap with the perceptual-motor processes required to execute the task, they can potentially produce interference or facilitation effects.     

Fingerspelling as a Novel Gateway into Reading Fluency in Deaf Bilinguals

Studies have shown that American Sign Language (ASL) fluency has a positive impact on deaf individuals’ English reading, but the cognitive and cross-linguistic mechanisms permitting the mapping of a visual-manual language onto a sound-based language have yet to be elucidated. Fingerspelling, which represents English orthography with 26 distinct hand configurations, is an integral part of ASL and has been suggested to provide deaf bilinguals with important cross-linguistic links between sign language and orthography. Using a hierarchical multiple regression analysis, this study examined the relationship of age of ASL exposure, ASL fluency, and fingerspelling skill on reading fluency in deaf college-age bilinguals. After controlling for ASL fluency, fingerspelling skill significantly predicted reading fluency, revealing for the first-time that fingerspelling, above and beyond ASL skills, contributes to reading fluency in deaf bilinguals. We suggest that both fingerspelling—in the visual-manual modality—and reading—in the visual-orthographic modality—are mutually facilitating because they share common underlying cognitive capacities of word decoding accuracy and automaticity of word recognition. The findings provide support for the hypothesis that the development of English reading proficiency may be facilitated through strengthening of the relationship among fingerspelling, sign language, and orthographic decoding en route to reading mastery, and may also reveal optimal approaches for reading instruction for deaf and hard of hearing children.     

SUBTLEX-CH: Chinese Word and Character Frequencies Based on Film Subtitles

Background

Word frequency is the most important variable in language research. However, despite the growing interest in the Chinese language, there are only a few sources of word frequency measures available to researchers, and the quality is less than what researchers in other languages are used to.

Methodology

Following recent work by New, Brysbaert, and colleagues in English, French and Dutch, we assembled a database of word and character frequencies based on a corpus of film and television subtitles (46.8 million characters, 33.5 million words). In line with what has been found in the other languages, the new word and character frequencies explain significantly more of the variance in Chinese word naming and lexical decision performance than measures based on written texts.

Conclusions

Our results confirm that word frequencies based on subtitles are a good estimate of daily language exposure and capture much of the variance in word processing efficiency. In addition, our database is the first to include information about the contextual diversity of the words and to provide good frequency estimates for multi-character words and the different syntactic roles in which the words are used. The word frequencies are freely available for research purposes.     

Language proficiency modulates the recruitment of non-classical language areas in bilinguals

Bilingualism provides a unique opportunity for understanding the relative roles of proficiency and order of acquisition in determining how the brain represents language. In a previous study, we combined magnetoencephalography (MEG) and magnetic resonance imaging (MRI) to examine the spatiotemporal dynamics of word processing in a group of Spanish-English bilinguals who were more proficient in their native language. We found that from the earliest stages of lexical processing, words in the second language evoke greater activity in bilateral posterior visual regions, while activity to the native language is largely confined to classical left hemisphere fronto-temporal areas. In the present study, we sought to examine whether these effects relate to language proficiency or order of language acquisition by testing Spanish-English bilingual subjects who had become dominant in their second language. Additionally, we wanted to determine whether activity in bilateral visual regions was related to the presentation of written words in our previous study, so we presented subjects with both written and auditory words. We found greater activity for the less proficient native language in bilateral posterior visual regions for both the visual and auditory modalities, which started during the earliest word encoding stages and continued through lexico-semantic processing. In classical left fronto-temporal regions, the two languages evoked similar activity. Therefore, it is the lack of proficiency rather than secondary acquisition order that determines the recruitment of non-classical areas for word processing.     

视觉信息处理:阅读中文和英文时眼动模式的对比研究

文字阅读是一个复杂的视觉模式识别过程,虽然客观测量阅读过程中的脑的活动比较困难,但用记录分析阅读中由脑部控制的眼球活动来研究脑的信息处理特点却是可行的.本文采用两种不同结构的文字——以空间图象为基础的方块汉字和以发音序列为基础的横行英文——作为输入,用红外眼动仪测量阅读时的眼动曲线,再由计算机分析其异同.结果表明:1)阅读注视时程对中文及英文分别为0.260及0.265秒;2)阅读辨认跨度对中文及英文分别为1.7及1.8信息单位.由两者的相似性提示我们:整段理解阅读信息处理能力决定于神经系统高级阅读中枢的解码速率.     

Learning Word Meanings: Overnight Integration and Study Modality Effects

According to the complementary learning systems (CLS) account of word learning, novel words are rapidly acquired (learning system 1), but slowly integrated into the mental lexicon (learning system 2). This two-step learning process has been shown to apply to novel word forms. In this study, we investigated whether novel word meanings are also gradually integrated after acquisition by measuring the extent to which newly learned words were able to prime semantically related words at two different time points. In addition, we investigated whether modality at study modulates this integration process. Sixty-four adult participants studied novel words together with written or spoken definitions. These words did not prime semantically related words directly following study, but did so after a 24-hour delay. This significant increase in the magnitude of the priming effect suggests that semantic integration occurs over time. Overall, words that were studied with a written definition showed larger priming effects, suggesting greater integration for the written study modality. Although the process of integration, reflected as an increase in the priming effect over time, did not significantly differ between study modalities, words studied with a written definition showed the most prominent positive effect after a 24-hour delay. Our data suggest that semantic integration requires time, and that studying in written format benefits semantic integration more than studying in spoken format. These findings are discussed in light of the CLS theory of word learning.     

Mechanisms of Reading in Persons with Different Levels of Written Text Comprehension

The aim of the present study was to investigate the reading mechanisms in adults (27 subjects; mean age, 19.5 ± 0.8 [SD] years) with different levels of written text comprehension using fMRI. The main objective was to analyze the basic brain mechanisms of verbal stimuli perception with and without semantic component during reading discrimination tasks. The BOLD signal changes during WORD and PSEUDOWORD reading comparing to GAZE FIXATION state were estimated using both analysis of whole brain activation and ROIs (structures connected with the brain system providing reading) in two groups of subjects, “good” and “poor” readers. It was revealed that activations were higher in “poor” readers in lingual gyrus, SMG, STG compared to “good” readers during PSEUDOWORD reading. It was supposed, that the strategies of words and pseudowords recognition differed in two groups of readers: “good” readers identified words or pseudowords already at the stage of visual analysis of “word” structure and demonstrated attempts to decode pseudowords (i.e., language lexical zones were not activated); “poor” readers, apparently, tried to read pseudowords using the same strategy as for the words reading referring to the lexicon, and after failure identified pseudowords as meaningless concepts. In that case, activations of both lexical “language” zones and visual word form area (VWFA) were observed.     

Do Chinese Readers Follow the National Standard Rules for Word Segmentation during Reading?

We conducted a preliminary study to examine whether Chinese readers’ spontaneous word segmentation processing is consistent with the national standard rules of word segmentation based on the Contemporary Chinese language word segmentation specification for information processing (CCLWSSIP). Participants were asked to segment Chinese sentences into individual words according to their prior knowledge of words. The results showed that Chinese readers did not follow the segmentation rules of the CCLWSSIP, and their word segmentation processing was influenced by the syntactic categories of consecutive words. In many cases, the participants did not consider the auxiliary words, adverbs, adjectives, nouns, verbs, numerals and quantifiers as single word units. Generally, Chinese readers tended to combine function words with content words to form single word units, indicating they were inclined to chunk single words into large information units during word segmentation. Additionally, the “overextension of monosyllable words” hypothesis was tested and it might need to be corrected to some degree, implying that word length have an implicit influence on Chinese readers’ segmentation processing. Implications of these results for models of word recognition and eye movement control are discussed.     

The Genetic and Environmental Foundation of the Simple View of Reading in Chinese

The Simple View of Reading (SVR) in Chinese was examined in a genetically sensitive design. A total of 270 pairs of Chinese twins (190 pairs of monozygotic twins and 80 pairs of same-sex dizygotic twins) were tested on Chinese vocabulary and word reading at the mean age 7.8 years and reading comprehension of sentences and passages one year later. Results of behavior-genetic analyses showed that both vocabulary and word reading had significant independent genetic influences on reading comprehension, and the two factors together accounted for most but not all of the genetic influences on reading comprehension. In addition, sentence comprehension had a stronger genetic correlation with word reading while passage comprehension showed a trend of stronger genetic overlap with vocabulary. These findings suggest that the genetic foundation of the SVR in Chinese is largely supported in that language comprehension and decoding are two core skills for reading comprehension in nonalphabetic as well as alphabetic written languages.     

A word of a natural language has 2.718 different meanings or slightly more

The capacity of lexical decision-making in the brain conforms to the indefiniteness latent in natural languages. The average number of different meanings per word of a natural language is measured to be 2.805 +/- 0.005 irrespective of whether the language is Chinese, English or Japanese. If one can almost perfectly comprehend words and sentences written in a natural language in a context-dependent manner, the average number of different meanings per word would reduce to e (= 2.718281828459...), the base of natural or Napierian logarithms.     

Suffix combinations in Bulgarian: parsability and hierarchy-based ordering

This article extends the empirical scope of the most recent approach to affix ordering, the Parsability Hypothesis (Hay 2001, 2002, 2003) or Complexity-Based Ordering (CBO) (Plag 2002; Hay and Plag 2004; Plag and Baayen 2009), to the inflecting-fusional morphological type, as represented by the South Slavic language Bulgarian. In order to account properly for the structure of the Bulgarian word, I distinguish between suffixes that are in the derivational word slot and suffixes that are in the inflectional word slot and show that inflectional suffix combinations are more easily parsable than derivational suffix combinations. Derivational suffixes participate in mirror-image combinations of AB–BA type and can be also attached recursively. The order of 12 out of the 22 derivational suffixes under scrutiny in this article is thus incompatible with CBO. With respect to recursiveness and productivity, the Bulgarian word exhibits three domains of suffixation (in order of increasing productivity): (1) a non-diminutive derivational domain, where a suffix may attach recursively on non-adjacent cycles; (2) a diminutive domain, where a suffix may attach recursively on adjacent cycles; and (3) an inflectional domain, where a suffix never attaches recursively. Overall, the results of this study conform to the last revision of the Parsability Hypothesis (Baayen et al. 2009); and if we see the derivational suffix slot and the inflectional suffix slot of the Bulgarian word as parallel to the non-native stratum and the Germanic stratum respectively in English word-formation, we can conclude that suffixes that are closer to the root tend to exhibit idiosyncrasies and appear less parsable in both languages.     

Word production errors in children with developmental language impairments

This review focuses on the errors that children with developmental language impairments make on three types of word production tasks: lexical retrieval, the elicitation of derivationally complex forms and the repetition of non-sense forms. The studies discussed in this review come principally from children with specific language impairment, and from children who are English-speakers or deaf users of British sign language. It is argued that models of word production need to be able to account for the data presented here, and need to have explanatory power across both modalities (i.e. speech and sign).     

Phonological,grammatical, and written words in Wichi

This article aims at investigating the linguistic criteria to determine what a word is in Wichi (Matacoan), a polysynthetic and agglutinative language spoken in the Gran Chaco Region, in South America. The main phonological criteria proposed are phonological rules and stress. We also apply some grammatical criteria that have been proposed cross linguistically, some of which are useful to determine the boundaries of grammatical words in Wichi. Finally, we explore the relationship between the phonological and grammatical word with the written word. We base our analysis of written words on a textbook (Tsalanawu) used in many bilingual schools in Northeastern Argentina.     

Constraints on Negative Prefixation in Polish Sign Language

The aim of this article is to describe a negative prefix, NEG-, in Polish Sign Language (PJM) which appears to be indigenous to the language. This is of interest given the relative rarity of prefixes in sign languages. Prefixed PJM signs were analyzed on the basis of both a corpus of texts signed by 15 deaf PJM users who are either native or near-native signers, and material including a specified range of prefixed signs as demonstrated by native signers in dictionary form (i.e. signs produced in isolation, not as part of phrases or sentences). In order to define the morphological rules behind prefixation on both the phonological and morphological levels, native PJM users were consulted for their expertise. The research results can enrich models for describing processes of grammaticalization in the context of the visual-gestural modality that forms the basis for sign language structure.     

Letter Position Coding Across Modalities: The Case of Braille Readers

Background

The question of how the brain encodes letter position in written words has attracted increasing attention in recent years. A number of models have recently been proposed to accommodate the fact that transposed-letter stimuli like jugde or caniso are perceptually very close to their base words.

Methodology

Here we examined how letter position coding is attained in the tactile modality via Braille reading. The idea is that Braille word recognition may provide more serial processing than the visual modality, and this may produce differences in the input coding schemes employed to encode letters in written words. To that end, we conducted a lexical decision experiment with adult Braille readers in which the pseudowords were created by transposing/replacing two letters.

Principal Findings

We found a word-frequency effect for words. In addition, unlike parallel experiments in the visual modality, we failed to find any clear signs of transposed-letter confusability effects. This dissociation highlights the differences between modalities.

Conclusions

The present data argue against models of letter position coding that assume that transposed-letter effects (in the visual modality) occur at a relatively late, abstract locus.     

Word Boundaries Affect Visual Attention in Chinese Reading

In two experiments, we explored attention deployment during the reading of Chinese words using a probe detection task. In both experiments, Chinese readers saw four simplified Chinese characters briefly, and then a probe was presented at one of the character positions. The four characters constituted either one word or two words of two characters each. Reaction time was shorter when the probe was at the character 2 position than the character 3 position in the two-word condition, but not in the one-word condition. In Experiment 2, there were more trials and the materials were more carefully controlled, and the results replicated that of Experiment 1. These results suggest that word boundary information affects attentional deployment in Chinese reading.     

Simultaneously Uncovering the Patterns of Brain Regions Involved in Different Story Reading Subprocesses

Story understanding involves many perceptual and cognitive subprocesses, from perceiving individual words, to parsing sentences, to understanding the relationships among the story characters. We present an integrated computational model of reading that incorporates these and additional subprocesses, simultaneously discovering their fMRI signatures. Our model predicts the fMRI activity associated with reading arbitrary text passages, well enough to distinguish which of two story segments is being read with 74% accuracy. This approach is the first to simultaneously track diverse reading subprocesses during complex story processing and predict the detailed neural representation of diverse story features, ranging from visual word properties to the mention of different story characters and different actions they perform. We construct brain representation maps that replicate many results from a wide range of classical studies that focus each on one aspect of language processing and offer new insights on which type of information is processed by different areas involved in language processing. Additionally, this approach is promising for studying individual differences: it can be used to create single subject maps that may potentially be used to measure reading comprehension and diagnose reading disorders.     

Reading comprehension without phonological mediation: Further evidence from a Chinese aphasic individual

Abstrct  An important issue in visual word comprehension literature is whether or not semantic access is mediated by phonological processing. In this paper, we present a Chinese individual, YGA, who provides converging evidence to directly address this issue. YGA has sustained damage to the left posterior superior and middle temporal lobe, and shows difficulty in orally name pictures and reading printed words aloud. He makes phonological errors on these tasks and also semantic errors on picture naming, indicating a deficit at accessing the phonological representations for output. However, he is intact at understanding the meaning of visually presented words. Such a profile challenges the hypothesis that semantic access in reading is phonologically mediated and provides further evidence for the universal principle of direct semantic access in reading. Supported by Grants PCSIRT (IRT0710), National Natural Science Foundation of China (Grant Nos. 30770715, 30700224), Beijing Natural Science Foundation (Grant No.7082051).