Forms of the Word and the Mystery of the Objectified Nature of the Word

The time has come to proceed from forms of givenness of the word to forms of the word as such. They can, if you like, be called external and inner structures. Humboldt, however, preferred to speak of the external and inner forms of the language. Shpet adopted precisely this distinction. Why did this problem interest Shpet? Already in [Appearance and sense], he had set the task of returning to the source of pretheoretical, living science. Shpet wrote that the outer cover of words and logical expressions obscure the objectified meaning and that it was necessary to remove another cover from the objectified sign so as to grasp a certain genuine intimacy, and in it the fullness of being (Shpet, 1914. Pp. 5-6). We shall keep in mind this major undertaking posed by this scientist. The existence of the inner form of words should not come as a surprise. That same year (1914) Ortega y Gasset wrote that material objects have a third dimension. However, we cannot see or touch it: "For just as depth needs a surface beneath which to be concealed, the surface, or outer cover, in order to be so, needs something over which to spread, covering it" (Ortega y Gasset, 2000. Pp. 62-63).     

In Lieu of an Introduction

Nikolai Veresov: Tatiana, in this volume of our journal we publish a selection of your articles. Two of your other articles were published in Soviet Psychology in the 1970s. Introducing you to the readers of that journal, James Wertsch (1978) wrote: "The author … is one of the leading young investigators from the Luria school of neurolinguistics. She has studied and conducted extensive research both with Luria and with A. A. Leontiev, a major figure in Soviet psycholinguistics. Her analysis of inner speech as a mechanism in speech production reveals the strong influence that L. S. Vygotsky has had on Soviet psychology."¹ But first of all, I suppose our readers would be interested in learning more about your life, about events that preceded your scientific achievements. Could you please tell us briefly about your childhood and your family? How did your parents influence your course of life and your occupational choice? What did they do?     

XII. Something on Vision from Within

Earlier I attempted to show that Shpet was able to penetrate behind the external form of the word through its shell, which in itself is by no means simple, into its inner form, which proved to be immeasurably more complex than the external form. For me it still remains a mystery: How was he able to penetrate into the "living soul" of the word? Of course, he was helped in this by encyclopedic knowledge. He was, after all, a philosopher, a linguist, a psychologist, and an art cognoscente; he completed two years at the physics and mathematics and the history and philology departments of Kiev University. And Shpet also knew seventeen (!) languages. It seems to me that Shpet saw language (languages) and the word from within. He blended into the word rather than manipulated it. "Vision from within" is not a fantasy of my own. Goethe, who in the words of Ralph Waldo Emerson could see with his every pore, knew how to see from within. Ortega y Gasset in 1932 published a special article on this subject: "Goethe's vision from within." What Daniil Kharms saw from within was the absurd.     

The Problem of the "Formative" Elements of Consciousness in the Activity Theory of the Mind

The problem of the structure and psychological mechanisms of consciousness has a rich history, to which M. M. Bakhtin, G. G. Shpet, L. S. Vygotsky, and, later, A. N. Leont'ev and S. L. Rubinshtein all made significant contributions. It is our purpose in the present article to discuss only one aspect of this problem: the structure of individual consciousness. Pursuing the line of research delineated by Vygotsky, Leont'ev (1977) posed some cardinal questions: Of what is consciousness composed? How does it arise? What are its components? He called the latter the "formative elements" of consciousness. According to Leont'ev, there are three such "forming" elements: the sensory fabric of perception (or of an image), meaning, and sense. The inclusion of the sensory fabric in the structure of consciousness along with ostensive meaning and sense was a definite step forward along the path toward the ontologization of conceptions of consciousness.¹ But I think that individual consciousness construed in this way is still insufficiently ontological. Leont'ev's three "formative elements" do not completely account for the connection between consciousness and being (see M. M. Bakhtin, for whom consciousness "participates" in being and is essential for life). One might even reproach Leont'ev for a certain inconsistency: activity, although it is the source of consciousness, is itself not one of its "formative elements." Of course, he could answer this reproach by saying that the "formative elements" are structural elements, constituents, not generative elements. However, it seems to me that the distinction between constitutive and generative is very, very relative in any analysis of living consciousness, which is continually in the process of being constructed.     

Memory in the neonate brain

Background

The capacity to memorize speech sounds is crucial for language acquisition. Newborn human infants can discriminate phonetic contrasts and extract rhythm, prosodic information, and simple regularities from speech. Yet, there is scarce evidence that infants can recognize common words from the surrounding language before four months of age.

Methodology/Principal Findings

We studied one hundred and twelve 1-5 day-old infants, using functional near-infrared spectroscopy (fNIRS). We found that newborns tested with a novel bisyllabic word show greater hemodynamic brain response than newborns tested with a familiar bisyllabic word. We showed that newborns recognize the familiar word after two minutes of silence or after hearing music, but not after hearing a different word.

Conclusions/Significance

The data show that retroactive interference is an important cause of forgetting in the early stages of language acquisition. Moreover, because neonates forget words in the presence of some –but not all– sounds, the results indicate that the interference phenomenon that causes forgetting is selective.     

Inner speech during silent reading reflects the reader's regional accent

While reading silently, we often have the subjective experience of inner speech. However, there is currently little evidence regarding whether this inner voice resembles our own voice while we are speaking out loud. To investigate this issue, we compared reading behaviour of Northern and Southern English participants who have differing pronunciations for words like 'glass', in which the vowel duration is short in a Northern accent and long in a Southern accent. Participants' eye movements were monitored while they silently read limericks in which the end words of the first two lines (e.g., glass/class) would be pronounced differently by Northern and Southern participants. The final word of the limerick (e.g., mass/sparse) then either did or did not rhyme, depending on the reader's accent. Results showed disruption to eye movement behaviour when the final word did not rhyme, determined by the reader's accent, suggesting that inner speech resembles our own voice.     

Auditory affective norms for German: testing the influence of depression and anxiety on valence and arousal ratings

Background

The study of emotional speech perception and emotional prosody necessitates stimuli with reliable affective norms. However, ratings may be affected by the participants'' current emotional state as increased anxiety and depression have been shown to yield altered neural responding to emotional stimuli. Therefore, the present study had two aims, first to provide a database of emotional speech stimuli and second to probe the influence of depression and anxiety on the affective ratings.

Methodology/Principal Findings

We selected 120 words from the Leipzig Affective Norms for German database (LANG), which includes visual ratings of positive, negative, and neutral word stimuli. These words were spoken by a male and a female native speaker of German with the respective emotional prosody, creating a total set of 240 auditory emotional stimuli. The recordings were rated again by an independent sample of subjects for valence and arousal, yielding groups of highly arousing negative or positive stimuli and neutral stimuli low in arousal. These ratings were correlated with participants'' emotional state measured with the Depression Anxiety Stress Scales (DASS). Higher depression scores were related to more negative valence of negative and positive, but not neutral words. Anxiety scores correlated with increased arousal and more negative valence of negative words.

Conclusions/Significance

These results underscore the importance of representatively distributed depression and anxiety scores in participants of affective rating studies. The LANG-audition database, which provides well-controlled, short-duration auditory word stimuli for the experimental investigation of emotional speech is available in Supporting Information S1.     

The Role of Speech in the Accuracy of Perception and Reproduction of Visual Images

Two questions remain virtually unexplored in the problem of the significance of speech for perception: the significance of speech for perception and reproduction of individual aspects of a complex entity (the number of elements of which it is comprised, their color and disposition), and the features of the connection between words and these elements. The latter question requires some explanation. There are objects whose names we employ very frequently in conversation (table, chair, etc.). There is a particularly close relationship between the visual image of such objects and the words. But at the same time, there are quite a number of objects (certain types of uncommon colors, birds, details of instruments, etc.) the names of which many people do not know. Further, certain details have no special names at all (for example, particular details of ornaments). A. G. Ivanov-Smolenskii, in his article "The Interaction of the First and Second Signal Systems Under Certain Physiological and Pathological Conditions" [O vzaimodeistvii pervoi i vtoroi signal'nykh sistem pri nekotorykh fiziologicheskikh i patologicheskikh usloviiakh], The Physiological Journal, USSR Academy of Sciences [Fiziologicheskii zhurnal AN SSSR], 1949, No. 5, wrote: "Some individually distinct part of experience is always found — for a while — to be untransmitted to the second signal system, and not yet subject to verbal interpretation and verbal formulation ('unverbalized')."     

Psychophysiological components of imagery

McGuigan's neuromuscular model of information processing (1978a, 1978b, and 1989) was investigated by electrically recording eye movements (electro-oculograms), covert lip and preferred arm responses (electromyograms), and electroencephalograms. This model predicts that codes are generated as the lips are uniquely activated when processing words beginning with bilabial sounds like "p" or "b," as is the right arm to words like "pencil" that refer to its use. Twelve adult female participants selected for their high imagery ratings were asked to form images to three orally presented linguistic stimuli: the letter "p," the words "pencil" and "pasture," and to a control stimulus, the words "go blank." The following findings were significant beyond the 0.05 level: an increased covert lip response only to the letter "p," increased vertical eye activity to "p" and to the word "pencil," right arm response only to the word "pencil," and a decreased percentage of alpha waves from the right 02 lead only to the word "pasture." Since these covert responses uniquely occurred during specific imagery processes, it is inferred that they are components of neuromuscular circuits that function in accord with the model of information processing tested.     

Temporal predictive codes for spoken words in auditory cortex

Humans can recognize spoken words with unmatched speed and accuracy. Hearing the initial portion of a word such as "formu…" is sufficient for the brain to identify "formula" from the thousands of other words that partially match. Two alternative computational accounts propose that partially matching words (1) inhibit each other until a single word is selected ("formula" inhibits "formal" by lexical competition) or (2) are used to predict upcoming speech sounds more accurately (segment prediction error is minimal after sequences like "formu…"). To distinguish these theories we taught participants novel words (e.g., "formubo") that sound like existing words ("formula") on two successive days. Computational simulations show that knowing "formubo" increases lexical competition when hearing "formu…", but reduces segment prediction error. Conversely, when the sounds in "formula" and "formubo" diverge, the reverse is observed. The time course of magnetoencephalographic brain responses in the superior temporal gyrus (STG) is uniquely consistent with a segment prediction account. We propose a predictive coding model of spoken word recognition in which STG neurons represent the difference between predicted and heard speech sounds. This prediction error signal explains the efficiency of human word recognition and simulates neural responses in auditory regions.     

Shades of Déjerine--forging a causal link between the visual word form area and reading

In 1892, the French neurologist Jules Déjerine suggested that pure alexia resulted from an occipital lesion that selectively disconnected visual input from a region of the brain that housed "optical images of words." In this issue of Neuron, Gaillard and colleagues offer evidence consistent with Déjerine's proposal and provide new insights to the functional role of the "visual word form area."     

The Psychological Structure of Meaning

1. The meaning of a word may be interpreted in the philosophical-gnoseological framework as the ideal equivalent of signs that have been interchanged in the process of semiosis, as the ideal "social substance" of their type, not appearing immediately in the material form of the signs, but realized only in the mechanism of their interchange. This "social substance" of the signs, which is the basis of their equivalence, cannot be … the external object itself, but rather only its mental reflection" (Problemy myshleniya v sorremennoy nauke. Moscow, 1964, p. 82). In such an approach the "mental reflection," i.e., the psychological equivalent of linguistic meaning, the meaning of a sign as a psychological phenomenon, must be a certain form determined by those potential interchanges of signs that represent its limits. It is evident that this determination should be sought primarily in the psychological structure of meaning, in the system of its "semantic components," which in this sense should at least partially be determined by a system of juxtaposed words in the process of their actual use.     

Hearing feelings: affective categorization of music and speech in alexithymia, an ERP study

Background

Alexithymia, a condition characterized by deficits in interpreting and regulating feelings, is a risk factor for a variety of psychiatric conditions. Little is known about how alexithymia influences the processing of emotions in music and speech. Appreciation of such emotional qualities in auditory material is fundamental to human experience and has profound consequences for functioning in daily life. We investigated the neural signature of such emotional processing in alexithymia by means of event-related potentials.

Methodology

Affective music and speech prosody were presented as targets following affectively congruent or incongruent visual word primes in two conditions. In two further conditions, affective music and speech prosody served as primes and visually presented words with affective connotations were presented as targets. Thirty-two participants (16 male) judged the affective valence of the targets. We tested the influence of alexithymia on cross-modal affective priming and on N400 amplitudes, indicative of individual sensitivity to an affective mismatch between words, prosody, and music. Our results indicate that the affective priming effect for prosody targets tended to be reduced with increasing scores on alexithymia, while no behavioral differences were observed for music and word targets. At the electrophysiological level, alexithymia was associated with significantly smaller N400 amplitudes in response to affectively incongruent music and speech targets, but not to incongruent word targets.

Conclusions

Our results suggest a reduced sensitivity for the emotional qualities of speech and music in alexithymia during affective categorization. This deficit becomes evident primarily in situations in which a verbalization of emotional information is required.     

Distributional Learning of Appearance

Opportunities for associationist learning of word meaning, where a word is heard or read contemperaneously with information being available on its meaning, are considered too infrequent to account for the rate of language acquisition in children. It has been suggested that additional learning could occur in a distributional mode, where information is gleaned from the distributional statistics (word co-occurrence etc.) of natural language. Such statistics are relevant to meaning because of the Distributional Principle that ‘words of similar meaning tend to occur in similar contexts’. Computational systems, such as Latent Semantic Analysis, have substantiated the viability of distributional learning of word meaning, by showing that semantic similarities between words can be accurately estimated from analysis of the distributional statistics of a natural language corpus. We consider whether appearance similarities can also be learnt in a distributional mode. As grounds for such a mode we advance the Appearance Hypothesis that ‘words with referents of similar appearance tend to occur in similar contexts’. We assess the viability of such learning by looking at the performance of a computer system that interpolates, on the basis of distributional and appearance similarity, from words that it has been explicitly taught the appearance of, in order to identify and name objects that it has not been taught about. Our experiment tests with a set of 660 simple concrete noun words. Appearance information on words is modelled using sets of images of examples of the word. Distributional similarity is computed from a standard natural language corpus. Our computation results support the viability of distributional learning of appearance.     

Activation of the Left Inferior Frontal Gyrus in the First 200 ms of Reading: Evidence from Magnetoencephalography (MEG)

Background

It is well established that the left inferior frontal gyrus plays a key role in the cerebral cortical network that supports reading and visual word recognition. Less clear is when in time this contribution begins. We used magnetoencephalography (MEG), which has both good spatial and excellent temporal resolution, to address this question.

Methodology/Principal Findings

MEG data were recorded during a passive viewing paradigm, chosen to emphasize the stimulus-driven component of the cortical response, in which right-handed participants were presented words, consonant strings, and unfamiliar faces to central vision. Time-frequency analyses showed a left-lateralized inferior frontal gyrus (pars opercularis) response to words between 100–250 ms in the beta frequency band that was significantly stronger than the response to consonant strings or faces. The left inferior frontal gyrus response to words peaked at ∼130 ms. This response was significantly later in time than the left middle occipital gyrus, which peaked at ∼115 ms, but not significantly different from the peak response in the left mid fusiform gyrus, which peaked at ∼140 ms, at a location coincident with the fMRI–defined visual word form area (VWFA). Significant responses were also detected to words in other parts of the reading network, including the anterior middle temporal gyrus, the left posterior middle temporal gyrus, the angular and supramarginal gyri, and the left superior temporal gyrus.

Conclusions/Significance

These findings suggest very early interactions between the vision and language domains during visual word recognition, with speech motor areas being activated at the same time as the orthographic word-form is being resolved within the fusiform gyrus. This challenges the conventional view of a temporally serial processing sequence for visual word recognition in which letter forms are initially decoded, interact with their phonological and semantic representations, and only then gain access to a speech code.     

Beyond Word Frequency: Bursts,Lulls, and Scaling in the Temporal Distributions of Words

Background

Zipf''s discovery that word frequency distributions obey a power law established parallels between biological and physical processes, and language, laying the groundwork for a complex systems perspective on human communication. More recent research has also identified scaling regularities in the dynamics underlying the successive occurrences of events, suggesting the possibility of similar findings for language as well.

Methodology/Principal Findings

By considering frequent words in USENET discussion groups and in disparate databases where the language has different levels of formality, here we show that the distributions of distances between successive occurrences of the same word display bursty deviations from a Poisson process and are well characterized by a stretched exponential (Weibull) scaling. The extent of this deviation depends strongly on semantic type – a measure of the logicality of each word – and less strongly on frequency. We develop a generative model of this behavior that fully determines the dynamics of word usage.

Conclusions/Significance

Recurrence patterns of words are well described by a stretched exponential distribution of recurrence times, an empirical scaling that cannot be anticipated from Zipf''s law. Because the use of words provides a uniquely precise and powerful lens on human thought and activity, our findings also have implications for other overt manifestations of collective human dynamics.     

Collapse of The System of Word Meanings In Aphasia

1. Data obtained from an investigation of the speech of aphasics confirm the view of linguists that the meaning of a word represents a definite system. Thus, in a word of multiple meanings we distinguish the "nucleus," which comprises free, nominative meanings that are coextensive with the objective reference of the word, and the "periphery," comprising the contextual, associative meanings.     

Somatotopic representation of action words in human motor and premotor cortex

Since the early days of research into language and the brain, word meaning was assumed to be processed in specific brain regions, which most modern neuroscientists localize to the left temporal lobe. Here we use event-related fMRI to show that action words referring to face, arm, or leg actions (e.g., to lick, pick, or kick), when presented in a passive reading task, differentially activated areas along the motor strip that either were directly adjacent to or overlapped with areas activated by actual movement of the tongue, fingers, or feet. These results demonstrate that the referential meaning of action words has a correlate in the somatotopic activation of motor and premotor cortex. This rules out a unified "meaning center" in the human brain and supports a dynamic view according to which words are processed by distributed neuronal assemblies with cortical topographies that reflect word semantics.     

A method of inferring the relationship between Biomedical entities through correlation analysis on text

Background

One of the most important processes in a machine learning-based natural language processing is to represent words. The one-hot representation that has been commonly used has a large size of vector and assumes that the features that make up the vector are independent of each other. On the other hand, it is known that word embedding has a great effect in estimating the similarity between words because it expresses the meaning of the word well. In this study, we try to clarify the correlation between various terms in the biomedical texts based on the excellent ability of estimating similarity between words shown by word embedding. Therefore, we used word embedding to find new biomarkers and microorganisms related to a specific diseases.

Methods

In this study, we try to analyze the correlation between diseases-markers and diseases-microorganisms. First, we need to construct a corpus that seems to be related to them. To do this, we extract the titles and abstracts from the biomedical texts on the PubMed site. Second, we express diseases, markers, and microorganisms’ terms in word embedding using Canonical Correlation Analysis (CCA). CCA is a statistical based methodology that has a very good performance on vector dimension reduction. Finally, we tried to estimate the relationship between diseases-markers pairs and diseases-microorganisms pairs by measuring their similarity.

Results

In the experiment, we tried to confirm the correlation derived through word embedding using Google Scholar search results. Of the top 20 highly correlated disease-marker pairs, about 85% of the pairs have actually undergone a lot of research as a result of Google Scholars search. Conversely, for 85% of the 20 pairs with the lowest correlation, we could not actually find any other study to determine the relationship between the disease and the marker. This trend was similar for disease-microbe pairs.

Conclusions

The correlation between diseases and markers and diseases and microorganisms calculated through word embedding reflects actual research trends. If the word-embedding correlation is high, but there are not many published actual studies, additional research can be proposed for the pair.

     

Arbitrary symbolism in natural language revisited: when word forms carry meaning

Cognitive science has a rich history of interest in the ways that languages represent abstract and concrete concepts (e.g., idea vs. dog). Until recently, this focus has centered largely on aspects of word meaning and semantic representation. However, recent corpora analyses have demonstrated that abstract and concrete words are also marked by phonological, orthographic, and morphological differences. These regularities in sound-meaning correspondence potentially allow listeners to infer certain aspects of semantics directly from word form. We investigated this relationship between form and meaning in a series of four experiments. In Experiments 1-2 we examined the role of metalinguistic knowledge in semantic decision by asking participants to make semantic judgments for aurally presented nonwords selectively varied by specific acoustic and phonetic parameters. Participants consistently associated increased word length and diminished wordlikeness with abstract concepts. In Experiment 3, participants completed a semantic decision task (i.e., abstract or concrete) for real words varied by length and concreteness. Participants were more likely to misclassify longer, inflected words (e.g., "apartment") as abstract and shorter uninflected abstract words (e.g., "fate") as concrete. In Experiment 4, we used a multiple regression to predict trial level naming data from a large corpus of nouns which revealed significant interaction effects between concreteness and word form. Together these results provide converging evidence for the hypothesis that listeners map sound to meaning through a non-arbitrary process using prior knowledge about statistical regularities in the surface forms of words.