Language as a multimodal phenomenon: implications for language learning,processing and evolution

Our understanding of the cognitive and neural underpinnings of language has traditionally been firmly based on spoken Indo-European languages and on language studied as speech or text. However, in face-to-face communication, language is multimodal: speech signals are invariably accompanied by visual information on the face and in manual gestures, and sign languages deploy multiple channels (hands, face and body) in utterance construction. Moreover, the narrow focus on spoken Indo-European languages has entrenched the assumption that language is comprised wholly by an arbitrary system of symbols and rules. However, iconicity (i.e. resemblance between aspects of communicative form and meaning) is also present: speakers use iconic gestures when they speak; many non-Indo-European spoken languages exhibit a substantial amount of iconicity in word forms and, finally, iconicity is the norm, rather than the exception in sign languages. This introduction provides the motivation for taking a multimodal approach to the study of language learning, processing and evolution, and discusses the broad implications of shifting our current dominant approaches and assumptions to encompass multimodal expression in both signed and spoken languages.     

When words fail us: insights into language processing from developmental and acquired disorders

Acquired disorders of language represent loss of previously acquired skills, usually with relatively specific impairments. In children with developmental disorders of language, we may also see selective impairment in some skills; but in this case, the acquisition of language or literacy is affected from the outset. Because systems for processing spoken and written language change as they develop, we should beware of drawing too close a parallel between developmental and acquired disorders. Nevertheless, comparisons between the two may yield new insights. A key feature of connectionist models simulating acquired disorders is the interaction of components of language processing with each other and with other cognitive domains. This kind of model might help make sense of patterns of comorbidity in developmental disorders. Meanwhile, the study of developmental disorders emphasizes learning and change in underlying representations, allowing us to study how heterogeneity in cognitive profile may relate not just to neurobiology but also to experience. Children with persistent language difficulties pose challenges both to our efforts at intervention and to theories of learning of written and spoken language. Future attention to learning in individuals with developmental and acquired disorders could be of both theoretical and applied value.     

Song recognition memory in juvenile zebra finches: effects of varying the number of presentations of heterospecific and conspecific songs

Seven male and three female zebra finches were exposed to 14 zebra finch (CON) and 14 starling (HET) songs during their sensitive period for song learning and then tested for their recognition memory of both the CON and HET songs in two separate memory tests. Amount of song exposure was varied by presenting individual songs either 3, 9, 27, or 81 times per day for nine consecutive days. After song exposure the birds were trained to discriminate two of the exposed, familiar songs (FAM) from two novel songs (NOV) in a go/no-go operant discrimination procedure, with FAM songs as "go" stimuli. Following discrimination training, untrained FAM and NOV songs were presented as probe songs without reinforcement. Birds responded more to FAM than NOV songs at all levels of song exposure, indicating that the songs were recognized. There were no differences in recognition memory for CON and HET song at any level of song exposure. The results suggest that selective song learning does not result from selective memorization of conspecific song.     

What can functional brain imaging studies tell us about typical and atypical cognitive development in children?

Functional brain imaging has been largely reserved for adults. However, in recent years there have been increasing attempts to use functional brain imaging to inform our understanding of child development. These have taken three main forms: (1) Children with known or suspected neurological disorders may undergo brain imaging for medical diagnostic purposes and/or for the purpose of research into the nature of the disorders. (2) There have been a few studies where children, usually over the age of 8, have undergone functional brain imaging. (3) Results from brain imaging studies of adults have influenced theories about children's development. This chapter discusses the impact of brain imaging studies on our understanding of working memory; reading; and arithmetic. The different forms of brain imaging converge in demonstrating that different brain regions show differential activation for different domains and for different components within the domains: e.g. different reading strategies and different components of arithmetic. They show important similarities between children and adults, though it must be remembered that very few studies have involved young children. They also indicate that experience influences brain function, as well as the other way around.     

Primate origins and evolution. By R. D. Martin. Princeton,NJ: Princeton University Press. 1990. ISBN 0-691-08565-X. xiv + 840 pp. $125 (cloth)

Dental emergence ages are examined for a mixed longitudinal sample of 58 chimpanzees of known age and sex (22 males, 36 females) followed over the past 10 years. This study provides the most complete data set currently available on dental emergence in chimpanzees of known age and sex. Summary statistics and cumulative frequency percentiles of emergence ages are presented for both the permanent and the primary teeth. Male and female percentiles are also compared and reveal a number of cases of sexual dimorphism in emergence ages. Comparisons of emergence means reveal some statistically significant differences between upper and lower teeth but not between antimeres in the upper or lower dentition. Kendall's rank correlation coefficient (tau) suggests a correlation in timing between first molar and incisor emergence within individuals. In addition, a significant time lag was observed between first molar and central incisor emergence. A number of emergence sequence polymorphisms are presented as well. These findings provide important baseline information for future studies of chimpanzee growth, development, and demography and also contribute to several current issues in paleoanthropology relating to dental maturation patterns in early hominids.     

Severe cognitive and motor coordination deficits in tenascin-R-deficient mice

The extracellular matrix molecule tenascin-R (TN-R), predominantly expressed in the central nervous system, has been implied in a variety of functions, e.g. during myelination, cerebellar neurite fasciculation and hippocampal long-term potentiation. In this study, we investigated in detail the impact of TN-R deficiency on the living animal by analyzing the behavior of TN-R-deficient mice. The general state, gross sensory functions, reflexes and motoric capabilities appeared normal. In contrast, motor coordination on the rota-rod was compromised in these mice, indicating a deficit in cerebellar functions. In the open field and the hole board, the mutants interact differently with their environment, probably due to differences in their exploratory behavior. TN-R-deficient mice were able to learn a reference memory task in the Morris water maze. In contrast to wild-type mice, the mutants displayed an alternative strategy; swimming around the pool using a stereotypical circling pattern, crossing all possible platform positions after relocation of the escape platform (reversal). These results, confirmed by relocating the platform in the center of the pool, suggest that TN-R-deficient mice may be impaired in constructing a goal-independent representation of space. In addition, a two-way active avoidance test (shuttle box) revealed a severe deficit in associative learning in TN-R-deficient mice. Our results support important functions of TN-R in vivo in the central nervous system, in particular in the cerebellum and the hippocampus.     

Effect of Aging on the Metabolism of Pyruvate and 3-Hydroxybutyrate in Nonsynaptic and Synaptic Mitochondria from Rat Brain

Abstract: Age-dependent changes in the oxidative metabolism in nonsynaptic and synaptic mitochondria from brains of 3, 12, and 24-month-old rats were investigated. When pyruvate and malate were used in conjunction as substrates, a significant reduction in State 3 respiration was observed in both mitochondrial populations from 12-and 24-month-old rats compared with 3-month-old animals. A similar age-dependent reduction in the oxidation of [1-¹¹C]pyruvate was also observed in nonsynaptic and synaptic mitochondria from senescent rats. Pyruvate dehydrogenase complex activity (both active and total) was, however, not decreased in the two mitochondrial populations from brains of 3, 12, and 24-month-old rats. When DL-3-hydroxybutyrate plus malate were used as substrates, a decrease in State 3 respiration was observed only in synaptic mitochondria from 24-month-old rats compared with 3- month-old animals. Similarly, an age-dependent reduction in the oxidation of 3-hydroxy[3-¹¹C]butyrate was also observed only in synaptic mitochondria from 12-and 24-month-old rats. However, a significant reduction in the activities of ketone body-metabolizing enzymes, namely, 3-hydroxybutyrate dehydrogenase, 3-ketoacid CoA transferase, and acetoacetyl-CoA thiolase was observed in both mitochondrlal populations from 12- and 24-month-old rats compared with 3 month-old animals. These findings show that specific alterations in oxidative metabolism occur in nonsynaptic and synaptic mitochondria from aging rats. The data also suggest that in addition to alterations in enzyme activities, permeability of anions (e.g. pyruvate) across the inner mitochondrial membrane may be altered in nonsynaptic and synaptic mitochondria from senescent animals.     

MicroRNA与动物发育

MicroRNA(miRNA)是一类约22nt大小的内源性非编码RNA,它们通过剪切靶基因的转录产物或者抑制转录产物的翻译从而起到转录后调控靶基因表达的作用。在动物体内,通过基因敲除等方法所进行的大量研究表明了miRNA参与了胚胎早期发育、脑及神经发育、心脏发育、肌肉及骨骼发育等动物发育的各个方面。miRNA是动物发生发育过程中重要的调控因子。主要介绍了近年来miRNA在动物生长发育过程中的研究进展。     

A locus coeruleus to dentate gyrus noradrenergic circuit modulates aversive contextual processing

1. Download : Download high-res image (239KB)
2. Download : Download full-size image

     

小学生多元智能与全脑开发训练效果的生理评估

采用全身皮电统一测量方法分析了6-12岁小学生“多元智能与全脑开发训练”的效果。检测值分别为进行多元智能与全脑开发训练的实验组被试训练前和训练后的能量过筛值,无任何训练的对照组被试的能量过筛值。结果表明：实验组被试头部能量有显著性提高,而对照组被试头部能量没有显著变化。本研究结果支持了“多元智能与全脑开发训练”能够显著地提高青少年身心状态并保持提高效果,且本研究为将来进一步研究青少年的“多元智能与全脑开发”提供了一种新的可借鉴的生理检验手段。     

Brain and behaviour phenotyping of a mouse model of neurofibromatosis type‐1: an MRI/DTI study on social cognition

Neurofibromatosis type‐1 (NF1) is a common neurogenetic disorder and an important cause of intellectual disability. Brain‐behaviour associations can be examined in vivo using morphometric magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) to study brain structure. Here, we studied structural and behavioural phenotypes in heterozygous Nf1 mice (Nf1^+/?) using T2‐weighted imaging MRI and DTI, with a focus on social recognition deficits. We found that Nf1^+/? mice have larger volumes than wild‐type (WT) mice in regions of interest involved in social cognition, the prefrontal cortex (PFC) and the caudate‐putamen (CPu). Higher diffusivity was found across a distributed network of cortical and subcortical brain regions, within and beyond these regions. Significant differences were observed for the social recognition test. Most importantly, significant structure–function correlations were identified concerning social recognition performance and PFC volumes in Nf1^+/? mice. Analyses of spatial learning corroborated the previously known deficits in the mutant mice, as corroborated by platform crossings, training quadrant time and average proximity measures. Moreover, linear discriminant analysis of spatial performance identified 2 separate sub‐groups in Nf1^+/? mice. A significant correlation between quadrant time and CPu volumes was found specifically for the sub‐group of Nf1^+/? mice with lower spatial learning performance, suggesting additional evidence for reorganization of this region. We found strong evidence that social and spatial cognition deficits can be associated with PFC/CPu structural changes and reorganization in NF1.     

Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings

Background

Natural Language Processing (NLP) has been shown effective to analyze the content of radiology reports and identify diagnosis or patient characteristics. We evaluate the combination of NLP and machine learning to detect thromboembolic disease diagnosis and incidental clinically relevant findings from angiography and venography reports written in French. We model thromboembolic diagnosis and incidental findings as a set of concepts, modalities and relations between concepts that can be used as features by a supervised machine learning algorithm. A corpus of 573 radiology reports was de-identified and manually annotated with the support of NLP tools by a physician for relevant concepts, modalities and relations. A machine learning classifier was trained on the dataset interpreted by a physician for diagnosis of deep-vein thrombosis, pulmonary embolism and clinically relevant incidental findings. Decision models accounted for the imbalanced nature of the data and exploited the structure of the reports.

Results

The best model achieved an F measure of 0.98 for pulmonary embolism identification, 1.00 for deep vein thrombosis, and 0.80 for incidental clinically relevant findings. The use of concepts, modalities and relations improved performances in all cases.

Conclusions

This study demonstrates the benefits of developing an automated method to identify medical concepts, modality and relations from radiology reports in French. An end-to-end automatic system for annotation and classification which could be applied to other radiology reports databases would be valuable for epidemiological surveillance, performance monitoring, and accreditation in French hospitals.     

Individual and population penalized regression splines for accelerated longitudinal designs

In an accelerated longitudinal design (ALD), individuals enter the study at different points of their growth trajectory and are observed over a short time span relative to the entire time span of interest. ALD data are combined across independent units to provide an estimate of an overall population curve and predictions of individual patterns of change. As a modest extension of the work of Ruppert et al. (2003, Semiparametric Regression, Cambridge University Press), we develop a computationally efficient procedure for the application of longitudinal semiparametric methods under ALD sampling schemes. We compare balanced and complete longitudinal designs to ALDs using the Berkeley Growth Study data and apply our method to longitudinal magnetic resonance imaging (MRI) brain structure size (volume) measurements from an ongoing developmental study. Potential applications extend beyond growth studies to many other fields in which cost and feasibility constraints impose restrictions on sample size and on the numbers and timings of repeated measurements across subjects.     

基于机器学习的医学影像分析在药物研发和精准医疗方面的应用

MRI,PET,和CT等医学影像在新药研发和精准医疗中起着越来越重要的作用。影像技术可以被用来诊断疾病,评估药效,选择适应患者,或者确定用药剂量。 随着人工智能技术的发展,特别是机器学习以及深度学习技术在医学影像中的应用,使得我们可以用更短的时间,更少的放射剂量获取更高质量的影像。这些技术还可以帮助放射科医生缩短读片时间,提高诊断准确率。除此之外,机器学习技术还可以提高量化分析的可行性和精度,帮助建立影像与基因以及疾病的临床表现之间的关系。首先根据不同形态的医学影像,简单介绍他们在药物研发和精准医疗中的应用。并对机器学习在医学影像中的功能作一概括总结。最后讨论这个领域的挑战和机遇。     

Dynamic changes in DNA demethylation in the tree shrew (Tupaia belangeri chinensis) brain during postnatal development and aging

Brain development and aging are associated with alterations in multiple epigenetic systems,including DNA methylation and demethylation patterns.Here,we observed that the levels of the 5-hydroxymethylcytosine (5hmC) ten-eleven translocation (TET) enzyme-mediated active DNA demethylation products were dynamically changed and involved in postnatal brain development and aging in tree shrews (Tupaia belangeri chinensis).The levels of 5hmC in multiple anatomic structures showed a gradual increase throughout postnatal development,whereas a significant decrease in 5hmC was found in several brain regions in aged tree shrews,including in the prefrontal cortex and hippocampus,but not the cerebellum.Active changes in Tet mRNA levels indicated that TET2 and TET3 predominantly contributed to the changes in 5hmC levels.Our findings provide new insight into the dynamic changes in 5hmC levels in tree shrew brains during postnatal development and aging processes.     

A structural and a functional aspect of stable information processing by the brain

Brain is an expert in producing the same output from a particular set of inputs, even from a very noisy environment. In this article a model of neural circuit in the brain has been proposed which is composed of cyclic sub-circuits. A big loop has been defined to be consisting of a feed forward path from the sensory neurons to the highest processing area of the brain and feed back paths from that region back up to close to the same sensory neurons. It has been mathematically shown how some smaller cycles can amplify signal. A big loop processes information by contrast and amplify principle. How a pair of presynaptic and postsynaptic neurons can be identified by an exact synchronization detection method has also been mentioned. It has been assumed that the spike train coming out of a firing neuron encodes all the information produced by it as output. It is possible to extract this information over a period of time by Fourier transforms. The Fourier coefficients arranged in a vector form will uniquely represent the neural spike train over a period of time. The information emanating out of all the neurons in a given neural circuit over a period of time can be represented by a collection of points in a multidimensional vector space. This cluster of points represents the functional or behavioral form of the neural circuit. It has been proposed that a particular cluster of vectors as the representation of a new behavior is chosen by the brain interactively with respect to the memory stored in that circuit and the amount of emotion involved. It has been proposed that in this situation a Coulomb force like expression governs the dynamics of functioning of the circuit and stability of the system is reached at the minimum of all the minima of a potential function derived from the force like expression. The calculations have been done with respect to a pseudometric defined in a multidimensional vector space.     

Increasing synaptic noradrenaline, serotonin and histamine enhances in vivo binding of phosphodiesterase-4 inhibitor (R)-[11C]rolipram in rat brain, lung and heart

Phosphodiesterase-4 (PDE4) is one of the main enzymes that specifically terminate the action of cAMP, thereby contributing to intracellular signaling following stimulation of various G protein-coupled receptors. PDE4 expression and activity are modulated by agents affecting cAMP levels. The selective PDE4 inhibitor (R)-rolipram labeled with C-11 was tested in vivo in rats to analyze changes in PDE4 levels following drug treatments that increase synaptic noradrenaline (NA), serotonin (5HT), histamine (HA) and dopamine (DA) levels. We hypothesized that increasing synaptic neurotransmitter levels and subsequent cAMP-mediated signaling would significantly enhance (R)-[(11)C]rolipram retention and specific binding to PDE4 in vivo. Pre-treatments were performed 3 h prior to tracer injection, and rats were sacrificed 45 min later. Biodistribution studies revealed a dose-dependent increase in (R)-[(11)C]rolipram uptake following administration of the monoamine oxidase (MAO) inhibitor tranylcypromine, NA and 5HT reuptake inhibitors (desipramine [DMI], maprotiline; and fluoxetine, sertraline, respectively), and the HA H(3) receptor antagonist (thioperamide), but not with DA transporter blockers GBR 12909, cocaine or DA D(1) agonist SKF81297. Significant increases in rat brain and heart reflect changes in PDE4 specific binding (total-non-specific binding [coinjection with saturating dose of (R)-rolipram]). These results demonstrate that acute treatments elevating synaptic NA, 5HT and HA, but not DA levels, significantly enhance (R)-[(11)C]rolipram binding. Use of (R)-[(11)C]rolipram and positron emission tomography as an index of PDE4 activity could provide insight into understanding disease states with altered NA, 5HT and HA concentrations.     

Pre- and perinatal brain development and enculturation

Ample evidence from various quarters indicates that the perceptual-cognitive competence of the pre- and perinatal human being is significantly greater than was once thought. Some of the evidence of this emerging picture of early competence is reviewed, and its importance both as evidence of the biogenetic structural concept of “neurognosis” and for a theory of enculturation is discussed. The literature of pre- and perinatal psychology, especially that of developmental neuropsychology, psychobiology, and social psychophysiology, is incorporated, and some of the implications of these data for a theory of enculturation are suggested. This paper was presented at the annual meeting of the American Anthropological Association, Washington, D.C., November 1989. Charles D. Laughlin, Professor of Anthropology at Carleton University, Ottawa, Canada, has done ethnographic fieldwork among the So of northeastern Uganda and among Tibetan lamas in Nepal and India. He completed postdoctoral studies in neurophysiology at the Institute of Neurological Sciences, University of Pennsylvania. He is editor of both theNeuroanthropology Network Newsletter and thePre- and Peri-Natal Psychology Journal.