Survival of the Synesthesia Gene: Why Do People Hear Colors and Taste Words?

Synesthesia is a perceptual experience in which stimuli presented through one modality will spontaneously evoke sensations in an unrelated modality. The condition occurs from increased communication between sensory regions and is involuntary, automatic, and stable over time. While synesthesia can occur in response to drugs, sensory deprivation, or brain damage, research has largely focused on heritable variants comprising roughly 4% of the general population. Genetic research on synesthesia suggests the phenomenon is heterogeneous and polygenetic, yet it remains unclear whether synesthesia ever provided a selective advantage or is merely a byproduct of some other useful selected trait. Progress in uncovering the genetic basis of synesthesia will help us understand why synesthesia has been conserved in the population.     

Training Synesthetic Letter-color Associations by Reading in Color

Synesthesia is a rare condition in which a stimulus from one modality automatically and consistently triggers unusual sensations in the same and/or other modalities. A relatively common and well-studied type is grapheme-color synesthesia, defined as the consistent experience of color when viewing, hearing and thinking about letters, words and numbers. We describe our method for investigating to what extent synesthetic associations between letters and colors can be learned by reading in color in nonsynesthetes. Reading in color is a special method for training associations in the sense that the associations are learned implicitly while the reader reads text as he or she normally would and it does not require explicit computer-directed training methods. In this protocol, participants are given specially prepared books to read in which four high-frequency letters are paired with four high-frequency colors. Participants receive unique sets of letter-color pairs based on their pre-existing preferences for colored letters. A modified Stroop task is administered before and after reading in order to test for learned letter-color associations and changes in brain activation. In addition to objective testing, a reading experience questionnaire is administered that is designed to probe for differences in subjective experience. A subset of questions may predict how well an individual learned the associations from reading in color. Importantly, we are not claiming that this method will cause each individual to develop grapheme-color synesthesia, only that it is possible for certain individuals to form letter-color associations by reading in color and these associations are similar in some aspects to those seen in developmental grapheme-color synesthetes. The method is quite flexible and can be used to investigate different aspects and outcomes of training synesthetic associations, including learning-induced changes in brain function and structure.     

Assessment of the Hemispheric Lateralization of Grapheme-Color Synesthesia with Stroop-Type Tests

Grapheme-color synesthesia, the idiosyncratic, arbitrary association of colors to letters or numbers, develops in childhood once reading is mastered. Because language processing is strongly left-lateralized in most individuals, we hypothesized that grapheme-color synesthesia could be left-lateralized as well. We used synesthetic versions of the Stroop test with colored letters and numbers presented either in the right or the left visual field of thirty-four synesthetes. Interference by synesthetic colors was stronger for stimuli in the right hemifield (first experiment, color naming task). Synesthetes were also faster in the right hemifield when naming the synesthetic color of graphemes (second experiment). Overall, the lateralization effect was 7 ms (the 95% confidence interval was [1.5 12] ms), a delay compatible with an additional callosal transfer for stimuli presented in the left hemifield. Though weak, this effect suggests that the association of synesthetic colors to graphemes may be preferentially processed in the left hemisphere. We speculate that this left-lateralization could be a landmark of synesthetic grapheme-color associations, if not found for color associations learnt by non-synesthete adults.     

A Whole-Genome Scan and Fine-Mapping Linkage Study of Auditory-Visual Synesthesia Reveals Evidence of Linkage to Chromosomes 2q24, 5q33, 6p12, and 12p12

Synesthesia, a neurological condition affecting between 0.05%–1% of the population, is characterized by anomalous sensory perception and associated alterations in cognitive function due to interference from synesthetic percepts. A stimulus in one sensory modality triggers an automatic, consistent response in either another modality or a different aspect of the same modality. Familiality studies show evidence of a strong genetic predisposition; whereas initial pedigree analyses supported a single-gene X-linked dominant mode of inheritance with a skewed F:M ratio and a notable absence of male-to-male transmission, subsequent analyses in larger samples indicated that the mode of inheritance was likely to be more complex. Here, we report the results of a whole-genome linkage scan for auditory-visual synesthesia with 410 microsatellite markers at 9.05 cM density in 43 multiplex families (n = 196) with potential candidate regions fine-mapped at 5 cM density. Using NPL and HLOD analysis, we identified four candidate regions. Significant linkage at the genome-wide level was detected to chromosome 2q24 (HLOD = 3.025, empirical genome-wide p = 0.047). Suggestive linkage was found to chromosomes 5q33, 6p12, and 12p12. No support was found for linkage to the X chromosome; furthermore, we have identified two confirmed cases of male-to-male transmission of synesthesia. Our results demonstrate that auditory-visual synesthesia is likely to be an oligogenic disorder subject to multiple modes of inheritance and locus heterogeneity. This study comprises a significant step toward identifying the genetic substrates underlying synesthesia, with important implications for our understanding of the role of genes in human cognition and perception.     

Personality influences the neural responses to viewing facial expressions of emotion

Cognitive research has long been aware of the relationship between individual differences in personality and performance on behavioural tasks. However, within the field of cognitive neuroscience, the way in which such differences manifest at a neural level has received relatively little attention. We review recent research addressing the relationship between personality traits and the neural response to viewing facial signals of emotion. In one section, we discuss work demonstrating the relationship between anxiety and the amygdala response to facial signals of threat. A second section considers research showing that individual differences in reward drive (behavioural activation system), a trait linked to aggression, influence the neural responsivity and connectivity between brain regions implicated in aggression when viewing facial signals of anger. Finally, we address recent criticisms of the correlational approach to fMRI analyses and conclude that when used appropriately, analyses examining the relationship between personality and brain activity provide a useful tool for understanding the neural basis of facial expression processing and emotion processing in general.     

Individual differences among grapheme-color synesthetes: brain-behavior correlations

Grapheme-color synesthetes experience specific colors associated with specific number or letter characters. To determine the neural locus of this condition, we compared behavioral and fMRI responses in six grapheme-color synesthetes to control subjects. In our behavioral experiments, we found that a subject's synesthetic experience can aid in texture segregation (experiment 1) and reduce the effects of crowding (experiment 2). For synesthetes, graphemes produced larger fMRI responses in color-selective area human V4 than for control subjects (experiment 3). Importantly, we found a correlation within subjects between the behavioral and fMRI results; subjects with better performance on the behavioral experiments showed larger fMRI responses in early retinotopic visual areas (V1, V2, V3, and hV4). These results suggest that grapheme-color synesthesia is the result of cross-activation between grapheme-selective and color-selective brain areas. The correlation between the behavioral and fMRI results suggests that grapheme-color synesthetes may constitute a heterogeneous group.     

An optimization framework of biological dynamical systems

Different biological dynamics are often described by different mathematical equations. On the other hand, some mathematical models describe many biological dynamics universally. Here, we focus on three biological dynamics: the Lotka-Volterra equation, the Hopfield neural networks, and the replicator equation. We describe these three dynamical models using a single optimization framework, which is constructed with employing the Riemannian geometry. Then, we show that the optimization structures of these dynamics are identical, and the differences among the three dynamics are only in the constraints of the optimization. From this perspective, we discuss the unified view for biological dynamics. We also discuss the plausible categorizations, the fundamental nature, and the efficient modeling of the biological dynamics, which arise from the optimization perspective of the dynamical systems.     

The importance of individual differences in grapheme-color synesthesia

In this issue of Neuron, Hubbard et al. show individual differences in how grapheme-color synesthetes perform on cognitive tasks. Importantly, these behavioral differences were correlated with fMRI measures. Such individual differences have important ramifications for synesthesia research. If individual differences are ignored, then synesthesia research will be characterized by erroneous conclusions and failures to replicate.     

Fruit advertisement strategies in two Neotropical plant–seed disperser markets

Mutualisms can be seen as biological markets in which participating species exchange resources and services. Advertisements like the colors fleshy fruits are commonly used to attract mutualistic partners such seed dispersers. Although advertisements are common, the strategies employed in partner attraction and shaping the diversity of advertisements such as fruit colors remain largely unknown. Here, we adopt a market perspective on fruit color advertisement in multi-specific ensembles of fleshy-fruited plants and their avian seed dispersers. We develop and test the following non-exclusive hypotheses about fruit advertisement strategies in two Neotropical plant ensembles: (1) some low-rewarding plants offering low-energy fruits have fruit advertisements indistinguishable from those of some highly rewarding ones offering high-energy fruits thus forming possible mimicry pairs; (2) highly rewarding plants advertise their fruits with distinctive colors; and (3) fruit colors indicate the type of nutrient offered. We find support for two of the advertisement strategies. Further, we discuss how constraints on signal diversity may affect the evolution of advertisement strategies and we provide a perspective on which processes could characterize plant advertisement strategies in the biological market of seed-dispersal mutualisms.     

Prevalence of Learned Grapheme-Color Pairings in a Large Online Sample of Synesthetes

In this paper we estimate the minimum prevalence of grapheme-color synesthetes with letter-color matches learned from an external stimulus, by analyzing a large sample of English-speaking grapheme-color synesthetes. We find that at least 6% (400/6588 participants) of the total sample learned many of their matches from a widely available colored letter toy. Among those born in the decade after the toy began to be manufactured, the proportion of synesthetes with learned letter-color pairings approaches 15% for some 5-year periods. Among those born 5 years or more before it was manufactured, none have colors learned from the toy. Analysis of the letter-color matching data suggests the only difference between synesthetes with matches to the toy and those without is exposure to the stimulus. These data indicate learning of letter-color pairings from external contingencies can occur in a substantial fraction of synesthetes, and are consistent with the hypothesis that grapheme-color synesthesia is a kind of conditioned mental imagery.     

Components of Attention in Grapheme-Color Synesthesia: A Modeling Approach

Grapheme-color synesthesia is a condition where the perception of graphemes consistently and automatically evokes an experience of non-physical color. Many have studied how synesthesia affects the processing of achromatic graphemes, but less is known about the synesthetic processing of physically colored graphemes. Here, we investigated how the visual processing of colored letters is affected by the congruence or incongruence of synesthetic grapheme-color associations. We briefly presented graphemes (10–150 ms) to 9 grapheme-color synesthetes and to 9 control observers. Their task was to report as many letters (targets) as possible, while ignoring digit (distractors). Graphemes were either congruently or incongruently colored with the synesthetes’ reported grapheme-color association. A mathematical model, based on Bundesen’s (1990) Theory of Visual Attention (TVA), was fitted to each observer’s data, allowing us to estimate discrete components of visual attention. The models suggested that the synesthetes processed congruent letters faster than incongruent ones, and that they were able to retain more congruent letters in visual short-term memory, while the control group’s model parameters were not significantly affected by congruence. The increase in processing speed, when synesthetes process congruent letters, suggests that synesthesia affects the processing of letters at a perceptual level. To account for the benefit in processing speed, we propose that synesthetic associations become integrated into the categories of graphemes, and that letter colors are considered as evidence for making certain perceptual categorizations in the visual system. We also propose that enhanced visual short-term memory capacity for congruently colored graphemes can be explained by the synesthetes’ expertise regarding their specific grapheme-color associations.     

Emotional Picture and Word Processing: An fMRI Study on Effects of Stimulus Complexity

Neuroscientific investigations regarding aspects of emotional experiences usually focus on one stimulus modality (e.g., pictorial or verbal). Similarities and differences in the processing between the different modalities have rarely been studied directly. The comparison of verbal and pictorial emotional stimuli often reveals a processing advantage of emotional pictures in terms of larger or more pronounced emotion effects evoked by pictorial stimuli. In this study, we examined whether this picture advantage refers to general processing differences or whether it might partly be attributed to differences in visual complexity between pictures and words. We first developed a new stimulus database comprising valence and arousal ratings for more than 200 concrete objects representable in different modalities including different levels of complexity: words, phrases, pictograms, and photographs. Using fMRI we then studied the neural correlates of the processing of these emotional stimuli in a valence judgment task, in which the stimulus material was controlled for differences in emotional arousal. No superiority for the pictorial stimuli was found in terms of emotional information processing with differences between modalities being revealed mainly in perceptual processing regions. While visual complexity might partly account for previously found differences in emotional stimulus processing, the main existing processing differences are probably due to enhanced processing in modality specific perceptual regions. We would suggest that both pictures and words elicit emotional responses with no general superiority for either stimulus modality, while emotional responses to pictures are modulated by perceptual stimulus features, such as picture complexity.     

Enhanced cortical excitability in grapheme-color synesthesia and its modulation

Synesthesia is an unusual condition characterized by the over-binding of two or more features and the concomitant automatic and conscious experience of atypical, ancillary images or perceptions. Previous research suggests that synesthetes display enhanced modality-specific perceptual processing, but it remains unclear whether enhanced processing contributes to conscious awareness of color photisms. In three experiments, we investigated whether grapheme-color synesthesia is characterized by enhanced cortical excitability in primary visual cortex and the role played by this hyperexcitability in the expression of synesthesia. Using transcranial magnetic stimulation, we show that synesthetes display 3-fold lower phosphene thresholds than controls during stimulation of the primary visual cortex. We next used transcranial direct current stimulation to discriminate between two competing hypotheses of the role of hyperexcitability in the expression of synesthesia. We demonstrate that synesthesia can be selectively augmented with cathodal stimulation and attenuated with anodal stimulation of primary visual cortex. A control task revealed that the effect of the brain stimulation was specific to the experience of synesthesia. These results indicate that hyperexcitability acts as a source of noise in visual cortex that influences the availability of the neuronal signals underlying conscious awareness of synesthetic photisms.     

Sensory Perception: Lessons from Synesthesia: Using Synesthesia to Inform the Understanding of Sensory Perception

Synesthesia, the conscious, idiosyncratic, repeatable, and involuntary sensation of one sensory modality in response to another, is a condition that has puzzled both researchers and philosophers for centuries. Much time has been spent proving the condition’s existence as well as investigating its etiology, but what can be learned from synesthesia remains a poorly discussed topic. Here, synaesthesia is presented as a possible answer rather than a question to the current gaps in our understanding of sensory perception. By first appreciating the similarities between normal sensory perception and synesthesia, one can use what is known about synaesthesia, from behavioral and imaging studies, to inform our understanding of “normal” sensory perception. In particular, in considering synesthesia, one can better understand how and where the different sensory modalities interact in the brain, how different sensory modalities can interact without confusion ― the binding problem ― as well as how sensory perception develops.     

Odors and olfaction

In this review, we discuss some of the neural processes involved in the perception of odors that, together with audition and vision, provide essential information for analyzing our surroundings. We shall see how odor detection and learning induce substantial structural and functional changes at the first relay of the olfactory system, i.e., the main olfactory bulb. Among the mechanisms that participate in these modifications is the persistence of a high level of interneuron neurogenesis within the adult olfactory bulb. Our goal is to present some observations related to the neurogenesis that may aid in understanding the neural mechanisms of sensory perception and shed light on the cellular basis of olfactory learning. We summarize the current ideas concerning the molecular mechanisms and organizational strategies used by the olfactory system to transduce, encode, and process information at various levels in the olfactory sensory pathway. Due to space constraints, this review focuses exclusively on the olfactory systems of vertebrates and primarily those of mammals.     

A new look at state-space models for neural data

State space methods have proven indispensable in neural data analysis. However, common methods for performing inference in state-space models with non-Gaussian observations rely on certain approximations which are not always accurate. Here we review direct optimization methods that avoid these approximations, but that nonetheless retain the computational efficiency of the approximate methods. We discuss a variety of examples, applying these direct optimization techniques to problems in spike train smoothing, stimulus decoding, parameter estimation, and inference of synaptic properties. Along the way, we point out connections to some related standard statistical methods, including spline smoothing and isotonic regression. Finally, we note that the computational methods reviewed here do not in fact depend on the state-space setting at all; instead, the key property we are exploiting involves the bandedness of certain matrices. We close by discussing some applications of this more general point of view, including Markov chain Monte Carlo methods for neural decoding and efficient estimation of spatially-varying firing rates.     

Evolution and development of neural circuits in invertebrates

Developmental mechanisms can shed light on how evolutionary diversity has arisen. Invertebrate nervous systems offer a wealth of diverse structures and functions from which to relate development to evolution. Individual homologous neurons have been shown to have distinct roles in species with different behaviors. In addition, specific neurons have been lost or gained in some phylogenetic lineages. The ability to address the neural basis of behavior at the cellular level in invertebrates has facilitated discoveries showing that species-specific behavior can arise from differences in synaptic strength, in neuronal structure and in neuromodulation. The mechanisms involved in the development of neural circuits lead to these differences across species.     

On problem solving with Hopfield neural networks

Hopfield and Tank have shown that neural networks can be used to solve certain computationally hard problems, in particular they studied the Traveling Salesman Problem (TSP). Based on network simulation results they conclude that analog VLSI neural nets can be promising in solving these problems. Recently, Wilson and Pawley presented the results of their simulations which contradict the original results and cast doubts on the usefulness of neural nets. In this paper we give the results of our simulations that clarify some of the discrepancies. We also investigate the scaling of TSP solutions found by neural nets as the size of the problem increases. Further, we consider the neural net solution of the Clustering Problem, also a computationally hard problem, and discuss the types of problems that appear to be well suited for a neural net approach.     

Neural mechanisms of stress resilience and vulnerability

Exposure to stressful events can be differently perceived by individuals and can have persistent sequelae depending on the level of stress resilience or vulnerability of each person. The neural processes that underlie such clinically and socially important differences reside in the anatomical, functional, and molecular connectivity of the brain. Recent work has provided novel insight into some of the involved biological mechanisms that promises to help prevent and treat stress-related disorders. In this review, we focus on causal and mechanistic evidence implicating altered functions and connectivity of the neuroendocrine system, and of hippocampal, cortical, reward, and serotonergic circuits in the establishment and the maintenance of stress resilience and vulnerability. We also touch upon recent findings suggesting a role for epigenetic mechanisms and neurogenesis in these processes and briefly discuss promising avenues of future investigation.