Synaesthetic Colour in the Brain: Beyond Colour Areas. A Functional Magnetic Resonance Imaging Study of Synaesthetes and Matched Controls

Background

In synaesthesia, sensations in a particular modality cause additional experiences in a second, unstimulated modality (e.g., letters elicit colour). Understanding how synaesthesia is mediated in the brain can help to understand normal processes of perceptual awareness and multisensory integration. In several neuroimaging studies, enhanced brain activity for grapheme-colour synaesthesia has been found in ventral-occipital areas that are also involved in real colour processing. Our question was whether the neural correlates of synaesthetically induced colour and real colour experience are truly shared.

Methodology/Principal Findings

First, in a free viewing functional magnetic resonance imaging (fMRI) experiment, we located main effects of synaesthesia in left superior parietal lobule and in colour related areas. In the left superior parietal lobe, individual differences between synaesthetes (projector-associator distinction) also influenced brain activity, confirming the importance of the left superior parietal lobe for synaesthesia. Next, we applied a repetition suppression paradigm in fMRI, in which a decrease in the BOLD (blood-oxygenated-level-dependent) response is generally observed for repeated stimuli. We hypothesized that synaesthetically induced colours would lead to a reduction in BOLD response for subsequently presented real colours, if the neural correlates were overlapping. We did find BOLD suppression effects induced by synaesthesia, but not within the colour areas.

Conclusions/Significance

Because synaesthetically induced colours were not able to suppress BOLD effects for real colour, we conclude that the neural correlates of synaesthetic colour experience and real colour experience are not fully shared. We propose that synaesthetic colour experiences are mediated by higher-order visual pathways that lie beyond the scope of classical, ventral-occipital visual areas. Feedback from these areas, in which the left parietal cortex is likely to play an important role, may induce V4 activation and the percept of synaesthetic colour.     

Grapheme-colour synaesthesia improves detection of embedded shapes,but without pre-attentive ‘pop-out’ of synaesthetic colour

For people with synaesthesia letters and numbers may evoke experiences of colour. It has been previously demonstrated that these synaesthetes may be better at detecting a triangle made of 2s among a background of 5s if they perceive 5 and 2 as having different synaesthetic colours. However, other studies using this task (or tasks based on the same principle) have failed to replicate the effect or have suggested alternative explanations of the effect. In this study, we repeat the original study on a larger group of synaesthetes (n = 36) and include, for the first time, an assessment of their self-reported colour experiences. We show that synaesthetes do have a general advantage over controls on this task. However, many synaesthetes report no colour experiences at all during the task. Synaesthetes who do report colour typically experience around one third of the graphemes in the display as coloured. This is more consistent with theories of synaesthesia in which spatial attention needs to be deployed to graphemes for conscious colour experiences to emerge than the interpretation based on ‘pop-out’.     

Synaesthetic colours do not camouflage form in visual search

One of the major issues in synaesthesia research is to identify the level of processing involved in the formation of the subjective colours experienced by synaesthetes: are they perceptual phenomena or are they due to memory and association learning? To address this question, we tested whether the colours reported by a group of grapheme-colour synaesthetes (previously studied in an functional magnetic resonance imaging experiment) influenced them in a visual search task. As well as using a condition where synaesthetic colours should have aided visual search, we introduced a condition where the colours experienced by synaesthetes would be expected to make them worse than controls. We found no evidence for differences between synaesthetes and normal controls, either when colours should have helped them or where they should have hindered. We conclude that the colours reported by our population of synaesthetes are not equivalent to perceptual signals, but arise at a cognitive level where they are unable to affect visual search.     

Anomalous perception in synaesthesia: a cognitive neuroscience perspective

An enduring question in cognitive neuroscience is how the physical properties of the world are represented in the brain to yield conscious perception. In most people, a particular physical stimulus gives rise to a unitary, unimodal perceptual experience. So, light energy leads to the sensation of seeing, whereas sound waves produce the experience of hearing. However, for individuals with the rare phenomenon of synaesthesia, specific physical stimuli consistently induce more than one perceptual experience. For example, hearing particular sounds might induce vivid experiences of colour, taste or odour, as might the sight of visual symbols, such as letters or digits. Here we review the latest findings on synaesthesia, and consider its possible genetic, neural and cognitive bases. We also propose a neurocognitive framework for understanding such anomalous perceptual experiences.     

Biological significance of distinguishing between similar colours in spectrally variable illumination: bumblebees (<Emphasis Type="Italic">Bombus terrestris</Emphasis>) as a case study

Individual bumblebees were trained to choose between rewarded target flowers and non-rewarded distractor flowers in a controlled illumination laboratory. Bees learnt to discriminate similar colours, but with smaller colour distances the frequency of errors increased. This indicates that pollen transfer might occur between flowers with similar colours, even if these colours are distinguishable. The effect of similar colours on reducing foraging accuracy of bees is evident for colour distances high above discrimination threshold, which explains previous field observations showing that bees do not exhibit complete flower constancy unless flower colour between species is distinct. Bees tested in spectrally different illumination conditions experienced a significant decrease in their ability to discriminate between similar colours. The extent to which this happens differs in different areas of colour space, which is consistent with a von Kries-type model of colour constancy. We find that it would be beneficial for plant species to have highly distinctive colour signals to overcome limitations on the bees performance in reliably judging differences between similar colours. An exception to this finding was flowers that varied in shape, in which case bees used this cue to compensate for inaccuracies of colour vision.     

Most and Least Preferred Colours Differ According to Object Context: New Insights from an Unrestricted Colour Range

Humans like some colours and dislike others, but which particular colours and why remains to be understood. Empirical studies on colour preferences generally targeted most preferred colours, but rarely least preferred (disliked) colours. In addition, findings are often based on general colour preferences leaving open the question whether results generalise to specific objects. Here, 88 participants selected the colours they preferred most and least for three context conditions (general, interior walls, t-shirt) using a high-precision colour picker. Participants also indicated whether they associated their colour choice to a valenced object or concept. The chosen colours varied widely between individuals and contexts and so did the reasons for their choices. Consistent patterns also emerged, as most preferred colours in general were more chromatic, while for walls they were lighter and for t-shirts they were darker and less chromatic compared to least preferred colours. This meant that general colour preferences could not explain object specific colour preferences. Measures of the selection process further revealed that, compared to most preferred colours, least preferred colours were chosen more quickly and were less often linked to valenced objects or concepts. The high intra- and inter-individual variability in this and previous reports furthers our understanding that colour preferences are determined by subjective experiences and that most and least preferred colours are not processed equally.     

Why birds eat colourful grit: colour preferences revealed by the colour of gizzard stones

Colour preferences from sexual or social contexts are assumed to have arisen owing to preferences for specific kinds of food, representing a sensory bias, but once colour preferences have evolved in a sexual context, they may also be expressed during foraging. We tested whether preferences for specific body colours (i.e. plumage and soft parts) were related to colour preferences for grit ingested by birds. Birds eat grit to facilitate break down of food by the gizzard, and this function is independent of the colour of grit, but depends on the physical properties of stones. Bird species were significantly consistent in colour of grit, and grit of different colours varied in prevalence among species, even when analyses were restricted to a sample from a single locality. There were positive correlations between presence of lilac and red grit in the gizzard and presence of sexually dichromatic lilac and red colour on the body. There was a positive correlation between red grit colour and red sexually monochromatic body colour. Bird species with many different sexual colours, but not sexually monochromatic colours on their body had many different colours of grit. Males had more lilac and red grit than females, with this effect differing among species, whereas that was not the case for grit of other colours. These findings are consistent with the sensory bias hypothesis that birds express preferences for grit of specific colours and a high diversity of colours related to sexual colouration of the body, even when the colour of such grit is only visible to the individual at the moment of ingestion.     

Components of Attention in Grapheme-Color Synesthesia: A Modeling Approach

Grapheme-color synesthesia is a condition where the perception of graphemes consistently and automatically evokes an experience of non-physical color. Many have studied how synesthesia affects the processing of achromatic graphemes, but less is known about the synesthetic processing of physically colored graphemes. Here, we investigated how the visual processing of colored letters is affected by the congruence or incongruence of synesthetic grapheme-color associations. We briefly presented graphemes (10–150 ms) to 9 grapheme-color synesthetes and to 9 control observers. Their task was to report as many letters (targets) as possible, while ignoring digit (distractors). Graphemes were either congruently or incongruently colored with the synesthetes’ reported grapheme-color association. A mathematical model, based on Bundesen’s (1990) Theory of Visual Attention (TVA), was fitted to each observer’s data, allowing us to estimate discrete components of visual attention. The models suggested that the synesthetes processed congruent letters faster than incongruent ones, and that they were able to retain more congruent letters in visual short-term memory, while the control group’s model parameters were not significantly affected by congruence. The increase in processing speed, when synesthetes process congruent letters, suggests that synesthesia affects the processing of letters at a perceptual level. To account for the benefit in processing speed, we propose that synesthetic associations become integrated into the categories of graphemes, and that letter colors are considered as evidence for making certain perceptual categorizations in the visual system. We also propose that enhanced visual short-term memory capacity for congruently colored graphemes can be explained by the synesthetes’ expertise regarding their specific grapheme-color associations.     

Bumblebees (Bombus terrestris) and honeybees (Apis mellifera) prefer similar colours of higher spectral purity over trained colours

Differences in the concentration of pigments as well as their composition and spatial arrangement cause intraspecific variation in the spectral signature of flowers. Known colour preferences and requirements for flower-constant foraging bees predict different responses to colour variability. In experimental settings, we simulated small variations of unicoloured petals and variations in the spatial arrangement of colours within tricoloured petals using artificial flowers and studied their impact on the colour choices of bumblebees and honeybees. Workers were trained to artificial flowers of a given colour and then given the simultaneous choice between three test colours: either the training colour, one colour of lower and one of higher spectral purity, or the training colour, one colour of lower and one of higher dominant wavelength; in all cases the perceptual contrast between the training colour and the additional test colours was similarly small. Bees preferred artificial test flowers which resembled the training colour with the exception that they preferred test colours with higher spectral purity over trained colours. Testing the behaviour of bees at artificial flowers displaying a centripetal or centrifugal arrangement of three equally sized colours with small differences in spectral purity, bees did not prefer any type of artificial flowers, but preferentially choose the most spectrally pure area for the first antenna contact at both types of artificial flowers. Our results indicate that innate preferences for flower colours of high spectral purity in pollinators might exert selective pressure on the evolution of flower colours.     

Simultaneous Discrimination Learning in Chicks: Spatial Representations and Object Characteristics

Chicks were trained to discriminate (1) between two boxes of the same colour on the basis of their positions; (2) between two boxes of different colours on the basis of their positions or on the basis of their colours. No significant differences between these tasks appeared. Addition of colour and position improved learning when the boxes were entirely coloured but not when differently coloured discs were placed over the lids of two identical boxes. It is argued that in simultaneous discrimination learning chicks rely primarily on the “relative” position of the goal objects (i. e. in relation to each other) and utilize featural information (colour) to segregate the goal objects as distinct perceptual units. Results also stressed the role of “object characteristics” as opposed to the traditional notion of “cues”.     

Disruptive Colouration and Perceptual Grouping

Camouflage is the primary defence of many animals and includes multiple strategies that interfere with figure-ground segmentation and object recognition. While matching background colours and textures is widespread and conceptually straightforward, less well explored are the optical ‘tricks’, collectively called disruptive colouration, that exploit perceptual grouping mechanisms. Adjacent high contrast colours create false edges, but this is not sufficient for an object’s shape to be broken up; some colours must blend with the background. We test the novel hypothesis that this will be particularly effective when the colour patches on the animal appear to belong to, not merely different background colours, but different background objects. We used computer-based experiments where human participants had to find cryptic targets on artificial backgrounds. Creating what appeared to be bi-coloured foreground objects on bi-coloured backgrounds, we generated colour boundaries that had identical local contrast but either lay within or between (illusory) objects. As predicted, error rates for targets matching what appeared to be different background objects were higher than for targets which had otherwise identical local contrast to the background but appeared to belong to single background objects. This provides evidence for disruptive colouration interfering with higher-level feature integration in addition to previously demonstrated low-level effects involving contour detection. In addition, detection was impeded in treatments where targets were on or in close proximity to multiple background colour or tone boundaries. This is consistent with other studies which show a deleterious influence of visual ‘clutter’ or background complexity on search.     

Colour learning in two behavioural contexts: how much can a butterfly keep in mind?

Here we examine the ability of butterflies to learn colour cues in two different behavioural contexts, nectar foraging and oviposition, more or less simultaneously. We first trained female Battus philenor (Papilionidae) butterflies to associate a given colour with the presence of host plant leaf extract and assayed their colour preference; we then trained a subset of these butterflies to associate a second colour with the presence of sucrose solution and assayed colour preference once more. When offered an array of four unscented and unrewarding coloured models, ‘single-trained’ butterflies consistently alighted most frequently on their oviposition training colour. Green-trained butterflies landed on nontrained colours only about 4% of the time, while butterflies trained to red, yellow or blue made about 23% of their landings on nontrained colours; of those nontrained landings, most were on green. The majority of ‘dual-trained’ butterflies made the greatest number of visits to both training colours in the appropriate behavioural context; that is, they probed the models of their sucrose-associated colour and alighted on the models of their oviposition-associated colour. Landings or probes on nontrained colours in one context were consistently biased towards what was learned in the alternative context, suggesting an information-processing constraint in the butterflies. This paper provides a clear demonstration that butterflies can learn in two behavioural contexts within a short span of time. A capacity for such dual conditioning presumably permits female butterflies to forage effectively for egg-laying sites and nectar resources even when those activities are intermingled in time. Copyright 2003 Published by Elsevier Science Ltd on behalf of The Association for the Study of Animal Behaviour.       

WWW design code - a new tool for colour estimation in animal studies

BACKGROUND: The colour of animals' skin, fur, feathers or cuticula has been estimated in a large number of studies. The methods used to do so are diverse, with some being costly and not available to all researchers. In a study to measure plumage colour in a bird species, a new method of creating a colour chart was developed. While colour-charts have their own limitations, these can be minimised when they have the following properties: 1) being readily available to the majority of biologists, 2) containing a large array of colours to allow accurate recording and differentiation of subtle colour differences, 3) low cost, 4) adhering to a world-wide standard, and 5) being available in both hard-copy and digital formats to allow for various analytical methods. The method described below satisfies all of these requirements. RESULTS: Colour charts estimated to fit the range of the species' plumage colours were created on the computer screen using web software that allowed for HTML-coding (in this case Dreamweavertrade mark). The charts were adjusted using feathers from dead specimens until a satisfying range of darker and lighter colours were found. The resulting chart was printed out and was successfully used in the field to determine the plumage colour of hand-held birds. CONCLUSION: Access to a computer and printer, and the software to enable the creation of a chart, is within the reach of the vast majority of biologists. The numbers of colours that can be generated should suit most studies, with the advantage of the method being that the chart can be individually tailored to the species under study. HTML colour coding is a worldwide standard, thus the colours used in studies can be described in the methods section of journal articles using the six-digit alphanumeric code. We believe this method is very useful as a low-tech method for future estimation of individual colour.     

Predation and the relative importance of larval colour polymorphisms and colour polyphenism in a damselfly

Intraspecific body colour variation is common in many animal species. Predation could be a key selective agent giving rise to variation in body colour, and such variation could be due to genetics (polymorphisms) or phenotypic plasticity (polyphenisms). In this study we examined the degree of colour polymorphism and polyphenism in background colour matching in larvae of the damselfly Coenagrion armatum. In addition, we tested if predation risk is reduced when larvae are exposed to a matching compared to a non-matching background. By raising families of larvae at three different background colours we showed that polymorphism explained about 20 % of the total variation and polyphenism about 35 %. In a predation experiment with fish, we showed that larvae with a body colour matching the background had a higher survival success compared to larvae with a non-matching background colour. We suggest that the background matching is adaptive in terms of survival from predation and that colour diversity is maintained because of spatial and temporal variation in the background experienced by damselfly larvae under field conditions.     

Insect attraction to wind turbines: does colour play a role?

The phenomenon of wildlife mortality at wind turbine installations has been generating increasing concern, both for the continued development of the wind industry and for local ecology. While an increase in aerial insectivore activity in the vicinity resulting from insect attraction to turbines remains a strong possibility, little research exists on the possible causes for such events. In this paper, the relative attraction of a selection of specific turbine colours and other hues is assessed in order to determine if turbine paint colour could be influencing insect numbers at these installations. The common turbine colours ‘pure white’ (RAL 9010) and ‘light grey’ (RAL 7035) were among those found to attract significantly more insects than other colours tested, suggesting colour may well have a role to play in potential mitigation.     

Mapping the variation in spider body colouration from an insect perspective

Colour variation is frequently observed in spiders. Such variation can impact fitness by affecting the way spiders are perceived by relevant observers such as prey (i.e. by resembling flower signals as visual lures) and predators (i.e. by disrupting search image formation). Verrucosa arenata is an orb-weaving spider that presents colour variation in a conspicuous triangular pattern on the dorsal part of the abdomen. This pattern has predominantly white or yellow colouration, but also reflects light in the UV part of the spectrum. We quantified colour variation in V. arenata from images obtained using a full spectrum digital camera. We obtained cone catch quanta and calculated chromatic and achromatic contrasts for the visual systems of Drosophila melanogaster and Apis mellifera. Cluster analyses of the colours of the triangular patch resulted in the formation of six clusters and three clusters in the colour space of D. melanogaster and A. mellifera, respectively. Significant differences were found between morphs for both visual systems in contrasts between the colour pattern and two backgrounds against which it would be viewed. Yellow spiders showed higher chromatic contrast than white spiders, while white spiders showed higher achromatic contrast. Therefore, there are perceptual differences between V. arenata colour morphs in the visual systems of potential relevant observers which could pose an important selective pressure on this trait. A variation in the contribution of colour channels to the colour pattern observed in colour maps constructed from reflectance values of individual pixels could influence the way the pattern is perceived, and its resemblance to attractive flower signals.     

Individual differences among grapheme-color synesthetes: brain-behavior correlations

Grapheme-color synesthetes experience specific colors associated with specific number or letter characters. To determine the neural locus of this condition, we compared behavioral and fMRI responses in six grapheme-color synesthetes to control subjects. In our behavioral experiments, we found that a subject's synesthetic experience can aid in texture segregation (experiment 1) and reduce the effects of crowding (experiment 2). For synesthetes, graphemes produced larger fMRI responses in color-selective area human V4 than for control subjects (experiment 3). Importantly, we found a correlation within subjects between the behavioral and fMRI results; subjects with better performance on the behavioral experiments showed larger fMRI responses in early retinotopic visual areas (V1, V2, V3, and hV4). These results suggest that grapheme-color synesthesia is the result of cross-activation between grapheme-selective and color-selective brain areas. The correlation between the behavioral and fMRI results suggests that grapheme-color synesthetes may constitute a heterogeneous group.     

WWW design code – a new tool for colour estimation in animal studies

Background

The colour of animals' skin, fur, feathers or cuticula has been estimated in a large number of studies. The methods used to do so are diverse, with some being costly and not available to all researchers. In a study to measure plumage colour in a bird species, a new method of creating a colour chart was developed. While colour-charts have their own limitations, these can be minimised when they have the following properties: 1) being readily available to the majority of biologists, 2) containing a large array of colours to allow accurate recording and differentiation of subtle colour differences, 3) low cost, 4) adhering to a world-wide standard, and 5) being available in both hard-copy and digital formats to allow for various analytical methods. The method described below satisfies all of these requirements.

Results

Colour charts estimated to fit the range of the species' plumage colours were created on the computer screen using web software that allowed for HTML-coding (in this case Dreamweaver?). The charts were adjusted using feathers from dead specimens until a satisfying range of darker and lighter colours were found. The resulting chart was printed out and was successfully used in the field to determine the plumage colour of hand-held birds.

Conclusion

Access to a computer and printer, and the software to enable the creation of a chart, is within the reach of the vast majority of biologists. The numbers of colours that can be generated should suit most studies, with the advantage of the method being that the chart can be individually tailored to the species under study. HTML colour coding is a worldwide standard, thus the colours used in studies can be described in the methods section of journal articles using the six-digit alphanumeric code. We believe this method is very useful as a low-tech method for future estimation of individual colour.     

Shell colour variation in Littorina saxatilis Olivi (Prosobranchia: Littorinidae): a multi-factor approach

The marine snail Littorina saxatilis is highly polymorphic for shell colour. It lives in the heterogeneous intertidal zone, where there are sharp transitions in a number of abiotic factors that may influence the relative fitness of morphs. We investigated the hypothesis of selected variation by relating the colour distribution to five factors (wave exposure, substratum, shore level, sex, snail age), and to interactions between them. We compared patterns from geographical areas in Sweden, Iceland and Russia. Cryptic morphs (tessellated and different dark colours) generally dominated (80–98%) while conspicuous morphs (white, yellow, red and banded) were less common (2–20%). The colour frequencies were often related to wave exposure, substratum and shore level. Frequencies rarely varied with age and never with sex. In order to test the assumption that the different colours are genetically determined we cross-bred snails from Iceland in the laboratory. Both the presence of bands and the ground colours of the shell were inherited, and we have tentative support for a one-locus two-allele model for banding. Our results support a model of selected inherited colour variation, involving a number of different selective agents, the importance of which may vary between populations on local and geographical scales.     

The relationship between visual working memory and attention: retention of precise colour information in the absence of effects on perceptual selection

We examined the conditions under which a feature value in visual working memory (VWM) recruits visual attention to matching stimuli. Previous work has suggested that VWM supports two qualitatively different states of representation: an active state that interacts with perceptual selection and a passive (or accessory) state that does not. An alternative hypothesis is that VWM supports a single form of representation, with the precision of feature memory controlling whether or not the representation interacts with perceptual selection. The results of three experiments supported the dual-state hypothesis. We established conditions under which participants retained a relatively precise representation of a parcticular colour. If the colour was immediately task relevant, it reliably recruited attention to matching stimuli. However, if the colour was not immediately task relevant, it failed to interact with perceptual selection. Feature maintenance in VWM is not necessarily equivalent with feature-based attentional selection.