Event-Related Potentials Dissociate Effects of Salience and Space in Biased Competition for Visual Representation

Background

Selective visual attention is the process by which the visual system enhances behaviorally relevant stimuli and filters out others. Visual attention is thought to operate through a cortical mechanism known as biased competition. Representations of stimuli within cortical visual areas compete such that they mutually suppress each others'' neural response. Competition increases with stimulus proximity and can be biased in favor of one stimulus (over another) as a function of stimulus significance, salience, or expectancy. Though there is considerable evidence of biased competition within the human visual system, the dynamics of the process remain unknown.

Methodology/Principal Findings

Here, we used scalp-recorded electroencephalography (EEG) to examine neural correlates of biased competition in the human visual system. In two experiments, subjects performed a task requiring them to either simultaneously identify two targets (Experiment 1) or discriminate one target while ignoring a decoy (Experiment 2). Competition was manipulated by altering the spatial separation between target(s) and/or decoy. Both experimental tasks should induce competition between stimuli. However, only the task of Experiment 2 should invoke a strong bias in favor of the target (over the decoy). The amplitude of two lateralized components of the event-related potential, the N2pc and Ptc, mirrored these predictions. N2pc amplitude increased with increasing stimulus separation in Experiments 1 and 2. However, Ptc amplitude varied only in Experiment 2, becoming more positive with decreased spatial separation.

Conclusions/Significance

These results suggest that N2pc and Ptc components may index distinct processes of biased competition—N2pc reflecting visual competitive interactions and Ptc reflecting a bias in processing necessary to individuate task-relevant stimuli.     

The Impact of Spatial Incongruence on an Auditory-Visual Illusion

Background

The sound-induced flash illusion is an auditory-visual illusion – when a single flash is presented along with two or more beeps, observers report seeing two or more flashes. Previous research has shown that the illusion gradually disappears as the temporal delay between auditory and visual stimuli increases, suggesting that the illusion is consistent with existing temporal rules of neural activation in the superior colliculus to multisensory stimuli. However little is known about the effect of spatial incongruence, and whether the illusion follows the corresponding spatial rule. If the illusion occurs less strongly when auditory and visual stimuli are separated, then integrative processes supporting the illusion must be strongly dependant on spatial congruence. In this case, the illusion would be consistent with both the spatial and temporal rules describing response properties of multisensory neurons in the superior colliculus.

Methodology/Principal Findings

The main aim of this study was to investigate the importance of spatial congruence in the flash-beep illusion. Selected combinations of one to four short flashes and zero to four short 3.5 KHz tones were presented. Observers were asked to count the number of flashes they saw. After replication of the basic illusion using centrally-presented stimuli, the auditory and visual components of the illusion stimuli were presented either both 10 degrees to the left or right of fixation (spatially congruent) or on opposite (spatially incongruent) sides, for a total separation of 20 degrees.

Conclusions/Significance

The sound-induced flash fission illusion was successfully replicated. However, when the sources of the auditory and visual stimuli were spatially separated, perception of the illusion was unaffected, suggesting that the “spatial rule” does not extend to describing behavioural responses in this illusion. We also find no evidence for an associated “fusion” illusion reportedly occurring when multiple flashes are accompanied by a single beep.     

Discrimination training with multimodal stimuli changes activity in the mushroom body of the hawkmoth Manduca sexta

Background

The mushroom bodies of the insect brain play an important role in olfactory processing, associative learning and memory. The mushroom bodies show odor-specific spatial patterns of activity and are also influenced by visual stimuli.

Methodology/Principal Findings

Functional imaging was used to investigate changes in the in vivo responses of the mushroom body of the hawkmoth Manduca sexta during multimodal discrimination training. A visual and an odour stimulus were presented either together or individually. Initially, mushroom body activation patterns were identical to the odour stimulus and the multimodal stimulus. After training, however, the mushroom body response to the rewarded multimodal stimulus was significantly lower than the response to the unrewarded unimodal odour stimulus, indicating that the coding of the stimuli had changed as a result of training. The opposite pattern was seen when only the unimodal odour stimulus was rewarded. In this case, the mushroom body was more strongly activated by the multimodal stimuli after training. When no stimuli were rewarded, the mushroom body activity decreased for both the multimodal and unimodal odour stimuli. There was no measurable response to the unimodal visual stimulus in any of the experiments. These results can be explained using a connectionist model where the mushroom body is assumed to be excited by olfactory stimulus components, and suppressed by multimodal configurations.

Conclusions

Discrimination training with multimodal stimuli consisting of visual and odour cues leads to stimulus specific changes in the in vivo responses of the mushroom body of the hawkmoth.     

Aversive reinforcement improves visual discrimination learning in free-flying honeybees

Background

Learning and perception of visual stimuli by free-flying honeybees has been shown to vary dramatically depending on the way insects are trained. Fine color discrimination is achieved when both a target and a distractor are present during training (differential conditioning), whilst if the same target is learnt in isolation (absolute conditioning), discrimination is coarse and limited to perceptually dissimilar alternatives. Another way to potentially enhance discrimination is to increase the penalty associated with the distractor. Here we studied whether coupling the distractor with a highly concentrated quinine solution improves color discrimination of both similar and dissimilar colors by free-flying honeybees. As we assumed that quinine acts as an aversive stimulus, we analyzed whether aversion, if any, is based on an aversive sensory input at the gustatory level or on a post-ingestional malaise following quinine feeding.

Methodology/Principal Findings

We show that the presence of a highly concentrated quinine solution (60 mM) acts as an aversive reinforcer promoting rejection of the target associated with it, and improving discrimination of perceptually similar stimuli but not of dissimilar stimuli. Free-flying bees did not use remote cues to detect the presence of quinine solution; the aversive effect exerted by this substance was mediated via a gustatory input, i.e. via a distasteful sensory experience, rather than via a post-ingestional malaise.

Conclusion

The present study supports the hypothesis that aversion conditioning is important for understanding how and what animals perceive and learn. By using this form of conditioning coupled with appetitive conditioning in the framework of a differential conditioning procedure, it is possible to uncover discrimination capabilities that may remain otherwise unsuspected. We show, therefore, that visual discrimination is not an absolute phenomenon but can be modulated by experience.     

The neurochemical basis of human cortical auditory processing: combining proton magnetic resonance spectroscopy and magnetoencephalography

Background  

A combination of magnetoencephalography and proton magnetic resonance spectroscopy was used to correlate the electrophysiology of rapid auditory processing and the neurochemistry of the auditory cortex in 15 healthy adults. To assess rapid auditory processing in the left auditory cortex, the amplitude and decrement of the N1m peak, the major component of the late auditory evoked response, were measured during rapidly successive presentation of acoustic stimuli. We tested the hypothesis that: (i) the amplitude of the N1m response and (ii) its decrement during rapid stimulation are associated with the cortical neurochemistry as determined by proton magnetic resonance spectroscopy.     

Keeping in Touch with One's Self: Multisensory Mechanisms of Self-Consciousness

Background

The spatial unity between self and body can be disrupted by employing conflicting visual-somatosensory bodily input, thereby bringing neurological observations on bodily self-consciousness under scientific scrutiny. Here we designed a novel paradigm linking the study of bodily self-consciousness to the spatial representation of visuo-tactile stimuli by measuring crossmodal congruency effects (CCEs) for the full body.

Methodology/Principal Findings

We measured full body CCEs by attaching four vibrator-light pairs to the trunks (backs) of subjects who viewed their bodies from behind via a camera and a head mounted display (HMD). Subjects made speeded elevation (up/down) judgments of the tactile stimuli while ignoring light stimuli. To modulate self-identification for the seen body subjects were stroked on their backs with a stick and the felt stroking was either synchronous or asynchronous with the stroking that could be seen via the HMD.We found that (1) tactile stimuli were mislocalized towards the seen body (2) CCEs were modulated systematically during visual-somatosensory conflict when subjects viewed their body but not when they viewed a body-sized object, i.e. CCEs were larger during synchronous than during asynchronous stroking of the body and (3) these changes in the mapping of tactile stimuli were induced in the same experimental condition in which predictable changes in bodily self-consciousness occurred.

Conclusions/Significance

These data reveal that systematic alterations in the mapping of tactile stimuli occur in a full body illusion and thus establish CCE magnitude as an online performance proxy for subjective changes in global bodily self-consciousness.     

Perceptual anchoring in preschool children: not adultlike, but there

Background

Recent studies suggest that human auditory perception follows a prolonged developmental trajectory, sometimes continuing well into adolescence. Whereas both sensory and cognitive accounts have been proposed, the development of the ability to base current perceptual decisions on prior information, an ability that strongly benefits adult perception, has not been directly explored. Here we ask whether the auditory frequency discrimination of preschool children also improves when given the opportunity to use previously presented standard stimuli as perceptual anchors, and whether the magnitude of this anchoring effect undergoes developmental changes.

Methodology/Principal Findings

Frequency discrimination was tested using two adaptive same/different protocols. In one protocol (with-reference), a repeated 1-kHz standard tone was presented repeatedly across trials. In the other (no-reference), no such repetitions occurred. Verbal memory and early reading skills were also evaluated to determine if the pattern of correlations between frequency discrimination, memory and literacy is similar to that previously reported in older children and adults. Preschool children were significantly more sensitive in the with-reference than in the no-reference condition, but the magnitude of this anchoring effect was smaller than that observed in adults. The pattern of correlations among discrimination thresholds, memory and literacy replicated previous reports in older children.

Conclusions/Significance

The processes allowing the use of context to form perceptual anchors are already functional among preschool children, albeit to a lesser extent than in adults. Nevertheless, immature anchoring cannot fully account for the poorer frequency discrimination abilities of young children. That anchoring is present among the majority of typically developing preschool children suggests that the anchoring deficits observed among individuals with dyslexia represent a true deficit rather than a developmental delay.     

Peeling Plaids Apart: Context Counteracts Cross-Orientation Contrast Masking

Background

Contrast discrimination for an image is usually harder if another image is superimposed on top. We asked whether such contrast masking may be enhanced or relieved depending on cues promoting integration of both images as a single pattern, versus segmentation into two independent components.

Methodology & Principal Findings

Contrast discrimination thresholds for a foveal test grating were sharply elevated in the presence of a perfectly overlapping orthogonally-oriented mask grating. However thresholds returned to the unmasked baseline when a surround grating was added, having the same orientation and phase of either the test or mask grating. Both such masking and ‘unmasking’ effects were much stronger for moving than static stimuli.

Conclusions & Significance

Our results suggest that common-fate motion reinforces the perception of a single coherent plaid pattern, while the surround helps to identify each component independently, thus peeling the plaid apart again. These results challenge current models of early vision, suggesting that higher-level surface organization influences contrast encoding, determining whether the contrast of a grating may be recovered independently from that of its mask.     

Hemispheric Asymmetries in Repetition Enhancement and Suppression Effects in the Newborn Brain

Background

The repeated presentation of stimuli typically attenuates neural responses (repetition suppression) or, less commonly, increases them (repetition enhancement) when stimuli are highly complex, degraded or presented under noisy conditions. In adult functional neuroimaging research, these repetition effects are considered as neural correlates of habituation. The development and respective functional significance of these effects in infancy remain largely unknown.

Objective

This study investigates repetition effects in newborns using functional near-infrared spectroscopy, and specifically the role of stimulus complexity in evoking a repetition enhancement vs. a repetition suppression response, following up on Gervain et al. (2008). In that study, abstract rule-learning was found at birth in cortical areas specific to speech processing, as evidenced by a left-lateralized repetition enhancement of the hemodynamic response to highly variable speech sequences conforming to a repetition-based ABB artificial grammar, but not to a random ABC grammar.

Methods

Here, the same paradigm was used to investigate how simpler stimuli (12 different sequences per condition as opposed to 140), and simpler presentation conditions (blocked rather than interleaved) would influence repetition effects at birth.

Results

Results revealed that the two grammars elicited different dynamics in the two hemispheres. In left fronto-temporal areas, we reproduce the early perceptual discrimination of the two grammars, with ABB giving rise to a greater response at the beginning of the experiment than ABC. In addition, the ABC grammar evoked a repetition enhancement effect over time, whereas a stable response was found for the ABB grammar. Right fronto-temporal areas showed neither initial discrimination, nor change over time to either pattern.

Conclusion

Taken together with Gervain et al. (2008), this is the first evidence that manipulating methodological factors influences the presence or absence of neural repetition enhancement effects in newborns and stimulus variability appears a particularly important factor. Further, this temporal modulation is restricted to the left hemisphere, confirming its specialization for learning linguistic regularities from birth.     

Large number discrimination by mosquitofish

Background

Recent studies have demonstrated that fish display rudimentary numerical abilities similar to those observed in mammals and birds. The mechanisms underlying the discrimination of small quantities (<4) were recently investigated while, to date, no study has examined the discrimination of large numerosities in fish.

Methodology/Principal Findings

Subjects were trained to discriminate between two sets of small geometric figures using social reinforcement. In the first experiment mosquitofish were required to discriminate 4 from 8 objects with or without experimental control of the continuous variables that co-vary with number (area, space, density, total luminance). Results showed that fish can use the sole numerical information to compare quantities but that they preferentially use cumulative surface area as a proxy of the number when this information is available. A second experiment investigated the influence of the total number of elements to discriminate large quantities. Fish proved to be able to discriminate up to 100 vs. 200 objects, without showing any significant decrease in accuracy compared with the 4 vs. 8 discrimination. The third experiment investigated the influence of the ratio between the numerosities. Performance was found to decrease when decreasing the numerical distance. Fish were able to discriminate numbers when ratios were 1∶2 or 2∶3 but not when the ratio was 3∶4. The performance of a sample of undergraduate students, tested non-verbally using the same sets of stimuli, largely overlapped that of fish.

Conclusions/Significance

Fish are able to use pure numerical information when discriminating between quantities larger than 4 units. As observed in human and non-human primates, the numerical system of fish appears to have virtually no upper limit while the numerical ratio has a clear effect on performance. These similarities further reinforce the view of a common origin of non-verbal numerical systems in all vertebrates.     

Hemispheric asymmetries in speech perception: sense, nonsense and modulations

Background

The well-established left hemisphere specialisation for language processing has long been claimed to be based on a low-level auditory specialization for specific acoustic features in speech, particularly regarding ‘rapid temporal processing’.

Methodology

A novel analysis/synthesis technique was used to construct a variety of sounds based on simple sentences which could be manipulated in spectro-temporal complexity, and whether they were intelligible or not. All sounds consisted of two noise-excited spectral prominences (based on the lower two formants in the original speech) which could be static or varying in frequency and/or amplitude independently. Dynamically varying both acoustic features based on the same sentence led to intelligible speech but when either or both acoustic features were static, the stimuli were not intelligible. Using the frequency dynamics from one sentence with the amplitude dynamics of another led to unintelligible sounds of comparable spectro-temporal complexity to the intelligible ones. Positron emission tomography (PET) was used to compare which brain regions were active when participants listened to the different sounds.

Conclusions

Neural activity to spectral and amplitude modulations sufficient to support speech intelligibility (without actually being intelligible) was seen bilaterally, with a right temporal lobe dominance. A left dominant response was seen only to intelligible sounds. It thus appears that the left hemisphere specialisation for speech is based on the linguistic properties of utterances, not on particular acoustic features.     

Two-Point Discriminability: Relation to Properties of the Somatosensory System

The ability to resolve two closely spaced cutaneous stimuli presumably depends upon the degree of overlap between the two populations of responding neurons. The degree of overlap is determined by receptive field (RF) geometry and location, and by interactive factors such as lateral inhibition. In this paper, we first consider some aspects of RFs that would be expected to influence two-point acuity.

In some somatosensory brain regions, relatively few RFs overlap the body midline. As would be expected, discrimination is enhanced for two points straddling the backbone. This does not simply reflect a mediolateral gradient of acuity, as we found higher acuity laterally.

On the limbs, where RFs are elongated along the length of the limb, transverse two-point acuity was greater than longitudinal acuity. However, on the back, where RFs are fairly round, there was an even larger orientation effect, with two-point acuity greater for stimuli longitudinal than for stimuli transverse to the spine.

Thus, the substantial variation of two-point acuity with stimulus orientation on the back cannot be explained by RF geometry alone. We discuss the possibility that differences in lateral inhibition and degree of similarity in dermatomal composition contribute to the observed stimulus orientation effects.     

Preparing to Grasp Emotionally Laden Stimuli

Background

Contemporary theories of motor control propose that motor planning involves the prediction of the consequences of actions. These predictions include the associated costs as well as the rewarding nature of movements’ outcomes. Within the estimation of these costs and rewards would lie the valence, that is, the pleasantness or unpleasantness of a given stimulus with which one is about to interact. The aim of this study was to test if motor preparation encompasses valence.

Methodology/Principal Findings

The readiness potential, an electrophysiological marker of motor preparation, was recorded before the grasping of pleasant, neutral and unpleasant stimuli. Items used were balanced in weight and placed inside transparent cylinders to prompt a similar grip among trials. Compared with neutral stimuli, the grasping of pleasant stimuli was preceded by a readiness potential of lower amplitude, whereas that of unpleasant stimuli was associated with a readiness potential of higher amplitude.

Conclusions/Significance

We show for the first time that the sensorimotor cortex activity preceding the grasping of a stimulus is affected by its valence. Smaller readiness potential amplitudes found for pleasant stimuli could imply in the recruitment of pre-set motor repertoires, whereas higher amplitudes found for unpleasant stimuli would emerge from a discrepancy between the required action and their aversiveness. Our results indicate that the prediction of action outcomes encompasses an estimate of the valence of a stimulus with which one is about to interact.     

The Duration of a Co-Occurring Sound Modulates Visual Detection Performance in Humans

Background

The duration of sounds can affect the perceived duration of co-occurring visual stimuli. However, it is unclear whether this is limited to amodal processes of duration perception or affects other non-temporal qualities of visual perception.

Methodology/Principal Findings

Here, we tested the hypothesis that visual sensitivity - rather than only the perceived duration of visual stimuli - can be affected by the duration of co-occurring sounds. We found that visual detection sensitivity (d’) for unimodal stimuli was higher for stimuli of longer duration. Crucially, in a cross-modal condition, we replicated previous unimodal findings, observing that visual sensitivity was shaped by the duration of co-occurring sounds. When short visual stimuli (∼24 ms) were accompanied by sounds of matching duration, visual sensitivity was decreased relative to the unimodal visual condition. However, when the same visual stimuli were accompanied by longer auditory stimuli (∼60–96 ms), visual sensitivity was increased relative to the performance for ∼24 ms auditory stimuli. Across participants, this sensitivity enhancement was observed within a critical time window of ∼60–96 ms. Moreover, the amplitude of this effect correlated with visual sensitivity enhancement found for longer lasting visual stimuli across participants.

Conclusions/Significance

Our findings show that the duration of co-occurring sounds affects visual perception; it changes visual sensitivity in a similar way as altering the (actual) duration of the visual stimuli does.     

Electroretinographic detection of human brain dopamine response to oral food stimulation

Objective:

The activity of dopamine‐dependent retinal signaling can be assessed using electroretinography. Response of this system to oral food stimulation might provide accessible insight into the brain dopamine response to oral stimuli as retinal dopamine concentration is dependent upon mid brain dopamine concentration was postulated.

Design and Methods:

Nine individuals had cone ERG (b wave) response to oral food stimulation and oral methylphenidate (MPH) administration measured on separate days, and completed self reported eating behavior questionnaires.

Results:

Significant and similar increases in b wave response to both stimuli (P = 0.012 and P = 0.042, MPH and food, respectively) and significant correlations of the food stimulated b wave amplitude with binge eating related behavior as measured by the Gormally Binge Eating Scale (r = 0.68, P = 0.044) and self‐reported trait hunger as measured by the Stunkard and Messick Three Factor Eating Questionnaire (r = 0.67, P = 0.048) were found.

Conclusion:

The significant increase in food stimulated dopamine dependent b wave amplitude and correlation with methylphenidate stimulated b wave amplitude suggest that ERG may offer a relatively inexpensive and accessible methodology for potentially assess dopaminergic responses to food and other externally applied stimuli that have been implicated in the pathogenesis of a number of human diseases.     

The release of attack and escape behavior by vibratory stimuli in a wandering spider (Cupiennim salei keys.)

Summary The wandering spiderCupiennius salei responds to vibration of the substrate either with predatory behavior (approach) or with a startle reaction or escape behavior (withdrawal) (Fig. 3). The effects of different parameters of the signal in releasing this behavior were studied by applying various artificial stimuli to a spider standing on a vibrating platform with one or more legs. Receptors sensitive to substrate vibration and the trichobothria, which respond to airborne vibration, together determine the response. Spiders without trichobothria: The type of response to vertical vibrations isfrequency-dependent (Fig. 4a), with predatory reactions predominant at low frequencies (3–4 Hz), and withdrawal reactions at high frequencies (350–460 Hz). Whereas approach is most likely to occur at an intermediate, frequency-dependentamplitude, the probability of withdrawal increases continuously with increasing amplitude (Fig. 6). With sine wave stimuli the lowest threshold amplitude for approach is 9 m peak-to-peak (550 Hz, range tested 1–550 Hz) whereas that for withdrawal is 17 m (800 Hz, range tested 1–800 Hz). The threshold for approach is lower by 6–8 dB whenband-limited noise is used, and the probability of an approach response increases as the bandwidth is expanded. The threshold curve for withdrawal, however, is the same in all cases (Fig. 4b and 5). The spider is capable of both frequency and amplitude discrimination.The metatarsal and pretarsal slit sense organs contribute to these responses as is shown by increased thresholds following their destruction (Fig- 7). Intact animals, with functional trichobothria as well as slit sense organs: They have lower thresholds for withdrawal (by ca. 10 dB; Fig. 9) and shorter reaction times than do spiders without trichobothria. Unlike animals without trichobothria the amplitude thresholds of intact animals to bandlimited noise are ca. 7.5 dB lower than those to sine wave stimuli. The approach threshold is the same as that of spiders without trichobothria. According to direct observation the trichobothria are deflected by airborne sound generated by the substrate motion; the deflection angle increases with both amplitude and frequency of substrate vibration (Fig. 10).There is acentral nervous interaction between the signals from the trichobothria and the slit sense organs with the following basic properties: when both of the two receptor systems receive either a prey-like stimulus or a stimulus eliciting withdrawal their effects add, but when the trichobothria receive stimuli unlike prey they inhibit the approach reaction that would otherwise be triggered by substrate vibration.     

Alternation of Sound Location Induces Visual Motion Perception of a Static Object

Background

Audition provides important cues with regard to stimulus motion although vision may provide the most salient information. It has been reported that a sound of fixed intensity tends to be judged as decreasing in intensity after adaptation to looming visual stimuli or as increasing in intensity after adaptation to receding visual stimuli. This audiovisual interaction in motion aftereffects indicates that there are multimodal contributions to motion perception at early levels of sensory processing. However, there has been no report that sounds can induce the perception of visual motion.

Methodology/Principal Findings

A visual stimulus blinking at a fixed location was perceived to be moving laterally when the flash onset was synchronized to an alternating left-right sound source. This illusory visual motion was strengthened with an increasing retinal eccentricity (2.5 deg to 20 deg) and occurred more frequently when the onsets of the audio and visual stimuli were synchronized.

Conclusions/Significance

We clearly demonstrated that the alternation of sound location induces illusory visual motion when vision cannot provide accurate spatial information. The present findings strongly suggest that the neural representations of auditory and visual motion processing can bias each other, which yields the best estimates of external events in a complementary manner.     

‘When Birds of a Feather Flock Together’: Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

Background

Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously.

Methodology

Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli.

Principal Findings

The reliability of non-synesthetic participants'' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli.

Conclusions

Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information.     

The Audiovisual Tau Effect in Infancy

Background

Perceived spatial intervals between successive flashes can be distorted by varying the temporal intervals between them (the “tau effect”). A previous study showed that a tau effect for visual flashes could be induced when they were accompanied by auditory beeps with varied temporal intervals (an audiovisual tau effect).

Methodology/Principal Findings

We conducted two experiments to investigate whether the audiovisual tau effect occurs in infancy. Forty-eight infants aged 5–8 months took part in this study. In Experiment 1, infants were familiarized with audiovisual stimuli consisting of three pairs of two flashes and three beeps. The onsets of the first and third pairs of flashes were respectively matched to those of the first and third beeps. The onset of the second pair of flashes was separated from that of the second beep by 150 ms. Following the familiarization phase, infants were exposed to a test stimulus composed of two vertical arrays of three static flashes with different spatial intervals. We hypothesized that if the audiovisual tau effect occurred in infancy then infants would preferentially look at the flash array with spatial intervals that would be expected to be different from the perceived spatial intervals between flashes they were exposed to in the familiarization phase. The results of Experiment 1 supported this hypothesis. In Experiment 2, the first and third beeps were removed from the familiarization stimuli, resulting in the disappearance of the audiovisual tau effect. This indicates that the modulation of temporal intervals among flashes by beeps was essential for the audiovisual tau effect to occur (Experiment 2).

Conclusions/Significance

These results suggest that the cross-modal processing that underlies the audiovisual tau effect occurs even in early infancy. In particular, the results indicate that audiovisual modulation of temporal intervals emerges by 5–8 months of age.     

Express Attentional Re-Engagement but Delayed Entry into Consciousness Following Invalid Spatial Cues in Visual Search

Background

In predictive spatial cueing studies, reaction times (RT) are shorter for targets appearing at cued locations (valid trials) than at other locations (invalid trials). An increase in the amplitude of early P1 and/or N1 event-related potential (ERP) components is also present for items appearing at cued locations, reflecting early attentional sensory gain control mechanisms. However, it is still unknown at which stage in the processing stream these early amplitude effects are translated into latency effects.

Methodology/Principal Findings

Here, we measured the latency of two ERP components, the N2pc and the sustained posterior contralateral negativity (SPCN), to evaluate whether visual selection (as indexed by the N2pc) and visual-short term memory processes (as indexed by the SPCN) are delayed in invalid trials compared to valid trials. The P1 was larger contralateral to the cued side, indicating that attention was deployed to the cued location prior to the target onset. Despite these early amplitude effects, the N2pc onset latency was unaffected by cue validity, indicating an express, quasi-instantaneous re-engagement of attention in invalid trials. In contrast, latency effects were observed for the SPCN, and these were correlated to the RT effect.

Conclusions/Significance

Results show that latency differences that could explain the RT cueing effects must occur after visual selection processes giving rise to the N2pc, but at or before transfer in visual short-term memory, as reflected by the SPCN, at least in discrimination tasks in which the target is presented concurrently with at least one distractor. Given that the SPCN was previously associated to conscious report, these results further show that entry into consciousness is delayed following invalid cues.