Selective Attention Modulates the Direction of Audio-Visual Temporal Recalibration

Temporal recalibration of cross-modal synchrony has been proposed as a mechanism to compensate for timing differences between sensory modalities. However, far from the rich complexity of everyday life sensory environments, most studies to date have examined recalibration on isolated cross-modal pairings. Here, we hypothesize that selective attention might provide an effective filter to help resolve which stimuli are selected when multiple events compete for recalibration. We addressed this question by testing audio-visual recalibration following an adaptation phase where two opposing audio-visual asynchronies were present. The direction of voluntary visual attention, and therefore to one of the two possible asynchronies (flash leading or flash lagging), was manipulated using colour as a selection criterion. We found a shift in the point of subjective audio-visual simultaneity as a function of whether the observer had focused attention to audio-then-flash or to flash-then-audio groupings during the adaptation phase. A baseline adaptation condition revealed that this effect of endogenous attention was only effective toward the lagging flash. This hints at the role of exogenous capture and/or additional endogenous effects producing an asymmetry toward the leading flash. We conclude that selective attention helps promote selected audio-visual pairings to be combined and subsequently adjusted in time but, stimulus organization exerts a strong impact on recalibration. We tentatively hypothesize that the resolution of recalibration in complex scenarios involves the orchestration of top-down selection mechanisms and stimulus-driven processes.     

Multisensory Integration and Behavioral Plasticity in Sharks from Different Ecological Niches

The underwater sensory world and the sensory systems of aquatic animals have become better understood in recent decades, but typically have been studied one sense at a time. A comprehensive analysis of multisensory interactions during complex behavioral tasks has remained a subject of discussion without experimental evidence. We set out to generate a general model of multisensory information extraction by aquatic animals. For our model we chose to analyze the hierarchical, integrative, and sometimes alternate use of various sensory systems during the feeding sequence in three species of sharks that differ in sensory anatomy and behavioral ecology. By blocking senses in different combinations, we show that when some of their normal sensory cues were unavailable, sharks were often still capable of successfully detecting, tracking and capturing prey by switching to alternate sensory modalities. While there were significant species differences, odor was generally the first signal detected, leading to upstream swimming and wake tracking. Closer to the prey, as more sensory cues became available, the preferred sensory modalities varied among species, with vision, hydrodynamic imaging, electroreception, and touch being important for orienting to, striking at, and capturing the prey. Experimental deprivation of senses showed how sharks exploit the many signals that comprise their sensory world, each sense coming into play as they provide more accurate information during the behavioral sequence of hunting. The results may be applicable to aquatic hunting in general and, with appropriate modification, to other types of animal behavior.     

Excitatory Neuronal Hubs Configure Multisensory Integration of Slow Waves in Association Cortex

Download video (6MB)Help with mp4 files     

Preschool Children Fail Primate Prosocial Game Because of Attentional Task Demands

Various nonhuman primate species have been tested with prosocial games (i.e. derivates from dictator games) in order to better understand the evolutionary origin of proactive prosociality in humans. Results of these efforts are mixed, and it is difficult to disentangle true species differences from methodological artifacts. We tested 2- to 5-year-old children with a costly and a cost-free version of a prosocial game that differ with regard to the payoff distribution and are widely used with nonhuman primates. Simultaneously, we assessed the subjects’ level of Theory of Mind understanding. Prosocial behavior was demonstrated with the prosocial game, and did not increase with more advanced Theory of Mind understanding. However, prosocial behavior could only be detected with the costly version of the game, whereas the children failed the cost-free version that is most commonly used with nonhuman primates. A detailed comparison of the children’s behavior in the two versions of the game indicates that the failure was due to higher attentional demands of the cost-free version, rather than to a lack of prosociality per se. Our results thus show (i) that subtle differences in prosociality tasks can substantially bias the outcome and thus prevent meaningful species comparisons, and (ii) that like in nonhuman primates, prosocial behavior in human children does not require advanced Theory of Mind understanding in the present context. However, both developmental and comparative psychology accumulate increasing evidence for the multidimensionality of prosocial behaviors, suggesting that different forms of prosociality are also regulated differentially. For future efforts to understand the evolutionary origin of prosociality it is thus crucial to take this heterogeneity into account.     

Variation in the Trajectories of Depressive Symptoms: Results from the Americans' Changing Lives Study

This study examines the association between race and depressive symptoms over a 16‐year study period. The analysis is based on the responses of 3,485 African-American and White respondents from four waves of the Americans' Changing Lives Panel Study. Growth mixture modeling was used to identify latent trajectory classes based on the reported levels of depressive symptoms over 16 years. Four latent trajectory classes were identified: two “high-risk” groups and two “low-risk” groups. Findings show the heterogeneity among and within racial groups in their trajectories of depressive symptoms and the distinct demographic and social relationship predictors for symptom trajectories.     

Multisensory Perceptual Learning of Temporal Order: Audiovisual Learning Transfers to Vision but Not Audition

Background

An outstanding question in sensory neuroscience is whether the perceived timing of events is mediated by a central supra-modal timing mechanism, or multiple modality-specific systems. We use a perceptual learning paradigm to address this question.

Methodology/Principal Findings

Three groups were trained daily for 10 sessions on an auditory, a visual or a combined audiovisual temporal order judgment (TOJ). Groups were pre-tested on a range TOJ tasks within and between their group modality prior to learning so that transfer of any learning from the trained task could be measured by post-testing other tasks. Robust TOJ learning (reduced temporal order discrimination thresholds) occurred for all groups, although auditory learning (dichotic 500/2000 Hz tones) was slightly weaker than visual learning (lateralised grating patches). Crossmodal TOJs also displayed robust learning. Post-testing revealed that improvements in temporal resolution acquired during visual learning transferred within modality to other retinotopic locations and orientations, but not to auditory or crossmodal tasks. Auditory learning did not transfer to visual or crossmodal tasks, and neither did it transfer within audition to another frequency pair. In an interesting asymmetry, crossmodal learning transferred to all visual tasks but not to auditory tasks. Finally, in all conditions, learning to make TOJs for stimulus onsets did not transfer at all to discriminating temporal offsets. These data present a complex picture of timing processes.

Conclusions/Significance

The lack of transfer between unimodal groups indicates no central supramodal timing process for this task; however, the audiovisual-to-visual transfer cannot be explained without some form of sensory interaction. We propose that auditory learning occurred in frequency-tuned processes in the periphery, precluding interactions with more central visual and audiovisual timing processes. Functionally the patterns of featural transfer suggest that perceptual learning of temporal order may be optimised to object-centered rather than viewer-centered constraints.     

Integration of Visual Information in Auditory Cortex Promotes Auditory Scene Analysis through Multisensory Binding

1. Download high-res image (244KB)
2. Download full-size image

     

Trial-to-Trial Reoptimization of Motor Behavior Due to Changes in Task Demands Is Limited

Each task requires a specific motor behavior that is tuned to task demands. For instance, writing requires a lot of accuracy while clapping does not. It is known that the brain adjusts the motor behavior to different task demands as predicted by optimal control theory. In this study, the mechanism of this reoptimization process is investigated by varying the accuracy demands of a reaching task. In this task, the width of the reaching target (0.5 or 8 cm) was varied either on a trial-to-trial basis (random schedule) or in blocks (blocked schedule). On some trials, the hand of the subjects was clamped to a rectilinear trajectory that ended 2 cm on the left or right of the target center. The rejection of this perturbation largely varied with target width in the blocked schedule but not in the random schedule. That is, subjects exhibited different motor behavior in the different schedules despite identical accuracy demands. Therefore, while reoptimization has been considered immediate and automatic, the differences in motor behavior observed across schedules suggest that the reoptimization of the motor behavior is neither happening on a trial-by-trial basis nor obligatory. The absence of trial-to-trial mechanisms, the inability of the brain to adapt to two conflicting task demands and the existence of a switching cost are discussed as possible sources of the non-optimality of motor behavior during the random schedule.     

Multisensory integration: current issues from the perspective of the single neuron

For thousands of years science philosophers have been impressed by how effectively the senses work together to enhance the salience of biologically meaningful events. However, they really had no idea how this was accomplished. Recent insights into the underlying physiological mechanisms reveal that, in at least one circuit, this ability depends on an intimate dialogue among neurons at multiple levels of the neuraxis; this dialogue cannot take place until long after birth and might require a specific kind of experience. Understanding the acquisition and usage of multisensory integration in the midbrain and cerebral cortex of mammals has been aided by a multiplicity of approaches. Here we examine some of the fundamental advances that have been made and some of the challenging questions that remain.     

Neural Control of Enhanced Filtering Demands in a Combined Flanker and Garner Conflict Task

Several studies demonstrated that visual filtering mechanisms might underlie both conflict resolution of the Flanker conflict and the control of the Garner effect. However, it remains unclear whether the mechanisms involved in the processing of both effects depend on similar filter mechanisms, such that especially the Garner effect is able to modulate filtering needs in the Flanker conflict. In the present experiment twenty-four subjects participated in a combined Garner and Flanker task during two runs of functional magnetic resonance imaging (fMRI) recordings. Behavioral data showed a significant Flanker but no Garner effect. A run-wise analysis, however, revealed a Flanker effect in the Garner filtering condition in the first experimental run, while we found a Flanker effect in the Garner baseline condition in the second experimental run. The fMRI data revealed a fronto-parietal network involved in the processing of both types of effects. Flanker interference was associated with activity in the inferior frontal gyrus, the anterior cingulate cortex, the precuneus as well as the inferior (IPL) and superior parietal lobule (SPL). Garner interference was associated with activation in middle frontal and middle temporal gyrus, the lingual gyrus as well as the IPL and SPL. Interaction analyses between the Garner and the Flanker effect additionally revealed differences between the two experimental runs. In the first experimental run, activity specifically related to the interaction of effects was found in frontal and parietal regions, while in the second run we found activity in the hippocampus, the parahippocampal cortex and the basal ganglia. This shift in activity for the interaction effects might be associated with a task-related learning process to control filtering demands. Especially perceptual learning mechanisms might play a crucial role in the present Flanker and Garner task design and, therefore, increased performance in the second experimental run could be the reason for the lack of behavioral Garner interference on the level of the whole experiment.     

Restraint Stress Inhibits Mouse Implantation: Temporal Window and the Involvement of HB-EGF,Estrogen and Progesterone

It is known that psychological stress affects reproduction in women, but it is unknown whether the effect is by impairing implantation. Although studies suggest that long periods of auditory or restraint stress may inhibit implantation in rats and mice, the exact stage of pregnancy at which stress impairs implantation is unclear. Furthermore, whether stress impairs implantation by decreasing the heparin-binding epidermal growth factor-like growth factor (HB-EGF), estrogen and/or progesterone and whether by acting on embryos or on the uterus need further investigations. In this study, a 24-h restraint stress was initiated at 15:30 of day 3 (regimen 1) or at 07:30 (regimen 2) or 15:30 of day 4 (regimen 3) of pregnancy (vaginal plug  =  day 1) to observe effects of restraint stress applied at different peri-implantation stages on implantation. Among the three regimens, whereas regimens 1 and 3 affected neither term pregnancy nor litter size, regimen 2 reduced both. Further observations indicated that regimen 2 of restraint stress also delayed blastocyst hatching and the attachment reaction, decreased serum concentrations of progesterone and estradiol, and down regulated the expression of HB-EGF in both the endometrium and blastocysts. Taken together, the results suggested that restraint stress inhibited mouse implantation in a temporal window-dependent manner and by impairing blastocyst activation and hatching and uterine receptivity via down-regulating HB-EGF, estrogen and progesterone. Thus, the stress applied within the implantation window impaired implantation by acting on both embryos and the uterus.     

Reverse Engineering of Oxygen Transport in the Lung: Adaptation to Changing Demands and Resources through Space-Filling Networks

The space-filling fractal network in the human lung creates a remarkable distribution system for gas exchange. Landmark studies have illuminated how the fractal network guarantees minimum energy dissipation, slows air down with minimum hardware, maximizes the gas- exchange surface area, and creates respiratory flexibility between rest and exercise. In this paper, we investigate how the fractal architecture affects oxygen transport and exchange under varying physiological conditions, with respect to performance metrics not previously studied.We present a renormalization treatment of the diffusion-reaction equation which describes how oxygen concentrations drop in the airways as oxygen crosses the alveolar membrane system. The treatment predicts oxygen currents across the lung at different levels of exercise which agree with measured values within a few percent. The results exhibit wide-ranging adaptation to changing process parameters, including maximum oxygen uptake rate at minimum alveolar membrane permeability, the ability to rapidly switch from a low oxygen uptake rate at rest to high rates at exercise, and the ability to maintain a constant oxygen uptake rate in the event of a change in permeability or surface area. We show that alternative, less than space-filling architectures perform sub-optimally and that optimal performance of the space-filling architecture results from a competition between underexploration and overexploration of the surface by oxygen molecules.     

Multisensory integration of colors and scents: insights from bees and flowers

Karl von Frisch’s studies of bees’ color vision and chemical senses opened a window into the perceptual world of a species other than our own. A century of subsequent research on bees’ visual and olfactory systems has developed along two productive but independent trajectories, leaving the questions of how and why bees use these two senses in concert largely unexplored. Given current interest in multimodal communication and recently discovered interplay between olfaction and vision in humans and Drosophila, understanding multisensory integration in bees is an opportunity to advance knowledge across fields. Using a classic ethological framework, we formulate proximate and ultimate perspectives on bees’ use of multisensory stimuli. We discuss interactions between scent and color in the context of bee cognition and perception, focusing on mechanistic and functional approaches, and we highlight opportunities to further explore the development and evolution of multisensory integration. We argue that although the visual and olfactory worlds of bees are perhaps the best-studied of any non-human species, research focusing on the interactions between these two sensory modalities is vitally needed.     

Multisensory integration: maintaining the perception of synchrony

We are rarely aware of differences in the arrival time of inputs to each of our senses. New research suggests that this is explained by a 'moveable window' for multisensory integration and by a 'temporal ventriloquism' effect.