The effects of task and saliency on latencies for colour and motion processing

In human visual perception, there is evidence that different visual attributes, such as colour, form and motion, have different neural-processing latencies. Specifically, recent studies have suggested that colour changes are processed faster than motion changes. We propose that the processing latencies should not be considered as fixed quantities for different attributes, but instead depend upon attribute salience and the observer's task. We asked observers to respond to high- and low-salience colour and motion changes in three different tasks. The tasks varied from having a strong motor component to having a strong perceptual component. Increasing salience led to shorter processing times in all three tasks. We also found an interaction between task and attribute: motion was processed more quickly in reaction-time tasks, whereas colour was processed more quickly in more perceptual tasks. Our results caution against making direct comparisons between latencies for processing different visual attributes without equating salience or considering task effects. More-salient attributes are processed faster than less-salient ones, and attributes that are critical for the task are also processed more quickly.     

Perceptual learning reduces interneuronal correlations in macaque visual cortex

Responses of neurons in early visual cortex change little with training and appear insufficient to account for perceptual learning. Behavioral performance, however, relies on population activity, and the accuracy of a population code is constrained by correlated noise among neurons. We tested whether training changes interneuronal correlations in the dorsal medial superior temporal area, which is involved in multisensory heading perception. Pairs of single units were recorded simultaneously in two groups of subjects: animals trained extensively in a heading discrimination task, and "naive" animals that performed a passive fixation task. Correlated noise was significantly weaker in trained versus naive animals, which might be expected to improve coding efficiency. However, we show that the observed uniform reduction in noise correlations leads to little change in population coding efficiency when all neurons are decoded. Thus, global changes in correlated noise among sensory neurons may be insufficient to account for perceptual learning.     

Spatial heterogeneity in the perception of face and form attributes

The identity of an object is a fixed property, independent of where it appears, and an effective visual system should capture this invariance [1-3]. However, we now report that the perceived gender of a face is strongly biased toward male or female at different locations in the visual field. The spatial pattern of these biases was distinctive and stable for each individual. Identical neutral faces looked different when they were presented simultaneously at locations maximally biased to opposite genders. A similar effect was observed for perceived age of faces. We measured the magnitude of this perceptual heterogeneity for four other visual judgments: perceived aspect ratio, orientation discrimination, spatial-frequency discrimination, and color discrimination. The effect was sizeable for the aspect ratio task but substantially smaller for the other three tasks. We also evaluated perceptual heterogeneity for facial gender and orientation tasks at different spatial scales. Strong heterogeneity was observed even for the orientation task when tested at small scales. We suggest that perceptual heterogeneity is a general property of visual perception and results from undersampling of the visual signal at spatial scales that are small relative to the size of the receptive fields associated with each visual attribute.     

Less is more: expectation sharpens representations in the primary visual cortex

Prior expectations about the visual world facilitate perception by allowing us to quickly deduce plausible interpretations from noisy and ambiguous data. The neural mechanisms of this facilitation remain largely unclear. Here, we used functional magnetic resonance imaging (fMRI) and multivariate pattern analysis (MVPA) techniques to measure both the amplitude and representational content of neural activity in the early visual cortex of human volunteers. We find that while perceptual expectation reduces the neural response amplitude in the primary visual cortex (V1), it improves the stimulus representation in this area, as revealed by MVPA. This informational improvement was independent of attentional modulations by task relevance. Finally, the informational improvement in V1 correlated with subjects' behavioral improvement when the expected stimulus feature was relevant. These data suggest that expectation facilitates perception by sharpening sensory representations.     

Perceiving what is reachable depends on motor representations: evidence from a transcranial magnetic stimulation study

Background

Visually determining what is reachable in peripersonal space requires information about the egocentric location of objects but also information about the possibilities of action with the body, which are context dependent. The aim of the present study was to test the role of motor representations in the visual perception of peripersonal space.

Methodology

Seven healthy participants underwent a TMS study while performing a right-left decision (control) task or perceptually judging whether a visual target was reachable or not with their right hand. An actual grasping movement task was also included. Single pulse TMS was delivered 80% of the trials on the left motor and premotor cortex and on a control site (the temporo-occipital area), at 90% of the resting motor threshold and at different SOA conditions (50ms, 100ms, 200ms or 300ms).

Principal Findings

Results showed a facilitation effect of the TMS on reaction times in all tasks, whatever the site stimulated and until 200ms after stimulus presentation. However, the facilitation effect was on average 34ms lower when stimulating the motor cortex in the perceptual judgement task, especially for stimuli located at the boundary of peripersonal space.

Conclusion

This study provides the first evidence that brain motor area participate in the visual determination of what is reachable. We discuss how motor representations may feed the perceptual system with information about possible interactions with nearby objects and thus may contribute to the perception of the boundary of peripersonal space.     

Corticomuscular coherence with and without additional task in the elderly

Aging and dual-task paradigms often degrade fine motor performance, but the effects of aging on correlated neural activity between motor cortex and contracting muscle are unknown during dual tasks requiring fine motor performance. The purpose of this study was to compare corticomuscular coherence between young and elderly adults during the performance of a unilateral fine motor task and concurrent motor and cognitive tasks. Twenty-nine healthy young (18-38 yr) and elderly (61-75 yr) adults performed unilateral motor, bilateral motor, concurrent motor-cognitive, and cognitive tasks. Peak corticomuscular coherence between the electroencephalogram from the primary motor cortex and surface electromyogram from the first dorsal interosseous muscle was compared during steady abduction of the index finger with visual feedback. In the alpha-band (8-14 Hz), corticomuscular coherence was greater in elderly than young adults especially during the motor-cognitive task. The beta-band (15-32 Hz) corticomuscular coherence was higher in elderly than young adults across unilateral motor and dual tasks. In addition, beta-band corticomuscular coherence in the motor-cognitive task was negatively correlated with motor output error across young but not elderly adults. The results suggest that 1) corticomuscular coherence was increased in senior age with a greater influence of an additional cognitive task in the alpha-band and 2) individuals with greater beta-band corticomuscular coherence may exhibit more accurate motor output in young, but not elderly adults, during steady contraction with visual feedback.     

Motor Cost Influences Perceptual Decisions

Perceptual decision making has been widely studied using tasks in which subjects are asked to discriminate a visual stimulus and instructed to report their decision with a movement. In these studies, performance is measured by assessing the accuracy of the participants’ choices as a function of the ambiguity of the visual stimulus. Typically, the reporting movement is considered as a mere means of reporting the decision with no influence on the decision-making process. However, recent studies have shown that even subtle differences of biomechanical costs between movements may influence how we select between them. Here we investigated whether this purely motor cost could also influence decisions in a perceptual discrimination task in detriment of accuracy. In other words, are perceptual decisions only dependent on the visual stimulus and entirely orthogonal to motor costs? Here we show the results of a psychophysical experiment in which human subjects were presented with a random dot motion discrimination task and asked to report the perceived motion direction using movements of different biomechanical cost. We found that the pattern of decisions exhibited a significant bias towards the movement of lower cost, even when this bias reduced performance accuracy. This strongly suggests that motor costs influence decision making in visual discrimination tasks for which its contribution is neither instructed nor beneficial.     

Neuronal mechanisms for visual stability: progress and problems

How our vision remains stable in spite of the interruptions produced by saccadic eye movements has been a repeatedly revisited perceptual puzzle. The major hypothesis is that a corollary discharge (CD) or efference copy signal provides information that the eye has moved, and this information is used to compensate for the motion. There has been progress in the search for neuronal correlates of such a CD in the monkey brain, the best animal model of the human visual system. In this article, we briefly summarize the evidence for a CD pathway to frontal cortex, and then consider four questions on the relation of neuronal mechanisms in the monkey brain to stable visual perception. First, how can we determine whether the neuronal activity is related to stable visual perception? Second, is the activity a possible neuronal correlate of the proposed transsaccadic memory hypothesis of visual stability? Third, are the neuronal mechanisms modified by visual attention and does our perceived visual stability actually result from neuronal mechanisms related primarily to the central visual field? Fourth, does the pathway from superior colliculus through the pulvinar nucleus to visual cortex contribute to visual stability through suppression of the visual blur produced by saccades?     

Does Perceptual Learning Suffer from Retrograde Interference?

In motor learning, training a task B can disrupt improvements of performance of a previously learned task A, indicating that learning needs consolidation. An influential study suggested that this is the case also for visual perceptual learning. Using the same paradigm, we failed to reproduce these results. Further experiments with bisection stimuli also showed no retrograde disruption from task B on task A. Hence, for the tasks tested here, perceptual learning does not suffer from retrograde interference.     

Electrophysiological evidence for right frontal lobe dominance in spatial visuomotor learning

Slow negative potential shifts were recorded together with the error made in motor performance when two different groups of 14 students tracked visual stimuli with their right hand. Various visuomotor tasks were compared. A tracking task (T) in which subjects had to track the stimulus directly, showed no decrease of error in motor performance during the experiment. In a distorted tracking task (DT) a continuous horizontal distortion of the visual feedback had to be compensated. The additional demands of this task required visuomotor learning. Another learning condition was a mirrored-tracking task (horizontally inverted tracking, hIT), i.e. an elementary function, such as the concept of changing left and right was interposed between perception and action. In addition, subjects performed a no-tracking control task (NT) in which they started the visual stimulus without tracking it. A slow negative potential shift was associated with the visuomotor performance (TP: tracking potential). In the learning tasks (DT and hIT) this negativity was significantly enhanced over the anterior midline and in hIT frontally and precentrally over both hemispheres. Comparing hIT and T for every subject, the enhancement of the tracking potential in hIT was correlated with the success in motor learning in frontomedial and bilaterally in frontolateral recordings (r = 0.81-0.88). However, comparing DT and T, such a correlation was only found in frontomedial and right frontolateral electrodes (r = 0.5-0.61), but not at the left frontolateral electrode. These experiments are consistent with previous findings and give further neurophysiological evidence for frontal lobe activity in visuomotor learning. The hemispherical asymmetry is discussed in respect to hemispherical specialization (right frontal lobe dominance in spatial visuomotor learning).     

A common neuronal code for perceptual processes in visual cortex? Comparing choice and attentional correlates in V5/MT.

In the past two decades, sensory neuroscience has moved from describing response properties to external stimuli in cerebral cortex to establishing connections between neuronal activity and sensory perception. The seminal studies by Newsome, Movshon and colleagues in the awake behaving macaque firmly link single cells in extrastriate area V5/MT and perception of motion. A decade later, extrastriate visual cortex appears awash with neuronal correlates for many different perceptual tasks. Examples are attentional signals, choice signals for ambiguous images, correlates for binocular rivalry, stereo and shape perception, and so on. These diverse paradigms are aimed at elucidating the neuronal code for perceptual processes, but it has been little studied how they directly compare or even interact. In this paper, I explore to what degree the measured neuronal signals in V5/MT for choice and attentional paradigms might reflect a common neuronal mechanism for visual perception.     

Cue integration in categorical tasks: insights from audio-visual speech perception

Previous cue integration studies have examined continuous perceptual dimensions (e.g., size) and have shown that human cue integration is well described by a normative model in which cues are weighted in proportion to their sensory reliability, as estimated from single-cue performance. However, this normative model may not be applicable to categorical perceptual dimensions (e.g., phonemes). In tasks defined over categorical perceptual dimensions, optimal cue weights should depend not only on the sensory variance affecting the perception of each cue but also on the environmental variance inherent in each task-relevant category. Here, we present a computational and experimental investigation of cue integration in a categorical audio-visual (articulatory) speech perception task. Our results show that human performance during audio-visual phonemic labeling is qualitatively consistent with the behavior of a Bayes-optimal observer. Specifically, we show that the participants in our task are sensitive, on a trial-by-trial basis, to the sensory uncertainty associated with the auditory and visual cues, during phonemic categorization. In addition, we show that while sensory uncertainty is a significant factor in determining cue weights, it is not the only one and participants' performance is consistent with an optimal model in which environmental, within category variability also plays a role in determining cue weights. Furthermore, we show that in our task, the sensory variability affecting the visual modality during cue-combination is not well estimated from single-cue performance, but can be estimated from multi-cue performance. The findings and computational principles described here represent a principled first step towards characterizing the mechanisms underlying human cue integration in categorical tasks.     

Autism-Specific Covariation in Perceptual Performances: “g” or “p” Factor?

Background

Autistic perception is characterized by atypical and sometimes exceptional performance in several low- (e.g., discrimination) and mid-level (e.g., pattern matching) tasks in both visual and auditory domains. A factor that specifically affects perceptive abilities in autistic individuals should manifest as an autism-specific association between perceptual tasks. The first purpose of this study was to explore how perceptual performances are associated within or across processing levels and/or modalities. The second purpose was to determine if general intelligence, the major factor that accounts for covariation in task performances in non-autistic individuals, equally controls perceptual abilities in autistic individuals.

Methods

We asked 46 autistic individuals and 46 typically developing controls to perform four tasks measuring low- or mid-level visual or auditory processing. Intelligence was measured with the Wechsler''s Intelligence Scale (FSIQ) and Raven Progressive Matrices (RPM). We conducted linear regression models to compare task performances between groups and patterns of covariation between tasks. The addition of either Wechsler''s FSIQ or RPM in the regression models controlled for the effects of intelligence.

Results

In typically developing individuals, most perceptual tasks were associated with intelligence measured either by RPM or Wechsler FSIQ. The residual covariation between unimodal tasks, i.e. covariation not explained by intelligence, could be explained by a modality-specific factor. In the autistic group, residual covariation revealed the presence of a plurimodal factor specific to autism.

Conclusions

Autistic individuals show exceptional performance in some perceptual tasks. Here, we demonstrate the existence of specific, plurimodal covariation that does not dependent on general intelligence (or “g” factor). Instead, this residual covariation is accounted for by a common perceptual process (or “p” factor), which may drive perceptual abilities differently in autistic and non-autistic individuals.     

Multivariate EEG spectral analysis evidences the functional link between motor and visual cortex during integrative sensorimotor tasks

The identification of the networks connecting brain areas and the understanding of their role in executing complex tasks is a crucial issue in cognitive neuroscience. In this study, specific visuomotor tasks were devised to reveal the functional network underlying the cooperation process between visual and motor regions. Electroencephalography (EEG) data were recorded from twelve healthy subjects during a combined visuomotor task, which integrated precise grip motor commands with sensory visual feedback (VM). This condition was compared with control tasks involving pure motor action (M), pure visual perception (V) and visuomotor performance without feedback (V + M). Multivariate parametric cross-spectral analysis was applied to ten EEG derivations in each subject to assess changes in the oscillatory activity of the involved cortical regions and quantify their coupling. Spectral decomposition was applied to precisely and objectively determine the power associated with each oscillatory component of the spectrum, while surrogate data analysis was performed to assess the statistical significance of estimated coherence values. A significant decrease of the alpha and/or beta power in EEG spectra with respect to rest values was assumed as indicative of specific cortical area activation during task execution. Indeed alpha band coherence increased in proximity of task-involved areas, while it was suppressed or remained unchanged in other regions, suggesting the activation of a specific network for each task. According to our coherence analysis, a direct link between visual and motor areas was activated during V + M and VM tasks. The effect of visual feedback was evident in the beta band, where the increase of coherence was observed only during the VM task. Multivariate analysis suggested the presence of a functional link between motor and visual cortex subserving sensorimotor integration. Furthermore, network activation was related to the sum of single task (M and V) local effects in the alpha band, and to the presence of visual feedback in the beta band.     

Beta,but Not Gamma,Band Oscillations Index Visual Form-Motion Integration

Electrophysiological oscillations in different frequency bands co-occur with perceptual, motor and cognitive processes but their function and respective contributions to these processes need further investigations. Here, we recorded MEG signals and seek for percept related modulations of alpha, beta and gamma band activity during a perceptual form/motion integration task. Participants reported their bound or unbound perception of ambiguously moving displays that could either be seen as a whole square-like shape moving along a Lissajou''s figure (bound percept) or as pairs of bars oscillating independently along cardinal axes (unbound percept). We found that beta (15–25 Hz), but not gamma (55–85 Hz) oscillations, index perceptual states at the individual and group level. The gamma band activity found in the occipital lobe, although significantly higher during visual stimulation than during base line, is similar in all perceptual states. Similarly, decreased alpha activity during visual stimulation is not different for the different percepts. Trial-by-trial classification of perceptual reports based on beta band oscillations was significant in most observers, further supporting the view that modulation of beta power reliably index perceptual integration of form/motion stimuli, even at the individual level.     

Action evaluation is modulated dominantly by internal sensorimotor information and partly by noncausal external cue

Previous studies demonstrated that human motor actions are not always monitored by perceptual awareness and that implicit motor control plays a key role in performing actions. In addition, appropriate evaluation of our own motor behavior is vital for human life. Here we combined a reaching task with a visual backward masking paradigm to induce an implicit motor response that is congruent or incongruent with the visual perception. We used this to investigate (i) how we evaluate such implicit motor response that could be inconsistent with perceptual awareness and (ii) the possible contributions of reaching error, external visual cues, and internal sensorimotor information to this evaluation. Participants were instructed, after each trial, to rate their own reaching performance on a 5-point scale (i.e., smooth-clumsy). They also needed to identify a color presented at a fixation point that could be changed just after the reaching start. The color was linked to the prime-mask congruency (i.e., congruent-green, incongruent-blue) in the practice phase, and then inconsistent pairs (congruent-blue or incongruent-green) were introduced in the test phase. We found early trajectory deviations induced by the invisible prime stimulus, and such implicit motor responses are significantly correlated with the action evaluation score. The results suggest the "conscious" action evaluation is properly monitoring online sensory outcomes derived by implicit motor control. Furthermore, statistical path analyses showed that internal sensorimotor information from the motor behavior modulated by the invisible prime was the predominant cue for the action evaluation, while the color-cue association learned in the practice phase in some cases biases the action evaluation in the test phase.     

To Perceive or Not Perceive: The Role of Gamma-band Activity in Signaling Object Percepts

The relation of gamma-band synchrony to holistic perception in which concerns the effects of sensory processing, high level perceptual gestalt formation, motor planning and response is still controversial. To provide a more direct link to emergent perceptual states we have used holistic EEG/ERP paradigms where the moment of perceptual “discovery” of a global pattern was variable. Using a rapid visual presentation of short-lived Mooney objects we found an increase of gamma-band activity locked to perceptual events. Additional experiments using dynamic Mooney stimuli showed that gamma activity increases well before the report of an emergent holistic percept. To confirm these findings in a data driven manner we have further used a support vector machine classification approach to distinguish between perceptual vs. non perceptual states, based on time-frequency features. Sensitivity, specificity and accuracy were all above 95%. Modulations in the 30–75 Hz range were larger for perception states. Interestingly, phase synchrony was larger for perception states for high frequency bands. By focusing on global gestalt mechanisms instead of local processing we conclude that gamma-band activity and synchrony provide a signature of holistic perceptual states of variable onset, which are separable from sensory and motor processing.     

Fooling the Eyes: The Influence of a Sound-Induced Visual Motion Illusion on Eye Movements

The question of whether perceptual illusions influence eye movements is critical for the long-standing debate regarding the separation between action and perception. To test the role of auditory context on a visual illusion and on eye movements, we took advantage of the fact that the presence of an auditory cue can successfully modulate illusory motion perception of an otherwise static flickering object (sound-induced visual motion effect). We found that illusory motion perception modulated by an auditory context consistently affected saccadic eye movements. Specifically, the landing positions of saccades performed towards flickering static bars in the periphery were biased in the direction of illusory motion. Moreover, the magnitude of this bias was strongly correlated with the effect size of the perceptual illusion. These results show that both an audio-visual and a purely visual illusion can significantly affect visuo-motor behavior. Our findings are consistent with arguments for a tight link between perception and action in localization tasks.     

What we see is how we are: new paradigms in visual research

As most sensory modalities, the visual system needs to deal with very fast changes in the environment. Instead of processing all sensory stimuli, the brain is able to construct a perceptual experience by combining selected sensory input with an ongoing internal activity. Thus, the study of visual perception needs to be approached by examining not only the physical properties of stimuli, but also the brain's ongoing dynamical states onto which these perturbations are imposed. At least three different models account for this internal dynamics. One model is based on cardinal cells where the activity of few cells by itself constitutes the neuronal correlate of perception, while a second model is based on a population coding that states that the neuronal correlate of perception requires distributed activity throughout many areas of the brain. A third proposition, known as the temporal correlation hypothesis states that the distributed neuronal populations that correlate with perception, are also defined by synchronization of the activity on a millisecond time scale. This would serve to encode contextual information by defining relations between the features of visual objects. If temporal properties of neural activity are important to establish the neural mechanisms of perception, then the study of appropriate dynamical stimuli should be instrumental to determine how these systems operate. The use of natural stimuli and natural behaviors such as free viewing, which features fast changes of internal brain states as seen by motor markers, is proposed as a new experimental paradigm to study visual perception.     

Reducing Bias in Auditory Duration Reproduction by Integrating the Reproduced Signal

Duration estimation is known to be far from veridical and to differ for sensory estimates and motor reproduction. To investigate how these differential estimates are integrated for estimating or reproducing a duration and to examine sensorimotor biases in duration comparison and reproduction tasks, we compared estimation biases and variances among three different duration estimation tasks: perceptual comparison, motor reproduction, and auditory reproduction (i.e. a combined perceptual-motor task). We found consistent overestimation in both motor and perceptual-motor auditory reproduction tasks, and the least overestimation in the comparison task. More interestingly, compared to pure motor reproduction, the overestimation bias was reduced in the auditory reproduction task, due to the additional reproduced auditory signal. We further manipulated the signal-to-noise ratio (SNR) in the feedback/comparison tones to examine the changes in estimation biases and variances. Considering perceptual and motor biases as two independent components, we applied the reliability-based model, which successfully predicted the biases in auditory reproduction. Our findings thus provide behavioral evidence of how the brain combines motor and perceptual information together to reduce duration estimation biases and improve estimation reliability.