Adaptation to visual feedback delay influences visuomotor learning

Computational theory of motor control suggests that the brain continuously monitors motor commands, to predict their sensory consequences before actual sensory feedback becomes available. Such prediction error is a driving force of motor learning, and therefore appropriate associations between motor commands and delayed sensory feedback signals are crucial. Indeed, artificially introduced delays in visual feedback have been reported to degrade motor learning. However, considering our perceptual ability to causally bind our own actions with sensory feedback, demonstrated by the decrease in the perceived time delay following repeated exposure to an artificial delay, we hypothesized that such perceptual binding might alleviate deficits of motor learning associated with delayed visual feedback. Here, we evaluated this hypothesis by investigating the ability of human participants to adapt their reaching movements in response to a novel visuomotor environment with 3 visual feedback conditions--no-delay, sudden-delay, and adapted-delay. To introduce novelty into the trials, the cursor position, which originally indicated the hand position in baseline trials, was rotated around the starting position. In contrast to the no-delay condition, a 200-ms delay was artificially introduced between the cursor and hand positions during the presence of visual rotation (sudden-delay condition), or before the application of visual rotation (adapted-delay condition). We compared the learning rate (representing how the movement error modifies the movement direction in the subsequent trial) between the 3 conditions. In comparison with the no-delay condition, the learning rate was significantly degraded for the sudden-delay condition. However, this degradation was significantly alleviated by prior exposure to the delay (adapted-delay condition). Our data indicate the importance of appropriate temporal associations between motor commands and sensory feedback in visuomotor learning. Moreover, they suggest that the brain is able to account for such temporal associations in a flexible manner.     

The Effect of Optokinetic Stimulation on Perceptual and Postural Symptoms in Visual Vestibular Mismatch Patients

BackgroundVestibular patients occasionally report aggravation or triggering of their symptoms by visual stimuli, which is called visual vestibular mismatch (VVM). These patients therefore experience discomfort, disorientation, dizziness and postural unsteadiness.ObjectiveFirstly, we aimed to get a better insight in the underlying mechanism of VVM by examining perceptual and postural symptoms. Secondly, we wanted to investigate whether roll-motion is a necessary trait to evoke these symptoms or whether a complex but stationary visual pattern equally provokes them.MethodsNine VVM patients and healthy matched control group were examined by exposing both groups to a stationary stimulus as well as an optokinetic stimulus rotating around the naso-occipital axis for a prolonged period of time. Subjective visual vertical (SVV) measurements, posturography and relevant questionnaires were assessed.ResultsNo significant differences between both groups were found for SVV measurements. Patients always swayed more and reported more symptoms than healthy controls. Prolonged exposure to roll-motion caused in patients and controls an increase in postural sway and symptoms. However, only VVM patients reported significantly more symptoms after prolonged exposure to the optokinetic stimulus compared to scores after exposure to a stationary stimulus.ConclusionsVVM patients differ from healthy controls in postural and subjective symptoms and motion is a crucial factor in provoking these symptoms. A possible explanation could be a central visual-vestibular integration deficit, which has implications for diagnostics and clinical rehabilitation purposes. Future research should focus on the underlying central mechanism of VVM and the effectiveness of optokinetic stimulation in resolving it.     

Perceptual rivalry: reflexes reveal the gradual nature of visual awareness

Rivalry is a common tool to probe visual awareness: a constant physical stimulus evokes multiple, distinct perceptual interpretations ("percepts") that alternate over time. Percepts are typically described as mutually exclusive, suggesting that a discrete (all-or-none) process underlies changes in visual awareness. Here we follow two strategies to address whether rivalry is an all-or-none process: first, we introduce two reflexes as objective measures of rivalry, pupil dilation and optokinetic nystagmus (OKN); second, we use a continuous input device (analog joystick) to allow observers a gradual subjective report. We find that the "reflexes" reflect the percept rather than the physical stimulus. Both reflexes show a gradual dependence on the time relative to perceptual transitions. Similarly, observers' joystick deflections, which are highly correlated with the reflex measures, indicate gradual transitions. Physically simulating wave-like transitions between percepts suggest piece-meal rivalry (i.e., different regions of space belonging to distinct percepts) as one possible explanation for the gradual transitions. Furthermore, the reflexes show that dominance durations depend on whether or not the percept is actively reported. In addition, reflexes respond to transitions with shorter latencies than the subjective report and show an abundance of short dominance durations. This failure to report fast changes in dominance may result from limited access of introspection to rivalry dynamics. In sum, reflexes reveal that rivalry is a gradual process, rivalry's dynamics is modulated by the required action (response mode), and that rapid transitions in perceptual dominance can slip away from awareness.     

Source of the eye-movement signal reaching real-motion cells

The stability of visual perception despite eye movements suggests the existence in the visual system of neurons able to recognize whether the movement of a retinal image is due to the actual movement of an object or is self-induced by the ocular movement. We found neurons of this type in several areas of the monkey visual cortex and named them "real-motion" cells. Extracellular recordings were carried out from single neurons of the cortical prestriate area V3A of two awake macaque monkeys. Eighty-seven neurons were studied by comparing their responses during stimulus movement across the stationary receptive field, and receptive-field movement across the stationary stimulus. This visual stimulation was presented against a uniform visual background, in darkness or against a textured background. Neurons which were not real-motion in light (45/87) maintained their behaviour in darkness, while about 40% of real-motion cells lost this behaviour in darkness. Both real-motion and non real-motion cells maintained the same behaviour when tested against a uniform or textured visual background but often, texture increased the difference in the response that real-motion cells showed between stimulus and eye movement. These data suggest that the eye-movement signal which reaches real-motion cells and is responsible for their behaviour may be either retinal or extraretinal in nature. This double innervation is in good agreement with perceptual phenomena related to the detection of movement in the visual field.     

Perceptual compression of space through position integration

The mechanism of positional localization has recently been debated due to interest in the flash-lag effect, which occurs when a briefly flashed stationary stimulus is perceived to lag behind a spatially aligned moving stimulus. Here we report positional localization observed at motion offsets as well as at onsets. In the 'flash-lead' effect, a moving object is perceived to be behind a spatially concurrent stationary flash before the two disappear. With 'reverse-repmo', subjects mis-localize the final position of a moving bar in the direction opposite to the trajectory of motion. Finally, we demonstrate that simultaneous onset and offset effects lead to a perceived compression of visual space. By characterizing illusory effects observed at motion offsets as well as at onsets, we provide evidence that the perceived position of a moving object is the result of an averaging process over a short time period, weighted towards the most recent positions. Our account explains a variety of motion illusions, including the compression of moving shapes when viewed through apertures.     

Reinstatement of short-latency responses after asymptotic Pavlovian conditioning training by the presentation of an extraneous stimulus

The purpose of this study was to examine whether the progressive disappearance of short-latency conditioned responses, or inhibition of delay, observed in Pavlovian conditioning with long inter-stimulus intervals, could be reverted by the presentation of a novel stimulus. In one experiment, two groups of rabbits received extensive training with a short (250 ms) or a long (1500 ms) tone that overlapped and terminated with a periorbital shock unconditioned stimulus. After training, the presentation of an extraneous stimulus prior to tone onset produced a reinstatement of short latency CRs in the group trained with the long CS, but did not affect CR latency in the group trained with the short CS. This finding is consistent with Pavlov's (1927) view that conditioning with long conditioned stimuli involves the acquisition of response tendencies in the early portion of the stimulus that are subsequently suppressed by the development of an inhibitory process.     

Auditory event-related potentials dissociate early and late memory processes

Event-related potentials (ERPs) to environmental sounds were recorded from 15 young control subjects in an auditory recognition memory task. Subjects listened to a continuous string of binaurally presented sounds, 20% of which were presented once and 80% were repeated. Of the repeated sounds, some repeated immediately after the initial presentation (2 sec; short delay repetition) while others repeated after 2–6 intervening sounds (4–12 sec; long delay repetition). Subjects were instructed to indicate whether they had heard the sounds before by pressing a “yes” or “no” button.The initial stimulus presentation and long delay repetition stimuli generated both an N4 component and a prolonged latency P3 component while the short delay repetition stimuli elicited no N4 component and an earlier latency P3 component. Subjects' responses were faster and more accurate for short delay repetition. All stimuli generated a sustained frontal negative component (SFN). These data indicate that auditory recognition memory for environmental sounds may involve two processes. The P3 generated by both short and long delay repetition stimuli may index activation of a neocortical template matching system. The N4 generated by initial stimulus presentations and long delay repetition is proposed to measure additional activation of limbic memory systems at long retention intervals.     

BOLD Signal in Both Ipsilateral and Contralateral Retinotopic Cortex Modulates with Perceptual Fading

Under conditions of visual fixation, perceptual fading occurs when a stationary object, though present in the world and continually casting light upon the retina, vanishes from visual consciousness. The neural correlates of the consciousness of such an object will presumably modulate in activity with the onset and cessation of perceptual fading.

Method

In order to localize the neural correlates of perceptual fading, a green disk that had been individually set to be equiluminant with the orange background, was presented in one of the four visual quadrants; Subjects indicated with a button press whether or not the disk was subjectively visible as it perceptually faded in and out.

Results

Blood oxygen-level dependent (BOLD) signal in V1 and ventral retinotopic areas V2v and V3v decreases when the disk subjectively disappears, and increases when it subjectively reappears. This effect occurs in early visual areas both ipsilaterally and contralaterally to the fading figure. That is, it occurs regardless of whether the fading stimulus is presented inside or outside of the corresponding portion of visual field. In addition, we find that the microsaccade rate rises before and after perceptual transitions from not seeing to seeing the disk, and decreases before perceptual transitions from seeing to not seeing the disk. These BOLD signal changes could be driven by a global process that operates across contralateral and ipsilateral visual cortex or by a confounding factor, such as microsaccade rate.     

Electrophysiological evidence for right frontal lobe dominance in spatial visuomotor learning

Slow negative potential shifts were recorded together with the error made in motor performance when two different groups of 14 students tracked visual stimuli with their right hand. Various visuomotor tasks were compared. A tracking task (T) in which subjects had to track the stimulus directly, showed no decrease of error in motor performance during the experiment. In a distorted tracking task (DT) a continuous horizontal distortion of the visual feedback had to be compensated. The additional demands of this task required visuomotor learning. Another learning condition was a mirrored-tracking task (horizontally inverted tracking, hIT), i.e. an elementary function, such as the concept of changing left and right was interposed between perception and action. In addition, subjects performed a no-tracking control task (NT) in which they started the visual stimulus without tracking it. A slow negative potential shift was associated with the visuomotor performance (TP: tracking potential). In the learning tasks (DT and hIT) this negativity was significantly enhanced over the anterior midline and in hIT frontally and precentrally over both hemispheres. Comparing hIT and T for every subject, the enhancement of the tracking potential in hIT was correlated with the success in motor learning in frontomedial and bilaterally in frontolateral recordings (r = 0.81-0.88). However, comparing DT and T, such a correlation was only found in frontomedial and right frontolateral electrodes (r = 0.5-0.61), but not at the left frontolateral electrode. These experiments are consistent with previous findings and give further neurophysiological evidence for frontal lobe activity in visuomotor learning. The hemispherical asymmetry is discussed in respect to hemispherical specialization (right frontal lobe dominance in spatial visuomotor learning).     

Dynamic perceptual changes in audiovisual simultaneity

Background

The timing at which sensory input reaches the level of conscious perception is an intriguing question still awaiting an answer. It is often assumed that both visual and auditory percepts have a modality specific processing delay and their difference determines perceptual temporal offset.

Methodology/Principal Findings

Here, we show that the perception of audiovisual simultaneity can change flexibly and fluctuates over a short period of time while subjects observe a constant stimulus. We investigated the mechanisms underlying the spontaneous alternations in this audiovisual illusion and found that attention plays a crucial role. When attention was distracted from the stimulus, the perceptual transitions disappeared. When attention was directed to a visual event, the perceived timing of an auditory event was attracted towards that event.

Conclusions/Significance

This multistable display illustrates how flexible perceived timing can be, and at the same time offers a paradigm to dissociate perceptual from stimulus-driven factors in crossmodal feature binding. Our findings suggest that the perception of crossmodal synchrony depends on perceptual binding of audiovisual stimuli as a common event.     

Action without awareness: reaching to an object you do not remember seeing

Background

Previous work by our group has shown that the scaling of reach trajectories to target size is independent of obligatory awareness of that target property and that “action without awareness” can persist for up to 2000 ms of visual delay. In the present investigation we sought to determine if the ability to scale reaching trajectories to target size following a delay is related to the pre-computing of movement parameters during initial stimulus presentation or the maintenance of a sensory (i.e., visual) representation for on-demand response parameterization.

Methodology/Principal Findings

Participants completed immediate or delayed (i.e., 2000 ms) perceptual reports and reaching responses to different sized targets under non-masked and masked target conditions. For the reaching task, the limb associated with a trial (i.e., left or right) was not specified until the time of response cuing: a manipulation that prevented participants from pre-computing the effector-related parameters of their response. In terms of the immediate and delayed perceptual tasks, target size was accurately reported during non-masked trials; however, for masked trials only a chance level of accuracy was observed. For the immediate and delayed reaching tasks, movement time as well as other temporal kinematic measures (e.g., times to peak acceleration, velocity and deceleration) increased in relation to decreasing target size across non-masked and masked trials.

Conclusions/Significance

Our results demonstrate that speed-accuracy relations were observed regardless of whether participants were aware (i.e., non-masked trials) or unaware (i.e., masked trials) of target size. Moreover, the equivalent scaling of immediate and delayed reaches during masked trials indicates that a persistent sensory-based representation supports the unconscious and metrical scaling of memory-guided reaching.     

Dopamine agonists and antagonists can produce an attenuation of response bias in a temporal discrimination task depending on discriminability of target duration

The current study examined the effects of the D2 agonist (quinpirole) and D2 antagonist (eticlopride) on temporal discrimination performance in a conditional discrimination task (Experiment I) and a delayed conditional discrimination task (Experiment II). In both experiments rats discriminated between a scheduled stimulus duration of 3 s versus 9 s. Consistent with previous reports, overall discrimination performance decreased in a dose-dependent manner with both drugs. Changes in response bias (the tendency to choose-short or choose-long irrespective of actual stimulus duration), however, were best characterized in terms of both drugs tending to attenuate the bias effects normally observed during baseline drug-free performance. Specifically, the 'choose-short' bias observed in Experiment I and at a relatively short, 0.1 s, delay in Experiment II became less extreme with increasing doses. In addition, the 'choose-long' bias observed at a relatively long, 6 s, delay in Experiment II also became less extreme with increasing doses. Thus, whether there was an apparent shift from a short response bias to long, or vice versa, was the product of the delay interval between stimulus presentation and choice rather than whether the drug in question was a D2 agonist or antagonist. Such an attenuation of bias may have arisen because of subjects confounding the delay interval with the actual discriminative stimulus duration.     

Perceptual Grouping Enhances Visual Plasticity

Visual perceptual learning, a manifestation of neural plasticity, refers to improvements in performance on a visual task achieved by training. Attention is known to play an important role in perceptual learning, given that the observer''s discriminative ability improves only for those stimulus feature that are attended. However, the distribution of attention can be severely constrained by perceptual grouping, a process whereby the visual system organizes the initial retinal input into candidate objects. Taken together, these two pieces of evidence suggest the interesting possibility that perceptual grouping might also affect perceptual learning, either directly or via attentional mechanisms. To address this issue, we conducted two experiments. During the training phase, participants attended to the contrast of the task-relevant stimulus (oriented grating), while two similar task-irrelevant stimuli were presented in the adjacent positions. One of the two flanking stimuli was perceptually grouped with the attended stimulus as a consequence of its similar orientation (Experiment 1) or because it was part of the same perceptual object (Experiment 2). A test phase followed the training phase at each location. Compared to the task-irrelevant no-grouping stimulus, orientation discrimination improved at the attended location. Critically, a perceptual learning effect equivalent to the one observed for the attended location also emerged for the task-irrelevant grouping stimulus, indicating that perceptual grouping induced a transfer of learning to the stimulus (or feature) being perceptually grouped with the task-relevant one. Our findings indicate that no voluntary effort to direct attention to the grouping stimulus or feature is necessary to enhance visual plasticity.     

Dissociable Perceptual Effects of Visual Adaptation

Neurons in the visual cortex are responsive to the presentation of oriented and curved line segments, which are thought to act as primitives for the visual processing of shapes and objects. Prolonged adaptation to such stimuli gives rise to two related perceptual effects: a slow change in the appearance of the adapting stimulus (perceptual drift), and the distortion of subsequently presented test stimuli (adaptational aftereffects). Here we used a psychophysical nulling technique to dissociate and quantify these two classical observations in order to examine their underlying mechanisms and their relationship to one another. In agreement with previous work, we found that during adaptation horizontal and vertical straight lines serve as attractors for perceived orientation and curvature. However, the rate of perceptual drift for different stimuli was not predictive of the corresponding aftereffect magnitudes, indicating that the two perceptual effects are governed by distinct neural processes. Finally, the rate of perceptual drift for curved line segments did not depend on the spatial scale of the stimulus, suggesting that its mechanisms lie outside strictly retinotopic processing stages. These findings provide new evidence that the visual system relies on statistically salient intrinsic reference stimuli for the processing of visual patterns, and point to perceptual drift as an experimental window for studying the mechanisms of visual perception.     

Perceptual organization at attended and unattended locations

This study examined the effects of attention on forming perceptual units by proximity grouping and by uniform connectedness (UC). In Experiment 1 a row of three global letters defined by either proximity or UC was presented at the center of the visual field. Participants were asked to identify the letter in the middle of stimulus arrays while ignoring the flankers. The stimulus onset asynchrony (SOA) between stimulus arrays and masks varied between 180 and 500 ms. We found that responses to targets defined by proximity grouping were slower than to those defined by UC at median SOAs but there were no differences at short or long SOAs. Incongruent flankers slowed responses to targets and this flanker compatibility effect was larger for UC than for proximity-defined flankers. Experiment 2 examined the effects of spatial precueing on discrimination responses to proximity- and UC-defined targets. The advantage for targets defined by UC over targets defined by proximity grouping was greater at uncued relative to cued locations. The results suggest that the advantage for UC over proximity grouping in forming perceptual units is contingent on the stimuli not being fully attended, and that paying attention to the stimuli differentially benefits proximity grouping.     

Perceptual organization at attended and unattended locations

In order to perceive complex visual scenes, the human perceptual system has to organize discrete enti-ties in the visual field into chunks or perceptual units for higher-level processing. Perceptual organization is governed by Gestalt principles such as proximity, similarity, and continuity[1]. Thus spatially close ob-jects tend to be grouped together, as do elements that are similar to one another. Grouping based on the Ge-stalt laws (particularly proximity) is critical for the perception of…     

Mental fatigue modulates dynamic adaptation to perceptual demand in speeded detection

When stimulus intensity in simple reaction-time tasks randomly varies across trials, detection speed usually improves after a low-intensity trial. With auditory stimuli, this improvement was often found to be asymmetric, being greater on current low-intensity trials. Our study investigated (1) whether asymmetric sequential intensity adaptation also occurs with visual stimuli; (2) whether these adjustments reflect decision-criterion shifts or, rather, a modulation of perceptual sensitivity; and (3) how sequential intensity adaptation and its underlying mechanisms are affected by mental fatigue induced through prolonged performance. In a continuous speeded detection task with randomly alternating high- and low-intensity visual stimuli, the reaction-time benefit after low-intensity trials was greater on subsequent low- than high-intensity trials. This asymmetry, however, only developed with time on task (TOT). Signal-detection analyses showed that the decision criterion transiently became more liberal after a low-intensity trial, whereas observer sensitivity increased when the preceding and current stimulus were of equal intensity. TOT-induced mental fatigue only affected sensitivity, which dropped more on low- than on high-intensity trials. This differential fatigue-related sensitivity decrease selectively enhanced the impact of criterion down-shifts on low-intensity trials, revealing how the interplay of two perceptual mechanisms and their modulation by fatigue combine to produce the observed overall pattern of asymmetric performance adjustments to varying visual intensity in continuous speeded detection. Our results have implications for similar patterns of sequential demand adaptation in other cognitive domains as well as for real-world prolonged detection performance.     

Effects of Context on Visuomotor Interference Depends on the Perspective of Observed Actions

Visuomotor interference occurs when the execution of an action is facilitated by the concurrent observation of the same action and hindered by the concurrent observation of a different action. There is evidence that visuomotor interference can be modulated top-down by higher cognitive functions, depending on whether own performed actions or observed actions are selectively attended. Here, we studied whether these effects of cognitive context on visuomotor interference are also dependent on the point-of-view of the observed action. We employed a delayed go/no-go task known to induce visuomotor interference. Static images of hand gestures in either egocentric or allocentric perspective were presented as “go” stimuli after participants were pre-cued to prepare either a matching (congruent) or non-matching (incongruent) action. Participants performed this task in two different cognitive contexts: In one, they focused on the visual image of the hand gesture shown as the go stimulus (image context), whereas in the other they focused on the hand gesture they performed (action context). We analyzed reaction times to initiate the prepared action upon presentation of the gesture image and found evidence of visuomotor interference in both contexts and for both perspectives. Strikingly, results show that the effect of cognitive context on visuomotor interference also depends on the perspective of observed actions. When focusing on own-actions, visuomotor interference was significantly less for gesture images in allocentric perspective than in egocentric perspective; when focusing on observed actions, visuomotor interference was present regardless of the perspective of the gesture image. Overall these data suggest that visuomotor interference may be modulated by higher cognitive processes, so that when we are specifically attending to our own actions, images depicting others’ actions (allocentric perspective) have much less interference on our own actions.     

Audiovisual integration: an investigation of the "streaming-bouncing" phenomenon

Temporal aspects of the perceptual integration of audiovisual information were investigated by utilizing the visual "streaming-bouncing" phenomenon. When two identical visual objects move towards each other, coincide, and then move away from each other, the objects can either be seen as streaming past one another or bouncing off each other. Although the streaming percept is dominant, the bouncing percept can be induced by presenting an auditory stimulus during the visual coincidence of the moving objects. Here we show that the bounce-inducing effect of the auditory stimulus is paramount when its onset and offset occur in temporal proximity of the onset and offset of the period of visual coincidence of the moving objects. When the duration of the auditory stimulus exceeded this period, visual bouncing disappears. Implications for a temporal window of audiovisual integration and the design of effective audiovisual warning signals are discussed.     

Ganzfeld Stimulation or Sleep Enhance Long Term Motor Memory Consolidation Compared to Normal Viewing in Saccadic Adaptation Paradigm

Adaptation of saccade amplitude in response to intra-saccadic target displacement is a type of implicit motor learning which is required to compensate for physiological changes in saccade performance. Once established trials without intra-saccadic target displacement lead to de-adaptation or extinction, which has been attributed either to extra-retinal mechanisms of spatial constancy or to the influence of the stable visual surroundings. Therefore we investigated whether visual deprivation (“Ganzfeld”-stimulation or sleep) can partially maintain this motor learning compared to free viewing of the natural surroundings. Thirty-five healthy volunteers performed two adaptation blocks of 100 inward adaptation trials – interspersed by an extinction block – which were followed by a two-hour break with or without visual deprivation (VD). Using additional adaptation and extinction blocks short and long (4 weeks) term memory of this implicit motor learning were tested. In the short term, motor memory tested immediately after free viewing was superior to adaptation performance after VD. In the long run, however, effects were opposite: motor memory and relearning of adaptation was superior in the VD conditions. This could imply independent mechanisms that underlie the short-term ability of retrieving learned saccadic gain and its long term consolidation. We suggest that subjects mainly rely on visual cues (i.e., retinal error) in the free viewing condition which makes them prone to changes of the visual stimulus in the extinction block. This indicates the role of a stable visual array for resetting adapted saccade amplitudes. In contrast, visual deprivation (GS and sleep), might train subjects to rely on extra-retinal cues, e.g., efference copy or prediction to remap their internal representations of saccade targets, thus leading to better consolidation of saccadic adaptation.