Human perceptual learning: The effect of pre-exposure schedule depends on task demands

The effects of the pre-exposure schedule (concurrent, intermixed, and blocked) to two similar visual stimuli were assessed in three different tasks. Participants were more accurate identifying one of two pre-exposed stimuli as the target by means of same/different judgments after concurrent than intermixed or blocked pre-exposures. Regardless of pre-exposure schedule, participants were accurate in identifying the same target stimulus in a subsequent multiple choice task. However, the other pre-exposed stimulus was incorrectly chosen as the target in a greater proportion after blocked than intermixed or concurrent pre-exposure. Finally, participants who received the blocked schedule showed a greater ability to construct the target in a puzzle test than those who received a concurrent or intermixed schedule. These results suggest that the effect of pre-exposure schedule may depend on task-specific demands. But all these results might be explained by a selective attention mechanism like that proposed by Gibson (1969) to account for perceptual learning.     

Average Is Optimal: An Inverted-U Relationship between Trial-to-Trial Brain Activity and Behavioral Performance

It is well known that even under identical task conditions, there is a tremendous amount of trial-to-trial variability in both brain activity and behavioral output. Thus far the vast majority of event-related potential (ERP) studies investigating the relationship between trial-to-trial fluctuations in brain activity and behavioral performance have only tested a monotonic relationship between them. However, it was recently found that across-trial variability can correlate with behavioral performance independent of trial-averaged activity. This finding predicts a U- or inverted-U- shaped relationship between trial-to-trial brain activity and behavioral output, depending on whether larger brain variability is associated with better or worse behavior, respectively. Using a visual stimulus detection task, we provide evidence from human electrocorticography (ECoG) for an inverted-U brain-behavior relationship: When the raw fluctuation in broadband ECoG activity is closer to the across-trial mean, hit rate is higher and reaction times faster. Importantly, we show that this relationship is present not only in the post-stimulus task-evoked brain activity, but also in the pre-stimulus spontaneous brain activity, suggesting anticipatory brain dynamics. Our findings are consistent with the presence of stochastic noise in the brain. They further support attractor network theories, which postulate that the brain settles into a more confined state space under task performance, and proximity to the targeted trajectory is associated with better performance.     

Motor learning with unstable neural representations

It is often assumed that learning takes place by changing an otherwise stable neural representation. To test this assumption, we studied changes in the directional tuning of primate motor cortical neurons during reaching movements performed in familiar and novel environments. During the familiar task, tuning curves exhibited slow random drift. During learning of the novel task, random drift was accompanied by systematic shifts of tuning curves. Our analysis suggests that motor learning is based on a surprisingly unstable neural representation. To explain these results, we propose that motor cortex is a redundant neural network, i.e., any single behavior can be realized by multiple configurations of synaptic strengths. We further hypothesize that synaptic modifications underlying learning contain a random component, which causes wandering among synaptic configurations with equivalent behaviors but different neural representations. We use a simple model to explore the implications of these assumptions.     

Contextual cues are not unique for motor learning: Task-dependant switching of feedback controllers

The separation of distinct motor memories by contextual cues is a well known and well studied phenomenon of feedforward human motor control. However, there is no clear evidence of such context-induced separation in feedback control. Here we test both experimentally and computationally if context-dependent switching of feedback controllers is possible in the human motor system. Specifically, we probe visuomotor feedback responses of our human participants in two different tasks—stop and hit—and under two different schedules. The first, blocked schedule, is used to measure the behaviour of stop and hit controllers in isolation, showing that it can only be described by two independent controllers with two different sets of control gains. The second, mixed schedule, is then used to compare how such behaviour evolves when participants regularly switch from one task to the other. Our results support our hypothesis that there is contextual switching of feedback controllers, further extending the accumulating evidence of shared features between feedforward and feedback control.     

Priors Engaged in Long-Latency Responses to Mechanical Perturbations Suggest a Rapid Update in State Estimation

In every motor task, our brain must handle external forces acting on the body. For example, riding a bike on cobblestones or skating on irregular surface requires us to appropriately respond to external perturbations. In these situations, motor predictions cannot help anticipate the motion of the body induced by external factors, and direct use of delayed sensory feedback will tend to generate instability. Here, we show that to solve this problem the motor system uses a rapid sensory prediction to correct the estimated state of the limb. We used a postural task with mechanical perturbations to address whether sensory predictions were engaged in upper-limb corrective movements. Subjects altered their initial motor response in ∼60 ms, depending on the expected perturbation profile, suggesting the use of an internal model, or prior, in this corrective process. Further, we found trial-to-trial changes in corrective responses indicating a rapid update of these perturbation priors. We used a computational model based on Kalman filtering to show that the response modulation was compatible with a rapid correction of the estimated state engaged in the feedback response. Such a process may allow us to handle external disturbances encountered in virtually every physical activity, which is likely an important feature of skilled motor behaviour.     

Intrinsic fluctuations within cortical systems account for intertrial variability in human behavior

The resting brain is not silent, but exhibits organized fluctuations in neuronal activity even in the absence of tasks or stimuli. This intrinsic brain activity persists during task performance and contributes to variability in evoked brain responses. What is unknown is if this intrinsic activity also contributes to variability in behavior. In the current fMRI study, we identify a relationship between human brain activity in the left somatomotor cortex and spontaneous trial-to-trial variability in button press force. We then demonstrate that 74% of this brain-behavior relationship is attributable to ongoing fluctuations in intrinsic activity similar to those observed during resting fixation. In addition to establishing a functional and behavioral significance of intrinsic brain activity, these results lend new insight into the origins of variability in human behavior.     

Dealing with Target Uncertainty in a Reaching Control Interface

Prosthetic devices need to be controlled by their users, typically using physiological signals. People tend to look at objects before reaching for them and we have shown that combining eye movements with other continuous physiological signal sources enhances control. This approach suffers when subjects also look at non-targets, a problem we addressed with a probabilistic mixture over targets where subject gaze information is used to identify target candidates. However, this approach would be ineffective if a user wanted to move towards targets that have not been foveated. Here we evaluated how the accuracy of prior target information influenced decoding accuracy, as the availability of neural control signals was varied. We also considered a mixture model where we assumed that the target may be foveated or, alternatively, that the target may not be foveated. We tested the accuracy of the models at decoding natural reaching data, and also in a closed-loop robot-assisted reaching task. The mixture model worked well in the face of high target uncertainty. Furthermore, errors due to inaccurate target information were reduced by including a generic model that relied on neural signals only.     

Peripheral Attentional Targets under Covert Attention Lead to Paradoxically Enhanced Alpha Desynchronization in Neurofibromatosis Type 1

The limited capacity of the human brain to process the full extent of visual information reaching the visual cortex requires the recruitment of mechanisms of information selection through attention. Neurofibromatosis type-1 (NF1) is a neurodevelopmental disease often exhibiting attentional deficits and learning disabilities, and is considered to model similar impairments common in other neurodevelopmental disorders such as autism. In a previous study, we found that patients with NF1 are more prone to miss targets under overt attention conditions. This finding was interpreted as a result of increased occipito-parietal alpha oscillations. In the present study, we used electroencephalography (EEG) to study alpha power modulations and the performance of patients with NF1 in a covert attention task. Covert attention was required in order to perceive changes (target offset) of a peripherally presented stimulus. Interestingly, alpha oscillations were found to undergo greater desynchronization under this task in the NF1 group compared with control subjects. A similar pattern of desynchronization was found for beta frequencies while no changes in gamma oscillations could be identified. These results are consistent with the notion that different attentional states and task demands generate different patterns of abnormal modulation of alpha oscillatory processes in NF1. Under covert attention conditions and while target offset was reported with relatively high accuracy (over 90% correct responses), excessive desynchronization was found. These findings suggest an abnormal modulation of oscillatory activity and attentional processes in NF1. Given the known role of alpha in modulating attention, we suggest that alpha patterns can show both abnormal increases and decreases that are task and performance dependent, in a way that enhanced alpha desynchronization may reflect a compensatory mechanism to keep performance at normal levels. These results suggest that dysregulation of alpha oscillations may occur in NF1 both in terms of excessive or diminished activation patterns.     

Physical Demand but Not Dexterity Is Associated with Motor Flexibility during Rapid Reaching in Healthy Young Adults

Healthy humans are able to place light and heavy objects in small and large target locations with remarkable accuracy. Here we examine how dexterity demand and physical demand affect flexibility in joint coordination and end-effector kinematics when healthy young adults perform an upper extremity reaching task. We manipulated dexterity demand by changing target size and physical demand by increasing external resistance to reaching. Uncontrolled manifold analysis was used to decompose variability in joint coordination patterns into variability stabilizing the end-effector and variability de-stabilizing the end-effector during reaching. Our results demonstrate a proportional increase in stabilizing and de-stabilizing variability without a change in the ratio of the two variability components as physical demands increase. We interpret this finding in the context of previous studies showing that sensorimotor noise increases with increasing physical demands. We propose that the larger de-stabilizing variability as a function of physical demand originated from larger sensorimotor noise in the neuromuscular system. The larger stabilizing variability with larger physical demands is a strategy employed by the neuromuscular system to counter the de-stabilizing variability so that performance stability is maintained. Our findings have practical implications for improving the effectiveness of movement therapy in a wide range of patient groups, maintaining upper extremity function in old adults, and for maximizing athletic performance.     

Two Agents in the Brain: Motor Control of Unimanual and Bimanual Reaching Movements

Previous studies have suggested that the left and right hands have different specialties for motor control that can be represented as two agents in the brain. This study examined how coordinated movements are performed during bimanual reaching tasks to highlight differences in the characteristics of the hands. We examined motor movement accuracy, reaction time, and movement time in right-handed subjects performing a three-dimensional motor control task (visually guided reaching). In the no-visual-feedback condition, right-hand movement had lower accuracy and a shorter reaction time than did left-hand movement, whereas bimanual movement had the longest reaction time, but the best accuracy. This suggests that the two hands have different internal models and specialties: closed-loop control for the right hand and open-loop control for the left hand. Consequently, during bimanual movements, both models might be used, creating better control and planning (or prediction), but requiring more computation time compared to the use of one hand only.     

Time-integrated position error accounts for sensorimotor behavior in time-constrained tasks

Several studies have shown that human motor behavior can be successfully described using optimal control theory, which describes behavior by optimizing the trade-off between the subject's effort and performance. This approach predicts that subjects reach the goal exactly at the final time. However, another strategy might be that subjects try to reach the target position well before the final time to avoid the risk of missing the target. To test this, we have investigated whether minimizing the control effort and maximizing the performance is sufficient to describe human motor behavior in time-constrained motor tasks. In addition to the standard model, we postulate a new model which includes an additional cost criterion which penalizes deviations between the position of the effector and the target throughout the trial, forcing arrival on target before the final time. To investigate which model gives the best fit to the data and to see whether that model is generic, we tested both models in two different tasks where subjects used a joystick to steer a ball on a screen to hit a target (first task) or one of two targets (second task) before a final time. Noise of different amplitudes was superimposed on the ball position to investigate the ability of the models to predict motor behavior for different levels of uncertainty. The results show that a cost function representing only a trade-off between effort and accuracy at the end time is insufficient to describe the observed behavior. The new model correctly predicts that subjects steer the ball to the target position well before the final time is reached, which is in agreement with the observed behavior. This result is consistent for all noise amplitudes and for both tasks.     

The Effects of Stimulus Variability on the Perceptual Learning of Speech and Non-Speech Stimuli

Previous studies suggest fundamental differences between the perceptual learning of speech and non-speech stimuli. One major difference is in the way variability in the training set affects learning and its generalization to untrained stimuli: training-set variability appears to facilitate speech learning, while slowing or altogether extinguishing non-speech auditory learning. We asked whether the reason for this apparent difference is a consequence of the very different methodologies used in speech and non-speech studies. We hypothesized that speech and non-speech training would result in a similar pattern of learning if they were trained using the same training regimen. We used a 2 (random vs. blocked pre- and post-testing) × 2 (random vs. blocked training) × 2 (speech vs. non-speech discrimination task) study design, yielding 8 training groups. A further 2 groups acted as untrained controls, tested with either random or blocked stimuli. The speech task required syllable discrimination along 4 minimal-pair continua (e.g., bee-dee), and the non-speech stimuli required duration discrimination around 4 base durations (e.g., 50 ms). Training and testing required listeners to pick the odd-one-out of three stimuli, two of which were the base duration or phoneme continuum endpoint and the third varied adaptively. Training was administered in 9 sessions of 640 trials each, spread over 4–8 weeks. Significant learning was only observed following speech training, with similar learning rates and full generalization regardless of whether training used random or blocked schedules. No learning was observed for duration discrimination with either training regimen. We therefore conclude that the two stimulus classes respond differently to the same training regimen. A reasonable interpretation of the findings is that speech is perceived categorically, enabling learning in either paradigm, while the different base durations are not well-enough differentiated to allow for categorization, resulting in disruption to learning.     

Evidence for composite cost functions in arm movement planning: an inverse optimal control approach

An important issue in motor control is understanding the basic principles underlying the accomplishment of natural movements. According to optimal control theory, the problem can be stated in these terms: what cost function do we optimize to coordinate the many more degrees of freedom than necessary to fulfill a specific motor goal? This question has not received a final answer yet, since what is optimized partly depends on the requirements of the task. Many cost functions were proposed in the past, and most of them were found to be in agreement with experimental data. Therefore, the actual principles on which the brain relies to achieve a certain motor behavior are still unclear. Existing results might suggest that movements are not the results of the minimization of single but rather of composite cost functions. In order to better clarify this last point, we consider an innovative experimental paradigm characterized by arm reaching with target redundancy. Within this framework, we make use of an inverse optimal control technique to automatically infer the (combination of) optimality criteria that best fit the experimental data. Results show that the subjects exhibited a consistent behavior during each experimental condition, even though the target point was not prescribed in advance. Inverse and direct optimal control together reveal that the average arm trajectories were best replicated when optimizing the combination of two cost functions, nominally a mix between the absolute work of torques and the integrated squared joint acceleration. Our results thus support the cost combination hypothesis and demonstrate that the recorded movements were closely linked to the combination of two complementary functions related to mechanical energy expenditure and joint-level smoothness.     

Neural mechanisms underlying motivation of mental versus physical effort

Mental and physical efforts, such as paying attention and lifting weights, have been shown to involve different brain systems. These cognitive and motor systems, respectively, include cortical networks (prefronto-parietal and precentral regions) as well as subregions of the dorsal basal ganglia (caudate and putamen). Both systems appeared sensitive to incentive motivation: their activity increases when we work for higher rewards. Another brain system, including the ventral prefrontal cortex and the ventral basal ganglia, has been implicated in encoding expected rewards. How this motivational system drives the cognitive and motor systems remains poorly understood. More specifically, it is unclear whether cognitive and motor systems can be driven by a common motivational center or if they are driven by distinct, dedicated motivational modules. To address this issue, we used functional MRI to scan healthy participants while performing a task in which incentive motivation, cognitive, and motor demands were varied independently. We reasoned that a common motivational node should (1) represent the reward expected from effort exertion, (2) correlate with the performance attained, and (3) switch effective connectivity between cognitive and motor regions depending on task demand. The ventral striatum fulfilled all three criteria and therefore qualified as a common motivational node capable of driving both cognitive and motor regions of the dorsal striatum. Thus, we suggest that the interaction between a common motivational system and the different task-specific systems underpinning behavioral performance might occur within the basal ganglia.     

Increased brain signal variability accompanies lower behavioral variability in development

As the brain matures, its responses become optimized. Behavioral measures show this through improved accuracy and decreased trial-to-trial variability. The question remains whether the supporting brain dynamics show a similar decrease in variability. We examined the relation between variability in single trial evoked electrical activity of the brain (measured with EEG) and performance of a face memory task in children (8–15 y) and young adults (20–33 y). Behaviorally, children showed slower, more variable response times (RT), and less accurate recognition than adults. However, brain signal variability increased with age, and showed strong negative correlations with intrasubject RT variability and positive correlations with accuracy. Thus, maturation appears to lead to a brain with greater functional variability, which is indicative of enhanced neural complexity. This variability may reflect a broader repertoire of metastable brain states and more fluid transitions among them that enable optimum responses. Our results suggest that the moment-to-moment variability in brain activity may be a critical index of the cognitive capacity of the brain.     

Normalized Index of Synergy for Evaluating the Coordination of Motor Commands

Humans perform various motor tasks by coordinating the redundant motor elements in their bodies. The coordination of motor outputs is produced by motor commands, as well properties of the musculoskeletal system. The aim of this study was to dissociate the coordination of motor commands from motor outputs. First, we conducted simulation experiments where the total elbow torque was generated by a model of a simple human right and left elbow with redundant muscles. The results demonstrated that muscle tension with signal-dependent noise formed a coordinated structure of trial-to-trial variability of muscle tension. Therefore, the removal of signal-dependent noise effects was required to evaluate the coordination of motor commands. We proposed a method to evaluate the coordination of motor commands, which removed signal-dependent noise from the measured variability of muscle tension. We used uncontrolled manifold analysis to calculate a normalized index of synergy. Simulation experiments confirmed that the proposed method could appropriately represent the coordinated structure of the variability of motor commands. We also conducted experiments in which subjects performed the same task as in the simulation experiments. The normalized index of synergy revealed that the subjects coordinated their motor commands to achieve the task. Finally, the normalized index of synergy was applied to a motor learning task to determine the utility of the proposed method. We hypothesized that a large part of the change in the coordination of motor outputs through learning was because of changes in motor commands. In a motor learning task, subjects tracked a target trajectory of the total torque. The change in the coordination of muscle tension through learning was dominated by that of motor commands, which supported the hypothesis. We conclude that the normalized index of synergy can be used to evaluate the coordination of motor commands independently from the properties of the musculoskeletal system.     

Examination of the reproducibility of grip force and muscle oxygenation kinetics on maximal repeated rhythmic grip exertion

The contribution of physiological mechanisms involving force-exertion value during maximal repeated rhythmic muscle contraction work changes over time. The purpose of this study was to examine the reproducibility of grip force and muscle oxygenation kinetics with a decrease of the gripping force during maximal repeated rhythmic grip (RRG). Subjects were 10 males, aged 20-26 years (height 173.9+/-7.3 cm, body weight 71.5+/-11.2 kg). Each subject performed maximal repeated rhythmic grip as a target value with a target frequency of 30 grips.min(-1) for 6 min. The trial-to-trial reproducibility of Oxygenated haemoglobin (Oxy-Hb), Deoxygenated haemoglobin (Deoxy-Hb), Total haemoglobin (Total Hb) and grip force during the RRG (6 min) was very high (r(xy)=0.919-0.966) and the decreasing pattern of the force-time curve was consistent. The cross correlation coefficients of the grip force (r(xy)=0.985) and muscle oxygenation kinetics (Total Hb: 0.996, Oxy-Hb: 0.992, Deoxy-Hb: 0.995) in the pre-inflection phase (marked force decreasing phase) were very high, while these coefficients in the post-inflection phase (almost steady state phase) were low as compared with those in the pre-inflection phase. The trial-to-trial reliabilities of any parameter regarding grip were fair or high (ICC=0.686-0.927). The changing points of muscle oxygenation kinetics appeared before reaching an almost steady state, which showed a high reliability and they were considered to reflect the shift of physiological mechanisms. In particular, the intraclass correlation coefficients (ICC) for the time to reach maximum Deoxy-Hb and Oxy-Hb values and regression coefficient in an increasing phase of Oxy-Hb were very high (ICC=0.894-0.947). It was found that the trial-to-trial reproducibility of grip force and muscle oxygenation kinetics is very high during the whole 6 min in RRG, but is poor during the post-inflection phase. The reproducibility of the grip force and muscle oxygenation kinetics in the phase before reaching an almost steady state during RRG is fair, and the decrease of the grip force in this phase may be influenced by the muscle oxygenation kinetics.     

Modulation by dopamine of human basal ganglia involvement in feedback control of movement

We learn new motor tasks by trial and error, repeating what works best and avoiding past mistakes. To repeat what works best we must register a satisfactory outcome, and in a study [1] we showed the existence of an evoked activity in the basal ganglia that correlates with accuracy of task performance and is associated with reiteration of successful motor parameters in subsequent movements. Here we report evidence that the signaling of positive trial outcome relies on dopaminergic input to the basal ganglia, by recording from the subthalamic nucleus (STN) in patients with nigrostriatal denervation due to Parkinson's Disease (PD) who have undergone functional neurosurgery. Correlations between subthalamic evoked activities and trial accuracy were weak and behavioral performance remained poor while patients were untreated; however, both improved after the dopamine prodrug levodopa was re-introduced. The results suggest that the midbrain dopaminergic system may be important, not only in signaling explicit positive outcomes or rewards in tasks requiring choices between options [2,3], but also in trial-to-trial learning and in reinforcing the selection of optimal parameters in more automatic motor control.     

Is rotating between static and dynamic work beneficial for our fatigue state?

Shoulder disorders comprise a large part of work-related musculoskeletal disorders. Risk factors, such as repetitiveness and monotony, may cause muscle fatigue and be attenuated by task rotation. We investigated rotation between a dynamic box-lifting task and a relatively static pick-and-place task and aimed to determine whether (1) a high rotation frequency leads to less fatigue development than a low rotation frequency, and (2) a self-selected rotation frequency leads to less fatigue development than imposed rotation frequencies. Ten participants performed four one-hour rotation schedules: two low frequency rotation schedules rotating at 30 min, one high frequency rotation schedule rotating every sixth minute, and a self-selected rotation schedule. Borg, SOFI and electromyography of Trapezius and Deltoid subparts served as fatigue indicators. We found significant signs of fatigue for most schedules regarding the Borg and SOFI ratings and the M. Trapezius pars Descendens. Task rotation frequency had no significant effect on any of the outcome parameters, whereas the self-selected rotation schedule clearly resulted in less development of perceived fatigue than imposed schedules. In conclusion, we think that freedom of rotation has the greatest potential to attenuate potential development of musculoskeletal disorders and we require due caution with the use and interpretation of EMG indicators of fatigue.