Task Complexity Differentially Affects Executed and Imagined Movement Preparation: Evidence from Movement-Related Potentials

Background

The neural simulation theory predicts similarity for the neural mechanisms subserving overt (motor execution) and covert (movement imagination) actions. Here we tested this prediction for movement preparation, a key characteristic of motor cognition.

Methodology/Principal Findings

High-density electroencephalogram (EEG) was recorded during covert and overt actions. Movement preparation was studied with a motor priming paradigm, which varied task complexity and amount of advance information. Participants performed simple or complex sequential finger movements either overtly or covertly. Advance information was either fully predictive or partially predictive. Stimulus-locked event-related potential (ERP) data showed the typical pattern of foreperiod activation for overt and covert movements. The foreperiod contingent negative variation (CNV) differed between simple and complex movements only in the execution task. ERP topographies differed between execution and imagination only when advance information was fully predictive.

Conclusions/Significance

Results suggest a differential contribution of the movement preparation network to action imagination and execution. Overt and covert actions seem to involve similar though not identical mechanisms, where overt actions engage a more fine-grained modulation of covert preparatory states.     

Perceived Cost and Intrinsic Motor Variability Modulate the Speed-Accuracy Trade-Off

Fitts’ Law describes the speed-accuracy trade-off of human movements, and it is an elegant strategy that compensates for random and uncontrollable noise in the motor system. The control strategy during targeted movements may also take into account the rewards or costs of any outcomes that may occur. The aim of this study was to test the hypothesis that movement time in Fitts’ Law emerges not only from the accuracy constraints of the task, but also depends on the perceived cost of error for missing the targets. Subjects were asked to touch targets on an iPad^® screen with different costs for missed targets. We manipulated the probability of error by comparing children with dystonia (who are characterized by increased intrinsic motor variability) to typically developing children. The results show a strong effect of the cost of error on the Fitts’ Law relationship characterized by an increase in movement time as cost increased. In addition, we observed a greater sensitivity to increased cost for children with dystonia, and this behavior appears to minimize the average cost. The findings support a proposed mathematical model that explains how movement time in a Fitts-like task is related to perceived risk.     

Automatic Imitation in Rhythmical Actions: Kinematic Fidelity and the Effects of Compatibility,Delay, and Visual Monitoring

We demonstrate that observation of everyday rhythmical actions biases subsequent motor execution of the same and of different actions, using a paradigm where the observed actions were irrelevant for action execution. The cycle time of the distractor actions was subtly manipulated across trials, and the cycle time of motor responses served as the main dependent measure. Although distractor frequencies reliably biased response cycle times, this imitation bias was only a small fraction of the modulations in distractor speed, as well as of the modulations produced when participants intentionally imitated the observed rhythms. Importantly, this bias was not only present for compatible actions, but was also found, though numerically reduced, when distractor and executed actions were different (e.g., tooth brushing vs. window wiping), or when the dominant plane of movement was different (horizontal vs. vertical). In addition, these effects were equally pronounced for execution at 0, 4, and 8 s after action observation, a finding that contrasts with the more short-lived effects reported in earlier studies. The imitation bias was also unaffected when vision of the hand was occluded during execution, indicating that this effect most likely resulted from visuomotor interactions during distractor observation, rather than from visual monitoring and guidance during execution. Finally, when the distractor was incompatible in both dimensions (action type and plane) the imitation bias was not reduced further, in an additive way, relative to the single-incompatible conditions. This points to a mechanism whereby the observed action’s impact on motor processing is generally reduced whenever this is not useful for motor planning. We interpret these findings in the framework of biased competition, where intended and distractor actions can be represented as competing and quasi-encapsulated sensorimotor streams.     

Nonvisual motor learning influences abstract action observation

Neuroimaging studies have recently provided support for the existence of a human equivalent of the "mirror-neuron" system as first described in monkeys [1], involved in both the execution of movements as well as the observation and imitation of actions performed by others (e.g., [2-6]). A widely held conception concerning this system is that the understanding of observed actions is mediated by a covert simulation process [7]. In the present fMRI experiment, this simulation process was probed by asking subjects to discriminate between visually presented trajectories that either did or did not match previously performed but unseen continuous movement sequences. A specific network of learning-related premotor and parietal areas was found to be reactivated when participants were confronted with their movements' visual counterpart. Moreover, the strength of these reactivations was dependent on the observers' experience with executing the corresponding movement sequence. These findings provide further support for the emerging view that embodied simulations during action observation engage widespread activations in cortical motor regions beyond the classically defined mirror-neuron system. Furthermore, the obtained results extend previous work by showing experience-dependent perceptual modulations at the neural systems level based on nonvisual motor learning.     

An interference effect of observed biological movement on action

It has been proposed that actions are intrinsically linked to perception and that imagining, observing, preparing, or in any way representing an action excites the motor programs used to execute that same action. There is neurophysiological evidence that certain brain regions involved in executing actions are activated by the mere observation of action (the so-called "mirror system;" ). However, it is unknown whether this mirror system causes interference between observed and simultaneously executed movements. In this study we test the hypothesis that, because of the overlap between action observation and execution, observed actions should interfere with incongruous executed actions. Subjects made arm movements while observing either a robot or another human making the same or qualitatively different arm movements. Variance in the executed movement was measured as an index of interference to the movement. The results demonstrate that observing another human making incongruent movements has a significant interference effect on executed movements. However, we found no evidence that this interference effect occurred when subjects observed a robotic arm making incongruent movements. These results suggest that the simultaneous activation of the overlapping neural networks that process movement observation and execution infers a measurable cost to motor control.     

Concatenation of Observed Grasp Phases with Observer’s Distal Movements: A Behavioural and TMS Study

The present study aimed at determining how actions executed by two conspecifics can be coordinated with each other, or more specifically, how the observation of different phases of a reaching-grasping action is temporary related to the execution of a movement of the observer. Participants observed postures of initial finger opening, maximal finger aperture, and final finger closing of grasp after observation of an initial hand posture. Then, they opened or closed their right thumb and index finger (experiments 1, 2 and 3). Response times decreased, whereas acceleration and velocity of actual finger movements increased when observing the two late phases of grasp. In addition, the results ruled out the possibility that this effect was due to salience of the visual stimulus when the hand was close to the target and confirmed an effect of even hand postures in addition to hand apparent motion due to the succession of initial hand posture and grasp phase. In experiments 4 and 5, the observation of grasp phases modulated even foot movements and pronunciation of syllables. Finally, in experiment 6, transcranial magnetic stimulation applied to primary motor cortex 300 ms post-stimulus induced an increase in hand motor evoked potentials of opponens pollicis muscle when observing the two late phases of grasp. These data suggest that the observation of grasp phases induced simulation which was stronger during observation of finger closing. This produced shorter response times, greater acceleration and velocity of the successive movement. In general, our data suggest best concatenation between two movements (one observed and the other executed) when the observed (and simulated) movement was to be accomplished. The mechanism joining the observation of a conspecific’s action with our own movement may be precursor of social functions. It may be at the basis for interactions between conspecifics, and related to communication between individuals.     

Favouritism in the motor system: social interaction modulates action simulation

The ability to anticipate others'' actions is crucial for social interaction. It has been shown that this ability relies on motor areas of the human brain that are not only active during action execution and action observation, but also during anticipation of another person''s action. Recording electroencephalograms during a triadic social interaction, we assessed whether activation of motor areas pertaining to the human mirror-neuron system prior to action observation depends on the social relationship between the actor and the observer. Anticipatory motor activation was stronger when participants expected an interaction partner to perform a particular action than when they anticipated that the same action would be performed by a third person they did not interact with. These results demonstrate that social interaction modulates action simulation.     

Predictive motor activation during action observation in human infants

Certain regions of the human brain are activated both during action execution and action observation. This so-called ‘mirror neuron system’ has been proposed to enable an observer to understand an action through a process of internal motor simulation. Although there has been much speculation about the existence of such a system from early in life, to date there is little direct evidence that young infants recruit brain areas involved in action production during action observation. To address this question, we identified the individual frequency range in which sensorimotor alpha-band activity was attenuated in nine-month-old infants'' electroencephalographs (EEGs) during elicited reaching for objects, and measured whether activity in this frequency range was also modulated by observing others'' actions. We found that observing a grasping action resulted in motor activation in the infant brain, but that this activity began prior to observation of the action, once it could be anticipated. These results demonstrate not only that infants, like adults, display overlapping neural activity during execution and observation of actions, but that this activation, rather than being directly induced by the visual input, is driven by infants'' understanding of a forthcoming action. These results provide support for theories implicating the motor system in action prediction.     

Motor Inhibition during Overt and Covert Actions: An Electrical Neuroimaging Study

Given ample evidence for shared cortical structures involved in encoding actions, whether or not subsequently executed, a still unsolved problem is the identification of neural mechanisms of motor inhibition, preventing “covert actions” as motor imagery from being performed, in spite of the activation of the motor system. The principal aims of the present study were the evaluation of: 1) the presence in covert actions as motor imagery of putative motor inhibitory mechanisms; 2) their underlying cerebral sources; 3) their differences or similarities with respect to cerebral networks underpinning the inhibition of overt actions during a Go/NoGo task. For these purposes, we performed a high density EEG study evaluating the cerebral microstates and their related sources elicited during two types of Go/NoGo tasks, requiring the execution or withholding of an overt or a covert imagined action, respectively. Our results show for the first time the engagement during motor imagery of key nodes of a putative inhibitory network (including pre-supplementary motor area and right inferior frontal gyrus) partially overlapping with those activated for the inhibition of an overt action during the overt NoGo condition. At the same time, different patterns of temporal recruitment in these shared neural inhibitory substrates are shown, in accord with the intended overt or covert modality of action performance. The evidence that apparently divergent mechanisms such as controlled inhibition of overt actions and contingent automatic inhibition of covert actions do indeed share partially overlapping neural substrates, further challenges the rigid dichotomy between conscious, explicit, flexible and unconscious, implicit, inflexible forms of motor behavioral control.     

Corticospinal mirror neurons

Here, we report the properties of neurons with mirror-like characteristics that were identified as pyramidal tract neurons (PTNs) and recorded in the ventral premotor cortex (area F5) and primary motor cortex (M1) of three macaque monkeys. We analysed the neurons’ discharge while the monkeys performed active grasp of either food or an object, and also while they observed an experimenter carrying out a similar range of grasps. A considerable proportion of tested PTNs showed clear mirror-like properties (52% F5 and 58% M1). Some PTNs exhibited ‘classical’ mirror neuron properties, increasing activity for both execution and observation, while others decreased their discharge during observation (‘suppression mirror-neurons’). These experiments not only demonstrate the existence of PTNs as mirror neurons in M1, but also reveal some interesting differences between M1 and F5 mirror PTNs. Although observation-related changes in the discharge of PTNs must reach the spinal cord and will include some direct projections to motoneurons supplying grasping muscles, there was no EMG activity in these muscles during action observation. We suggest that the mirror neuron system is involved in the withholding of unwanted movement during action observation. Mirror neurons are differentially recruited in the behaviour that switches rapidly between making your own movements and observing those of others.     

FMRI supports the sensorimotor theory of motor resonance

The neural mechanisms mediating the activation of the motor system during action observation, also known as motor resonance, are of major interest to the field of motor control. It has been proposed that motor resonance develops in infants through Hebbian plasticity of pathways connecting sensory and motor regions that fire simultaneously during imitation or self movement observation. A fundamental problem when testing this theory in adults is that most experimental paradigms involve actions that have been overpracticed throughout life. Here, we directly tested the sensorimotor theory of motor resonance by creating new visuomotor representations using abstract stimuli (motor symbols) and identifying the neural networks recruited through fMRI. We predicted that the network recruited during action observation and execution would overlap with that recruited during observation of new motor symbols. Our results indicate that a network consisting of premotor and posterior parietal cortex, the supplementary motor area, the inferior frontal gyrus and cerebellum was activated both by new motor symbols and by direct observation of the corresponding action. This tight spatial overlap underscores the importance of sensorimotor learning for motor resonance and further indicates that the physical characteristics of the perceived stimulus are irrelevant to the evoked response in the observer.     

What Do Eye Gaze Metrics Tell Us about Motor Imagery?

Many of the brain structures involved in performing real movements also have increased activity during imagined movements or during motor observation, and this could be the neural substrate underlying the effects of motor imagery in motor learning or motor rehabilitation. In the absence of any objective physiological method of measurement, it is currently impossible to be sure that the patient is indeed performing the task as instructed. Eye gaze recording during a motor imagery task could be a possible way to “spy” on the activity an individual is really engaged in. The aim of the present study was to compare the pattern of eye movement metrics during motor observation, visual and kinesthetic motor imagery (VI, KI), target fixation, and mental calculation. Twenty-two healthy subjects (16 females and 6 males), were required to perform tests in five conditions using imagery in the Box and Block Test tasks following the procedure described by Liepert et al. Eye movements were analysed by a non-invasive oculometric measure (SMI RED250 system). Two parameters describing gaze pattern were calculated: the index of ocular mobility (saccade duration over saccade + fixation duration) and the number of midline crossings (i.e. the number of times the subjects gaze crossed the midline of the screen when performing the different tasks). Both parameters were significantly different between visual imagery and kinesthesic imagery, visual imagery and mental calculation, and visual imagery and target fixation. For the first time we were able to show that eye movement patterns are different during VI and KI tasks. Our results suggest gaze metric parameters could be used as an objective unobtrusive approach to assess engagement in a motor imagery task. Further studies should define how oculomotor parameters could be used as an indicator of the rehabilitation task a patient is engaged in.     

Ready steady slow: action preparation slows the subjective passage of time

Professional ball game players report the feeling of the ball ‘slowing-down’ before hitting it. Because effective motor preparation is critical in achieving such expert motor performance, these anecdotal comments imply that the subjective passage of time may be influenced by preparation for action. Previous reports of temporal illusions associated with action generally emphasize compensation for suppressed sensory signals that accompany motor commands. Here, we show that the time is perceived slowed-down during preparation of a ballistic reaching movement before action, involving enhancement of sensory processing. Preparing for a reaching movement increased perceived duration of a visual stimulus. This effect was tightly linked to action preparation, because the amount of temporal dilation increased with the information about the upcoming movement. Furthermore, we showed a reduction of perceived frequency for flickering stimuli and an enhanced detection of rapidly presented letters during action preparation, suggesting increased temporal resolution of visual perception during action preparation. We propose that the temporal dilation during action preparation reflects the function of the brain to maximize the capacity of sensory information-acquisition prior to execution of a ballistic movement. This strategy might facilitate changing or inhibiting the planned action in response to last-minute changes in the external environment.     

Apparent Time Interval of Visual Stimuli Is Compressed during Fast Hand Movement

The influence of body movements on visual time perception is receiving increased attention. Past studies showed apparent expansion of visual time before and after the execution of hand movements and apparent compression of visual time during the execution of eye movements. Here we examined whether the estimation of sub-second time intervals between visual events is expanded, compressed, or unaffected during the execution of hand movements. The results show that hand movements, at least the fast ones, reduced the apparent time interval between visual events. A control experiment indicated that the apparent time compression was not produced by the participants’ involuntary eye movements during the hand movements. These results, together with earlier findings, suggest hand movement can change apparent visual time either in a compressive way or in an expansive way, depending on the relative timing between the hand movement and visual stimulus.     

Mental motor imagery: a window into the representational stages of action

The physiological basis of mental states can be effectively studied by combining cognitive psychology with human neuroscience. Recent research has employed mental motor imagery in normal and brain-damaged subjects to decipher the content and the structure of covert processes preceding the execution of action. The mapping of brain activity during motor imagery discloses a pattern of activation similar to that of an executed action.     

Enhanced Activation of Motor Execution Networks Using Action Observation Combined with Imagination of Lower Limb Movements

The combination of first-person observation and motor imagery, i.e. first-person observation of limbs with online motor imagination, is commonly used in interactive 3D computer gaming and in some movie scenes. These scenarios are designed to induce a cognitive process in which a subject imagines himself/herself acting as the agent in the displayed movement situation. Despite the ubiquity of this type of interaction and its therapeutic potential, its relationship to passive observation and imitation during observation has not been directly studied using an interactive paradigm. In the present study we show activation resulting from observation, coupled with online imagination and with online imitation of a goal-directed lower limb movement using functional MRI (fMRI) in a mixed block/event-related design. Healthy volunteers viewed a video (first-person perspective) of a foot kicking a ball. They were instructed to observe-only the action (O), observe and simultaneously imagine performing the action (O-MI), or imitate the action (O-IMIT). We found that when O-MI was compared to O, activation was enhanced in the ventralpremotor cortex bilaterally, left inferior parietal lobule and left insula. The O-MI and O-IMIT conditions shared many activation foci in motor relevant areas as confirmed by conjunction analysis. These results show that (i) combining observation with motor imagery (O-MI) enhances activation compared to observation-only (O) in the relevant foot motor network and in regions responsible for attention, for control of goal-directed movements and for the awareness of causing an action, and (ii) it is possible to extensively activate the motor execution network using O-MI, even in the absence of overt movement. Our results may have implications for the development of novel virtual reality interactions for neurorehabilitation interventions and other applications involving training of motor tasks.     

Children and Older Adults Exhibit Distinct Sub-Optimal Cost-Benefit Functions when Preparing to Move Their Eyes and Hands

Numerous activities require an individual to respond quickly to the correct stimulus. The provision of advance information allows response priming but heightened responses can cause errors (responding too early or reacting to the wrong stimulus). Thus, a balance is required between the online cognitive mechanisms (inhibitory and anticipatory) used to prepare and execute a motor response at the appropriate time. We investigated the use of advance information in 71 participants across four different age groups: (i) children, (ii) young adults, (iii) middle-aged adults, and (iv) older adults. We implemented ‘cued’ and ‘non-cued’ conditions to assess age-related changes in saccadic and touch responses to targets in three movement conditions: (a) Eyes only; (b) Hands only; (c) Eyes and Hand. Children made less saccade errors compared to young adults, but they also exhibited longer response times in cued versus non-cued conditions. In contrast, older adults showed faster responses in cued conditions but exhibited more errors. The results indicate that young adults (18–25 years) achieve an optimal balance between anticipation and execution. In contrast, children show benefits (few errors) and costs (slow responses) of good inhibition when preparing a motor response based on advance information; whilst older adults show the benefits and costs associated with a prospective response strategy (i.e., good anticipation).     

Occlusion of LTP-like plasticity in human primary motor cortex by action observation

Passive observation of motor actions induces cortical activity in the primary motor cortex (M1) of the onlooker, which could potentially contribute to motor learning. While recent studies report modulation of motor performance following action observation, the neurophysiological mechanism supporting these behavioral changes remains to be specifically defined. Here, we assessed whether the observation of a repetitive thumb movement--similarly to active motor practice--would inhibit subsequent long-term potentiation-like (LTP) plasticity induced by paired-associative stimulation (PAS). Before undergoing PAS, participants were asked to either 1) perform abductions of the right thumb as fast as possible; 2) passively observe someone else perform thumb abductions; or 3) passively observe a moving dot mimicking thumb movements. Motor evoked potentials (MEP) were used to assess cortical excitability before and after motor practice (or observation) and at two time points following PAS. Results show that, similarly to participants in the motor practice group, individuals observing repeated motor actions showed marked inhibition of PAS-induced LTP, while the "moving dot" group displayed the expected increase in MEP amplitude, despite differences in baseline excitability. Interestingly, LTP occlusion in the action-observation group was present even if no increase in cortical excitability or movement speed was observed following observation. These results suggest that mere observation of repeated hand actions is sufficient to induce LTP, despite the absence of motor learning.     

Modulation of motor cortex excitability by physical similarity with an observed hand action

The passive observation of hand actions is associated with increased motor cortex excitability, presumably reflecting activity within the human mirror neuron system (MNS). Recent data show that in-group ethnic membership increases motor cortex excitability during observation of culturally relevant hand gestures, suggesting that physical similarity with an observed body part may modulate MNS responses. Here, we ask whether the MNS is preferentially activated by passive observation of hand actions that are similar or dissimilar to self in terms of sex and skin color. Transcranial magnetic stimulation-induced motor evoked potentials were recorded from the first dorsal interosseus muscle while participants viewed videos depicting index finger movements made by female or male participants with black or white skin color. Forty-eight participants equally distributed in terms of sex and skin color participated in the study. Results show an interaction between self-attributes and physical attributes of the observed hand in the right motor cortex of female participants, where corticospinal excitability is increased during observation of hand actions in a different skin color than that of the observer. Our data show that specific physical properties of an observed action modulate motor cortex excitability and we hypothesize that in-group/out-group membership and self-related processes underlie these effects.     

Stay Focused! The Effects of Internal and External Focus of Attention on Movement Automaticity in Patients with Stroke

Dual-task performance is often impaired after stroke. This may be resolved by enhancing patients’ automaticity of movement. This study sets out to test the constrained action hypothesis, which holds that automaticity of movement is enhanced by triggering an external focus (on movement effects), rather than an internal focus (on movement execution). Thirty-nine individuals with chronic, unilateral stroke performed a one-leg-stepping task with both legs in single- and dual-task conditions. Attentional focus was manipulated with instructions. Motor performance (movement speed), movement automaticity (fluency of movement), and dual-task performance (dual-task costs) were assessed. The effects of focus on movement speed, single- and dual-task movement fluency, and dual-task costs were analysed with generalized estimating equations. Results showed that, overall, single-task performance was unaffected by focus (p = .341). Regarding movement fluency, no main effects of focus were found in single- or dual-task conditions (p’s ≥ .13). However, focus by leg interactions suggested that an external focus reduced movement fluency of the paretic leg compared to an internal focus (single-task conditions: p = .068; dual-task conditions: p = .084). An external focus also tended to result in inferior dual-task performance (β = -2.38, p = .065). Finally, a near-significant interaction (β = 2.36, p = .055) suggested that dual-task performance was more constrained by patients’ attentional capacity in external focus conditions. We conclude that, compared to an internal focus, an external focus did not result in more automated movements in chronic stroke patients. Contrary to expectations, trends were found for enhanced automaticity with an internal focus. These findings might be due to patients’ strong preference to use an internal focus in daily life. Future work needs to establish the more permanent effects of learning with different attentional foci on re-automating motor control after stroke.