Learning to control a brain-machine interface for reaching and grasping by primates

Reaching and grasping in primates depend on the coordination of neural activity in large frontoparietal ensembles. Here we demonstrate that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain–machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters (i.e., hand position, velocity, gripping force, and the EMGs of multiple arm muscles) from the electrical activity of frontoparietal neuronal ensembles. As single neurons typically contribute to the encoding of several motor parameters, we observed that high BMIc accuracy required recording from large neuronal ensembles. Continuous BMIc operation by monkeys led to significant improvements in both model predictions and behavioral performance. Using visual feedback, monkeys succeeded in producing robot reach-and-grasp movements even when their arms did not move. Learning to operate the BMIc was paralleled by functional reorganization in multiple cortical areas, suggesting that the dynamic properties of the BMIc were incorporated into motor and sensory cortical representations.     

Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates

Reaching and grasping in primates depend on the coordination of neural activity in large frontoparietal ensembles. Here we demonstrate that primates can learn to reach and grasp virtual objects by controlling a robot arm through a closed-loop brain–machine interface (BMIc) that uses multiple mathematical models to extract several motor parameters (i.e., hand position, velocity, gripping force, and the EMGs of multiple arm muscles) from the electrical activity of frontoparietal neuronal ensembles. As single neurons typically contribute to the encoding of several motor parameters, we observed that high BMIc accuracy required recording from large neuronal ensembles. Continuous BMIc operation by monkeys led to significant improvements in both model predictions and behavioral performance. Using visual feedback, monkeys succeeded in producing robot reach-and-grasp movements even when their arms did not move. Learning to operate the BMIc was paralleled by functional reorganization in multiple cortical areas, suggesting that the dynamic properties of the BMIc were incorporated into motor and sensory cortical representations.     

Influence of Vibration on Motor Responses in the Upper Arm Muscles under Stationary Conditions and during Voluntary and Evoked Arm Movements under Limb Unloading Conditions

Locomotion of mammals, including humans, is based on the rhythmic activity of spinal cord circuitries. The functioning of these circuitries depends on multimodal afferent information and on supraspinal influences from the motor cortex. Using the method of transcranial magnetic stimulation (TMS) of arm muscle areas in the motor cortex, we studied the motor evoked potentials (MEP) in the upper arm muscles in stationary conditions and during voluntary and vibration-evoked arm movements. The study included 13 healthy subjects under arm and leg unloading conditions. In the first series of experiments, with motionless limbs, the effect of vibration of left upper arm muscles on motor responses in these muscles was evaluated. In the second series of experiments, MEP were compared in the same muscles during voluntary and rhythmic movements generated by left arm m. triceps brachii vibration (the right arm was stationary). Motionless left arm vibration led to an increase in MEP values in both vibrated muscle and in most of the non-vibrated muscles. For most target muscles, MEP was greater with voluntary arm movements than with vibration-evoked movements. At the same time, a similar MEP modulation in the cycle of arm movements was observed in the same upper arm muscles during both types of arm movements. TMS of the motor cortex significantly potentiated arm movements generated by vibration, but its effect on voluntary movements was weaker. These results indicate significant differences in the degree of motor cortex involvement in voluntary and evoked arm movements. We suppose that evoked arm movements are largely due to spinal rather than central mechanisms of generation of rhythmic movements.     

New insights into motor cortex

An exciting new experiment on the motor cortex of monkeys, by Shenoy and colleagues, begins to elucidate how the neuronal ensemble travels in a systematic fashion through state space. This trajectory through state space may help to explain how the motor cortex sets up and then triggers arm movements.     

Covert shift of attention modulates the ongoing neural activity in a reaching area of the macaque dorsomedial visual stream

Background

Attention is used to enhance neural processing of selected parts of a visual scene. It increases neural responses to stimuli near target locations and is usually coupled to eye movements. Covert attention shifts, however, decouple the attentional focus from gaze, allowing to direct the attention to a peripheral location without moving the eyes. We tested whether covert attention shifts modulate ongoing neuronal activity in cortical area V6A, an area that provides a bridge between visual signals and arm-motor control.

Methodology/Principal Findings

We performed single cell recordings from 3 Macaca Fascicularis trained to fixate straight-head, while shifting attention outward to a peripheral cue and inward again to the fixation point. We found that neurons in V6A are influenced by spatial attention. The attentional modulation occurs without gaze shifts and cannot be explained by visual stimulations. Visual, motor, and attentional responses can occur in combination in single neurons.

Conclusions/Significance

This modulation in an area primarily involved in visuo-motor transformation for reaching may form a neural basis for coupling attention to the preparation of reaching movements. Our results show that cortical processes of attention are related not only to eye-movements, as many studies have shown, but also to arm movements, a finding that has been suggested by some previous behavioral findings. Therefore, the widely-held view that spatial attention is tightly intertwined with—and perhaps directly derived from—motor preparatory processes should be extended to a broader spectrum of motor processes than just eye movements.     

Distributed network actions by nicotine increase the threshold for spike-timing-dependent plasticity in prefrontal cortex

Nicotine enhances attention and working memory by activating nicotinic acetylcholine receptors (nAChRs). The prefrontal cortex (PFC) is critical for these cognitive functions and is also rich in nAChR expression. Specific cellular and synaptic mechanisms underlying nicotine's effects on cognition remain elusive. Here we show that nicotine exposure increases the threshold for synaptic spike-timing-dependent potentiation (STDP) in layer V pyramidal neurons of the mouse PFC. During coincident presynaptic and postsynaptic activity, nicotine reduces dendritic calcium signals associated with action potential propagation by enhancing GABAergic transmission. This results from a series of presynaptic actions involving different PFC interneurons and multiple nAChR subtypes. Pharmacological block of nAChRs or GABA(A) receptors prevented nicotine's actions and restored STDP, as did increasing dendritic calcium signals with stronger postsynaptic activity. Thus, by activating nAChRs distributed throughout the PFC neuronal network, nicotine affects PFC information processing and storage by increasing the amount of postsynaptic activity necessary to induce STDP.     

Activity of pre-entral neurones in conscious monkeys: effects of deafferentation and cerebellar ablation.

After limb deafferentation, there was no gross alteration in the initiation and performance of a sound-triggered ballistic movement. The pattern of neuronal discharge in the arm area of the motor cortex was not significantly modified. In the absence of cerebellum, the reaction time of motor cortex cells was about 150 msec longer than the reaction time observed in normal and deafferented animals. This was associated with an equal retardation in the onset of ENG changes in the limb muscles. This observation is compatible with the idea that the motor cortex is normally situated downstream to the cerebellum in the initiation of some movements. However, the motor cortex is necessary for the initiation and execution of simple sound-triggered movements since its removal results in a permanent inability to perform the task. Finally, in the absence of peripheral feedback, the pattern of motor output to the agonistic and antagonistic muscles was initiated normally and thus appeared to be preprogrammed centrally. The importance of the motor cortex as a "reflex center" in the control of slower movements is obviously not challenged by these observations since the motor task that we have used depends very little or not at all on sensory feedback (Stark, 1968). What these results indicate, however, is that the execution of some voluntary fast ballistic movements can be entirely preprogrammed independently of peripheral and cerebellar influences, and that the program, which is mainly concerned with generating velocity signals, appears to require the integrity of the motor cortex for its execution.     

Getting ready to move: transmitted information in the corticospinal pathway during preparation for movement

Corticospinal interactions are considered to play a key role in executing voluntary movements. Nonetheless several different studies have shown directly and indirectly that these interactions take place long before movement starts, when preparation for forthcoming movements dominates. When motor-related parameters are continuously processed in several premotor cortical sites, segmental circuitry is directly exposed to this processing via descending pathways which originate from these sites in parallel to descending fibers that derive from primary motor cortex. Recent studies have highlighted the functional role of these interactions in priming downstream elements for the ensuing motor actions. Time-resolved analysis has further emphasized the dynamic properties of pre-movement preparatory activity.     

Somatic and motor components of action simulation

Seminal studies in monkeys report that the viewing of actions performed by other individuals activates frontal and parietal cortical areas typically involved in action planning and execution. That mirroring actions might rely on both motor and somatosensory components is suggested by reports that action observation and execution increase neural activity in motor and in somatosensory areas. This occurs not only during observation of naturalistic movements but also during the viewing of biomechanically impossible movements that tap the afferent component of action, possibly by eliciting strong somatic feelings in the onlooker. Although somatosensory feedback is inherently linked to action execution, information on the possible causative role of frontal and parietal cortices in simulating motor and sensory action components is lacking. By combining low-frequency repetitive and single-pulse transcranial magnetic stimulation, we found that virtual lesions of ventral premotor cortex (vPMc) and primary somatosensory cortex (S1) suppressed mirror motor facilitation contingent upon observation of possible and impossible movements, respectively. In contrast, virtual lesions of primary motor cortex did not influence mirror motor facilitation. The reported double dissociation suggests that vPMc and S1 play an active, differential role in simulating efferent and afferent components of observed actions.     

Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field

The primary motor cortex (M1) is known to control motor performance. Recent findings have also implicated M1 in motor learning, as neurons in this area show learning-related plasticity. In the present study, we analyzed the neuronal activity recorded in M1 in a force field adaptation task. Our goal was to investigate the neuronal reorganization across behavioral epochs (before, during, and after adaptation). Here we report two main findings. First, memory cells were present in two classes. With respect to the changes of preferred direction (Pd), these two classes complemented each other after readaptation. Second, for the entire neuronal population, the shift of Pd matched the shift observed for muscles. These results provide a framework whereby the activity of distinct neuronal subpopulations combines to subserve both functions of motor performance and motor learning.     

Hybrid dedicated and distributed coding in PMd/M1 provides separation and interaction of bilateral arm signals

Pronounced activity is observed in both hemispheres of the motor cortex during preparation and execution of unimanual movements. The organizational principles of bi-hemispheric signals and the functions they serve throughout motor planning remain unclear. Using an instructed-delay reaching task in monkeys, we identified two components in population responses spanning PMd and M1. A “dedicated” component, which segregated activity at the level of individual units, emerged in PMd during preparation. It was most prominent following movement when M1 became strongly engaged, and principally involved the contralateral hemisphere. In contrast to recent reports, these dedicated signals solely accounted for divergence of arm-specific neural subspaces. The other “distributed” component mixed signals for each arm within units, and the subspace containing it did not discriminate between arms at any stage. The statistics of the population response suggest two functional aspects of the cortical network: one that spans both hemispheres for supporting preparatory and ongoing processes, and another that is predominantly housed in the contralateral hemisphere and specifies unilateral output.     

Distinct motor plans form and retrieve distinct motor memories for physically identical movements

We can adapt movements to a novel dynamic environment (e.g., tool use, microgravity, and perturbation) by acquiring an internal model of the dynamics. Although multiple environments can be learned simultaneously if each environment is experienced with different limb movement kinematics, it is controversial as to whether multiple internal models for a particular movement can be learned and flexibly retrieved according to behavioral contexts. Here, we address this issue by using a novel visuomotor task. While participants reached to each of two targets located at a clockwise or counter-clockwise position, a gradually increasing visual rotation was applied in the clockwise or counter-clockwise direction, respectively, to the on-screen cursor representing the unseen hand position. This procedure implicitly led participants to perform physically identical pointing movements irrespective of their intentions (i.e., movement plans) to move their hand toward two distinct visual targets. Surprisingly, if each identical movement was executed according to a distinct movement plan, participants could readily adapt these movements to two opposing force fields simultaneously. The results demonstrate that multiple motor memories can be learned and flexibly retrieved, even for physically identical movements, according to distinct motor plans in a visual space.     

Multiple Motor Learning Strategies in Visuomotor Rotation

Background

When exposed to a continuous directional discrepancy between movements of a visible hand cursor and the actual hand (visuomotor rotation), subjects adapt their reaching movements so that the cursor is brought to the target. Abrupt removal of the discrepancy after training induces reaching error in the direction opposite to the original discrepancy, which is called an aftereffect. Previous studies have shown that training with gradually increasing visuomotor rotation results in a larger aftereffect than with a suddenly increasing one. Although the aftereffect difference implies a difference in the learning process, it is still unclear whether the learned visuomotor transformations are qualitatively different between the training conditions.

Methodology/Principal Findings

We examined the qualitative changes in the visuomotor transformation after the learning of the sudden and gradual visuomotor rotations. The learning of the sudden rotation led to a significant increase of the reaction time for arm movement initiation and then the reaching error decreased, indicating that the learning is associated with an increase of computational load in motor preparation (planning). In contrast, the learning of the gradual rotation did not change the reaction time but resulted in an increase of the gain of feedback control, suggesting that the online adjustment of the reaching contributes to the learning of the gradual rotation. When the online cursor feedback was eliminated during the learning of the gradual rotation, the reaction time increased, indicating that additional computations are involved in the learning of the gradual rotation.

Conclusions/Significance

The results suggest that the change in the motor planning and online feedback adjustment of the movement are involved in the learning of the visuomotor rotation. The contributions of those computations to the learning are flexibly modulated according to the visual environment. Such multiple learning strategies would be required for reaching adaptation within a short training period.     

An interference effect of observed biological movement on action

It has been proposed that actions are intrinsically linked to perception and that imagining, observing, preparing, or in any way representing an action excites the motor programs used to execute that same action. There is neurophysiological evidence that certain brain regions involved in executing actions are activated by the mere observation of action (the so-called "mirror system;" ). However, it is unknown whether this mirror system causes interference between observed and simultaneously executed movements. In this study we test the hypothesis that, because of the overlap between action observation and execution, observed actions should interfere with incongruous executed actions. Subjects made arm movements while observing either a robot or another human making the same or qualitatively different arm movements. Variance in the executed movement was measured as an index of interference to the movement. The results demonstrate that observing another human making incongruent movements has a significant interference effect on executed movements. However, we found no evidence that this interference effect occurred when subjects observed a robotic arm making incongruent movements. These results suggest that the simultaneous activation of the overlapping neural networks that process movement observation and execution infers a measurable cost to motor control.     

Arm movements in monkeys: behavior and neurophysiology

Reaching to objects of interest is very common in the behavioral repertoire of primates. Monkeys possess keen binocular vision and make graceful and accurate arm movements. This review focuses on behavioral and neurophysiological aspects of eye-hand coordination in behaving monkeys, including neural coding mechanisms at the single cell level and in neuronal populations. The results of these studies have converged to a common behavioral-neurophysiological ground and provided a springboard for studies of brain mechanisms underlying motor cognitive function.     

Somatosensory-Motor Adaptation of Orofacial Actions in Posterior Parietal and Ventral Premotor Cortices

Recent studies have provided evidence for sensory-motor adaptive changes and action goal coding of visually guided manual action in premotor and posterior parietal cortices. To extend these results to orofacial actions, devoid of auditory and visual feedback, we used a repetition suppression paradigm while measuring neural activity with functional magnetic resonance imaging during repeated intransitive and silent lip, jaw and tongue movements. In the motor domain, this paradigm refers to decreased activity in specific neural populations due to repeated motor acts and has been proposed to reflect sensory-motor adaptation. Orofacial movements activated a set of largely overlapping, common brain areas forming a core neural network classically involved in orofacial motor control. Crucially, suppressed neural responses during repeated orofacial actions were specifically observed in the left ventral premotor cortex, the intraparietal sulcus, the inferior parietal lobule and the superior parietal lobule. Since no visual and auditory feedback were provided during orofacial actions, these results suggest somatosensory-motor adaptive control of intransitive and silent orofacial actions in these premotor and parietal regions.     

Motor Preparatory Activity in Posterior Parietal Cortex is Modulated by Subjective Absolute Value

For optimal response selection, the consequences associated with behavioral success or failure must be appraised. To determine how monetary consequences influence the neural representations of motor preparation, human brain activity was scanned with fMRI while subjects performed a complex spatial visuomotor task. At the beginning of each trial, reward context cues indicated the potential gain and loss imposed for correct or incorrect trial completion. FMRI-activity in canonical reward structures reflected the expected value related to the context. In contrast, motor preparatory activity in posterior parietal and premotor cortex peaked in high “absolute value” (high gain or loss) conditions: being highest for large gains in subjects who believed they performed well while being highest for large losses in those who believed they performed poorly. These results suggest that the neural activity preceding goal-directed actions incorporates the absolute value of that action, predicated upon subjective, rather than objective, estimates of one''s performance.     

Distinctions between dorsal and ventral premotor areas: anatomical connectivity and functional properties

The dorsal and ventral premotor areas, together with the primary motor cortex, are believed to have major roles in preparing and executing limb movements. Recent studies have expanded our knowledge of the dorsal and ventral premotor areas, which occupy the lateral part of area 6 in the frontal cortex. It is becoming clear that these two premotor areas, through involvement in distinct cortical networks, take part in unique aspects of motor planning and decision making. New lines of evidence also implicate the lateral premotor areas in planning motor behavior and selecting actions.     

Dynamics of population code for working memory in the prefrontal cortex

Some neurons (delay cells) in the prefrontal cortex elevate their activities throughout the time period during which the animal is required to remember past events and prepare future behavior, suggesting that working memory is mediated by continuous neural activity. It is unknown, however, how working memory is represented within a population of prefrontal cortical neurons. We recorded from neuronal ensembles in the prefrontal cortex as rats learned a new delayed alternation task. Ensemble activities changed in parallel with behavioral learning so that they increasingly allowed correct decoding of previous and future goal choices. In well-trained rats, considerable decoding was possible based on only a few neurons and after removing continuously active delay cells. These results show that neural activity in the prefrontal cortex changes dynamically during new task learning so that working memory is robustly represented and that working memory can be mediated by sequential activation of different neural populations.     

Abnormalities of mutual influences of the upper and lower limbs after a stroke

The common pattern of muscle activation and specifics of interlimb neuronal connections during the performance of rhythmic separate and simultaneous arm and leg movements in the lying position in healthy subjects, which reflected functionally significant interlimb neuronal interactions, were shown. The study was designed to investigate these mutual influences of the upper and lower limbs during the performance of similar motor tasks by stroke patients. Sixteen poststroke patients with different degrees of hemiparesis performed active and passive arm movements simultaneously with stepping leg movements or without them while lying supine. It was demonstrated that the patients had a disordered common pattern of distribution of muscle activity when they performed voluntary cyclic movements with both arms. Passive movements of both paretic and nonparetic arms led to different degrees of activation of their muscles, depending on the degree of paresis: in patients with mild paresis, muscle activation was similar to that in healthy subjects; in patients with severe paresis, it was insignificant. The loading of the nonparetic arm resulted in an increase in the activity in the paretic arm shoulder flexor muscles in patients with mild paresis (which was typical of healthy subjects), while loading did not influence significantly patients with severe paresis. The combination of cyclic arm movements and stepping leg movements in diagonal synergy decreased the activity in the proximal muscles of both arms, irrespective of the degree of paresis, as it was observed in healthy subjects. Simultaneous arm and leg movements did not change the muscle activity in nonparetic legs in either groups of patients, but the activity in the paretic leg muscles even decreased. The results obtained revealed important features of poststroke motor disturbances, which caused changes in interlimb interactions and largely depended on the degree of paresis. The data could be useful for developing new methods for the performance of rehabilitative procedures in poststroke patients.