Complementary roles of basal ganglia and cerebellum in learning and motor control

The classical notion that the basal ganglia and the cerebellum are dedicated to motor control has been challenged by the accumulation of evidence revealing their involvement in non-motor, cognitive functions. From a computational viewpoint, it has been suggested that the cerebellum, the basal ganglia, and the cerebral cortex are specialized for different types of learning: namely, supervised learning, reinforcement learning and unsupervised learning, respectively. This idea of learning-oriented specialization is helpful in understanding the complementary roles of the basal ganglia and the cerebellum in motor control and cognitive functions.     

Modeling effect of GABAergic current in a basal ganglia computational model

Electrical high frequency stimulation (HFS) of deep brain regions is a method shown to be clinically effective in different types of movement and neurological disorders. In order to shed light on its mode of action a computational model of the basal ganglia network coupled the HFS as injection current into the cells of the subthalamic nucleus (STN). Its overall increased activity rendered a faithful transmission of sensorimotor input through thalamo-cortical relay cells possible. Our contribution uses this model by Rubin and Terman (J Comput Neurosci, 16, 211–223, 2004) as a starting point and integrates recent findings on the importance of the extracellular concentrations of the inhibiting neurotransmitter GABA. We are able to show in this computational study that besides electrical stimulation a high concentration of GABA and its resulting conductivity in STN cells is able to re-establish faithful thalamocortical relaying, which otherwise broke down in the simulated parkinsonian state.     

Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease

Progressive loss of the ascending dopaminergic projection in the basal ganglia is a fundamental pathological feature of Parkinson's disease. Studies in animals and humans have identified spatially segregated functional territories in the basal ganglia for the control of goal-directed and habitual actions. In patients with Parkinson's disease the loss of dopamine is predominantly in the posterior putamen, a region of the basal ganglia associated with the control of habitual behaviour. These patients may therefore be forced into a progressive reliance on the goal-directed mode of action control that is mediated by comparatively preserved processing in the rostromedial striatum. Thus, many of their behavioural difficulties may reflect a loss of normal automatic control owing to distorting output signals from habitual control circuits, which impede the expression of goal-directed action.     

Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system

The prefrontal cortex (PFC) has long been thought to serve as an 'executive' that controls the selection of actions and cognitive functions more generally. However, the mechanistic basis of this executive function has not been clearly specified often amounting to a homunculus. This paper reviews recent attempts to deconstruct this homunculus by elucidating the precise computational and neural mechanisms underlying the executive functions of the PFC. The overall approach builds upon existing mechanistic models of the basal ganglia (BG) and frontal systems known to play a critical role in motor control and action selection, where the BG provide a 'Go' versus 'NoGo' modulation of frontal action representations. In our model, the BG modulate working memory representations in prefrontal areas to support more abstract executive functions. We have developed a computational model of this system that is capable of developing human-like performance on working memory and executive control tasks through trial-and-error learning. This learning is based on reinforcement learning mechanisms associated with the midbrain dopaminergic system and its activation via the BG and amygdala. Finally, we briefly describe various empirical tests of this framework.     

Inhibition of striatal soluble guanylyl cyclase-cGMP signaling reverses basal ganglia dysfunction and akinesia in experimental parkinsonism

Objective

There is clearly a necessity to identify novel non-dopaminergic mechanisms as new therapeutic targets for Parkinson''s disease (PD). Among these, the soluble guanylyl cyclase (sGC)-cGMP signaling cascade is emerging as a promising candidate for second messenger-based therapies for the amelioration of PD symptoms. In the present study, we examined the utility of the selective sGC inhibitor 1H-[1], [2], [4] oxadiazolo-[4,3-a]quinoxalin-1-one (ODQ) for reversing basal ganglia dysfunction and akinesia in animal models of PD.

Methods

The utility of the selective sGC inhibitor ODQ for reversing biochemical, electrophysiological, histochemical, and behavioral correlates of experimental PD was performed in 6-OHDA-lesioned rats and mice chronically treated with MPTP.

Results

We found that one systemic administration of ODQ is sufficient to reverse the characteristic elevations in striatal cGMP levels, striatal output neuron activity, and metabolic activity in the subthalamic nucleus observed in 6-OHDA-lesioned rats. The latter outcome was reproduced after intrastriatal infusion of ODQ. Systemic administration of ODQ was also effective in improving deficits in forelimb akinesia induced by 6-OHDA and MPTP.

Interpretation

Pharmacological inhibition of the sGC-cGMP signaling pathway is a promising non-dopaminergic treatment strategy for restoring basal ganglia dysfunction and attenuating motor symptoms associated with PD.     

Dopamine-glutamate interactions in the basal ganglia

Summary In an attempt to formulate a working hypothesis of basal-ganglia functions, arguments are considered suggesting that the basal ganglia are involved in a process of response selection i.e. in the facilitation of wanted and in the suppression of unwanted behaviour. The meso-accumbal dopamine-system is considered to mediate natural and drug-induced reward and sensitization. The meso-striatal dopamine-system seems to fulfill similar funcions: It may mediate reinforcement which strengthens a given behaviour when elicited subsequently, but which is not experienced as reward or hedonia.Glutamate as the transmitter of the corticofugal projections to the basal ganglia nuclei and of the subthalamic neurons is critically involved in basal ganglia funcions and dysfunctions; for example Parkinson's disease can be considered to be a secondary hyperglutamatergic disease. Additionally, glutamate is an essential factor in the plasticity response of the basal-ganglia. However, opposite to previous suggestions, the NMDA-receptor blocker MK-801 does not prevent psychostimulant- nor morphine-induced day to day increase (sensitization) of locomotion. Also the day to day increase of haloperidol-induced catalepsy was not prevented by MK-801.     

Two-phase model of the basal ganglia: implications for discontinuous control of the motor system

In this article, I point out that simple one-phase models of the role of the basal ganglia in action selection have a problem. Furthermore, I suggest a solution with major implications for the organization of the action-selection and motor systems. In current models, the striatum evaluates multiple potential actions by adding biases based on previous conditioning. These biases may arise in both the direct (bias for) and indirect (bias against) pathways. Together, these biases influence which action is ultimately chosen. For efficient conditioning to occur, a positive outcome must selectively strengthen the striatal bias for the chosen action (via a dopaminergic mechanism). This is problematic, however, because all potential action choices have influenced firing patterns in striatal cells during the selection process; it is therefore unclear how the synapses that represent the chosen plan could be selectively strengthened. I suggest a simple solution in which the striatum has two functional phases. In the first phase, the basal ganglia provide biases for multiple potential actions (using both the direct and indirect pathways), leading to the choice of a single action in the cortex. In the second phase, an efference copy of the chosen action is sent to the striatum, where it contributes to the establishment of the eligibility trace for that action. This trace, when acted on by subsequent dopaminergic reinforcement, leads to specific strengthening of the bias only for the chosen action. Consistent with this model, recordings show post-choice imposition onto the striatum of signals corresponding to the chosen action. The existence of dual phases of basal ganglia function implies that decisions about action choice are sent to the motor system in a discontinuous manner. This would not be problematic if the motor system also operated discontinuously. I will review evidence suggesting that this is the case, notably that action is organized by approximately 10 Hz oscillations.     

A computational model of action selection in the basal ganglia. I. A new functional anatomy

 We present a biologically plausible model of processing intrinsic to the basal ganglia based on the computational premise that action selection is a primary role of these central brain structures. By encoding the propensity for selecting a given action in a scalar value (the salience), it is shown that action selection may be re-cast in terms of signal selection. The generic properties of signal selection are defined and neural networks for this type of computation examined. A comparison between these networks and basal ganglia anatomy leads to a novel functional decomposition of the basal ganglia architecture into `selection' and `control' pathways. The former pathway performs the selection per se via a feedforward off-centre on-surround network. The control pathway regulates the action of the selection pathway to ensure its effective operation, and synergistically complements its dopaminergic modulation. The model contrasts with the prevailing functional segregation of basal ganglia into `direct' and `indirect' pathways. Received: 16 February 2000 / Accepted in revised form: 30 October 2000     

A population level computational model of the basal ganglia that generates parkinsonian local field potential activity

Recordings from the basal ganglia’s subthalamic nucleus are acquired via microelectrodes immediately prior to the application of Deep Brain Stimulation (DBS) treatment for Parkinson’s Disease (PD) to assist in the selection of the final point for the implantation of the DBS electrode. The acquired recordings reveal a persistent characteristic beta band peak in the power spectral density function of the Local Field Potential (LFP) signals. This peak is considered to lie at the core of the causality–effect relationships of the parkinsonian pathophysiology. Based on LFPs acquired from human subjects during DBS for PD, we constructed a computational model of the basal ganglia on the population level that generates LFPs to identify the critical pathophysiological alterations that lead to the expression of the beta band peak. To this end, we used experimental data reporting that the strengths of the synaptic connections are modified under dopamine depletion. The hypothesis that the altered dopaminergic modulation may affect both the amplitude and the time course of the postsynaptic potentials is validated by the model. The results suggest a pivotal role of both of these parameters to the pathophysiology of PD.     

Associative and sensorimotor cortico‐basal ganglia circuit roles in effects of abused drugs

The mammalian forebrain is characterized by the presence of several parallel cortico‐basal ganglia circuits that shape the learning and control of actions. Among these are the associative, limbic and sensorimotor circuits. The function of all of these circuits has now been implicated in responses to drugs of abuse, as well as drug seeking and drug taking. While the limbic circuit has been most widely examined, key roles for the other two circuits in control of goal‐directed and habitual instrumental actions related to drugs of abuse have been shown. In this review we describe the three circuits and effects of acute and chronic drug exposure on circuit physiology. Our main emphasis is on drug actions in dorsal striatal components of the associative and sensorimotor circuits. We then review key findings that have implicated these circuits in drug seeking and taking behaviors, as well as drug use disorders. Finally, we consider different models describing how the three cortico‐basal ganglia circuits become involved in drug‐related behaviors. This topic has implications for drug use disorders and addiction, as treatments that target the balance between the different circuits may be useful for reducing excessive substance use.     

Localization and physiological roles of metabotropic glutamate receptors in the direct and indirect pathways of the basal ganglia

Summary.  Our current understanding of the circuitry of the basal ganglia, and the pathophysiology of Parkinson's disease has led to major breakthroughs in the treatment of this debilitating movement disorder. Unfortunately, there are significant problems with the currently available pharmacological therapies that focus on dopamine replacement or dopaminergic agonists. Because of this, much effort has been focused on developing novel targets for the treatment of Parkinson's disease. The metabotropic glutamate receptors are a family of G-protein coupled receptors activated by glutamate. These receptors are differentially distributed throughout the basal ganglia in a manner suggesting that they may provide novel targets for the treatment of movement disorders. In this review we summarize anatomical and physiological data from our work and the work of other laboratories describing the distribution and physiological roles of metabotropic glutamate receptors in the basal ganglia with emphasis on possible therapeutic targets. Received July 2, 2001 Accepted August, 6, 2001 Published online June 26, 2002     

Involvement of human basal ganglia in offline feedback control of voluntary movement

Practice makes perfect, but the neural substrates of trial-to-trial learning in motor tasks remain unclear. There is some evidence that the basal ganglia process feedback-related information to modify learning in essentially cognitive tasks , but the evidence that these key motor structures are involved in offline feedback-related improvement of performance in motor tasks is paradoxically limited. Lesion studies in adult zebra finches suggest that the avian basal ganglia are involved in the transmission or production of an error signal during song . However, patients with Huntington's disease, in which there is prominent basal ganglia dysfunction, are not impaired in error-dependent modulation of future trial performance . By directly recording from the subthalamic nucleus in patients with Parkinson's disease, we demonstrate that this nucleus processes error in trial performance at short latency. Local evoked activity is greatest in response to smallest errors and influences the programming of subsequent movements. Accordingly, motor parameters are least likely to change after the greatest evoked responses so that accurately performed trials tend to precede other accurate trials. This relationship is disrupted by electrical stimulation of the nucleus at high frequency. Thus, the human subthalamic nucleus is involved in feedback-based learning.     

A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour

 In a companion paper a new functional architecture was proposed for the basal ganglia based on the premise that these brain structures play a central role in behavioural action selection. The current paper quantitatively describes the properties of the model using analysis and simulation. The decomposition of the basal ganglia into selection and control pathways is supported in several ways. First, several elegant features are exposed – capacity scaling, enhanced selectivity and synergistic dopamine modulation – which might be expected to exist in a well designed action selection mechanism. The discovery of these features also lends support to the computational premise of selection that underpins our model. Second, good matches between model globus pallidus external segment output and globus pallidus internal segment and substantia nigra reticulata area output, and neurophysiological data, have been found which are indicative of common architectural features in the model and biological basal ganglia. Third, the behaviour of the model as a signal selection mechanism has parallels with some kinds of action selection observed in animals under various levels of dopaminergic modulation. Received: 16 July 2000 / Accepted in revised form: 30 October 2000     

PET imaging of the basal ganglia

The present chapter reviews PET imaging in basal ganglia disorders; Parkinson's disease is used as a model of these disorders because the neurochemical pathobiology of this disease is well known and great advances in the imaging area have been achieved. Other basal ganglia disorders including Tourette's syndrome, dystonia, Huntington's chorea and Wilson's disease are also dealt with. With PET and SPECT techniques, the whole integrative dopaminergic network of neurons can be studied, which plays an important role in differential diagnostics. Furthermore, pharmacological effects of medication can be visualized and the role of stereotaxic neurosurgery can be evaluated. Finally, functional imaging gives clues about the prognosis and rehabilitation aspects of the basal ganglia disorders.     

Motor functions of the basal ganglia

This session dealt with the structure and function of the basal ganglia and their role in motor control. The key issues discussed in the first four presentations concerned the pathophysiology of movement performance in parkinsonian patients and in animal models of this disease. Three papers were presented on neurochemically specified subsystems of the basal ganglia. Therapeutic aspects (stereoencephalotomy and chronic electrical stimulation of neural tissue) were discussed in the last two papers. A brief account is given on the highlights of each of these reports.     

Modulation by dopamine of human basal ganglia involvement in feedback control of movement

We learn new motor tasks by trial and error, repeating what works best and avoiding past mistakes. To repeat what works best we must register a satisfactory outcome, and in a study [1] we showed the existence of an evoked activity in the basal ganglia that correlates with accuracy of task performance and is associated with reiteration of successful motor parameters in subsequent movements. Here we report evidence that the signaling of positive trial outcome relies on dopaminergic input to the basal ganglia, by recording from the subthalamic nucleus (STN) in patients with nigrostriatal denervation due to Parkinson's Disease (PD) who have undergone functional neurosurgery. Correlations between subthalamic evoked activities and trial accuracy were weak and behavioral performance remained poor while patients were untreated; however, both improved after the dopamine prodrug levodopa was re-introduced. The results suggest that the midbrain dopaminergic system may be important, not only in signaling explicit positive outcomes or rewards in tasks requiring choices between options [2,3], but also in trial-to-trial learning and in reinforcing the selection of optimal parameters in more automatic motor control.