A neural network model of basal ganglia’s decision-making circuitry

The basal ganglia have been increasingly recognized as an important structure involved in decision making. Neurons in the basal ganglia were found to reflect the evidence accumulation process during decision making. However, it is not well understood how the direct and indirect pathways of the basal ganglia work together for decision making. Here, we create a recurrent neural network model that is composed of the direct and indirect pathways and test it with the classic random dot motion discrimination task. The direct pathway drives the outputs, which are modulated through a gating mechanism controlled by the indirect pathway. We train the network to learn the task and find that the network reproduces the accuracy and reaction time patterns of previous animal studies. Units in the model exhibit ramping activities that reflect evidence accumulation. Finally, we simulate manipulations of the direct and indirect pathways and find that the manipulations of the direct pathway mainly affect the choice while the manipulations of the indirect pathway affect the model’s reaction time. These results suggest a potential circuitry mechanism of the basal ganglia’s role in decision making with predictions that can be tested experimentally in the future.     

Bidirectional Control of Absence Seizures by the Basal Ganglia: A Computational Evidence

Absence epilepsy is believed to be associated with the abnormal interactions between the cerebral cortex and thalamus. Besides the direct coupling, anatomical evidence indicates that the cerebral cortex and thalamus also communicate indirectly through an important intermediate bridge–basal ganglia. It has been thus postulated that the basal ganglia might play key roles in the modulation of absence seizures, but the relevant biophysical mechanisms are still not completely established. Using a biophysically based model, we demonstrate here that the typical absence seizure activities can be controlled and modulated by the direct GABAergic projections from the substantia nigra pars reticulata (SNr) to either the thalamic reticular nucleus (TRN) or the specific relay nuclei (SRN) of thalamus, through different biophysical mechanisms. Under certain conditions, these two types of seizure control are observed to coexist in the same network. More importantly, due to the competition between the inhibitory SNr-TRN and SNr-SRN pathways, we find that both decreasing and increasing the activation of SNr neurons from the normal level may considerably suppress the generation of spike-and-slow wave discharges in the coexistence region. Overall, these results highlight the bidirectional functional roles of basal ganglia in controlling and modulating absence seizures, and might provide novel insights into the therapeutic treatments of this brain disorder.     

Bipolar disorder: involvement of signaling cascades and AMPA receptor trafficking at synapses

There is increasing evidence that severe mood disorders are associated with impairment of structural plasticity and cellular resilience. Cumulative data demonstrate that mood stabilizers regulate intracellular signaling cascades, including protein kinase C (PKC), PKA, mitogen-activated protein (MAP) kinase, glycogen synthase kinase 3-beta (GSK3-beta) and intracellular calcium, which are signaling pathways that regulate synaptic plasticity. In this context, it is noteworthy that a growing body of data indicates that the glutamatergic system, has a major role in neuronal plasticity and cellular resilience, might be involved in the pathophysiology and treatment of mood disorders. AMPA glutamate-receptor trafficking is important in synaptic plasticity and might play crucial roles in maintaining critical neuronal circuits associated with mood. Two clinically effective, structurally dissimilar, antimanic agents, lithium and valproate (VPA), down-regulate synaptic expression of AMPA receptor subunit GluR1 in hippocampus in chronically treated rats. This reduction in synaptic GluR1 by lithium and VPA is due to attenuated phosphorylation of GluR1 at a specific PKA site (residue 845 of GluR1), which is crucial for AMPA receptor insertion. By contrast,imipramine, which can provoke mania, increases synaptic expression of GluR1 in the hippocampus in vivo. Furthermore, there is ample evidence from preclinical and clinical research that the glutamatergic system is involved in the pathophysiology of mood disorders and that many of the somatic treatments used for mood disorders including antidepressants, mood stabilizers, atypical antipsychotic drugs and electroconvulsive therapy have both direct and indirect effects on the glutamatergic system. Given these findings, further research with medications that specifically affect the glutamatergic system is warranted. Recent studies in our lab have shown that riluzole, a FDA approved medicine that regulates the glutamatergic system, shows antidepressant efficacy in unipolar and bipolar depression. These studies indicate that regulation of glutamate-mediated synaptic plasticity might play a role in the treatment of mood disorders, and raise new avenues for novel therapies for this devastating illness.     

Evaluating the Quality of Evidence from a Network Meta-Analysis

Systematic reviews that collate data about the relative effects of multiple interventions via network meta-analysis are highly informative for decision-making purposes. A network meta-analysis provides two types of findings for a specific outcome: the relative treatment effect for all pairwise comparisons, and a ranking of the treatments. It is important to consider the confidence with which these two types of results can enable clinicians, policy makers and patients to make informed decisions. We propose an approach to determining confidence in the output of a network meta-analysis. Our proposed approach is based on methodology developed by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group for pairwise meta-analyses. The suggested framework for evaluating a network meta-analysis acknowledges (i) the key role of indirect comparisons (ii) the contributions of each piece of direct evidence to the network meta-analysis estimates of effect size; (iii) the importance of the transitivity assumption to the validity of network meta-analysis; and (iv) the possibility of disagreement between direct evidence and indirect evidence. We apply our proposed strategy to a systematic review comparing topical antibiotics without steroids for chronically discharging ears with underlying eardrum perforations. The proposed framework can be used to determine confidence in the results from a network meta-analysis. Judgements about evidence from a network meta-analysis can be different from those made about evidence from pairwise meta-analyses.     

Existence and Control of Go/No-Go Decision Transition Threshold in the Striatum

A typical Go/No-Go decision is suggested to be implemented in the brain via the activation of the direct or indirect pathway in the basal ganglia. Medium spiny neurons (MSNs) in the striatum, receiving input from cortex and projecting to the direct and indirect pathways express D1 and D2 type dopamine receptors, respectively. Recently, it has become clear that the two types of MSNs markedly differ in their mutual and recurrent connectivities as well as feedforward inhibition from FSIs. Therefore, to understand striatal function in action selection, it is of key importance to identify the role of the distinct connectivities within and between the two types of MSNs on the balance of their activity. Here, we used both a reduced firing rate model and numerical simulations of a spiking network model of the striatum to analyze the dynamic balance of spiking activities in D1 and D2 MSNs. We show that the asymmetric connectivity of the two types of MSNs renders the striatum into a threshold device, indicating the state of cortical input rates and correlations by the relative activity rates of D1 and D2 MSNs. Next, we describe how this striatal threshold can be effectively modulated by the activity of fast spiking interneurons, by the dopamine level, and by the activity of the GPe via pallidostriatal backprojections. We show that multiple mechanisms exist in the basal ganglia for biasing striatal output in favour of either the `Go'' or the `No-Go'' pathway. This new understanding of striatal network dynamics provides novel insights into the putative role of the striatum in various behavioral deficits in patients with Parkinson''s disease, including increased reaction times, L-Dopa-induced dyskinesia, and deep brain stimulation-induced impulsivity.     

Mechanisms of effects of adenosine and dopamine on modification of synapses in striato-nigral and striato-pallidal neurons

On the basis of earlier suggested unitary mechanism of synaptic plasticity opposite effects of adenosine and dopamine on the cAMP concentration in striatal spinal cells can emphasize the well known antagonistic interactions between A2A and D2 receptors on striatopallidal cells and between A1 and D1 receptors on striatonigral cells. This is due to that both the dopamine agonist and adenosine antagonist must promote the induction of long-term potentiation/depression of efficacy of excitatory cortical inputs to striatopallidal/striatonigral cells. This modification must lead to synergistic disinhibition of thalamic cells via "direct" and "indirect" pathways through basal ganglia and subsequent strengthening of motor activity.     

Synaptic dysfunction and oxidative stress in Alzheimer's disease: emerging mechanisms

In this paper, we review experimental advances in molecular neurobiology of Alzheimer's disease (AD), with special emphasis on analysis of neural function of proteins involved in AD pathogenesis, their relation with several signaling pathways and with oxidative stress in neurons. Molecular genetic studies have found that mutations in APP, PS1 and PS2 genes and polymorphisms in APOE gene are implicated in AD pathogenesis. Recent studies show that these proteins, in addition to its role in beta-amyloid processing, are involved in several neuroplasticity-signaling pathways (NMDA-PKA-CREB-BDNF, reelin, wingless, notch, among others). Genomic and proteomic studies show early synaptic protein alterations in AD brains and animal models. DNA damage caused by oxidative stress is not completely repaired in neurons and is accumulated in the genes of synaptic proteins. Several functional SNPs in synaptic genes may be interesting candidates to explore in AD as genetic correlates of this synaptopathy in a "synaptogenomics" approach. Thus, experimental evidence shows that proteins implicated in AD pathogenesis have differential roles in several signaling pathways related to neuromodulation and neurotransmission in adult and developing brain. Genomic and proteomic studies support these results. We suggest that oxidative stress effects on DNA and inherited variations in synaptic genes may explain in part the synaptic dysfunction seen in AD.     

Two-phase model of the basal ganglia: implications for discontinuous control of the motor system

In this article, I point out that simple one-phase models of the role of the basal ganglia in action selection have a problem. Furthermore, I suggest a solution with major implications for the organization of the action-selection and motor systems. In current models, the striatum evaluates multiple potential actions by adding biases based on previous conditioning. These biases may arise in both the direct (bias for) and indirect (bias against) pathways. Together, these biases influence which action is ultimately chosen. For efficient conditioning to occur, a positive outcome must selectively strengthen the striatal bias for the chosen action (via a dopaminergic mechanism). This is problematic, however, because all potential action choices have influenced firing patterns in striatal cells during the selection process; it is therefore unclear how the synapses that represent the chosen plan could be selectively strengthened. I suggest a simple solution in which the striatum has two functional phases. In the first phase, the basal ganglia provide biases for multiple potential actions (using both the direct and indirect pathways), leading to the choice of a single action in the cortex. In the second phase, an efference copy of the chosen action is sent to the striatum, where it contributes to the establishment of the eligibility trace for that action. This trace, when acted on by subsequent dopaminergic reinforcement, leads to specific strengthening of the bias only for the chosen action. Consistent with this model, recordings show post-choice imposition onto the striatum of signals corresponding to the chosen action. The existence of dual phases of basal ganglia function implies that decisions about action choice are sent to the motor system in a discontinuous manner. This would not be problematic if the motor system also operated discontinuously. I will review evidence suggesting that this is the case, notably that action is organized by approximately 10 Hz oscillations.     

A direct method for the simultaneous measurement of ceramide and phospholipase D activity

Both ceramide and phospholipase D (PLD) have important roles in a variety of signal transduction pathways. Recent evidence suggests that ceramide is a novel second messenger with specific biological effects. Publications in this field have increased rapidly in the last few years. However, a method to directly and rapidly measure cermide production has been lacking. Herein, we report on a novel, inexpensive, direct and rapid assay for the measurement of ceramide and the simultaneous measurement of PLD activity. This method uses labeling of cells with [(14)C]myristic acid and a TLC solvent of ethyl acetate/acetic acid/trimethylpentane. This method avoids the loss of radioactivity and variability due to changes in DAG kinase activity that are associated with the commonly-used DAG kinase assay.     

Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons

Animals must respond selectively to specific combinations of salient environmental stimuli in order to survive in complex environments. A task with these features, biconditional discrimination, requires responses to select pairs of stimuli that are opposite to responses to those stimuli in another combination. We investigate the characteristics of synaptic plasticity and network connectivity needed to produce stimulus-pair neural responses within randomly connected model networks of spiking neurons trained in biconditional discrimination. Using reward-based plasticity for synapses from the random associative network onto a winner-takes-all decision-making network representing perceptual decision-making, we find that reliably correct decision making requires upstream neurons with strong stimulus-pair selectivity. By chance, selective neurons were present in initial networks; appropriate plasticity mechanisms improved task performance by enhancing the initial diversity of responses. We find long-term potentiation of inhibition to be the most beneficial plasticity rule by suppressing weak responses to produce reliably correct decisions across an extensive range of networks.     

溶酶体相关细胞器生物发生复合体相互作用组构成胞内体运输网络

随着高等生物中十几个新的参与囊泡运输的 Hermansky-Pudlak 综合征(HPS)蛋白质的发现, 认为可能存在一类新的囊泡运输通路。该通路主要由新近鉴定的 3 个被称为溶酶体相关细胞器生物发生复合体(BLOC)所组成, 被分别命名为BLOC-1、BLOC-2 和 BLOC-3。越来越多的证据表明这些复合体与以前认识较清楚的 AP3 和 HOPS 复合体共同在胞内体运输中起重要作用。这些复合体之间的相互作用构成了以胞内体和细胞骨架为连接纽带的参与蛋白质运输的复杂网络。该网络中的每个节点的相互作用可区分为复合体内和复合体外相互作用两大类。复合体之间的联系可以是来自不同复合体亚基间的直接相互作用, 也可以通过耦联的节点联结不同的复合体。解析这一复杂网络有助于进一步了解参与蛋白质和膜运输这一动态而精细网络的结构与功能。一旦该网络结构得到破坏, 则可能导致如 HPS 这类囊泡运输或细胞器发生障碍性疾病。     

Mean-field modeling of the basal ganglia-thalamocortical system. II: Dynamics of parkinsonian oscillations

Neuronal correlates of Parkinson's disease (PD) include a shift to lower frequencies in the electroencephalogram (EEG) and enhanced synchronized oscillations at 3-7 and 7-30 Hz in the basal ganglia, thalamus, and cortex. This study describes the dynamics of a recent physiologically based mean-field model of the basal ganglia-thalamocortical system, and shows how it accounts for many key electrophysiological correlates of PD. Its detailed functional connectivity comprises partially segregated direct and indirect pathways through two populations of striatal neurons, a hyperdirect pathway involving a corticosubthalamic projection, thalamostriatal feedback, and local inhibition in striatum and external pallidum (GPe). In a companion paper, realistic steady-state firing rates were obtained for the healthy state, and after dopamine loss modeled by weaker direct and stronger indirect pathways, reduced intrapallidal inhibition, lower firing thresholds of the GPe and subthalamic nucleus (STN), a stronger projection from striatum to GPe, and weaker cortical interactions. Here it is shown that oscillations around 5 and 20 Hz can arise with a strong indirect pathway, which also causes increased synchronization throughout the basal ganglia. Furthermore, increased theta power with progressive nigrostriatal degeneration is correlated with reduced alpha power and peak frequency, in agreement with empirical results. Unlike the hyperdirect pathway, the indirect pathway sustains oscillations with phase relationships that coincide with those found experimentally. Alterations in the responses of basal ganglia to transient stimuli accord with experimental observations. Reduced cortical gains due to both nigrostriatal and mesocortical dopamine loss lead to slower changes in cortical activity and may be related to bradykinesia. Finally, increased EEG power found in some studies may be partly explained by a lower effective GPe firing threshold, reduced GPe-GPe inhibition, and/or weaker intracortical connections in parkinsonian patients. Strict separation of the direct and indirect pathways is not necessary to obtain these results.     

Autophagic bias in the striatum

ABSTRACT

Macroautophagy/autophagy is implicated in the maintenance of normal neuronal activity through the regulation of synaptic function and plasticity. However, differences in autophagic degradation within different classes of neurons have not been examined. We have recently demonstrated that autophagy plays very different roles in the two closely related principal neurons of the striatum – the spiny projection neurons of the direct (dSPN) and indirect (iSPN) pathways. Behavioral and electrophysiological experiments revealed that the absence of autophagy in either of these SPN pathways produces unique effects on motor learning, dendritic length, and intrinsic excitability. Specifically, autophagy is required for the normal development of synaptic inputs onto dSPNs, while being required for intrinsic excitability in iSPNs. In iSPNs, this occurs through the regulation of the activity of the KCNJ/Kir2 ion channel, and provides a first demonstration of autophagic control of neuronal intrinsic excitability.     

Regulation of HSP70 in excitatory neurons: Possible implications for neuronal functioning

Neurons maintain an intricate organization of cytoplasmic and membrane proteins for their integrity, quick communication across synapses and for other complex activities. Molecular chaperones such as members of the 70 kDa heat shock protein (HSP70) family may play very important roles in these functions. However, in spite of a recent report suggesting the presence of HSP70 related proteins in the synaptic vesicle docking complex at presynaptic sites and the known significant roles for HSP70 in excitotoxicity, there are remarkably few studies that have explored the potential role of HSP70 family proteins in physiological functions of neurons. Here we bring together direct and indirect evidences which suggest that several different pathways involved in long-term potentiation can influence the HSP70 levels at the synapse and hypothesize on possible physiological significance of this family of proteins in neuronal functions.     

Studying the microbiota of bats: Accuracy of direct and indirect samplings

Given the recurrent bat‐associated disease outbreaks in humans and recent advances in metagenomics sequencing, the microbiota of bats is increasingly being studied. However, obtaining biological samples directly from wild individuals may represent a challenge, and thus, indirect passive sampling (without capturing bats) is sometimes used as an alternative. Currently, it is not known whether the bacterial community assessed using this approach provides an accurate representation of the bat microbiota. This study was designed to compare the use of direct sampling (based on bat capture and handling) and indirect sampling (collection of bat's excretions under bat colonies) in assessing bacterial communities in bats. Using high‐throughput 16S rRNA sequencing of urine and feces samples from Rousettus aegyptiacus, a cave‐dwelling fruit bat species, we found evidence of niche specialization among different excreta samples, independent of the sampling approach. However, sampling approach influenced both the alpha‐ and beta‐diversity of urinary and fecal microbiotas. In particular, increased alpha‐diversity and more overlapping composition between urine and feces samples was seen when direct sampling was used, suggesting that cross‐contamination may occur when collecting samples directly from bats in hand. In contrast, results from indirect sampling in the cave may be biased by environmental contamination. Our methodological comparison suggested some influence of the sampling approach on the bat‐associated microbiota, but both approaches were able to capture differences among excreta samples. Assessment of these techniques opens an avenue to use more indirect sampling, in order to explore microbial community dynamics in bats.     

Female mating decisions: maximizing fitness?

Sexual selection theory assumes that maximizing fitness is the ultimate goal in every mating decision. Fitness can be maximized directly by increasing the number of offspring (direct benefits) or indirectly by maximizing offspring's lifetime reproductive success (indirect benefits). Whereas there is considerable evidence in the literature for the influence of mating decisions on direct benefits, indirect benefits have been more elusive. Here, we review the variables that influence mating decisions made by females of freshwater fish and how these affect their fitness directly, as well as indirectly. Females enhance their fitness by matching their mating decisions to current environmental conditions, using a wide range of pre- and post-copulation mechanisms that enable them to maximize benefits from mating. Male sexual traits and courtship displays are signals used by females as a way of assessing male quality in terms of both direct and indirect benefits. Polyandry is very common among freshwater fish species, and indirect benefits have been hypothesized as drivers of its predominance. Despite intensive theoretical work, and multiple suggestions of the effects of indirect benefits, to date no study has been able to demonstrate experimentally the existence of indirect benefits in freshwater fish species. Additionally, most studies of direct benefits measure short-term benefits of mating decisions. In both cases, lifetime reproductive success is not assessed. Therefore, we are led to conclude that evidence as to whether female mating decisions result in direct and/or indirect benefits in freshwater fish species is still lacking. These results should be considered in light of the ongoing debate about the significance of indirect benefits in female mating decisions.     

How awareness changes the relative weights of evidence during human decision-making

Human decisions are based on accumulating evidence over time for different options. Here we ask a simple question: How is the accumulation of evidence affected by the level of awareness of the information? We examined the influence of awareness on decision-making using combined behavioral methods and magneto-encephalography (MEG). Participants were required to make decisions by accumulating evidence over a series of visually presented arrow stimuli whose visibility was modulated by masking. Behavioral results showed that participants could accumulate evidence under both high and low visibility. However, a top-down strategic modulation of the flow of incoming evidence was only present for stimuli with high visibility: once enough evidence had been accrued, participants strategically reduced the impact of new incoming stimuli. Also, decision-making speed and confidence were strongly modulated by the strength of the evidence for high-visible but not low-visible evidence, even though direct priming effects were identical for both types of stimuli. Neural recordings revealed that, while initial perceptual processing was independent of visibility, there was stronger top-down amplification for stimuli with high visibility than low visibility. Furthermore, neural markers of evidence accumulation over occipito-parietal cortex showed a strategic bias only for highly visible sensory information, speeding up processing and reducing neural computations related to the decision process. Our results indicate that the level of awareness of information changes decision-making: while accumulation of evidence already exists under low visibility conditions, high visibility allows evidence to be accumulated up to a higher level, leading to important strategical top-down changes in decision-making. Our results therefore suggest a potential role of awareness in deploying flexible strategies for biasing information acquisition in line with one''s expectations and goals.     

A possible mechanism of dopamine-induced synergistic disinhibition of thalamic cells via "direct" and "indirect" pathways in basal ganglia

On the basis of the mechanism of synaptic plasticity that we have earlier suggested for striatal spiny neurons and with regard to the known data about the predominance of dopamine-sensitive D1/D2 receptors on the striatonigral/striatopallidal cells it is hypothesized that the induction of the long-term potentiation/depression of the efficacy of excitatory cortical inputs to these cells can underlie the excitatory/inhibitory effect of dopamine on the activity of neurons that originate the "direct"/"indirect" pathways through the basal ganglia. Both these effects will lead to an enhancement of the activity of thalamic cells and activity of the efferent neocortical neurons excited by thalamic cells. The long-term potentiation of corticostriatal inputs to striosomal neurons, where, predominantly, D1 receptors are located, can also be induced by dopamine. This effect can be responsible of a rise of inhibition of dopaminergic cells and decrease in dopamine release by these cells. Such an event sequence can provide a stable dopamine concentration in the loop neocortex-basal ganglia-thalamus-neocortex.     

Neuromodulation of STDP through short-term changes in firing causality

Spike timing dependent plasticity (STDP) likely plays an important role in forming and changing connectivity patterns between neurons in our brain. In a unidirectional synaptic connection between two neurons, it uses the causal relation between spiking activity of a presynaptic input neuron and a postsynaptic output neuron to change the strength of this connection. While the nature of STDP benefits unsupervised learning of correlated inputs, any incorporation of value into the learning process needs some form of reinforcement. Chemical neuromodulators such as Dopamine or Acetylcholine are thought to signal changes between external reward and internal expectation to many brain regions, including the basal ganglia. This effect is often modelled through a direct inclusion of the level of Dopamine as a third factor into the STDP rule. While this gives the benefit of direct control over synaptic modification, it does not account for observed instantaneous effects in neuronal activity on application of Dopamine agonists. Specifically, an instant facilitation of neuronal excitability in the striatum can not be explained by the only indirect effect that dopamine-modulated STDP has on a neuron’s firing pattern. We therefore propose a model for synaptic transmission where the level of neuromodulator does not directly influence synaptic plasticity, but instead alters the relative firing causality between pre- and postsynaptic neurons. Through the direct effect on postsynaptic activity, our rule allows indirect modulation of the learning outcome even with unmodulated, two-factor STDP. However, it also does not prohibit joint operation together with three-factor STDP rules.