Network, cellular and molecular mechanisms of plasticity in simple nervous systems

In the present study we will try to single out several principles of the nervous system functioning essential for describing mechanisms of learning and memory basing on our own experimental investigation of cellular mechanisms of memory in the nervous system of gastropod molluscs and literature data: main changes in functioning due to learning occur in effectivity of synaptic inputs and in the intrinsic properties of postsynaptic neurons; due to learning some synaptic inputs of neurons selectively change its effectivity due to pre- and postsynaptic changes, but the induction of plasticity always starts in postsynapse, maintaining of long-term memory in postsynapse is also shown; reinforcement is not related to activity of the neural chain receptor-sensory neuron-interneuron-motoneuron-effector; reinforcement is mediated via activity of modulatory neurons, and in some cases can be exerted by a single neuron; activity of modulatory neurons is necessary for development of plastic modifications of behavior (including associative), but is not needed for recall of conditioned responses. At the same time, the modulatory neurons (in fact they constitute a neural reinforcement system) are necessary for recall of context associative memory; changes due to learning occur at least in two independent loci in the nervous system. A possibility for erasure of memory with participation of nitroxide is experimentally and theoretically based.     

A persistent cellular change in a single modulatory neuron contributes to associative long-term memory

Most neuronal models of learning assume that changes in synaptic strength are the main mechanism underlying long-term memory (LTM) formation. However, we show here that a persistent depolarization of membrane potential, a type of cellular change that increases neuronal responsiveness, contributes significantly to a long-lasting associative memory trace. The use of a model invertebrate network with identified neurons and known synaptic connectivity had the advantage that the contribution of this cellular change to memory could be evaluated in a neuron with a known function in the learning circuit. Specifically, we used the well-understood motor circuit underlying molluscan feeding and showed that a key modulatory neuron involved in the initiation of feeding ingestive movements underwent a long-term depolarization following behavioral associative conditioning. This depolarization led to an enhanced single cell and network responsiveness to a previously neutral tactile conditioned stimulus, and the persistence of both matched the time course of behavioral associative memory. The change in the membrane potential of a key modulatory neuron is both sufficient and necessary to initiate a conditioned response in a reduced preparation and underscores its importance for associative LTM.     

The Role of Dopamine in Drosophila Larval Classical Olfactory Conditioning

Learning and memory is not an attribute of higher animals. Even Drosophila larvae are able to form and recall an association of a given odor with an aversive or appetitive gustatory reinforcer. As the Drosophila larva has turned into a particularly simple model for studying odor processing, a detailed neuronal and functional map of the olfactory pathway is available up to the third order neurons in the mushroom bodies. At this point, a convergence of olfactory processing and gustatory reinforcement is suggested to underlie associative memory formation. The dopaminergic system was shown to be involved in mammalian and insect olfactory conditioning. To analyze the anatomy and function of the larval dopaminergic system, we first characterize dopaminergic neurons immunohistochemically up to the single cell level and subsequent test for the effects of distortions in the dopamine system upon aversive (odor-salt) as well as appetitive (odor-sugar) associative learning. Single cell analysis suggests that dopaminergic neurons do not directly connect gustatory input in the larval suboesophageal ganglion to olfactory information in the mushroom bodies. However, a number of dopaminergic neurons innervate different regions of the brain, including protocerebra, mushroom bodies and suboesophageal ganglion. We found that dopamine receptors are highly enriched in the mushroom bodies and that aversive and appetitive olfactory learning is strongly impaired in dopamine receptor mutants. Genetically interfering with dopaminergic signaling supports this finding, although our data do not exclude on naïve odor and sugar preferences of the larvae. Our data suggest that dopaminergic neurons provide input to different brain regions including protocerebra, suboesophageal ganglion and mushroom bodies by more than one route. We therefore propose that different types of dopaminergic neurons might be involved in different types of signaling necessary for aversive and appetitive olfactory memory formation respectively, or for the retrieval of these memory traces. Future studies of the dopaminergic system need to take into account such cellular dissociations in function in order to be meaningful.     

Parallel processing in an identified neural circuit: the Aplysia californica gill-withdrawal response model system

The response of the gill of Aplysia calfornica Cooper to weak to moderate tactile stimulation of the siphon, the gill-withdrawal response or GWR, has been an important model system for work aimed at understanding the relationship between neural plasticity and simple forms of non-associative and associative learning. Interest in the GWR has been based largely on the hypothesis that the response could be explained adequately by parallel monosynaptic reflex arcs between six parietovisceral ganglion (PVG) gill motor neurons (GMNs) and a cluster of sensory neurons termed the LE cluster. This hypothesis, the Kupfermann-Kandel model, made clear, falsifiable predictions that have stimulated experimental work for many years. Here, we review tests of three predictions of the Kupfermann-Kandel model: (1) that the GWR is a simple, reflexive behaviour graded with stimulus intensity; (2) that central nervous system (CNS) pathways are necessary and sufficient for the GWR; and (3) that activity in six identified GMNs is sufficient to account for the GWR. The available data suggest that (1) a variety of action patterns occur in the context of the GWR; (2) the PVG is not necessary and the diffuse peripheral nervous system (PNS) is sufficient to mediate these action patterns; and (3) the role of any individual GMN in the behaviour varies. Both the control of gill-withdrawal responses, and plasticity in these responses, are broadly distributed across both PNS and CNS pathways. The Kupfermann-Kandel model is inconsistent with the available data and therefore stands rejected. There is, no known causal connection or correlation between the observed plasticity at the identified synapses in this system and behavioural changes during non-associative and associative learning paradigms. Critical examination of these well-studied central pathways suggests that they represent a 'wetware' neural network, architecturally similar to the neural network models of the widely used 'Perceptron' and/or 'Back-propagation' type. Such models may offer a more biologically realistic representation of nervous system organisation than has been thought. In this model, the six parallel GMNs of the CNS correspond to a hidden layer within one module of the gill-control system. That is, the gill-control system appears to be organised as a distributed system with several parallel modules, some of which are neural networks in their own right. A new model is presented here which predicts that the six GMNs serve as components of a 'push-pull' gain control system, along with known but largely unidentified inhibitory motor neurons from the PVG. This 'push-pull' gain control system sets the responsiveness of the peripheral gill motor system. Neither causal nor correlational links between specific forms of neural plasticity and behavioural plasticity have been demonstrated in the GWR model system. However, the GWR model system does provide an opportunity to observe and describe directly the physiological and biochemical mechanisms of distributed representation and parallel processing in a largely identifiable 'wetware' neural network.     

Backward signal from medial temporal lobe in neural circuit reorganization of primate inferotemporal cortex

Neuropsychological theories proposed a critical role of the interaction between the medial temporal lobe and neocortex in the formation of long-term memory for facts and events, which has often been tested by learning of a series of paired words or figures in humans. We identify neural mechanisms of this long-term memory formation process by single-unit recording and molecular biological methods in an animal model of visual pair-association task in monkeys. In our previous studies, we found a group of neurons that manifested selective responses to both of the paired associates (pair-coding neuron) in the anterior inferior temporal (IT) cortex. It provides strong evidence that single IT neurons acquire the response-selectivity through associative learning, and suggests that the reorganized neural circuits for the pair-coding neurons serve as the memory engram of the pair-association learning. In this article, we investigated further mechanisms of the neural circuit reorganization. First, we tested the role of the backward connections from the medial temporal lobe to IT cortex. lbotenic acid was injected unilaterally into the entorhinal and perirhinal cortex which provided massive backward projections ipsilaterally to IT cortex. We found that the limbic lesion disrupted the associative code of the IT neurons between the paired associates, without impairing the visual response to each stimulus. Second, we ask why the limbic-neocortical interactions are so important. We hypothesize that limbic neurons would undergo rapid modification of synaptic connectivity and provide backward signals that guide reorganization of neocortical neural circuits. We then investigated the molecular basis of such rapid synaptic modifiability by detecting the expression of immediate-early genes. We found strong expression of zif268 during the learning of a new set of paired associates, most intensively in area 36 of the perirhinal cortex. All these results with visual pair-association task support our hypothesis, and demonstrate that the ‘consolidation’ process, which was first proposed on the basis of clinico-psychological evidence, can now be examined in the primate with neurophysiolocical and molecular biological approaches.     

Neural Population-Level Memory Traces in the Mouse Hippocampus

One of the fundamental goals in neurosciences is to elucidate the formation and retrieval of brain''s associative memory traces in real-time. Here, we describe real-time neural ensemble transient dynamics in the mouse hippocampal CA1 region and demonstrate their relationships with behavioral performances during both learning and recall. We employed the classic trace fear conditioning paradigm involving a neutral tone followed by a mild foot-shock 20 seconds later. Our large-scale recording and decoding methods revealed that conditioned tone responses and tone-shock association patterns were not present in CA1 during the first pairing, but emerged quickly after multiple pairings. These encoding patterns showed increased immediate-replay, correlating tightly with increased immediate-freezing during learning. Moreover, during contextual recall, these patterns reappeared in tandem six-to-fourteen times per minute, again correlating tightly with behavioral recall. Upon traced tone recall, while various fear memories were retrieved, the shock traces exhibited a unique recall-peak around the 20-second trace interval, further signifying the memory of time for the expected shock. Therefore, our study has revealed various real-time associative memory traces during learning and recall in CA1, and demonstrates that real-time memory traces can be decoded on a moment-to-moment basis over any single trial.     

Unsupervised learning and temporal context to recall complex robot trajectories

An unsupervised neural network is proposed to learn and recall complex robot trajectories. Two cases are considered: (i) A single trajectory in which a particular arm configuration (state) may occur more than once, and (ii) trajectories sharing states with each other. Ambiguities occur in both cases during recall of such trajectories. The proposed model consists of two groups of synaptic weights trained by competitive and Hebbian learning laws. They are responsible for encoding spatial and temporal features of the input sequences, respectively. Three mechanisms allow the network to deal with repeated or shared states: local and global context units, neurons disabled from learning, and redundancy. The network reproduces the current and the next state of the learned sequences and is able to resolve ambiguities. The model was simulated over various sets of robot trajectories in order to evaluate learning and recall, trajectory sampling effects and robustness.     

Higher brain functions of PACAP and a homologous Drosophila memory gene amnesiac: insights from knockouts and mutants

Neuropeptides usually exert a long-lived modulatory effect on the small-molecule neurotransmitters with which they colocalize via regulation of the response times of second messenger systems. Pituitary adenylate cyclase-activating polypeptide (PACAP) functions as a neuromodulator and neurotransmitter and regulates a variety of physiological processes. PACAP is structurally highly conserved during evolution, implying its vital importance. In Drosophila, loss-of-function mutations in a PACAP-like neuropeptide gene, amnesiac (amn), affect both memory retention and ethanol sensitivity. The amnesiac gene is expressed in neurons innervating the mushroom body lobes, the olfactory associative learning center. Conditional genetic ablation of neurotransmitter release from these neurons mimics the amnesiac memory phenotypes, suggesting an acute role for amnesiac in memory. However, genetic rescue experiments also suggest developmental defects in amnesiac mutants, implying a role in neuronal development. There is a parallel between memory formation in Drosophila and mammals. PACAP-specific (PAC(1)) receptor-deficient mice show a deficit in hippocampus-dependent associative learning and mossy fiber long-term potentiation (LTP). Meanwhile, PACAP-deficient mice display a high early mortality rate and additional CNS phenotypes including behavioral and psychological phenotypes (e.g., hyperlocomotion, intense novelty-seeking behavior, and explosive jumping). A functional comparison between PACAP and amnesiac underlines phylogenetically conserved functions across phyla and may provide insights into the possible mechanisms of action and evolution of this neuropeptidergic system.     

Aversive learning in honeybees revealed by the olfactory conditioning of the sting extension reflex

Invertebrates have contributed greatly to our understanding of associative learning because they allow learning protocols to be combined with experimental access to the nervous system. The honeybee Apis mellifera constitutes a standard model for the study of appetitive learning and memory since it was shown, almost a century ago, that bees learn to associate different sensory cues with a reward of sugar solution. However, up to now, no study has explored aversive learning in bees in such a way that simultaneous access to its neural bases is granted. Using odorants paired with electric shocks, we conditioned the sting extension reflex, which is exhibited by harnessed bees when subjected to a noxious stimulation. We show that this response can be conditioned so that bees learn to extend their sting in response to the odorant previously punished. Bees also learn to extend the proboscis to one odorant paired with sugar solution and the sting to a different odorant paired with electric shock, thus showing that they can master both appetitive and aversive associations simultaneously. Responding to the appropriate odorant with the appropriate response is possible because two different biogenic amines, octopamine and dopamine subserve appetitive and aversive reinforcement, respectively. While octopamine has been previously shown to substitute for appetitive reinforcement, we demonstrate that blocking of dopaminergic, but not octopaminergic, receptors suppresses aversive learning. Therefore, aversive learning in honeybees can now be accessed both at the behavioral and neural levels, thus opening new research avenues for understanding basic mechanisms of learning and memory.     

Role of delayed nonsynaptic neuronal plasticity in long-term associative memory

BACKGROUND: It is now well established that persistent nonsynaptic neuronal plasticity occurs after learning and, like synaptic plasticity, it can be the substrate for long-term memory. What still remains unclear, though, is how nonsynaptic plasticity contributes to the altered neural network properties on which memory depends. Understanding how nonsynaptic plasticity is translated into modified network and behavioral output therefore represents an important objective of current learning and memory research. RESULTS: By using behavioral single-trial classical conditioning together with electrophysiological analysis and calcium imaging, we have explored the cellular mechanisms by which experience-induced nonsynaptic electrical changes in a neuronal soma remote from the synaptic region are translated into synaptic and circuit level effects. We show that after single-trial food-reward conditioning in the snail Lymnaea stagnalis, identified modulatory neurons that are extrinsic to the feeding network become persistently depolarized between 16 and 24 hr after training. This is delayed with respect to early memory formation but concomitant with the establishment and duration of long-term memory. The persistent nonsynaptic change is extrinsic to and maintained independently of synaptic effects occurring within the network directly responsible for the generation of feeding. Artificial membrane potential manipulation and calcium-imaging experiments suggest a novel mechanism whereby the somal depolarization of an extrinsic neuron recruits command-like intrinsic neurons of the circuit underlying the learned behavior. CONCLUSIONS: We show that nonsynaptic plasticity in an extrinsic modulatory neuron encodes information that enables the expression of long-term associative memory, and we describe how this information can be translated into modified network and behavioral output.     

Contextual taste cues modulate olfactory learning in C. elegans by an occasion-setting mechanism

Manipulations of context can affect learning and memory performance across species in many associative learning paradigms. Using taste cues to create distinct contexts for olfactory adaptation assays in the nematode Caenorhabditis elegans, we now show that performance in this associative learning paradigm is sensitive to context manipulations, and we investigate the mechanism(s) used for the integration of context cues in learning. One possibility is that the taste and olfactory stimuli are perceived as a combined, blended cue that the animals then associate with the unconditioned stimulus (US) in the same manner as with any other unitary conditioned stimuli (CS). Alternatively, an occasion-setting model suggests that the taste cues only define the appropriate context for olfactory memory retrieval without directly entering into the primary association. Analysis of genetic mutants demonstrated that the olfactory and context cues are sensed by distinct primary sensory neurons and that the animals' ability to use taste cues to modulate olfactory learning is independent from their ability to utilize these same taste cues for adaptation. We interpret these results as evidence for the occasion-setting mechanism in which context cues modulate primary Pavlovian association by functioning in a hierarchical manner to define the appropriate setting for memory recall.     

Heterotypic gap junctions between two neurons in the drosophila brain are critical for memory

Gap junctions play an important role in the regulation of neuronal metabolism and homeostasis by serving as connections that enable small molecules to pass between cells and synchronize activity between cells. Although recent studies have linked gap junctions to memory formation, it remains unclear how they contribute to this process. Gap junctions are hexameric hemichannels formed from the connexin and pannexin gene families in chordates and the innexin (inx) gene family in invertebrates. Here we show that two modulatory neurons, the anterior paired lateral (APL) neuron and the dorsal paired medial (DPM) neuron, form heterotypic gap junctions within the mushroom body (MB), a learning and memory center in the Drosophila brain. Using RNA interference-mediated knockdowns of inx7 and inx6 in the APL and DPM neurons, respectively, we found that flies showed normal olfactory associative learning and intact anesthesia-resistant memory (ARM) but failed to form anesthesia-sensitive memory (ASM). Our results reveal that the heterotypic gap junctions between the APL and DPM neurons are an essential part of the MB circuitry for memory formation, potentially constituting a recurrent neural network to stabilize ASM.     

Modelling studies on the computational function of fast temporal structure in cortical circuit activity

The interplay between modelling and experimental studies can support the exploration of the function of neuronal circuits in the cortex. We exemplify such an approach with a study on the role of spike timing and gamma-oscillations in associative memory in strongly connected circuits of cortical neurones. It is demonstrated how associative memory studies on different levels of abstraction can specify the functionality to be expected in real cortical neuronal circuits. In our model overlapping random configurations of sparse cell populations correspond to memory items that are stored by simple Hebbian coincidence learning. This associative memory task will be implemented with biophysically well tested compartmental neurones developed by Pinsky and Rinzel . We ran simulation experiments to study memory recall in two network architectures: one interconnected pool of cells, and two reciprocally connected pools. When recalling a memory by stimulating a spatially overlapping set of cells, the completed pattern is coded by an event of synchronized single spikes occurring after 25-60 ms. These fast associations are performed even at a memory load corresponding to the memory capacity of optimally tuned formal associative networks (>0.1 bit/synapse). With tonic stimulation or feedback loops in the network the neurones fire periodically in the gamma-frequency range (20-80 Hz). With fast changing inputs memory recall can be switched between items within a single gamma cycle. Thus, oscillation is not a primary coding feature necessary for associative memory. However, it accompanies reverberatory feedback providing an improved iterative memory recall completed after a few gamma cycles (60-260 ms). In the bidirectional architecture reverberations do not express in a rigid phase locking between the pools. For small stimulation sets bursting occurred in these cells acting as a supportive mechanism for associative memory.     

Consolidation of fear extinction requires NMDA receptor-dependent bursting in the ventromedial prefrontal cortex

Extinction of conditioned fear is an active learning process requiring N-methyl-D-aspartate receptors (NMDARs), but the timing, location, and neural mechanisms of NMDAR-mediated processing in extinction are a matter of debate. Here we show that infusion of the NMDAR antagonist CPP into the ventromedial prefrontal cortex (vmPFC) prior to, or immediately after, extinction training impaired 24 hr recall of extinction. These findings indicate that consolidation of extinction requires posttraining activation of NMDARs within the vmPFC. Using multichannel unit recording, we observed that CPP selectively reduced burst firing in vmPFC neurons, suggesting that bursting in vmPFC is necessary for consolidation of extinction. In support of this, we found that the degree of bursting in infralimbic vmPFC neurons shortly after extinction predicted subsequent recall of extinction. We suggest that NMDAR-dependent bursting in the infralimbic vmPFC initiates calcium-dependent molecular cascades that stabilize extinction memory, thereby allowing for successful recall of extinction.     

Aplysia Ganglia Preparation for Electrophysiological and Molecular Analyses of Single Neurons

A major challenge in neurobiology is to understand the molecular underpinnings of neural circuitry that govern a specific behavior. Once the specific molecular mechanisms are identified, new therapeutic strategies can be developed to treat abnormalities in specific behaviors caused by degenerative diseases or aging of the nervous system. The marine snail Aplysia californica is well suited for the investigations of cellular and molecular basis of behavior because neural circuitry underlying a specific behavior could be easily determined and the individual components of the circuitry could be easily manipulated. These advantages of Aplysia have led to several fundamental discoveries of neurobiology of learning and memory. Here we describe a preparation of the Aplysia nervous system for the electrophysiological and molecular analyses of individual neurons. Briefly, ganglion dissected from the nervous system is exposed to protease to remove the ganglion sheath such that neurons are exposed but retain neuronal activity as in the intact animal. This preparation is used to carry out electrophysiological measurements of single or multiple neurons. Importantly, following the recording using a simple methodology, the neurons could be isolated directly from the ganglia for gene expression analysis. These protocols were used to carry out simultaneous electrophysiological recordings from L7 and R15 neurons, study their response to acetylcholine and quantitating expression of CREB1 gene in isolated single L7, L11, R15, and R2 neurons of Aplysia.     

Conditioned reflex: detector and command neuron

Conditioned reflex is characterized by plasticity resulting in a bilateral selective input-output linking. In simple nervous systems, input stimuli are represented by selective detectors connected with command neurons through plastic synapses strengthened during associative learning and weakened during extinction. The process of associative learning is due to temporal coincidence of excitation in both detector and command neurons. Short-term memory within a plastic synapses is mediated by phosphorilation of postsynaptic receptor molecules not requiring protein synthesis. Long-term synaptic memory parallels expression of immediate early genes that mediates structural gene expression and protein synthesis. A simple detector-command neuron association becomes more complex in the course of evolution. Input mechanism is supplemented with predetector interneurons preceding detectors. Detector selectively tuned to specific input stimulus is converging on a command neuron constitute selectivity mechanism for conditioned reflexes to complex stimuli. The complication also concerns the output mechanisms. Command neurons become more specialized, and an additional link of premotor interneurons is incorporated between command neurons and motor neurons. Via synapses, the command neurons can produce excitation in a particular set of premotor neurons controlling a specific set of motor neurons responsible for behavioral act configuration. Specialization of command neurons in combination with premotor neuron structures increases the variability of outputs. Conditioned reflexes with more complex inputs and more flexible outputs determine the diversity of acquired behaviors.     

Light-induced activation of distinct modulatory neurons triggers appetitive or aversive learning in Drosophila larvae

During classical conditioning, a positive or negative value is assigned to a previously neutral stimulus, thereby changing its significance for behavior. If an odor is associated with a negative stimulus, it can become repulsive. Conversely, an odor associated with a reward can become attractive. By using Drosophila larvae as a model system with minimal brain complexity, we address the question of which neurons attribute these values to odor stimuli. In insects, dopaminergic neurons are required for aversive learning, whereas octopaminergic neurons are necessary and sufficient for appetitive learning. However, it remains unclear whether two independent neuronal populations are sufficient to mediate such antagonistic values. We report the use of transgenically expressed channelrhodopsin-2, a light-activated cation channel, as a tool for optophysiological stimulation of genetically defined neuronal populations in Drosophila larvae. We demonstrate that distinct neuronal populations can be activated simply by illuminating the animals with blue light. Light-induced activation of dopaminergic neurons paired with an odor stimulus induces aversive memory formation, whereas activation of octopaminergic/tyraminergic neurons induces appetitive memory formation. These findings demonstrate that antagonistic modulatory subsystems are sufficient to substitute for aversive and appetitive reinforcement during classical conditioning.     

Drugging the methylome: DNA methylation and memory

Over the past decade, since epigenetic mechanisms were first implicated in memory formation and synaptic plasticity, dynamic DNA methylation reactions have been identified as integral to long-term memory formation, maintenance, and recall. This review incorporates various new findings that DNA methylation mechanisms are important regulators of non-Hebbian plasticity mechanisms, suggesting that these epigenetic mechanisms are a fundamental link between synaptic plasticity and metaplasticity. Because the field of neuroepigenetics is so young and the biochemical tools necessary to probe gene-specific questions are just now being developed and used, this review also speculates about the direction and potential of therapeutics that target epigenetic mechanisms in the central nervous system and the unique pharmacokinetic and pharmacodynamic properties that epigenetic therapies may possess. Mapping the dynamics of the epigenome in response to experiential learning, even a single epigenetic mark in isolation, remains a significant technical and bioinformatic hurdle facing the field, but will be necessary to identify changes to the methylome that govern memory-associated gene expression and effectively drug the epigenome.     

Izhikevich神经元网络的同步与联想记忆

联想记忆是人脑的一项重要功能。以Izhikevich神经元模型为节点,构建神经网络,神经元之间采用全连结的方式;以神经元群体的时空编码（spatio-temporal coding）理论研究所构建神经网络的联想记忆功能。在加入高斯白噪声的情况下,调节网络中神经元之间的连接强度的大小,当连接强度和噪声强度达到一个阈值时网络中部分神经元同步放电,实现了存储模式的联想记忆与恢复。仿真结果表明,神经元之间的连接强度在联想记忆的过程中发挥了重要的作用,噪声可以促使神经元间的同步放电,有助于神经网络实现存储模式的联想记忆与恢复。