A hippocampal model predicts a fluctuating phase transition when learning certain trace conditioning paradigms

The hippocampus is needed for at least one kind of trace classical conditioning, the air-puff eye-blink paradigm. A simple model of region CA3 predicts three basic, quantitative observations of the learning behavior of rabbits. One particular quantified prediction is the learnable trace interval. The boundary region of the reliably learnable trace interval represents a phase transition. Within this transition, three behaviorally distinguishable modes are expressed: failure to blink; blink too soon; and occasionally, appropriate predictive blinking. In the region of the phase transition, there is a small sub-interval where the behavioral modes fluctuate rapidly from trial to trial for individual simulations. Such observed fluctuations are an experimental prediction by the model. The discussion also includes a brief conjecture concerning the underlying cause of the phase transition and the fluctuations.     

Neural Population-Level Memory Traces in the Mouse Hippocampus

One of the fundamental goals in neurosciences is to elucidate the formation and retrieval of brain''s associative memory traces in real-time. Here, we describe real-time neural ensemble transient dynamics in the mouse hippocampal CA1 region and demonstrate their relationships with behavioral performances during both learning and recall. We employed the classic trace fear conditioning paradigm involving a neutral tone followed by a mild foot-shock 20 seconds later. Our large-scale recording and decoding methods revealed that conditioned tone responses and tone-shock association patterns were not present in CA1 during the first pairing, but emerged quickly after multiple pairings. These encoding patterns showed increased immediate-replay, correlating tightly with increased immediate-freezing during learning. Moreover, during contextual recall, these patterns reappeared in tandem six-to-fourteen times per minute, again correlating tightly with behavioral recall. Upon traced tone recall, while various fear memories were retrieved, the shock traces exhibited a unique recall-peak around the 20-second trace interval, further signifying the memory of time for the expected shock. Therefore, our study has revealed various real-time associative memory traces during learning and recall in CA1, and demonstrates that real-time memory traces can be decoded on a moment-to-moment basis over any single trial.     

Neuronal dynamics during the learning of trace conditioning in a CA3 model of hippocampal function

The present article develops quantitative behavioral and neurophysiological predictions for rabbits trained on an air-puff version of the trace-interval classical conditioning paradigm. Using a minimal hippocampal model, consisting of 8,000 primary cells sparsely and randomly interconnected as a model of hippocampal region CA-3, the simulations identify conditions which produce a clear split in the number of trials individual animals should need to learn a criterion response. A trace interval that is difficult to learn, but still learnable by half the experimental population, produces a bimodal population of learners: an early learner group and a late learner group. The model predicts that late learners are characterized by two kinds of CA-3 neuronal activity fluctuations that are not seen in the early learners. As is typical in our minimal hippocampal models, the off-rate constant of the N-methyl-d-aspartate receptor receptor gives a timescale to the model that leads to a temporally quantifiable behavior, the learnable trace interval.     

Formation of temporal memory requires NMDA receptors within CA1 pyramidal neurons

In humans the hippocampus is required for episodic memory, which extends into the spatial and temporal domains. Work on the rodent hippocampus has shown that NMDA receptor (NMDAR) -mediated plasticity is essential for spatial memory. Here, we have examined whether hippocampal NMDARs are also needed for temporal memory. We applied trace fear conditioning to knockout mice lacking NMDARs only in hippocampal CA1 pyramidal cells. This paradigm requires temporal processing because the conditional and unconditional stimuli are separated by 30 s (trace). We found that knockout mice failed to memorize this association but were indistinguishable from normal animals when the trace was removed. Thus, NMDARs in CA1 are crucial for the formation of memories that associate events across time.     

Regulation of histone acetylation during memory formation in the hippocampus

Formation of long term memory begins with the activation of many disparate signaling pathways that ultimately impinge on the cellular mechanisms regulating gene expression. We investigated whether mechanisms regulating chromatin structure were activated during the early stages of long term memory formation in the hippocampus. Specifically, we investigated hippocampal histone acetylation during the initial stages of consolidation of long term association memories in a contextual fear conditioning paradigm. Acetylation of histone H3 in area CA1 of the hippocampus was regulated in contextual fear conditioning, an effect dependent on activation of N-methyl-D-aspartic acid (NMDA) receptors and ERK, and blocked using a behavioral latent inhibition paradigm. Activation of NMDA receptors in area CA1 in vitro increased acetylation of histone H3, and this effect was blocked by inhibition of ERK signaling. Moreover, activation of ERK in area CA1 in vitro through either the protein kinase C or protein kinase A pathways, biochemical events known to be involved in long term memory formation, also increased histone H3 acetylation. Furthermore, we observed that elevating levels of histone acetylation through the use of the histone deacetylase inhibitors trichostatin A or sodium butyrate enhanced induction of long term potentiation at Schaffer-collateral synapses in area CA1 of the hippocampus, a candidate mechanism contributing to long term memory formation in vivo. In concert with our findings in vitro, injection of animals with sodium butyrate prior to contextual fear conditioning enhanced formation of long term memory. These results indicate that histone-associated heterochromatin undergoes changes in structure during the formation of long term memory. Mimicking memory-associated changes in heterochromatin enhances a cellular process thought to underlie long term memory formation, hippocampal long term potentiation, and memory formation itself.     

The Pavlovian analysis of instrumental conditioning.

An account was given of the development within the Russian literature of a uniprocess formulation of classical and instrumental conditioning, known as the bidirectional conditioning hypothesis. The hypothesis purports to offer a single set of Pavlovian principles to account for both paradigms, based upon a neural model which assumes that bidirectional (forward and backward) connections are formed in both calssical and instrumental conditioning situations. In instrumental conditioning, the bidirectional connections are hypothesized to be simply more complex than those in classical conditioning, and any differences in empirical functions are presumed to lie not in difference in mechanism, but in the strength of the forward and backward connections. Although bidirectional connections are assumed to develop in instrumental conditioning, the experimental investigation of the bidirectional conditioning hypothesis has been essentially restricted to the classical conditioning operations of pairing two CSs (sensory preconditioning training), a US followed by a CS (backward conditioning training) and two USs. However, the paradigm involving the pairing of two USs, because of theoretical and analytical considerations, is the one most commonly employed by Russian investigators. The results of an initial experiment involving the pairing of two USs, and reference to the results of a more extensive investigation, leads us to tentatively question the validity of the bidirectional conditioning account of instrumental conditioning.     

Retrieval of context-associated memory is dependent on the Ca(v)3.2 T-type calcium channel

Among all voltage-gated calcium channels, the T-type Ca²⁺ channels encoded by the Ca_v3.2 genes are highly expressed in the hippocampus, which is associated with contextual, temporal and spatial learning and memory. However, the specific involvement of the Ca_v3.2 T-type Ca²⁺ channel in these hippocampus-dependent types of learning and memory remains unclear. To investigate the functional role of this channel in learning and memory, we subjected Ca_v3.2 homozygous and heterozygous knockout mice and their wild-type littermates to hippocampus-dependent behavioral tasks, including trace fear conditioning, the Morris water-maze and passive avoidance. The Ca_v3.2 ^−/− mice performed normally in the Morris water-maze and auditory trace fear conditioning tasks but were impaired in the context-cued trace fear conditioning, step-down and step-through passive avoidance tasks. Furthermore, long-term potentiation (LTP) could be induced for 180 minutes in hippocampal slices of WTs and Ca_v3.2 ^+/− mice, whereas LTP persisted for only 120 minutes in Ca_v3.2 ^−/− mice. To determine whether the hippocampal formation is responsible for the impaired behavioral phenotypes, we next performed experiments to knock down local function of the Ca_v3.2 T-type Ca²⁺ channel in the hippocampus. Wild-type mice infused with mibefradil, a T-type channel blocker, exhibited similar behaviors as homozygous knockouts. Taken together, our results demonstrate that retrieval of context-associated memory is dependent on the Ca_v3.2 T-type Ca²⁺ channel.     

Distinct timing mechanisms produce discrete and continuous movements

The differentiation of discrete and continuous movement is one of the pillars of motor behavior classification. Discrete movements have a definite beginning and end, whereas continuous movements do not have such discriminable end points. In the past decade there has been vigorous debate whether this classification implies different control processes. This debate up until the present has been empirically based. Here, we present an unambiguous non-empirical classification based on theorems in dynamical system theory that sets discrete and continuous movements apart. Through computational simulations of representative modes of each class and topological analysis of the flow in state space, we show that distinct control mechanisms underwrite discrete and fast rhythmic movements. In particular, we demonstrate that discrete movements require a time keeper while fast rhythmic movements do not. We validate our computational findings experimentally using a behavioral paradigm in which human participants performed finger flexion-extension movements at various movement paces and under different instructions. Our results demonstrate that the human motor system employs different timing control mechanisms (presumably via differential recruitment of neural subsystems) to accomplish varying behavioral functions such as speed constraints.     

Context codes and the effect of noisy learning on a simplified hippocampal CA3 model

This paper investigates how noise affects a minimal computational model of the hippocampus and, in particular, region CA3. The architecture and physiology employed are consistent with the known anatomy and physiology of this region. Here, we use computer simulations to demonstrate and quantify the ability of this model to create context codes in sequential learning problems. These context codes are mediated by local context neurons which are analogous to hippocampal place-coding cells. These local context neurons endow the network with many of its problem-solving abilities. Our results show that the network encodes context on its own and then uses context to solve sequence prediction under ambiguous conditions. Noise during learning affects performance, and it also affects the development of context codes. The relationship between noise and performance in a sequence prediction is simple and corresponds to a disruption of local context neuron firing. As noise exceeds the signal, sequence completion and local context neuron firing are both lost. For the parameters investigated, extra learning trials and slower learning rates do not overcome either of the effects of noise. The results are consistent with the important role played, in this hippocampal model, by local context neurons in sequence prediction and for disambiguation across time.     

Hippocampal Homer1 Levels Influence Motivational Behavior in an Operant Conditioning Task

Loss of motivation and learning impairments are commonly accepted core symptoms of psychiatric disorders such as depression and schizophrenia. Reward-motivated learning is dependent on the hippocampal formation but the molecular mechanisms that lead to functional incentive motivation in this brain region are still largely unknown. Recent evidence implicates neurotransmission via metabotropic glutamate receptors and Homer1, their interaction partner in the postsynaptic density, in drug addiction and motivational learning. As previous reports mainly focused on the prefrontal cortex and the nucleus accumbens, we now investigated the role of hippocampal Homer1 in operant reward learning in the present study. We therefore tested either Homer1 knockout mice or mice that overexpress Homer1 in the hippocampus in an operant conditioning paradigm. Our results show that deletion of Homer1 leads to a diverging phenotype that either displays an inability to perform the task or outstanding hyperactivity in both learning and motivational sessions. Due to the apparent bimodal distribution of this phenotype, the overall effect of Homer1 deletion in this paradigm is not significantly altered. Overexpression of hippocampal Homer1 did not lead to a significantly altered learning performance in any stage of the testing paradigm, yet may subtly contribute to emerging motivational deficits. Our results indicate an involvement of Homer1-mediated signaling in the hippocampus in motivation-based learning tasks and encourage further investigations regarding the specific molecular underpinnings of the phenotypes observed in this study. We also suggest to cautiously interpret the results of this and other studies regarding the phenotype following Homer1 manipulations in animals, since their behavioral phenotype appears to be highly diverse. Future studies would benefit from larger group sizes that would allow splitting the experimental groups in responders and non-responders.     

Trace fear conditioning: a role for context?

Fear conditioning can be rapidly obtained over long trace intervals, but its specificity with respect to both time and stimulus is uncertain. Long-trace fear conditioning often parallels contextual conditioning, and it is sensitive to hippocampal lesions. These properties of trace conditioning are not directly addressed by timing models and multiple-time-scale models of conditioning. It is proposed that during early stages of conditioning, a joint representation of the context and the stimulus trace may underlie conditioned responses, and that discriminative processes allow the emergence of specific responses in a later stage.     

Subliminal instrumental conditioning demonstrated in the human brain

How the brain uses success and failure to optimize future decisions is a long-standing question in neuroscience. One computational solution involves updating the values of context-action associations in proportion to a reward prediction error. Previous evidence suggests that such computations are expressed in the striatum and, as they are cognitively impenetrable, represent an unconscious learning mechanism. Here, we formally test this by studying instrumental conditioning in a situation where we masked contextual cues, such that they were not consciously perceived. Behavioral data showed that subjects nonetheless developed a significant propensity to choose cues associated with monetary rewards relative to punishments. Functional neuroimaging revealed that during conditioning cue values and prediction errors, generated from a computational model, both correlated with activity in ventral striatum. We conclude that, even without conscious processing of contextual cues, our brain can learn their reward value and use them to provide a bias on decision making.     

Mapping and Deciphering Neural Codes of NMDA Receptor-Dependent Fear Memory Engrams in the Hippocampus

Mapping and decoding brain activity patterns underlying learning and memory represents both great interest and immense challenge. At present, very little is known regarding many of the very basic questions regarding the neural codes of memory: are fear memories retrieved during the freezing state or non-freezing state of the animals? How do individual memory traces give arise to a holistic, real-time associative memory engram? How are memory codes regulated by synaptic plasticity? Here, by applying high-density electrode arrays and dimensionality-reduction decoding algorithms, we investigate hippocampal CA1 activity patterns of trace fear conditioning memory code in inducible NMDA receptor knockout mice and their control littermates. Our analyses showed that the conditioned tone (CS) and unconditioned foot-shock (US) can evoke hippocampal ensemble responses in control and mutant mice. Yet, temporal formats and contents of CA1 fear memory engrams differ significantly between the genotypes. The mutant mice with disabled NMDA receptor plasticity failed to generate CS-to-US or US-to-CS associative memory traces. Moreover, the mutant CA1 region lacked memory traces for “what at when” information that predicts the timing relationship between the conditioned tone and the foot shock. The degraded associative fear memory engram is further manifested in its lack of intertwined and alternating temporal association between CS and US memory traces that are characteristic to the holistic memory recall in the wild-type animals. Therefore, our study has decoded real-time memory contents, timing relationship between CS and US, and temporal organizing patterns of fear memory engrams and demonstrated how hippocampal memory codes are regulated by NMDA receptor synaptic plasticity.     

A mouse model of Bardet-Biedl Syndrome has impaired fear memory,which is rescued by lithium treatment

Primary cilia are microtubule-based organelles present on most cells that regulate many physiological processes, ranging from maintaining energy homeostasis to renal function. However, the role of these structures in the regulation of behavior remains unknown. To study the role of cilia in behavior, we employ mouse models of the human ciliopathy, Bardet-Biedl Syndrome (BBS). Here, we demonstrate that BBS mice have significant impairments in context fear conditioning, a form of associative learning. Moreover, we show that postnatal deletion of BBS gene function, as well as congenital deletion, specifically in the forebrain, impairs context fear conditioning. Analyses indicated that these behavioral impairments are not the result of impaired hippocampal long-term potentiation. However, our results indicate that these behavioral impairments are the result of impaired hippocampal neurogenesis. Two-week treatment with lithium chloride partially restores the proliferation of hippocampal neurons which leads to a rescue of context fear conditioning. Overall, our results identify a novel role of cilia genes in hippocampal neurogenesis and long-term context fear conditioning.     

Molecular mechanisms underlying emotional learning and memory in the lateral amygdala

Fear conditioning is a valuable behavioral paradigm for studying the neural basis of emotional learning and memory. The lateral nucleus of the amygdala (LA) is a crucial site of neural changes that occur during fear conditioning. Pharmacological manipulations of the LA, strategically timed with respect to training and testing, have shed light on the molecular events that mediate the acquisition of fear associations and the formation and maintenance of long-term memories of those associations. Similar mechanisms have been found to underlie long-term potentiation (LTP) in LA, an artificial means of inducing synaptic plasticity and a physiological model of learning and memory. Thus, LTP-like changes in synaptic plasticity may underlie fear conditioning. Given that the neural circuit underlying fear conditioning has been implicated in emotional disorders in humans, the molecular mechanisms of fear conditioning are potential targets for psychotherapeutic drug development.     

Computational approaches to hippocampal function.

The results of theoretical work have led researchers to suggest that the hippocampal formation may maximize its memory storage capacity by recoding events into patterns that are as dissimilar to one another, and which use as few neurons per event, as possible.     

Double dissociation of amygdala and hippocampal contributions to trace and delay fear conditioning

A key finding in studies of the neurobiology of learning memory is that the amygdala is critically involved in Pavlovian fear conditioning. This is well established in delay-cued and contextual fear conditioning; however, surprisingly little is known of the role of the amygdala in trace conditioning. Trace fear conditioning, in which the CS and US are separated in time by a trace interval, requires the hippocampus and prefrontal cortex. It is possible that recruitment of cortical structures by trace conditioning alters the role of the amygdala compared to delay fear conditioning, where the CS and US overlap. To investigate this, we inactivated the amygdala of male C57BL/6 mice with GABA (A) agonist muscimol prior to 2-pairing trace or delay fear conditioning. Amygdala inactivation produced deficits in contextual and delay conditioning, but had no effect on trace conditioning. As controls, we demonstrate that dorsal hippocampal inactivation produced deficits in trace and contextual, but not delay fear conditioning. Further, pre- and post-training amygdala inactivation disrupted the contextual but the not cued component of trace conditioning, as did muscimol infusion prior to 1- or 4-pairing trace conditioning. These findings demonstrate that insertion of a temporal gap between the CS and US can generate amygdala-independent fear conditioning. We discuss the implications of this surprising finding for current models of the neural circuitry involved in fear conditioning.     

Towards a unified model of pavlovian conditioning: short review of trace conditioning models

There are three basic paradigms of classical conditioning: delay, trace and context conditioning where presentation of a conditioned stimulus (CS) or a context typically predicts an unconditioned stimulus (US). In delay conditioning CS and US normally coterminate, whereas in trace conditioning an interval of time exists between CS termination and US onset. The modeling of trace conditioning is a rather difficult computational problem and is a challenge to the behavior and connectionist approaches mainly due to a time gap between CS and US. To account for trace conditioning, Pavlov (Conditioned reflexes: an investigation of the physiological activity of the cerebral cortex, Oxford University Press, London, 1927) postulated the existence of a stimulus “trace” in the nervous system. Meanwhile, there exist many other options for solving this association problem. There are several excellent reviews of computational models of classical conditioning but none has thus far been devoted to trace conditioning. Eight representative models of trace conditioning aimed at building a prospective model are being reviewed below in a brief form. As a result, one of them, comprising the most important features of its predecessors, can be suggested as a real candidate for a unified model of trace conditioning.     

Artificial Theta Stimulation Impairs Encoding of Contextual Fear Memory

Several experiments have demonstrated an intimate relationship between hippocampal theta rhythm (4–12 Hz) and memory. Lesioning the medial septum or fimbria-fornix, a fiber track connecting the hippocampus and the medial septum, abolishes the theta rhythm and results in a severe impairment in declarative memory. To assess whether there is a causal relationship between hippocampal theta and memory formation we investigated whether restoration of hippocampal theta by electrical stimulation during the encoding phase also restores fimbria-fornix lesion induced memory deficit in rats in the fear conditioning paradigm. Male Wistar rats underwent sham or fimbria-fornix lesion operation. Stimulation electrodes were implanted in the ventral hippocampal commissure and recording electrodes in the septal hippocampus. Artificial theta stimulation of 8 Hz was delivered during 3-min free exploration of the test cage in half of the rats before aversive conditioning with three foot shocks during 2 min. Memory was assessed by total freezing time in the same environment 24 h and 28 h after fear conditioning, and in an intervening test session in a different context. As expected, fimbria-fornix lesion impaired fear memory and dramatically attenuated hippocampal theta power. Artificial theta stimulation produced continuous theta oscillations that were almost similar to endogenous theta rhythm in amplitude and frequency. However, contrary to our predictions, artificial theta stimulation impaired conditioned fear response in both sham and fimbria-fornix lesioned animals. These data suggest that restoration of theta oscillation per se is not sufficient to support memory encoding after fimbria-fornix lesion and that universal theta oscillation in the hippocampus with a fixed frequency may actually impair memory.     

Interval timing in genetically modified mice: a simple paradigm

We describe a behavioral screen for the quantitative study of interval timing and interval memory in mice. Mice learn to switch from a short-latency feeding station to a long-latency station when the short latency has passed without a feeding. The psychometric function is the cumulative distribution of switch latencies. Its median measures timing accuracy and its interquartile interval measures timing precision. Next, using this behavioral paradigm, we have examined mice with a gene knockout of the receptor for gastrin-releasing peptide that show enhanced (i.e. prolonged) freezing in fear conditioning. We have tested the hypothesis that the mutants freeze longer because they are more uncertain than wild types about when to expect the electric shock. The knockouts however show normal accuracy and precision in timing, so we have rejected this alternative hypothesis. Last, we conduct the pharmacological validation of our behavioral screen using d -amphetamine and methamphetamine. We suggest including the analysis of interval timing and temporal memory in tests of genetically modified mice for learning and memory and argue that our paradigm allows this to be done simply and efficiently.