Training-Dependent Associative Learning Induced Neocortical Structural Plasticity: A Trace Eyeblink Conditioning Analysis

Studies utilizing general learning and memory tasks have suggested the importance of neocortical structural plasticity for memory consolidation. However, these learning tasks typically result in learning of multiple different tasks over several days of training, making it difficult to determine the synaptic time course mediating each learning event. The current study used trace-eyeblink conditioning to determine the time course for neocortical spine modification during learning. With eyeblink conditioning, subjects are presented with a neutral, conditioned stimulus (CS) paired with a salient, unconditioned stimulus (US) to elicit an unconditioned response (UR). With multiple CS-US pairings, subjects learn to associate the CS with the US and exhibit a conditioned response (CR) when presented with the CS. Trace conditioning is when there is a stimulus free interval between the CS and the US. Utilizing trace-eyeblink conditioning with whisker stimulation as the CS (whisker-trace-eyeblink: WTEB), previous findings have shown that primary somatosensory (barrel) cortex is required for both acquisition and retention of the trace-association. Additionally, prior findings demonstrated that WTEB acquisition results in an expansion of the cytochrome oxidase whisker representation and synaptic modification in layer IV of barrel cortex. To further explore these findings and determine the time course for neocortical learning-induced spine modification, the present study utilized WTEB conditioning to examine Golgi-Cox stained neurons in layer IV of barrel cortex. Findings from this study demonstrated a training-dependent spine proliferation in layer IV of barrel cortex during trace associative learning. Furthermore, findings from this study showing that filopodia-like spines exhibited a similar pattern to the overall spine density further suggests that reorganization of synaptic contacts set the foundation for learning-induced neocortical modifications through the different neocortical layers.     

A simple, single, trial-learning paradigm for conditioned increase in natural killer cell activity.

A change in natural killer (NK) cell activity can be conditioned with one trial learning when conditioned stimulus (CS) precedes the unconditioned stimulus (US). To avoid the problems associated with two reexposures in our earlier studies, we have developed a reliable and simple conditioning protocol utilizing the one trial learning and one reexposure to the odor CS. The conditioned change in NK cell activity was significantly different (P less than 0.05) from the control groups of mice. The paradigm is short and simple in that the conditioned change could be demonstrated within 3 days. We have also compared the effects of temporal association of CS and US on conditioned increase in NK cell activity. Forward conditioning (CS preceded the US) demonstrated a conditioned change, but the backward conditioning protocol did not. The paradigm provides a reliable approach to the study of mechanisms of the phenomenon of odor-NK conditioning.     

A Biophysical Model of Synaptic Delay Learning and Temporal Pattern Recognition in a Cerebellar Purkinje Cell

It has been suggested that information in the brain is encoded in temporal spike patterns which are decoded by a combination of time delays and coincidence detection. Here, we show how a multi-compartmental model of a cerebellar Purkinje cell can learn to recognise temporal parallel fibre activity patterns by adapting latencies of calcium responses after activation of metabotropic glutamate receptors (mGluRs). In each compartment of our model, the mGluR signalling cascade is represented by a set of differential equations that reflect the underlying biochemistry. Phosphorylation of the mGluRs changes the concentration of receptors which are available for activation by glutamate and thereby adjusts the time delay between mGluR stimulation and voltage response. The adaptation of a synaptic delay as opposed to a weight represents a novel non-Hebbian learning mechanism that can also implement the adaptive timing of the classically conditioned eye-blink response.     

Properties of olfactory conditioning in the housefly, Musca domestica

The housefly, Musca domestica, was conditioned to odours using the proboscis extension response to labellar stimulation with sucrose solution as an unconditioned response and the properties of conditioning were investigated. Among trials including forward pairing of the conditioned stimulus (CS) with the unconditioned stimulus (US), backward pairing and isolated presentations of CS and US, only forward pairing is effective on the acquisition of conditioning. Backward pairing combined with forward pairing does not influence the effectiveness of the forward pairing. CS given overlapping with a US presentation permits only weak conditioning. The acquisition of conditioning decreases with increase of the CS-US interval. In the differential conditioning situation to two odours, discriminative responses are observed. In the flies conditioned with one antenna, the conditioned response is elicited not only by stimulation of the antenna used for conditioning but also by stimulation of the antenna not used for conditioning, although the response using the former is higher than with the latter. The ability to be conditioned is reduced immediately after fastening on a clay bed and increases with time. Ability can also be improved by transection of the ventral nerve cord.     

Mapping and Deciphering Neural Codes of NMDA Receptor-Dependent Fear Memory Engrams in the Hippocampus

Mapping and decoding brain activity patterns underlying learning and memory represents both great interest and immense challenge. At present, very little is known regarding many of the very basic questions regarding the neural codes of memory: are fear memories retrieved during the freezing state or non-freezing state of the animals? How do individual memory traces give arise to a holistic, real-time associative memory engram? How are memory codes regulated by synaptic plasticity? Here, by applying high-density electrode arrays and dimensionality-reduction decoding algorithms, we investigate hippocampal CA1 activity patterns of trace fear conditioning memory code in inducible NMDA receptor knockout mice and their control littermates. Our analyses showed that the conditioned tone (CS) and unconditioned foot-shock (US) can evoke hippocampal ensemble responses in control and mutant mice. Yet, temporal formats and contents of CA1 fear memory engrams differ significantly between the genotypes. The mutant mice with disabled NMDA receptor plasticity failed to generate CS-to-US or US-to-CS associative memory traces. Moreover, the mutant CA1 region lacked memory traces for “what at when” information that predicts the timing relationship between the conditioned tone and the foot shock. The degraded associative fear memory engram is further manifested in its lack of intertwined and alternating temporal association between CS and US memory traces that are characteristic to the holistic memory recall in the wild-type animals. Therefore, our study has decoded real-time memory contents, timing relationship between CS and US, and temporal organizing patterns of fear memory engrams and demonstrated how hippocampal memory codes are regulated by NMDA receptor synaptic plasticity.     

Stimulus representation in SOP: II. An application to inhibition of delay

The componential extension of SOP accounts for conditioned response (CR) timing in Pavlovian conditioning by assuming that learning accrues with relative independence to stimulus elements that are differentially occasioned during the duration of the conditioned stimulus (CS). SOP, using a competitive learning rule and the assumption that temporal learning emerges via resolution of what is equivalent to an "AX+BX-" discrimination, predicts a progressive increase in the latency of the CR over training, or what Pavlov refer to as "inhibition of delay." Other componential models, which use noncompetitive learning rules, do not predict inhibition of delay. Either type of model makes the prediction indicated, independently of the length of the CS-unconditioned stimulus (US) interval. We report two experiments that demonstrated inhibition of delay when rabbits were trained with relatively long, but not with short, CS-US intervals. To account for this divergence, we assumed that the SOP stimulus trace involves two kinds of elements, some with a temporally distributed pattern of activity over the duration of the CS duration, and some with a randomly distributed pattern. This stimulus representation, not only allows for inhibition of delay with long but not short CS-US intervals, but in combination with SOP's performance rule deduces CR's with "Weber variability."     

Adaptive timing in neural networks: The conditioned response

A conditioned response not only reflects knowledge of an association between two events, a CS and a US, it also reflects knowledge about the timing of these events. A neural network and set of learning rules that generates appropriately timed conditioned response waveforms is presented. The model is capable of simulating some of the basic temporal properties of conditioned responses exhibited in biological systems, including (1) decreasing onset latency during acquisition training, (2) peak amplitude accurring at the temporal locus of the US, (3) inhibition of delay, and (4) trace conditioning. The model is also capable of simulating complex CR waveforms under certain conditions, and these simulations are compared with the results of behavioral experiments. The temporally adaptive responses are achieved by virtue of stimulus trace processes that are built into the network architecture.     

Spatial serial conditioning maintained with minimal temporal contingency

Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatially informative conditioned stimuli in eliciting tracking behavior in pigeons. The experimental paradigm consisted of the simultaneous presentation of 2 key lights (CS2 and CTRL), followed by another key light (CS1), followed by food (the unconditioned stimulus or US). CS2 and CTRL were presented in 2 of 3 possible locations, randomly assigned; CS1 was always presented in the same location as CS2. CS2 was designed to signal the spatial, but not the temporal locus of CS1; CS1 signaled the temporal locus of the US. In experiment 1, differential pecking on CS2 was observed even when CS2 was present throughout the interval between consecutive presentations of CS1, but only in a minority of pigeons; prevalence of differential pecking was enhanced when CS2 duration was halved. A control condition verified that pecking on CS2 was not due to temporal proximity between CS2 and US. Experiment 2 demonstrated the reversibility of spatial conditioning between CS2 and CTRL. Asymptotic performance never involved tracking CTRL more than CS2 for any of 16 pigeons. It is inferred that pigeons learned the spatial association between CS2 and CS1, and that temporal contingency facilitated its expression as tracking behavior.     

Long-term depression of the cerebellar climbing fiber--Purkinje neuron synapse

In classic Marr-Albus-Ito models of cerebellar function, coactivation of the climbing fiber (CF) synapse, which provides massive, invariant excitation of Purkinje neurons (coding the unconditioned stimulus), together with a graded parallel fiber synaptic array (coding the conditioned stimulus) leads to long-term depression (LTD) of parallel fiber-Purkinje neuron synapses, underlying production of a conditioned response. Here, we show that the supposedly invariant CF synapse can also express LTD. Brief 5 Hz stimulation of the CF resulted in a sustained depression of CF EPSCs that did not spread to neighboring parallel fiber synapses. Like parallel fiber LTD, CF LTD required postsynaptic Ca2+ elevation, activation of group 1 mGluRs, and activation of PKC. CF LTD is potentially relevant for models of cerebellar motor control and learning and the developmental conversion from multiple to single CF innervation of Purkinje neurons.     

Acquisition of enhanced natural killer cell activity under anesthesia

An increase in natural killer (NK) cell activity can be conditioned with a one trial learning paradigm to demonstrate the interaction between the central nervous system (CNS) and the immune system. In order to demonstrate learning possibilities during ‘non-conscious’ state, mice were anesthetized with a ketamin/rompun mixture and underwent one trial learning with odor cue as the conditioned stimulus (CS) preceding the unconditioned stimulus (US). The results indicated that mice that were exposed to camphor odor cue under the influence of anesthesia can associate the signal with the poly I:C unconditioned stimulus and were able to recall the conditioned response upon reexposure to the CS. Secondly, the conditioned association made in a conscious state can be recalled by exposure to the same olfactory odor cue in a ‘non-conscious’ state. The increase in the conditioned change in NK cell activity of both situations was significantly higher than the control group. The results demonstrate that learning can take place and the learned response can be recalled under the reduced awareness caused by anesthesia. The findings we report are unusual and novel in that they demonstrate that the CNS can learn new associations under conditions where the host is apparently unaware of the signals being linked. Anesthesia combined with the long interstimulus interval indicates that certain neuronal pathways in the CNS are receptive to second signals (elicited by the US) even when the second signal is separated by one day. This means the conditioned learning of a physiological response can take place unconsciously at a separate level and under situations where the host is totally unaware of the events which the brain is processing and linking as incoming information.     

Varying temporal placement during CS of an added stimulus correlated with non-delivery of UCS.

This experiment extends Pavlov's method of contrasts for training a stimulus discrimination to the case of the cardiac conditional response in the rhesus monkey. It explores the parameter of temporal placement of an additional stimulus ("CS2") within a 10-sec CS (or "CS1"), with the appearance of the former stimulus on any trial signalling the absence of UCS (electric shock) on that trial. This experimental paradigm is a parallel to that of the "intruded stimulus" studies in operant conditioning. In both cases, several ways of describing the function of the added stimulus are possible, but all seem reducible to the same operational terms. Data were taken in the present study with respect to the form and latency of the cardiac rate changes produced by intrusion of CS2 (light), across a range of placements varying from simultaneity with CS1 (a different light) onset to two sec before UCS would have been delivered. The control of CS2 over the cardiac rate CR was occasionally exhibited with a latency as short as three beats after stimulus onset. The order of CS2 temporal placements to which a subject was exposed was a factor in determining the form of the conditioned cardiac rate response to CS1.     

Blood pressure variations real-time reflect the conditioned fear learning and memory

The conditioned fear learning and memory occurs when a neutral conditioned stimulus (CS) is paired with an aversive unconditioned stimulus (US). This process is critically dependent on the amygdala and inevitably involves blood pressure (BP) alterations. We hypothesized that BP variations could instantaneously reveal individual steps during conditioned fear learning and memory. An implanted telemetric probe was used to monitor the BP real-time in rats during training and testing sessions of the fear-potentiated startle. Our results showed that (i) the conditioned fear learning during the training sessions was reflected by light (CS)-induced rapid BP elevations and by electric shock (US)-evoked sympathetic tone elevations; (ii) these two BP-related parameters were not only negatively correlated with each other but also coupled to each other in the training session trials; (iii) both parameters closely predicted the performance of fear-potentiated startle on the next day; and (iv) although local blocking of one of the two fear-conditioned pathways in the training session partially inhibited fear learning, the fear memory retrieval still used both pathways. Altogether, real-time blood pressure variations faithfully revealed the critical steps involved in conditioned fear learning and memory, and our results supported a coupling between the cued learning and the post-shock calmness.     

Does conditioned taste aversion learning in the pond snail Lymnaea stagnalis produce conditioned fear?

In conditioned taste aversion (CTA) training performed on the pond snail Lymnaea stagnalis, a stimulus (the conditional stimulus, CS; e.g., sucrose) that elicits a feeding response is paired with an aversive stimulus (the unconditional stimulus, US) that elicits the whole-body withdrawal response and inhibits feeding. After CTA training and memory formation, the CS no longer elicits feeding. We hypothesize that one reason for this result is that after CTA training the CS now elicits a fear response. Consistent with this hypothesis, we predict the CS will cause (1) the heart to skip a beat and (2) a significant change in the heart rate. Such changes are seen in mammalian preparations exposed to fearful stimuli. We found that in snails exhibiting long-term memory for one-trial CTA (i.e., good learners) the CS significantly increased the probability of a skipped heartbeat, but did not significantly change the heart rate. The probability of a skipped heartbeat was unaltered in control snails given backward conditioning (US followed by CS) or in snails that did not acquire associative learning (i.e., poor learners) after the one-trial CTA training. These results suggest that as a consequence of acquiring CTA, the CS evokes conditioned fear in the conditioned snails, as evidenced by a change in the nervous system control of cardiac activity.     

Disrupting Reconsolidation of Fear Memory in Humans by a Noradrenergic β-Blocker

The basic design used in our human fear-conditioning studies on disrupting reconsolidation includes testing over different phases across three consecutive days. On day 1 - the fear acquisition phase, healthy participants are exposed to a series of picture presentations. One picture stimulus (CS1+) is repeatedly paired with an aversive electric stimulus (US), resulting in the acquisition of a fear association, whereas another picture stimulus (CS2-) is never followed by an US. On day 2 - the memory reactivation phase, the participants are re-exposed to the conditioned stimulus without the US (CS1-), which typically triggers a conditioned fear response. After the memory reactivation we administer an oral dose of 40 mg of propranolol HCl, a β-adrenergic receptor antagonist that indirectly targets the protein synthesis required for reconsolidation by inhibiting the noradrenaline-stimulated CREB phosphorylation. On day 3 - the test phase, the participants are again exposed to the unreinforced conditioned stimuli (CS1- and CS2-) in order to measure the fear-reducing effect of the manipulation. This retention test is followed by an extinction procedure and the presentation of situational triggers to test for the return of fear. Potentiation of the eye blink startle reflex is measured as an index for conditioned fear responding. Declarative knowledge of the fear association is measured through online US expectancy ratings during each CS presentation. In contrast to extinction learning, disrupting reconsolidation targets the original fear memory thereby preventing the return of fear. Although the clinical applications are still in their infancy, disrupting reconsolidation of fear memory seems to be a promising new technique with the prospect to persistently dampen the expression of fear memory in patients suffering from anxiety disorders and other psychiatric disorders.     

Extension of the CS past the US can facilitate conditioning of the rabbit's nictitating membrane response

Five experiments were conducted in which the onset of a tone conditioned stimulus (CS) preceded the unconditioned stimulus (US) by 500 ms. Across experiments, the offset of the CS was extended past the offset of the US by values ranging from 0 ms to 40000 ms. Extensions of the CS of 2000 ms or greater produced acquisition of a conditioned response (CR) that was as fast or faster than in the no-extension condition (0 ms). While extension of a forward tone CS after the US enhanced excitatory conditioning, insertion of another CS (light) in a purely backward relationship with the US passed only a retardation test, indicative of latent inhibition, and not a summation test needed for conditioned inhibition. The results add to the evidence that excitatory and inhibitory processes are both engaged following US offset. Alternative theories of CS processing are discussed.     

Changes in potentiation and timing of sensorimotor transmission after adaptation of a postsynaptic transient outward current in a simulated cortical neuron

How adaptation of a postsynaptic transient outward current might affect the efficacy of sensorimotor transmission was investigated. The transmission signals that were studied were a 5 ms conditioned stimulus (CS) and a 60 ms US drawn from intracellularly recorded, depolarizing postsynaptic potentials (PSPs) elicited in pyramidal neurons of the cat motor cortex by a click CS and a glabella tap US, respectively. SPICE, a program used to analyze electrical circuits, was used to simulate the cortical neuron containing the adaptive outward current. Changes in the magnitude and latency of rise to firing threshold of the PSPs were compared i) after presynaptic augmentation of a CS input in the absence of an adaptive postsynaptic current and ii) after decreasing the magnitude of an adaptive postsynaptic current that was rapidly activated by depolarization. Effects of short (6 ms) and long (24 ms) inactivation time constants of the postsynaptic current were also studied. In both presynaptic adaptation and postsynaptic adaptation, the potentiation of the magnitude of the CS-induced PSP was similar, with the latency to threshold being reduced by " 1 ms in both cases. The effects on the US PSP differed. Presynaptic adaptation affecting the CS had no effect on the US. Adaptation of the CS by a postsynaptic outward current with a 6 ms inactivation time constant, reduced the latency to threshold of an EPSP from a nearby US synapse by up to 6 ms by augmenting the initial portion of the slowly rising US-induced PSP. Adaptation of a postsynaptic current with a 24 ms inactivation time constant reduced the latency of response to the US PSP by up to 16 ms. When the US synapse was relocated to the soma, the reduction in US latency caused by adaptation of the outward current at the CS synapse was reduced by up to one half. The latency of slowly rising components of integrated synaptic responses to compound CSs of > 5 ms duration from multiple synaptic inputs would be expected to show reductions corresponding to those of the US. We conclude that potentiation of synaptic transmission by adaptation of a postsynaptic outward current can result in reductions of latency of sensorimotor transmission that can significantly affect the timing and accuracy of controlled motor tasks. These effects depend significantly on the locations of the synaptic inputs within the cell.     

Changes in potentiation and timing of sensorimotor transmission after adaptation of a postsynaptic transient outward current in a simulated cortical neuron

How adaptation of a postsynaptic transient outward current might affect the efficacy of sensorimotor transmission was investigated. The transmission signals that were studied were a 5 ms conditioned stimulus (CS) and a 60 ms US drawn from intracellularly recorded, depolarizing postsynaptic potentials (PSPs) elicited in pyramidal neurons of the cat motor cortex by a click CS and a glabella tap US, respectively. SPICE, a program used to analyze electrical circuits, was used to simulate the cortical neuron containing the adaptive outward current. Changes in the magnitude and latency of rise to firing threshold of the PSPs were compared i) after presynaptic augmentation of a CS input in the absence of an adaptive postsynaptic current and ii) after decreasing the magnitude of an adaptive postsynaptic current that was rapidly activated by depolarization. Effects of short (6 ms) and long (24 ms) inactivation time constants of the postsynaptic current were also studied. In both presynaptic adaptation and postsynaptic adaptation, the potentiation of the magnitude of the CS-induced PSP was similar, with the latency to threshold being reduced by < or = 1 ms in both cases. The effects on the US PSP differed. Presynaptic adaptation affecting the CS had no effect on the US. Adaptation of the CS by a postsynaptic outward current with a 6 ms inactivation time constant, reduced the latency to threshold of an EPSP from a nearby US synapse by up to 6 ms by augmenting the initial portion of the slowly rising US-induced PSP. Adaptation of a postsynaptic current with a 24 ms inactivation time constant reduced the latency of response to the US PSP by up to 16 ms. When the US synapse was relocated to the soma, the reduction in US latency caused by adaptation of the outward current at the CS synapse was reduced by up to one half. The latency of slowly rising components of integrated synaptic responses to compound CSs of > 5 ms duration from multiple synaptic inputs would be expected to show reductions corresponding to those of the US. We conclude that potentiation of synaptic transmission by adaptation of a postsynaptic outward current can result in reductions of latency of sensorimotor transmission that can significantly affect the timing and accuracy of controlled motor tasks. These effects depend significantly on the locations of the synaptic inputs within the cell.     

Conditioned augmentation of natural killer cell activity. Independence from nociceptive effects and dependence on interferon-beta

Injection of mice with 20 micrograms polyinosinic: polycytidylic acid (Poly I:C) after exposure to camphor odor results in a conditioned augmentation of natural killer cell (NK) activity. In this study, we show that the conditioned response is not the result of nociceptive stimulation and that interferon-beta (IFN), but not IFN-alpha can replace Poly I:C as the unconditioned stimulus (US). Two conditioned stimuli (CS) were used with equivalent results. A combination CS consisting of a novel taste (saccharin) and a 125 mg/kg injection of LiCl that induces gastric upset was paired with a Poly I:C or IFN-beta (1 X 10(4) IU) injection. This resulted in an augmentation of NK activity when the conditioned animals were reexposed to the saccharin-LiCl CS. In addition, an identical conditioned response was elicited when a camphor odor CS was paired with either of these US. To test whether the conditioned response might be an artifact not detected by our controls, a mock conditioning experiment was performed, which assessed the differential effect of multiple exposures to the saccharin-LiCl CS without a CS/US pairing. The mock conditioned group was significantly suppressed relative to saline treated controls, whereas the mock nonconditioned group and the mock conditioned group that was not reexposed to the CS after conditioning did not show significant suppression. This indicates that the augmentation observed in the conditioned group after CS/US pairing was not the result of exposure to the CS itself. Small doses of Poly I:C (5 micrograms or 2.5 micrograms) given on days 3 and 5 (or on day 5 only) to boost NK activity had the effect of increasing the magnitude of the conditioned response measured on day 6. In addition, an identical conditioned response was observed when the interval between the CS/US pairing and the later CS exposures was changed, which places the test for the conditioned response either on day 6 (CS given on days 3 and 5) or day 10 (CS given on days 7 and 9). These results show that the observed conditioned enhancement of NK activity in conditioned animals is not caused by any nociceptive properties of the CS itself and is dependent on the IFN-beta produced after Poly I:C injection in the conditioned paradigm.     

Protein synthesis subserves reconsolidation or extinction depending on reminder duration

When learned associations are recalled from long-term memory stores by presentation of an unreinforced conditioned stimulus (CS), two processes are initiated. One, termed reconsolidation, re-activates the association between the conditioned and unconditioned stimuli and transfers it from a stable protein synthesis-independent form of storage to a more labile protein-dependent state. The other is an extinction process in which presentation of the CS alone degrades the association between CS and US. To address the mechanistic relationship between reconsolidation and extinction, we have used an invertebrate model of contextual memory, which involves an association between the learning context and a visual danger stimulus. Here, we show that re-exposure duration to the learning context acts as a switch guiding the memory course toward reconsolidation or extinction, each depending on protein synthesis. Manipulation of this variable allows findings of impaired extinction to be discriminated from those of disrupted reconsolidation.