Stimulus representation in SOP: I. Theoretical rationalization and some implications

THE SOP MODEL [INFORMATION PROCESSING IN ANIMALS: Memory Mechanisms, Erlbaum, Hillsdale, NJ, 1981, p. 5] is described in terms of its assumed stimulus representation, network characteristics, and rules for learning and performance. It is shown how several Pavlovian conditioning phenomena can be accounted on the basis of the model's presumed stimulus representation. Challenges to the SOP model prompted the adoption of a componential stimulus representation in: AESOP [Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory, Erlbaum, Hillsdale, NJ, 1989, p. 149], this was a dual representation of the unconditioned stimulus (US), and C-SOP [Contemporary Learning: Theory and Application, Erlbaum, Mahwah, NJ, 2001, p. 23], this was a multi-component representation of the conditioned stimulus (CS). The assumption of a componential CS representation, where large numbers of elements can be separately learned about, necessitated a modification of the learning rule. The modified, "constrained" rule was found useful to explain timing characteristics of Pavlovian conditioned responses, as well as data offered by Rescorla [J. Exp. Psychol. Anim. Behav. Process. 26 (2000) 428; Q. J. Exp. Psychol. 54B (2001) 53; J. Exp. Psychol. Anim. Behav. Process. 28 (2002) 163] showing that stimuli trained in compound do not share the same quantitative fate.     

Reinstatement of short-latency responses after asymptotic Pavlovian conditioning training by the presentation of an extraneous stimulus

The purpose of this study was to examine whether the progressive disappearance of short-latency conditioned responses, or inhibition of delay, observed in Pavlovian conditioning with long inter-stimulus intervals, could be reverted by the presentation of a novel stimulus. In one experiment, two groups of rabbits received extensive training with a short (250 ms) or a long (1500 ms) tone that overlapped and terminated with a periorbital shock unconditioned stimulus. After training, the presentation of an extraneous stimulus prior to tone onset produced a reinstatement of short latency CRs in the group trained with the long CS, but did not affect CR latency in the group trained with the short CS. This finding is consistent with Pavlov's (1927) view that conditioning with long conditioned stimuli involves the acquisition of response tendencies in the early portion of the stimulus that are subsequently suppressed by the development of an inhibitory process.     

Molecular signaling during taste aversion learning

Behavioral and neural assessment tools have been used to identify cellular and molecular events that occur during taste aversion acquisition. Studies described here include an assessment of taste information processing and taste-illness association using fos-like immunoreactivity (FLI) to mark populations of cells that react strongly to the taste conditioned stimulus (CS), the illness unconditioned stimulus (US), or the pairing of CS and US. Exposure to a novel, but not a familiar, CS taste (saccharin) was found to induce robust increases in FLI in some, but not all, brain regions previously implicated in taste processing or taste aversion learning. Striking effects of taste novelty on FLI were found in central amygdala (CNA) and insular cortex (IC) but not in basolateral amygdala (BLA), pontine parabrachial nucleus (PBN), or nucleus of the solitary tract (NTS). Of those regions responding to taste novelty, only CNA showed significant elevations in FLI in response to the US, LiCl. In additional studies, FLI was examined after an effective training experience, novel CS-US pairing, and compared with an ineffective one, familiar CS-US pairing. After CS-US pairing, taste novelty modulated FLI in virtually all the regions previously implicated in conditioned taste aversion (CTA) learning, including PBN, CNA, BLA, IC, as well as NTS. Thus, a distributed and interdependent neural CTA circuit is mapped using this method, and the use of localized lesion and inactivation studies promises to further define the functional role of structures within this circuit.     

External inhibition in a goldfish (Carassius auratus) classical conditioning situation

Goldfish were classically conditioned with a light as the CS and shock as the US. The UR was a decrease in respiration. After 15 or 60 conditioning trials the fish were tested with novel stimuli (clicks) during the CS-US interval. High and moderate intensity novel stimuli produced a significant decrease in CRs (external inhibition) for fish with 60 conditioning trials (5.5 or 10.5 sec CS-US interval), but not fish with 15 conditioning trials. Low intensity novel stimuli produced no evidence for disinhibition (an increase in CRs). Control groups (e.g., groups with random presentations of the CS and US) showed that the external inhibition for fish with 60 conditioning trials was inhibition of a true CR.     

Extinction of a conditioned response in rainbow trout selected for high or low responsiveness to stress

Two lines of rainbow trout (Oncorhynchus mykiss) that exhibit divergent endocrine responsiveness to stressors also display disparate behavioral traits. To investigate whether the high-responding (HR) and low-responding (LR) fish also differ in cognitive function, the rate of extinction of a conditioned response was compared between the two lines. Groups of HR and LR fish were exposed to a paired conditioned stimulus (CS; water off) and unconditioned stimulus (US; confinement stressor). After exposure to 18 CS-US pairings, at least 70% of individuals of both lines acquired a conditioned response (CR) manifested as an elevation of blood cortisol levels on presentation of the CS only. Post-conditioning, the fish were tested by presentation of the CS at weekly intervals, for 4 weeks, with no further reinforcement, and the extinction of the CR in the two lines was compared. The decline in mean plasma cortisol levels after exposure to the CS over successive tests suggested that the CR was retained for a shorter period among the HR (<14 days) than LR fish (<21 days). The frequency of individuals within each line whose plasma cortisol levels indicated a stress response when exposed to the CS was significantly greater among the LR than HR fish at 14 and 21 days with no HR fish falling into this category at 21 days. At 28 days post-conditioning, there were no HR fish and only three LR fish were categorized as "stressed". These results suggest that there are differences in cognitive function between the two lines. Possible mechanisms underlying these differences are discussed.     

A time contraction effect of acute tail-pinch stress on the associative learning of rats

The effect of tail-pinch stress interpolated between the saccharin conditioned stimulus (CS) and the illness-inducing unconditioned stimulus (US) during long-trace taste-aversion conditioning was examined in young- and old adult rats with a two-cylinder (saccharin versus water) test. A 2 x 2 x 4 factorial ANOVA was performed on percent-preference-for-saccharin data, with age (young, old), stress condition (stressed, non-stressed), and CS-US interval (22.5-, 45-, 90-, and 180-min) being the factors under consideration. The ANOVA yielded only significant main effects of stress condition and CS-US interval. These findings indicate that stress weakens the CS-US association as evidenced by a higher percent preference for saccharin in the stressed rats than in non-stressed rats at all CS-US intervals. A comparison of the stressed and non-stressed conditioned rats with pseudo-conditioned controls showed that the non-stressed rats formed strong aversions up to the 45-min CS-US interval whereas the stressed rats showed no conditioning beyond the 22.5 min CS-US interval, indicating that stress decreases the effective CS-US interval. Results were interpreted in terms of time-contraction and an internal biological countdown timer hypothesized to govern processes involved in associative learning over long delays.     

Hippocampal place cells acquire location-specific responses to the conditioned stimulus during auditory fear conditioning

We recorded neurons from the hippocampus of freely behaving rats during an auditory fear conditioning task. Rats received either paired or unpaired presentations of an auditory conditioned stimulus (CS) and an electric shock unconditioned stimulus (US). Hippocampal neurons (place and theta cells) acquired responses to the auditory CS in the paired but not in the unpaired group. After CS-US pairing, rhythmic firing of theta cells became synchronized to the onset of the CS. Conditioned responses of place cells were gated by their location-specific firing, so that after CS-US pairing, place cells responded to the CS only when the rat was within the cell's place field. These findings may help to elucidate how the hippocampus contributes to context-specific memory formation during associative learning.     

Neural-network simulations of two context-dependence phenomena

This paper describes simulations of two context-dependence phenomena in Pavlovian conditioning, using a neural-network model that draws on knowledge from neuroscience and makes no distinction between operant and respondent learning mechanisms. One phenomenon is context specificity or the context-shift effect, the decrease of conditioned responding (CR) when the conditioned stimulus (CS) is tested in a context different from the one in which it had been paired with the unconditioned stimulus (US). The other effect is renewal, the recovery of CR in the training context after extinction in another context. For specificity (simulation 1), two neural networks were first given 200 CS-US pairings in a context. Then, the CS was tested either in the training context or a new context. Output activations in the new context were substantially lower. For renewal (simulation 2), two networks were first given 200 CS-US pairings in a context, then 100 extinction trials in either the same context or a new one, and then tested back in the training context. Output activations during the test phase were substantially higher after extinction in a new context. The results are interpreted in terms of the dynamics of activations and weights.     

Classical conditioning and retention in normal and mutantDrosophila melanogaster

Summary By changing the conditioned discrimination paradigm of Quinn et al. (1974) from an instrumental procedure to a classical (Pavlovian) one, we have demonstrated strong learning in type flies. About 150 flies were sequestered in a closed chamber and trained by explosing them sequentially to two odors in air currents. Flies received twelve electric shock pulses in the presence of the first odor (CS+) but not in the presence of the second odor (CS–). To test for conditioned avoidance responses, flies were transported to a Tmaze choice point, between converging currents of the two odors. Typically, 95% of trained flies avoided the shock-associated odor (CS+).Acquisition of learning was a function of the number of shock pulses received during CS+ presentation and was asymptotic within one training cycle. Conditioned avoidance increased with increasing shock intensity or odor concentration and was very resistant to extinction. Learning was best when CS+ presentations overlap shock (delay conditioning) and then decreased with increasing CS-US interstimulus intervals. Shocking flies immediately before CS+ presentation (backward conditioning) produced no learning. Nonassociative control procedures (CS Alone, US Alone and Explicitly Unpaired) produced slight decreases in avoidance responses, but these affected both odors equally and did not alter our associative learning index (A).Memory in wild-type flies decayed gradually over the first seven hours after training and still was present 24 h later. The mutantsamnesiac, rutabaga anddunce showed appreciable learning acquisition, but their memories decayed very rapidly during the first 30 min. After this, the rates of decay slowed sharply; conditioned avoidance still was measurable at least three hours after training.Abbreviations OCT 3-octanol - MCH 4-methylcyclohexanol - C-S Canton-Special - CS conditioned stimulus - US unconditioned stimulus     

Appetitive and aversive learning in Spodoptera littoralis larvae

Adult Lepidoptera are capable of associative learning. This helps them to forage flowers or to find suitable oviposition sites. Larval learning has never been seriously considered because they have limited foraging capabilities and usually depend on adults as concerns their food choices. We tested if Spodoptera littoralis larvae can learn to associate an odor with a tastant using a new classical conditioning paradigm. Groups of larvae were exposed to an unconditioned stimulus (US: fructose or quinine mixed with agar) paired with a conditioned stimulus (CS: hexanol, geraniol or pentyl acetate) in a petri dish. Their reaction to CS was subsequently tested in a petri dish at different time intervals after conditioning. Trained larvae showed a significant preference or avoidance to CS when paired with US depending on the reinforcer used. The training was more efficient when larvae were given a choice between an area where CS-US was paired and an area with no CS (or another odor). In these conditions, the memory formed could be recalled at least 24 h after pairing with an aversive stimulus and only 5 min after pairing with an appetitive stimulus. This learning was specific to CS because trained larvae were able to discriminate CS from another odor that was present during the training but unrewarded. These results suggest that Lepidoptera larvae exhibit more behavioral plasticity than previously appreciated.     

Training-Dependent Associative Learning Induced Neocortical Structural Plasticity: A Trace Eyeblink Conditioning Analysis

Studies utilizing general learning and memory tasks have suggested the importance of neocortical structural plasticity for memory consolidation. However, these learning tasks typically result in learning of multiple different tasks over several days of training, making it difficult to determine the synaptic time course mediating each learning event. The current study used trace-eyeblink conditioning to determine the time course for neocortical spine modification during learning. With eyeblink conditioning, subjects are presented with a neutral, conditioned stimulus (CS) paired with a salient, unconditioned stimulus (US) to elicit an unconditioned response (UR). With multiple CS-US pairings, subjects learn to associate the CS with the US and exhibit a conditioned response (CR) when presented with the CS. Trace conditioning is when there is a stimulus free interval between the CS and the US. Utilizing trace-eyeblink conditioning with whisker stimulation as the CS (whisker-trace-eyeblink: WTEB), previous findings have shown that primary somatosensory (barrel) cortex is required for both acquisition and retention of the trace-association. Additionally, prior findings demonstrated that WTEB acquisition results in an expansion of the cytochrome oxidase whisker representation and synaptic modification in layer IV of barrel cortex. To further explore these findings and determine the time course for neocortical learning-induced spine modification, the present study utilized WTEB conditioning to examine Golgi-Cox stained neurons in layer IV of barrel cortex. Findings from this study demonstrated a training-dependent spine proliferation in layer IV of barrel cortex during trace associative learning. Furthermore, findings from this study showing that filopodia-like spines exhibited a similar pattern to the overall spine density further suggests that reorganization of synaptic contacts set the foundation for learning-induced neocortical modifications through the different neocortical layers.     

Reevaluating the Role of the Hippocampus in Delay Eyeblink Conditioning

The role of the hippocampus in delay eyeblink conditioning (DEC) remains controversial. Here, we investigated the involvement of the hippocampus in DEC with a soft tone as the conditioned stimulus (CS) by using electrolytic lesions or muscimol inactivation of guinea pig dorsal hippocampus. Interestingly, when a soft tone was used as a CS, electrolytic lesions of the hippocampus significantly retarded acquisition of the conditioned response (CR), and muscimol infusions into hippocampus distinctly inhibited the acquisition and expression of CR, but had no significant effect on consolidation of well-learned CR. In contrast, both electrolytic lesions and muscimol inactivation of hippocampus produced no significant deficits in the CR when a loud tone was used as the CS. These results demonstrate that the hippocampus is essential for the DEC when the delay task was rendered more difficult.     

Autoshaping in the rat: conditioned licking response to a stimulus that signals sucrose reinforcement

The present experiments were designed to determine if repeated presentations of an empty sipper tube (the conditioned stimulus or CS) with the response-independent delivery of a sucrose solution (the unconditioned stimulus or US) from a second spout results in the development of Pavlovian conditioned responding. In Experiment 1, rats in the experimental condition received paired CS-US presentations whereas subjects in the control condition were exposed to random presentations of CS and US. In Experiment 2, an additional control condition (CS alone) was included and, to encourage generalized responding between the US and CS, the CS tube was filled with water for all groups. The results of both experiments indicate that the CS-directed responding in the paired CS-US condition was Pavlovian in nature. Thus, the present procedure serves as an autoshaping task in which conditioned licking is generated.     

Extension of the CS past the US can facilitate conditioning of the rabbit's nictitating membrane response

Five experiments were conducted in which the onset of a tone conditioned stimulus (CS) preceded the unconditioned stimulus (US) by 500 ms. Across experiments, the offset of the CS was extended past the offset of the US by values ranging from 0 ms to 40000 ms. Extensions of the CS of 2000 ms or greater produced acquisition of a conditioned response (CR) that was as fast or faster than in the no-extension condition (0 ms). While extension of a forward tone CS after the US enhanced excitatory conditioning, insertion of another CS (light) in a purely backward relationship with the US passed only a retardation test, indicative of latent inhibition, and not a summation test needed for conditioned inhibition. The results add to the evidence that excitatory and inhibitory processes are both engaged following US offset. Alternative theories of CS processing are discussed.     

Adaptive timing in neural networks: The conditioned response

A conditioned response not only reflects knowledge of an association between two events, a CS and a US, it also reflects knowledge about the timing of these events. A neural network and set of learning rules that generates appropriately timed conditioned response waveforms is presented. The model is capable of simulating some of the basic temporal properties of conditioned responses exhibited in biological systems, including (1) decreasing onset latency during acquisition training, (2) peak amplitude accurring at the temporal locus of the US, (3) inhibition of delay, and (4) trace conditioning. The model is also capable of simulating complex CR waveforms under certain conditions, and these simulations are compared with the results of behavioral experiments. The temporally adaptive responses are achieved by virtue of stimulus trace processes that are built into the network architecture.     

Varying temporal placement during CS of an added stimulus correlated with non-delivery of UCS.

This experiment extends Pavlov's method of contrasts for training a stimulus discrimination to the case of the cardiac conditional response in the rhesus monkey. It explores the parameter of temporal placement of an additional stimulus ("CS2") within a 10-sec CS (or "CS1"), with the appearance of the former stimulus on any trial signalling the absence of UCS (electric shock) on that trial. This experimental paradigm is a parallel to that of the "intruded stimulus" studies in operant conditioning. In both cases, several ways of describing the function of the added stimulus are possible, but all seem reducible to the same operational terms. Data were taken in the present study with respect to the form and latency of the cardiac rate changes produced by intrusion of CS2 (light), across a range of placements varying from simultaneity with CS1 (a different light) onset to two sec before UCS would have been delivered. The control of CS2 over the cardiac rate CR was occasionally exhibited with a latency as short as three beats after stimulus onset. The order of CS2 temporal placements to which a subject was exposed was a factor in determining the form of the conditioned cardiac rate response to CS1.     

Implicit Memory in Monkeys: Development of a Delay Eyeblink Conditioning System with Parallel Electromyographic and High-Speed Video Measurements

Delay eyeblink conditioning, a cerebellum-dependent learning paradigm, has been applied to various mammalian species but not yet to monkeys. We therefore developed an accurate measuring system that we believe is the first system suitable for delay eyeblink conditioning in a monkey species (Macaca mulatta). Monkey eyeblinking was simultaneously monitored by orbicularis oculi electromyographic (OO-EMG) measurements and a high-speed camera-based tracking system built around a 1-kHz CMOS image sensor. A 1-kHz tone was the conditioned stimulus (CS), while an air puff (0.02 MPa) was the unconditioned stimulus. EMG analysis showed that the monkeys exhibited a conditioned response (CR) incidence of more than 60% of trials during the 5-day acquisition phase and an extinguished CR during the 2-day extinction phase. The camera system yielded similar results. Hence, we conclude that both methods are effective in evaluating monkey eyeblink conditioning. This system incorporating two different measuring principles enabled us to elucidate the relationship between the actual presence of eyelid closure and OO-EMG activity. An interesting finding permitted by the new system was that the monkeys frequently exhibited obvious CRs even when they produced visible facial signs of drowsiness or microsleep. Indeed, the probability of observing a CR in a given trial was not influenced by whether the monkeys closed their eyelids just before CS onset, suggesting that this memory could be expressed independently of wakefulness. This work presents a novel system for cognitive assessment in monkeys that will be useful for elucidating the neural mechanisms of implicit learning in nonhuman primates.     

The effect of elevated blood cortisol levels on the extinction of a conditioned stress response in rainbow trout

Following previously published observations that a conditioned response (CR) was lost more quickly by rainbow trout (Oncorhynchus mykiss) exhibiting a high responsiveness to stressors than by low responding individuals this study was designed to investigate the effects of exogenous cortisol on the retention of a CR in unselected rainbow trout. Fish held in isolation were conditioned over a 10-day period by pairing an innocuous signal (conditioned stimulus, CS: a water jet played on the surface of the tank water) with a mild stressor (unconditioned stimulus, US: 30 min of confinement). This resulted in a brief elevation of plasma cortisol levels (the CR) when the fish was exposed to the CS only. The effect of exogenous cortisol on the retention of the CR was evaluated by comparing the performance of fish that received cortisol-containing slow-release intraperitoneal implants, with fish receiving vehicle-only implants. Retention of the CR was assessed at intervals up to 35 days after conditioning ceased. The CR was considered to be evident when 30 min following presentation of the CS, mean plasma cortisol levels were significantly higher in conditioned than untrained fish. On day 1 both cortisol-implanted and vehicle-implanted conditioned fish exhibited a CR. However, from day 5 onwards the CR was observed only in the vehicle-implanted and conditioned group. This finding indicates that administration of cortisol accelerated the extinction of the CR in the cortisol-implanted fish, suggesting that elevated plasma cortisol levels can impair memory processes in rainbow trout.     

Pavlovian conditioning: pigeon nictitating membrane

A new Pavlovian conditioning preparation was developed using the nictitating membrane of the restrained pigeon. Either visual or auditory stimuli served as conditioned stimuli (CSs) with an unconditioned stimulus (US) of a puff of air to the cornea. Movement of the nictitating membrane constituted the conditioned and unconditioned responses (CR and UR). Conditioning was studied with the Kamin blocking procedure. In agreement with findings from other conditioning preparations, responding to the redundant stimulus was attenuated relative to a stimulus that received the same number of CS-US pairings in a compound-conditioning procedure. Although response attenuation occurred, substantial individual variation was observed within the blocking procedure, a finding with some precedent in the experimental literature. Theoretical analysis and neural-network simulations indicate that inter-subject variation in response attenuation may result from differences in the extent to which contextual stimuli contribute to the functional CS.     

Deep Cerebellar Nuclei Play an Important Role in Two-Tone Discrimination on Delay Eyeblink Conditioning in C57BL/6 Mice

Previous studies have shown that deep cerebellar nuclei (DCN)-lesioned mice develop conditioned responses (CR) on delay eyeblink conditioning when a salient tone conditioned stimulus (CS) is used, which suggests that the cerebellum potentially plays a role in more complicated cognitive functions. In the present study, we examined the role of DCN in tone frequency discrimination in the delay eyeblink-conditioning paradigm. In the first experiment, DCN-lesioned and sham-operated mice were subjected to standard simple eyeblink conditioning under low-frequency tone CS (LCS: 1 kHz, 80 dB) or high-frequency tone CS (HCS: 10 kHz, 70 dB) conditions. DCN-lesioned mice developed CR in both CS conditions as well as sham-operated mice. In the second experiment, DCN-lesioned and sham-operated mice were subjected to two-tone discrimination tasks, with LCS+ (or HCS+) paired with unconditioned stimulus (US), and HCS− (or LCS−) without US. CR% in sham-operated mice increased in LCS+ (or HCS+) trials, regardless of tone frequency of CS, but not in HCS− (or LCS−) trials. The results indicate that sham-operated mice can discriminate between LCS+ and HCS− (or HCS+ and LCS−). In contrast, DCN-lesioned mice showed high CR% in not only LCS+ (or HCS+) trials but also HCS− (or LCS−) trials. The results indicate that DCN lesions impair the discrimination between tone frequency in eyeblink conditioning. Our results suggest that the cerebellum plays a pivotal role in the discrimination of tone frequency.