Pavlovian conditioning: pigeon nictitating membrane

A new Pavlovian conditioning preparation was developed using the nictitating membrane of the restrained pigeon. Either visual or auditory stimuli served as conditioned stimuli (CSs) with an unconditioned stimulus (US) of a puff of air to the cornea. Movement of the nictitating membrane constituted the conditioned and unconditioned responses (CR and UR). Conditioning was studied with the Kamin blocking procedure. In agreement with findings from other conditioning preparations, responding to the redundant stimulus was attenuated relative to a stimulus that received the same number of CS-US pairings in a compound-conditioning procedure. Although response attenuation occurred, substantial individual variation was observed within the blocking procedure, a finding with some precedent in the experimental literature. Theoretical analysis and neural-network simulations indicate that inter-subject variation in response attenuation may result from differences in the extent to which contextual stimuli contribute to the functional CS.     

Reinstatement of short-latency responses after asymptotic Pavlovian conditioning training by the presentation of an extraneous stimulus

The purpose of this study was to examine whether the progressive disappearance of short-latency conditioned responses, or inhibition of delay, observed in Pavlovian conditioning with long inter-stimulus intervals, could be reverted by the presentation of a novel stimulus. In one experiment, two groups of rabbits received extensive training with a short (250 ms) or a long (1500 ms) tone that overlapped and terminated with a periorbital shock unconditioned stimulus. After training, the presentation of an extraneous stimulus prior to tone onset produced a reinstatement of short latency CRs in the group trained with the long CS, but did not affect CR latency in the group trained with the short CS. This finding is consistent with Pavlov's (1927) view that conditioning with long conditioned stimuli involves the acquisition of response tendencies in the early portion of the stimulus that are subsequently suppressed by the development of an inhibitory process.     

Expression of freezing and fear‐potentiated startle during sustained fear in mice

Fear‐potentiated acoustic startle paradigms have been used to investigate phasic and sustained components of conditioned fear in rats and humans. This study describes a novel training protocol to assess phasic and sustained fear in freely behaving C57BL/6J mice, using freezing and/or fear‐potentiated startle as measures of fear, thereby, if needed, allowing in vivo application of various techniques, such as optogenetics, electrophysiology and pharmacological intervention, in freely behaving animals. An auditory Pavlovian fear conditioning paradigm, with pseudo‐randomized conditioned–unconditioned stimulus presentations at various durations, is combined with repetitive brief auditory white noise burst presentations during fear memory retrieval 24 h after fear conditioning. Major findings are that (1) a motion sensitive platform built on mechano‐electrical transducers enables measurement of startle responses in freely behaving mice, (2) absence or presence of startle stimuli during retrieval as well as unpredictability of a given threat determine phasic and sustained fear response profiles and (3) both freezing and startle responses indicate phasic and sustained components of behavioral fear, with sustained freezing reflecting unpredictability of conditioned stimulus (CS)/unconditioned stimulus (US) pairings. This paradigm and available genetically modified mouse lines will pave the way for investigation of the molecular and neural mechanisms relating to the transition from phasic to sustained fear.     

Neural-network simulations of two context-dependence phenomena

This paper describes simulations of two context-dependence phenomena in Pavlovian conditioning, using a neural-network model that draws on knowledge from neuroscience and makes no distinction between operant and respondent learning mechanisms. One phenomenon is context specificity or the context-shift effect, the decrease of conditioned responding (CR) when the conditioned stimulus (CS) is tested in a context different from the one in which it had been paired with the unconditioned stimulus (US). The other effect is renewal, the recovery of CR in the training context after extinction in another context. For specificity (simulation 1), two neural networks were first given 200 CS-US pairings in a context. Then, the CS was tested either in the training context or a new context. Output activations in the new context were substantially lower. For renewal (simulation 2), two networks were first given 200 CS-US pairings in a context, then 100 extinction trials in either the same context or a new one, and then tested back in the training context. Output activations during the test phase were substantially higher after extinction in a new context. The results are interpreted in terms of the dynamics of activations and weights.     

Stepping outside the box in considering the C/T ratio

Rate expectancy theory (RET) predicts that in Pavlovian procedures conditioned responding will be directly related to the ratio of time spent in the experimental context (C) relative to the trial time (T) or duration of the conditioned stimulus (CS). This prediction was discussed in the context of three experiments. The first and third experiments involved sexual conditioning in quail [Learn Motiv 31 (2000) 211; J Exp Psychol Anim Behav Processes 27 (2001) 269]; the second experiment involved conditioning rats with food as the unconditioned stimulus (US) [Learn Motiv 28(1997) 465]. In each experiment, one type of conditioned response was directly related to the C/T ratio (as predicted by RET) but another conditioned response was inversely related. In addition, the conditioned behavior that occurred with low C/T ratios was controlled by contextual cues rather than the putative CS. The implications of these findings for possible boundary conditions of RET were discussed. The discussion revealed serious shortcomings in the characterization of context conditioning by RET.     

A pitfall for the expectancy theory of human eyelid conditioning

Two simple eyeblink conditioning experiments with random intermittent reinforcement schedules were performed. In Experiment 1, subjects had to rate their expectancy for an unconditioned stimulus (US) on a seven-level scale prior to each trial. As anticipated, expectancy for US increased with a successive conditioned stimulus (CS) alone, and decreased with successive CS-US pairings. However, Experiments 1 and 2 showed that the frequency of eyeblink conditioned responses (CRs) evolved in a direction opposite to that of expectancy changes: CRs increased, whereas expectancy for US decreased, and vice versa. The possible effect of sensitization on eyeblink response was ruled out by the lack of a run effect in an unpaired control group in Experiment 2. These results tend to disconfirm the expectancy theory of conditioning. Although they were explicitly predicted by the conventional "strength" theory of conditioning, an alternative interpretation is proposed within a cognitive framework.     

Discriminative behavior and Pavlovian conditioning in the mollusc Pleurobranchaea

The buccal motor system in the sea slug Pleurobranchaea californica is multifunctional; similar sets of neurons and muscles generate different behaviors through similar electrophysiological motor patterns. Such multifunctional systems compromise the traditional practice of identifying a motor pattern and then using that pattern to indicate the behavior in reduced preparations. We address this issue in a series of experiments leading to the comparison of differential Pavlovian conditioning in whole animals with the conditioned behavior of the same animals during electrophysiological recording. Because differential conditioning requires two conditioned stimuli (CSs), we show here that each of two CSs activated the conditioned response from animals after they received the stimulus (CS+) paired with an unconditioned stimulus (UCS). Conditioning sessions consisted of 5 training trials with a 2-h intertrial interval. In one study, experimental animals received a 60-s CS+, derived from beer (Sbr), paired with a 50-s electrical shock UCS whose onset occurred 10 s after the CS+ onset; control animals received the Sbr and UCS explicitly unpaired. In a second study, animals received similar procedures as in the first but with a CS+ consisting of squid homogenate (Ssq). Tests with both CSs showed that animals did not discriminate between Sbr and Ssq before beginning conditioning, but did so afterward. Experimental animals exhibited robust food aversion (withdrawal and suppressed feeding) to the CS+, but retained strong appetitive responses to the CS they did not receive in training; response thresholds to the CS+ changed as much as 1000-fold by comparison to the preconditioning values. Control animals exhibited similar though significantly smaller behavioral changes as the experimental animals. Both stimuli evoked associatively learned responses, but Sbr produced greater experimental-control differences than Ssq did. Two accompanying papers show the results of using both CSs in differential conditioning, and describe the behavioral/electrophysiological comparisons.     

Contextual fear conditioning differs for infant, adolescent, and adult rats

Contextual fear conditioning was tested in infant, adolescent, and adult rats in terms of Pavlovian-conditioned suppression. When a discrete auditory-conditioned stimulus (CS) was paired with footshock (unconditioned stimulus, US) within the largely olfactory context, infants and adolescents conditioned to the context with substantial effectiveness, but adult rats did not. When unpaired presentations of the CS and US occurred within the context, contextual fear conditioning was strong for adults, weak for infants, but about as strong for adolescents as when pairings of CS and US occurred in the context. Nonreinforced presentations of either the CS or context markedly reduced contextual fear conditioning in infants, but, in adolescents, CS extinction had no effect on contextual fear conditioning, although context extinction significantly reduced it. Neither CS extinction nor context extinction affected responding to the CS–context compound in infants, suggesting striking discrimination between the compound and its components. Female adolescents showed the same lack of effect of component extinction on response to the compound as infants, but CS extinction reduced responding to the compound in adolescent males, a sex difference seen also in adults. Theoretical implications are discussed for the development of perceptual-cognitive processing and hippocampus role.     

Corticosterone responses, hurdle-jump acquisition, and the effects of dexamethasone using classical conditioning of fear

Male hooded rats were habituated, classically conditioned with 30 CS-UCS (light-footshock) pairings, and subsequently tested for corticosterone response or instrumental hurdle-jump acquisition. In Experiment 1, corticosterone levels were lowest during chamber placement alone (during habituation), higher during presentations of the CS after conditioning with a low shock intensity, even higher during classical conditioning with the low shock intensity, and highest during classical conditioning or CS presentations involving a high shock intensity. Injections of the synthetic glucocorticoid dexamethasone before both conditioning and hurdle-jump acquisition sessions (Experiment 2) did not affect acquisition occurring during early trials, but produced slow hurdle-jump speeds late in the session. This agrees with previous findings of glucocorticoid facilitation of fear extinction, but does not indicate a simple suppression of fear by dexamethasone. When dexamethasone was given only prior to the classical conditioning session (Experiment 3) hurdle-jump acquisition was poor only on the early trials, and corticosterone levels after 60 min of CS presentations were higher than control values. These results agree with the proposal of a state-dependent effect of dexamethasone on memory retrieval.     

Trace Fear Conditioning in Mice

In this experiment we present a technique to measure learning and memory. In the trace fear conditioning protocol presented here there are five pairings between a neutral stimulus and an unconditioned stimulus. There is a 20 sec trace period that separates each conditioning trial. On the following day freezing is measured during presentation of the conditioned stimulus (CS) and trace period. On the third day there is an 8 min test to measure contextual memory. The representative results are from mice that were presented with the aversive unconditioned stimulus (shock) compared to mice that received the tone presentations without the unconditioned stimulus. Trace fear conditioning has been successfully used to detect subtle learning and memory deficits and enhancements in mice that are not found with other fear conditioning methods. This type of fear conditioning is believed to be dependent upon connections between the medial prefrontal cortex and the hippocampus. One current controversy is whether this method is believed to be amygdala-independent. Therefore, other fear conditioning testing is needed to examine amygdala-dependent learning and memory effects, such as through the delay fear conditioning.     

Conditioning of stress in Nile tilapia

A Pavlovian conditioning paradigm was used to induce a connection between a conditioned stimulus, light (CS), associated with an unconditioned stimulus, confinement (US) in Nile tilapia Oreochromis niloticus , which resulted in a conditioned endocrine response (CR) to the CS alone manifested as an increase in plasma cortisol. Individual isolated Nile tilapia were submitted for 10 days to the conditioning treatment consisting of turning on a light (CS) for 1 min with subsequent 30 min confinement (US). On the 10th day of the experiment, plasma cortisol was not increased when fish were subjected to no handling at all, or only light, or even a daily stressor for the 9 days. On the other hand, at the 10th day cortisol was significantly increased only when light was presented either with or without pairing with the stressor. These results confirmed that the cue, light (CS), was not stressful in itself, but when given as the CS in the absence of the US post conditioning the hypothalamus–pituitary–interrenal axis was activated. Therefore, it was concluded that memory of a previous experience with a stressor can be recalled by a conditioned stimulus and induce stress, which is the first demonstration of a memory‐induced stress in fishes.     

Autoshaping in the rat: conditioned licking response to a stimulus that signals sucrose reinforcement

The present experiments were designed to determine if repeated presentations of an empty sipper tube (the conditioned stimulus or CS) with the response-independent delivery of a sucrose solution (the unconditioned stimulus or US) from a second spout results in the development of Pavlovian conditioned responding. In Experiment 1, rats in the experimental condition received paired CS-US presentations whereas subjects in the control condition were exposed to random presentations of CS and US. In Experiment 2, an additional control condition (CS alone) was included and, to encourage generalized responding between the US and CS, the CS tube was filled with water for all groups. The results of both experiments indicate that the CS-directed responding in the paired CS-US condition was Pavlovian in nature. Thus, the present procedure serves as an autoshaping task in which conditioned licking is generated.     

Conditioned modification of viscerosensory evoked potentials during sleep and wakefulness in cats

The effects of classic conditioning on the viscerosensory evoked potentials (EPs) were studied in twenty cats during wakefulness (W), slow-wave-sleep (SWS) and paradoxical sleep (PS). Four types of the experiment were performed on four groups of animals. Weak, non-painful stimulation of the small intestine or of the left splanchnic nerve was used as conditional stimulus (CS) in all experiments. A painful or non-painful shock on the left radial nerve served as unconditional stimulus (US) which followed the CS with a delay of 500 ms. In the first and second series of experiments, the CS was paired with non-painful or painful CS during W. In the third and fourth types of experiment, weak US was used and conditioning was done during SWS or PS. The evoked responses were recorded from the primary (SI) and secondary (SII) somatosensory and associative (AS) cortex, the thalamus (VPL), hypothalamus (HPT) and dorsal hippocampus (HPC). In each experiment, the stimulus pairings resulted in a complex electrographic conditional response (CR) which included an amplitude increase of the late components of EP's (early CR) and the development of a wave of 500 ms latency (delayed CR). In the second experiment, however, a behavioural CR (limb flexion) also appeared. All these CRs proved to be extinguishable. The recall of CR established during W was successful in SWS. The traces of CS-US pairings during SWS could, however, be elicited only in SWS. Both establishment and recall of CR were unsuccessful during PS. The possible mechanism of the effects originating from an interaction of conditioning and sleep on the viscerosensory inputs of the brain are discussed.     

Exposure to cold: aversive Pavlovian conditioning in individual Drosophila melanogaster

Abstract. Temperature changes can be especially threatening for ectotherms, such as Drosophila melanogaster (Diptera: Drosophilidea Meigen, 1830 ), and in this study we tested whether flies can associate olfactory stimuli with a sudden drop in temperature. Such Pavlovian conditioning would allow them to make appropriate behavioural and/or physiological responses in the future. We found that exposing individual flies to one of two odours in the presence of a sudden drop in temperature resulted in Pavlovian conditioning with flies subsequently avoiding the odour paired with cold. The characteristics of Pavlovian conditioning in flies were comparable to those observed for mammalian species. Specifically, the strength of conditioning increased with increasing intensity of the cold and decreased as the time interval between the olfactory stimulus (CS) and cold (US) was lengthened. Finally, the order in which CS and US were presented affected the strength of conditioning. Learning was observed when the CS preceded US and when the US immediately preceded the CS, but not when the CS preceded the US by 30 s or more. These results provide further evidence for learning in individual flies, and confirm that Pavlovian conditioning is a general mechanism used by organisms to obtain information about their environment.     

Klassische Konditionierung agonistischen Verhaltens beim Syrischen Goldhamster (Mesocricetus auratus Waterhouse)

Nine different reactions of unconditioned agonistic behavior of golden hamsters (Mesocricetus auratus Waterhouse) which could be elicited by an air blow (UCS) were classically conditioned at a sound of a xylophone (tone g), a previously neutral stimulus. Tone g (CS) was paired with UCS for a different number of trials/day. In all animals exposed to over 20 pairings/day components of the agonistic behavior were brought under the control of Cs, but it was not possible to predict which one of the agonistic reactions would appear. Most of the animals generalized and also showed conditioned reactions (CR) when presenting tone c' instead of tone g. When utilizing a differential conditioning procedure the animals learned to discriminate between the different tones. Extinction of CR at tone g was reached after an individually different number of trials.     

Stimulus representation in SOP: I. Theoretical rationalization and some implications

THE SOP MODEL [INFORMATION PROCESSING IN ANIMALS: Memory Mechanisms, Erlbaum, Hillsdale, NJ, 1981, p. 5] is described in terms of its assumed stimulus representation, network characteristics, and rules for learning and performance. It is shown how several Pavlovian conditioning phenomena can be accounted on the basis of the model's presumed stimulus representation. Challenges to the SOP model prompted the adoption of a componential stimulus representation in: AESOP [Contemporary Learning Theories: Pavlovian Conditioning and the Status of Traditional Learning Theory, Erlbaum, Hillsdale, NJ, 1989, p. 149], this was a dual representation of the unconditioned stimulus (US), and C-SOP [Contemporary Learning: Theory and Application, Erlbaum, Mahwah, NJ, 2001, p. 23], this was a multi-component representation of the conditioned stimulus (CS). The assumption of a componential CS representation, where large numbers of elements can be separately learned about, necessitated a modification of the learning rule. The modified, "constrained" rule was found useful to explain timing characteristics of Pavlovian conditioned responses, as well as data offered by Rescorla [J. Exp. Psychol. Anim. Behav. Process. 26 (2000) 428; Q. J. Exp. Psychol. 54B (2001) 53; J. Exp. Psychol. Anim. Behav. Process. 28 (2002) 163] showing that stimuli trained in compound do not share the same quantitative fate.     

A novel role for acid‐sensing ion channels in Pavlovian reward conditioning

Pavlovian fear conditioning has been shown to depend on acid‐sensing ion channel‐1A (ASIC1A); however, it is unknown whether conditioning to rewarding stimuli also depends on ASIC1A. Here, we tested the hypothesis that ASIC1A contributes to Pavlovian conditioning to a non‐drug reward. We found effects of ASIC1A disruption depended on the relationship between the conditional stimulus (CS) and the unconditional stimulus (US), which was varied between five experiments. In experiment 1, when the CS preceded the US signaling an upcoming reward, Asic1a^?/? mice exhibited a deficit in conditioning compared to Asic1a^+/+ mice. Alternatively, in experiment 2, when the CS coinitiated with the US and signaled immediate reward availability, the Asic1a^?/? mice exhibited an increase in conditioned responses compared to Asic1a^+/+ mice, which contrasted with the deficits in the first experiment. Furthermore, in experiments 3 and 4, when the CS partially overlapped in time with the US, or the CS was shortened and coinitiated with the US, the Asic1a^?/? mice did not differ from control mice. The contrasting outcomes were likely because of differences in conditioning because in experiment 5 neither the Asic1a^?/? nor Asic1a^+/+ mice acquired conditioned responses when the CS and US were explicitly unpaired. Taken together, these results suggest that the effects of ASIC1A disruption on reward conditioning depend on the temporal relationship between the CS and US. Furthermore, these results suggest that ASIC1A plays a critical, yet nuanced role in Pavlovian conditioning. More research will be needed to deconstruct the roles of ASIC1A in these fundamental forms of learning and memory.     

Temporal difference models and reward-related learning in the human brain

Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.     

Fasting stress exacerbates classical conditioned histamine release in guinea pigs

To clarify the contribution of stress to classical conditioning-associated asthmatic responses, the effect of fasting stress on conditioned histamine release was investigated in a guinea pig model of asthma. The animals were randomly divided into 2 groups for Experiment 1 and 2, and received a conditioning procedure in which ovalbumin (OA) as an unconditioned stimulus (US) and dimethylsulfide (DMS, sulfur smelling) as a conditioned stimulus (CS) were simultaneously inhaled after fasting for 16 h. Then, one group was given food as a reward for respiratory distress, and the other group was denied it for more than 3 h, while being placed in front of the feeding group. After this procedure was repeated 5 times, the plasma histamine levels in response to the CS were measured in half of each group in Experiment 1, and the respiratory resistance (Rrs) was assessed similarly in the other half of each group in Experiment 2. The same experiments were again performed after exchanging assignments of feeding group or fasting group in both experiments. The control groups in both experiments received the CS and the US 10 times separately in a random order under 16 h fasting conditions and were provided food after the exposures. After these pseudo-conditioning presentations, the plasma histamine levels or the Rrs in response to the CS were measured. In Experiment 1, the plasma histamine levels in the fasting stress group after the first conditioning sessions were significantly higher than those of the other groups. This difference was not observed when the groups were exchanged. In Experiment 2, the fasting stress group showed higher values in the Rrs compared to the other groups, irrespective of the first or second conditionings; however, they were not significant. The present study indicates that fasting stress after the conditioning procedures exacerbates the following conditioned histamine release, although the stress effect on bronchoconstriction was not confirmed.     

Pavlovian conditioning-specific increases of the Ca2+- and GTP-binding protein,calexcitin in identified Hermissenda visual cells

Hermissenda CNS, immunolabeled for the memory protein calexcitin showed significant immunostaining over background in the B-photoreceptor cells of the eye. The degree of staining correlated positively with the number of Pavlovian training events experienced by the animals and the degree of Pavlovian conditioning induced. The training regime consisted of exposing animals to light (conditioned stimulus, CS) paired with orbital rotation (unconditioned stimulus, US). In animals that exhibited the conditioned response, calexcitin immunolabeling was more intense than was found for naive (unconditioned) animals or animals given the CS and US in random sequence. Animals exposed to lead (maintained in 1.2 ppm lead acetate) at a dosage known to impair learning in children, showed reduced learning and less intense calexcitin staining whether the CS and US were paired or given randomly. However, the levels were still higher than that of naive animals. Immuno-electron microscopy indicated that the labeling was predominantly within calcium sequestering organelles such as the endoplasmic reticulum, and to lesser extent within mitochondria, and photopigments. The calexcitin density after a short-term memory (STM) regime was the same whether measured 5 minutes after conditioning (when STM was evidenced by foot contraction) or 90 minutes later when no recall was detected. The staining density was also similar to the levels found 5 minutes after long-term memory (LTM) conditioning. However, the LTM regime produced a greater calexcitin intensity at 90 minutes when the memory had been consolidated. This learning-specific increase in calexcitin is consistent with the previously implicated sequence of molecular events that are associated with progressively longer time domains of memory storage.