Inhibition of a conditioned reflex evoked emotional response as an "instrument" of avoidance

A method has been elaborated of training the human subjects to avoid electric shocks by overcoming the "fear" caused by a warning signal. A previously elaborated differentiated conditioned skin-galvanic response (SGR) to a sound stimulus served as a criterion of the emotional reaction. The SGR was projected on an oscilloscope screen. The electric shock was automatically delivered at the moment when the amplitude of the conditioned SGR exceeded the level marked on the screen. The subject was instructed, by overcoming the "fear", to retain the SGR amplitude below the level. If the subject succeeded in overcoming the conditioned SGR to the signal, the shock was not delivered. Since, the suppression of the conditioned SGR served as a "instrument" of avoidance and became consolidated as a habit based on a positive reinforcement. The subjects developed a stable attraction to repetition of training sessions in which they learned to suppress the "anxiety" caused by a signal of "threat".     

Conditioning of active type avoidance in the rat : effect of the interval between conditioned stimulus and unconditioned stimulus

Lengthening the time interval between the conditioned stimulus and the unconditioned stimulus increases the number of active avoidance conditioned responses in subjects that have been trained to a stable level of performance in many previous conditioning sessions. In the present research, rats chosen from a population specially selected for low rates of avoidance conditioning have been used. In addition to this characteristic, subjects were chosen for the exhibition of an apparent absence of retention from one day to another. The dependency of the number of conditioned responses on the time interval between conditioned stimulus and unconditioned stimulus may lead to wrong evaluation of the subjects' conditioning level. In fact, the level of conditioning may be attributed to either learning or memory processes when in many cases it is determined only by the latency time of the conditioned response. The conditioned response has no possibility of manifesting itself when its latency time exceeds in length the time interval between conditioned stimulus and unconditioned stimulus.     

Varying temporal placement during CS of an added stimulus correlated with non-delivery of UCS.

This experiment extends Pavlov's method of contrasts for training a stimulus discrimination to the case of the cardiac conditional response in the rhesus monkey. It explores the parameter of temporal placement of an additional stimulus ("CS2") within a 10-sec CS (or "CS1"), with the appearance of the former stimulus on any trial signalling the absence of UCS (electric shock) on that trial. This experimental paradigm is a parallel to that of the "intruded stimulus" studies in operant conditioning. In both cases, several ways of describing the function of the added stimulus are possible, but all seem reducible to the same operational terms. Data were taken in the present study with respect to the form and latency of the cardiac rate changes produced by intrusion of CS2 (light), across a range of placements varying from simultaneity with CS1 (a different light) onset to two sec before UCS would have been delivered. The control of CS2 over the cardiac rate CR was occasionally exhibited with a latency as short as three beats after stimulus onset. The order of CS2 temporal placements to which a subject was exposed was a factor in determining the form of the conditioned cardiac rate response to CS1.     

Reversing Stimulus Timing in Visual Conditioning Leads to Memories with Opposite Valence in Drosophila

Animals need to associate different environmental stimuli with each other regardless of whether they temporally overlap or not. Drosophila melanogaster displays olfactory trace conditioning, where an odor is followed by electric shock reinforcement after a temporal gap, leading to conditioned odor avoidance. Reversing the stimulus timing in olfactory conditioning results in the reversal of memory valence such that an odor that follows shock is later on approached (i.e. relief conditioning). Here, we explored the effects of stimulus timing on memory in another sensory modality, using a visual conditioning paradigm. We found that flies form visual memories of opposite valence depending on stimulus timing and can associate a visual stimulus with reinforcement despite being presented with a temporal gap. These results suggest that associative memories with non-overlapping stimuli and the effect of stimulus timing on memory valence are shared across sensory modalities.     

Classical conditioning to visual stimuli in the housefly, Musca domestica

In the housefly, Musca domestica, classical conditioning to monochromatic light was demonstrated by using a proboscis extension response to labellar stimulation with sucrose solution as an unconditioned response. Sequential and temporal relationships between the conditioned stimulus (CS) and unconditioned stimulus (UCS) to form conditioning were studied; conditioning occurred most readily when the CS was presented before the UCS without an interstimulus interval. Spectral response curves, which were obtained by examining the responsiveness of flies conditioned for one colour to other colours, were divided into two groups; one was that of 462 nm-conditioned flies and the other those of 516 nm-, 579 nm-, and 642 nm-conditioned flies.     

Hippocampal State-Dependent Behavioral Reflex to an Identical Sensory Input in Rats

We examined the local field potential of the hippocampus to monitor brain states during a conditional discrimination task, in order to elucidate the relationship between ongoing brain states and a conditioned motor reflex. Five 10-week-old Wistar/ST male rats underwent a serial feature positive conditional discrimination task in eyeblink conditioning using a preceding light stimulus as a conditional cue for reinforced trials. In this task, a 2-s light stimulus signaled that the following 350-ms tone (conditioned stimulus) was reinforced with a co-terminating 100-ms periorbital electrical shock. The interval between the end of conditional cue and the onset of the conditioned stimulus was 4±1 s. The conditioned stimulus was not reinforced when the light was not presented. Animals successfully utilized the light stimulus as a conditional cue to drive differential responses to the identical conditioned stimulus. We found that presentation of the conditional cue elicited hippocampal theta oscillations, which persisted during the interval of conditional cue and the conditioned stimulus. Moreover, expression of the conditioned response to the tone (conditioned stimulus) was correlated with the appearance of theta oscillations immediately before the conditioned stimulus. These data support hippocampal involvement in the network underlying a conditional discrimination task in eyeblink conditioning. They also suggest that the preceding hippocampal activity can determine information processing of the tone stimulus in the cerebellum and its associated circuits.     

Changes in autonomic control of heart associated with classical appetitive conditioning in rats.

The aim of this study was to examine the changes in autonomic control of the heart associated with classical appetitive conditioning in rats. We trained rats to learn that a movement into a test chamber was followed by delivery of reward (contextual conditioning) and performed power spectral analysis of heart rate variability from electrocardiograms recorded using the telemetry system. We investigated the sympathovagal balance of autonomic regulation of the heart in response to not only the conditioned stimulus (the movement into the test chamber), but also the unconditioned stimulus (reward), and compared the results of these two kinds of emotional states; it might be considered that "the reward-expecting state" is evoked by the conditioned stimulus and "the reward-receiving state" is evoked by the unconditioned stimulus in rats. The reward-expecting state resulted in a significant increase in both low frequency (LF) power and high frequency (HF) power with no change in heart rate (HR) and LF/HF ratio, indicating that both sympathetic and parasympathetic activity increased with no change in sympathovagal balance. The reward-receiving state resulted in a significant increase in HR and a significant decrease in LF power, HF power, and LF/HF ratio, indicating that both sympathetic and parasympathetic activity decreased with predominance in the parasympathetic activity. These results suggest that the method performed in our present study might be useful for distinguishing between two different emotional states evoked by classical appetitive conditioning in rats.     

Does conditioned taste aversion learning in the pond snail Lymnaea stagnalis produce conditioned fear?

In conditioned taste aversion (CTA) training performed on the pond snail Lymnaea stagnalis, a stimulus (the conditional stimulus, CS; e.g., sucrose) that elicits a feeding response is paired with an aversive stimulus (the unconditional stimulus, US) that elicits the whole-body withdrawal response and inhibits feeding. After CTA training and memory formation, the CS no longer elicits feeding. We hypothesize that one reason for this result is that after CTA training the CS now elicits a fear response. Consistent with this hypothesis, we predict the CS will cause (1) the heart to skip a beat and (2) a significant change in the heart rate. Such changes are seen in mammalian preparations exposed to fearful stimuli. We found that in snails exhibiting long-term memory for one-trial CTA (i.e., good learners) the CS significantly increased the probability of a skipped heartbeat, but did not significantly change the heart rate. The probability of a skipped heartbeat was unaltered in control snails given backward conditioning (US followed by CS) or in snails that did not acquire associative learning (i.e., poor learners) after the one-trial CTA training. These results suggest that as a consequence of acquiring CTA, the CS evokes conditioned fear in the conditioned snails, as evidenced by a change in the nervous system control of cardiac activity.     

The effect of opiate receptor ligands on emotional cardiovascular reactions in lower primates

Intravenous naloxone injection (0.1 mg/kg) facilitated blood pressure increase in response to conditioned sound stimulus followed by electrocutaneous shock in conscious chair-restrained baboons (Papio hamadryas). Naloxone at a dose of 1.0 mg/kg had an opposite effect and led to the decrease in blood pressure and heart rate in conditioned fear reflex. Naloxone microinjections (50 microM) into the periventricular hypothalamus led to a significant diminution of blood pressure and heart rate increment in response to electrocutaneous shock; naloxone microinjections into tractus solitarius nuclei suppressed blood pressure and heart rate reactions both to conditioned (sound) and unconditioned (electrocutaneous shock) stimuli. Microinjections of equimolar morphine quantities in these brain regions facilitated such reactions. It is concluded that endogenous opioid system participates in the formation of cardiovascular reactions to emotional stimuli in monkeys, with multiple opioid receptors of periventricular hypothalamus and tractus solitarius nuclei involved in the generation of such reactions.     

Conditioned suppression of contact sensitivity is independent of sympathetic splenic innervation

The present study investigated the role of sympathetic innervation of the spleen in conditioned suppression of a contact hypersensitivity (CHS) reaction. Behavioral conditioning was achieved by pairing saccharin drinking solution (conditioned stimulus, CS) with injection of cyclosporin A (CsA, 20 mg/kg; unconditioned stimulus, UCS). Four days after sensitization of the animals by application of a 5% 2,4-dinitrochlorobenzene (DNCB) to abdominal skin, the animals were challenged by applying a 1% DNCB solution to the ear. The CHS response was monitored by measuring the degree of ear swelling. Saccharin re-presentation reduced ear swelling to a magnitude that approached that achieved by CsA treatment. Histological examination demonstrated that the conditioned reduction of ear swelling was produced by a reduced leukocyte infiltration of the ear. Prior sympathetic denervation of the spleen did not alter the conditioned suppression of the CHS response. These data indicate that behavioral conditioning using CsA produces alterations of CHS that, unlike conditioned prolongation of heart allograft survival, are independent of sympathetically regulated conditioned alterations in the spleen.     

Conditioning and time representation in long short-term memory networks

Dopaminergic models based on the temporal-difference learning algorithm usually do not differentiate trace from delay conditioning. Instead, they use a fixed temporal representation of elapsed time since conditioned stimulus onset. Recently, a new model was proposed in which timing is learned within a long short-term memory (LSTM) artificial neural network representing the cerebral cortex (Rivest et al. in J Comput Neurosci 28(1):107–130, 2010). In this paper, that model’s ability to reproduce and explain relevant data, as well as its ability to make interesting new predictions, are evaluated. The model reveals a strikingly different temporal representation between trace and delay conditioning since trace conditioning requires working memory to remember the past conditioned stimulus while delay conditioning does not. On the other hand, the model predicts no important difference in DA responses between those two conditions when trained on one conditioning paradigm and tested on the other. The model predicts that in trace conditioning, animal timing starts with the conditioned stimulus offset as opposed to its onset. In classical conditioning, it predicts that if the conditioned stimulus does not disappear after the reward, the animal may expect a second reward. Finally, the last simulation reveals that the buildup of activity of some units in the networks can adapt to new delays by adjusting their rate of integration. Most importantly, the paper shows that it is possible, with the proposed architecture, to acquire discharge patterns similar to those observed in dopaminergic neurons and in the cerebral cortex on those tasks simply by minimizing a predictive cost function.     

Reinstatement of short-latency responses after asymptotic Pavlovian conditioning training by the presentation of an extraneous stimulus

The purpose of this study was to examine whether the progressive disappearance of short-latency conditioned responses, or inhibition of delay, observed in Pavlovian conditioning with long inter-stimulus intervals, could be reverted by the presentation of a novel stimulus. In one experiment, two groups of rabbits received extensive training with a short (250 ms) or a long (1500 ms) tone that overlapped and terminated with a periorbital shock unconditioned stimulus. After training, the presentation of an extraneous stimulus prior to tone onset produced a reinstatement of short latency CRs in the group trained with the long CS, but did not affect CR latency in the group trained with the short CS. This finding is consistent with Pavlov's (1927) view that conditioning with long conditioned stimuli involves the acquisition of response tendencies in the early portion of the stimulus that are subsequently suppressed by the development of an inhibitory process.     

Pituitary-adrenal influences on avoidance behavior of pigs

Pigs submitted to extinction of a signaled conditioned avoidance response were injected daily with various doses of dexamethasone (DX) or ACTH. Pigs treated with 0.2 mg/kg of DX showed a higher number of intertrial crosses, but the extinction rate was not modified by either treatment. The effects of ACTH and DX were further studied on the reaction to a Pavlovian conditioned fear signal presented to pigs having learned a continuous avoidance response in a shuttle-box. DX treatment before both the fear conditioning and the test sessions enhanced the reaction to the fear signal at intermediate doses (0.2 mg/kg) but had little effect at lower (0.1 mg/kg) and higher doses (0.5 and 1 mg/kg). ACTH 1–24 treatment induced the same behavioral changes as intermediate doses of DX. A behaviorally active ACTH 4–9 analog, Org 2766, did not modify behavioral reaction to fear signal presentations when administered before fear conditioning and/or test sessions. These results demonstrate that, in pigs, avoidance performance changes under fear signal presentations are modulated by corticosteroids.     

Learning-induced plasticity in the barrel cortex is disrupted by inhibition of layer 4 somatostatin-containing interneurons

Gaba-ergic neurons are a diverse cell class with extensive influence over cortical processing, but their role in experience-dependent plasticity is not completely understood. Here we addressed the role of cortical somatostatin- (SOM-INs) and vasoactive intestinal polypeptide- (VIP-INs) containing interneurons in a Pavlovian conditioning where stimulation of the vibrissae is used as a conditioned stimulus and tail shock as unconditioned one. This procedure induces a plastic change observed as an enlargement of the cortical functional representation of vibrissae activated during conditioning. Using layer-targeted, cell-selective DREADD transductions, we examined the involvement of SOM-INs and VIP-INs activity in learning-related plastic changes. Under optical recordings, we injected DREADD-expressing vectors into layer IV (L4) barrels or layer II/III (L2/3) areas corresponding to the activated vibrissae. The activity of the interneurons was modulated during all conditioning sessions, and functional 2-deoxyglucose (2DG) maps were obtained 24 h after the last session.In mice with L4 but not L2/3 SOM-INs suppressed during conditioning, the plastic change of whisker representation was absent. The behavioral effect of conditioning was disturbed. Both L4 SOM-INs excitation and L2/3 VIP-INs inhibition during conditioning did not affect the plasticity or the conditioned response.We found the activity of L4 SOM-INs is indispensable in the formation of learning-induced plastic change. We propose that L4 SOM-INs may provide disinhibition by blocking L4 parvalbumin interneurons, allowing a flow of information into upper cortical layers during learning.     

Discriminative behavior and Pavlovian conditioning in the mollusc Pleurobranchaea

The buccal motor system in the sea slug Pleurobranchaea californica is multifunctional; similar sets of neurons and muscles generate different behaviors through similar electrophysiological motor patterns. Such multifunctional systems compromise the traditional practice of identifying a motor pattern and then using that pattern to indicate the behavior in reduced preparations. We address this issue in a series of experiments leading to the comparison of differential Pavlovian conditioning in whole animals with the conditioned behavior of the same animals during electrophysiological recording. Because differential conditioning requires two conditioned stimuli (CSs), we show here that each of two CSs activated the conditioned response from animals after they received the stimulus (CS+) paired with an unconditioned stimulus (UCS). Conditioning sessions consisted of 5 training trials with a 2-h intertrial interval. In one study, experimental animals received a 60-s CS+, derived from beer (Sbr), paired with a 50-s electrical shock UCS whose onset occurred 10 s after the CS+ onset; control animals received the Sbr and UCS explicitly unpaired. In a second study, animals received similar procedures as in the first but with a CS+ consisting of squid homogenate (Ssq). Tests with both CSs showed that animals did not discriminate between Sbr and Ssq before beginning conditioning, but did so afterward. Experimental animals exhibited robust food aversion (withdrawal and suppressed feeding) to the CS+, but retained strong appetitive responses to the CS they did not receive in training; response thresholds to the CS+ changed as much as 1000-fold by comparison to the preconditioning values. Control animals exhibited similar though significantly smaller behavioral changes as the experimental animals. Both stimuli evoked associatively learned responses, but Sbr produced greater experimental-control differences than Ssq did. Two accompanying papers show the results of using both CSs in differential conditioning, and describe the behavioral/electrophysiological comparisons.     

Incubation of conditional suppression is an associatively-based phenomenon

Ten rats were deprived of water and trained to lick a tube for saccharin reinforcement. In each of the two sessions that followed, the rats received six contiguous pairings of a 30-second illumination of the houselight and a 0.75 second, 0.10 mA electric shock while licking. No sign of conditioning was observed during the first experimental session, but profound conditioning was observed on the first and subsequent trials of the second conditioning session. No comparable change in the rate of licking was observed in groups of rats that received only presentations of the visual stimulus, only presentations of the electric shock, or random presentation of the visual stimulus and electric shock during the first conditioning session. These data establish that the incubation of conditional suppression is an associative phenomenon.     

Unit responses of the secondary somatosensory cortex during defensive conditioning in cats

Unit responses in the secondary somatosensory cortex during the formation and extinction of a defensive conditioned reflex to acoustic stimulation were investigated in chronic experiments on cats. In 21 of 28 neurons tested during defensive conditioning the firing pattern changed in accordance with the character of responses to electric shock reinforcement. Two types of conditioned-reflex unit responses were distinguished: excitatory and inhibitory. Most neurons responding to the conditioned stimulus by activation did so during the first 50 msec, which was 80–100 msec before the conditioned motor response. Considerable variability of the unit responses was observed during conditioning. By the time of stabilization of the conditioned-reflex connections the unit response to the conditioned stimulus was stable in form. The pattern of extinction of the conditioned unit activity was expressed as a decrease in the discharge frequency in responses of excitatory type and disinhibition of activity in the case of inhibitory responses.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev, Translated from Neirofiziologiya, Vol. 9, No. 3, pp. 232–238, May–June, 1977.     

Conditioning odor-shock associations in the black blowfly,Phormia regina

Discriminative classical conditioning of an olfactory avoidance response was demonstrated in the blowfly, Phormia regina.Learning indices were calculated as the fraction of flies avoiding the CS+ (conditioned stimulus paired with electric shock reinforcement) minus the fraction of flies avoiding the CS-(conditioned stimulus not paired with electric shock), averaged over two different groups of flies, in which reciprocal odors were used as the CS+. Avoidance responses to both odors presented simultaneously at a T-maze choice point yielded mean learning indices of zero for naive flies or pseudoconditioned (shock alone) or sensitized (odors alone) controls. In contrast, pairing an odor with electric shock produced a mean learning index significantly greater than zero. These results are similar to those reported for Drosophila melanogaster.Blow flies, however, showed much lower levels of associative learning than fruit flies.     

Participation of frontal lobe neurons in the organization of successive inhibition and disinhibition of conditioned reflexes in the dog

Neuronal activity in g. proreus was studied during classical secretory conditioning and its differentiation in dogs. Three types of changes in neuronal reaction pattern were identified during differential conditioned stimulus compared to the pattern observed during positive conditioned stimulus. It has been shown that signal significance of the conditioned stimulus may be coded by specific distribution of interspike intervals in response to different conditioned stimuli. In situation of successive inhibition or disinhibition of the differentiation some neurones displayed simultaneous appearance of interspike intervals specific for responses to current and previously presented conditioned stimuli.     

Temporal difference models and reward-related learning in the human brain

Temporal difference learning has been proposed as a model for Pavlovian conditioning, in which an animal learns to predict delivery of reward following presentation of a conditioned stimulus (CS). A key component of this model is a prediction error signal, which, before learning, responds at the time of presentation of reward but, after learning, shifts its response to the time of onset of the CS. In order to test for regions manifesting this signal profile, subjects were scanned using event-related fMRI while undergoing appetitive conditioning with a pleasant taste reward. Regression analyses revealed that responses in ventral striatum and orbitofrontal cortex were significantly correlated with this error signal, suggesting that, during appetitive conditioning, computations described by temporal difference learning are expressed in the human brain.