Activity of neurons in the pedunculopontine nucleus in conditioned instrumental appetitive reflex

Activity of 91 neurons in the compact and diffuse parts of the pedunculopontine tegmental nucleus (PPTg) was recorded in freely moving rabbits during execution of instrumental appetitive conditioning. Of the recorded neurons, 37.4% changed their activity in response to a conditioned stimulus, which is the evidence for the PPTg involvement in instrumental conditioning. Excitatory conditioned neuronal responses to the conditioned stimulus and food reinforcement significantly prevailed over inhibitory reactions. Neuronal responses to the conditioned stimulus were classified in several basic patterns reflecting stimulus effects, structure of the behavioral act, and reinforcement properties. These reactions indicate the involvement of the PPTg in attention, motor learning, and reinforcement. The revealed differences in associative reactive properties of the compact and diffuse parts of the PPTg to the conditioned stimulus and reinforcement point to the functional heterogeneity of this structure and suggest the leading role of the cholinergic part of the PPTg in instrumental appetitive conditioning and reinforcement as well as the essential contribution of the diffuse part into classical appetitive conditioning.     

Increased regularity of activity of cortical neurons in learning due to disinhibitory effect of reinforcement

This paper reviews the author's studies on neurophysiologic mechanisms of conditioned reflex learning. Electroencephalograms, evoked potentials, activity of neocortical and hippocampal neurons and the rabbits' behavior in the course of elaboration of defensive and inhibitory conditioned reflexes to light flashes have been recorded. Electric shock (ECS) applied to the paw served as reinforcement. The study demonstrated three types of reinforcement effect on the activity of cortical neurons: activating, disinhibitory, and inhibitory. EEG activation due to reinforcement is accompanied by a change in phasic cortical neuronal activity from chaotic or irregular, typical of rest or inhibition, to regular tonic discharges (in neocortex and hippocampus) and group discharges in the stress rhythm, 5-7 Hz in the hippocampus. Following a number of conditioning trials, the effect of reinforcement is simulated by the effect of a conditioned stimulus. With EEG activation and increased regularity in impulses, facilitation of motor reactions is observed.     

Unit responses of the secondary somatosensory cortex during defensive conditioning in cats

Unit responses in the secondary somatosensory cortex during the formation and extinction of a defensive conditioned reflex to acoustic stimulation were investigated in chronic experiments on cats. In 21 of 28 neurons tested during defensive conditioning the firing pattern changed in accordance with the character of responses to electric shock reinforcement. Two types of conditioned-reflex unit responses were distinguished: excitatory and inhibitory. Most neurons responding to the conditioned stimulus by activation did so during the first 50 msec, which was 80–100 msec before the conditioned motor response. Considerable variability of the unit responses was observed during conditioning. By the time of stabilization of the conditioned-reflex connections the unit response to the conditioned stimulus was stable in form. The pattern of extinction of the conditioned unit activity was expressed as a decrease in the discharge frequency in responses of excitatory type and disinhibition of activity in the case of inhibitory responses.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev, Translated from Neirofiziologiya, Vol. 9, No. 3, pp. 232–238, May–June, 1977.     

Neuronal responses in area 7 of the cat cortex during defensive conditioning

Responses of neurons in area 7 of the parietal association cortex during and after formation of a defensive conditioned reflex to sound were recorded in waking cats. Changes in spike responses of the neurons as a result of the onset of conditioned reflex limb movements were observed in 68% of neurons. Spike responses of neurons formed as a result of learning appeared only if conditioned-reflex limb movements appeared, and they were not observed if, for some reason or other, movements were absent after presentation of the positive conditioned stimulus or on extinction of the reflex. Responses of 46% neurons to conditioned stimulation preceded the conditioned-reflex motor responses by 50–450 msec. The remaining responding neurons were recruited into the response after the beginning of movement. Characteristic spike responses of neurons to the conditioned stimulus appeared 500–900 msec before the beginning of movement and, in the case of appearance of special, "prolonged" motor responses of limb withdrawal, evoked by subsequent reinforcing stimulation.     

Training-Dependent Associative Learning Induced Neocortical Structural Plasticity: A Trace Eyeblink Conditioning Analysis

Studies utilizing general learning and memory tasks have suggested the importance of neocortical structural plasticity for memory consolidation. However, these learning tasks typically result in learning of multiple different tasks over several days of training, making it difficult to determine the synaptic time course mediating each learning event. The current study used trace-eyeblink conditioning to determine the time course for neocortical spine modification during learning. With eyeblink conditioning, subjects are presented with a neutral, conditioned stimulus (CS) paired with a salient, unconditioned stimulus (US) to elicit an unconditioned response (UR). With multiple CS-US pairings, subjects learn to associate the CS with the US and exhibit a conditioned response (CR) when presented with the CS. Trace conditioning is when there is a stimulus free interval between the CS and the US. Utilizing trace-eyeblink conditioning with whisker stimulation as the CS (whisker-trace-eyeblink: WTEB), previous findings have shown that primary somatosensory (barrel) cortex is required for both acquisition and retention of the trace-association. Additionally, prior findings demonstrated that WTEB acquisition results in an expansion of the cytochrome oxidase whisker representation and synaptic modification in layer IV of barrel cortex. To further explore these findings and determine the time course for neocortical learning-induced spine modification, the present study utilized WTEB conditioning to examine Golgi-Cox stained neurons in layer IV of barrel cortex. Findings from this study demonstrated a training-dependent spine proliferation in layer IV of barrel cortex during trace associative learning. Furthermore, findings from this study showing that filopodia-like spines exhibited a similar pattern to the overall spine density further suggests that reorganization of synaptic contacts set the foundation for learning-induced neocortical modifications through the different neocortical layers.     

Responses of motor cortex neurons of the cat to auditory stimulation and their role in the instrumental food reflex

The responses of motor cortex neurons in the cat to the presentation of a single auditory click and a series of 10 clicks presented with 1,000/sec frequency were studied under conditions of chronic experiments before and after the development of an instrumental food reflex. After reflex development a single presentation of a positive conditioned stimulus (single click) markedly influenced for 7 sec the appearance of instrumental movements. At the same time, the immediate responses of motor cortex neurons to presentation of the conditioned auditory stimulus had no impact on the appearance in the motor cortex of discharges leading to the realization of instrumental movements. Consequently, motor cortex neurons do not require activation from afferent sensory inputs for the generation of such discharges. The immediate neuronal responses to conditioned stimulation did not inhibit the realization of the instrumental reflex. It is proposed that they are associated with the realization of motor function in the unconditioned defensive response evoked by the presentation of an auditory stimulus. The presence or absence of responses to auditory conditioned stimulation was dependent upon the signal meaning of the stimulus, its physical parameters, and the degree of excitability of the animal.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 17, No. 4, pp. 539–550, July–August, 1985.     

Dynamics of cortical unit responses during defensive conditioning to sound

Several phases were distinguished in single-unit responses in areas 3 and 4 during defensive conditioning to acoustic stimulation: an initial response, short inhibition of the spike discharge, early and late after-discharges, and changes arising after the end of acoustic stimulation. The initial spike response appeared or intensified (if present already) in the first period of defensive conditioning parallel with an increase in spontaneous unit activity. After-discharges appeared later. The conditioned-reflex movement usually began 100–400 msec after stimulation began. This latent period of the first movement was the same whether for a real conditioned reflex or an after-discharge. Comparison of the latent periods of conditioned movements with the phases of the unit responses showed that the conditioned responses of the cortical neuron were primarily modified after-discharges of neurons evoked by a conditioned stimulus. Differential unit responses to acoustic stimulation, also based on after-discharges, were formed just as actively as positive. The basic role of reinforcement during conditioning is not to increase the excitability of the neurons, which is important in connection with their acquisition of polysensory properties, but to modify the after-discharges of the neurons.A. A. Bogomolets Institute of Physiology, Academy of Sciences of the Ukrainian SSR, Kiev. Translated from Neirofiziologiya, Vol. 10, No. 4, pp. 339–347, July–August, 1978.     

Hippocampal place cells acquire location-specific responses to the conditioned stimulus during auditory fear conditioning

We recorded neurons from the hippocampus of freely behaving rats during an auditory fear conditioning task. Rats received either paired or unpaired presentations of an auditory conditioned stimulus (CS) and an electric shock unconditioned stimulus (US). Hippocampal neurons (place and theta cells) acquired responses to the auditory CS in the paired but not in the unpaired group. After CS-US pairing, rhythmic firing of theta cells became synchronized to the onset of the CS. Conditioned responses of place cells were gated by their location-specific firing, so that after CS-US pairing, place cells responded to the CS only when the rat was within the cell's place field. These findings may help to elucidate how the hippocampus contributes to context-specific memory formation during associative learning.     

The individual organization of frontal-hippocampal networks during realization of different behavioral tasks

Four cats were subjected to appetitive instrumental conditioning with light as a conditioned stimulus by the method of "active choice" of the reinforcement quality: short-delay conditioned bar-press responses were followed by bread-meat mixture and the delayed responses--by meat. The animals differed in behavior strategy: four animals preferred bar-pressing with long delay (so called "self-control" group); two animal preferred bar-pressing with short-delay (so called "impulsive" group). Then all the animals were learned to short-delay (1 s) instrumental conditioned reflex to light (CS+) reinforced by meat. The multiunit activity in the frontal cortex and the hippocampus (CA3) was recorded through chronically implanted nichrome-wire semimicroelectrodes. The interactions among the neighboring neurons in the frontal cortex and hippocampus (within the local neuronal networks) and between the neurons of the frontal cortex and hippocampus (distributed neuronal networks of frontal-hippocampal and hippocampal-frontal directions) were evaluated by means of statistical crosscorrelation analysis of the spike trains. Crosscorrelation interneuronal connections in the delay range 0-100 ms were explored. It was shown that the functional organization of the frontal and hippocampal neuronal networks differed in choice behavior and was similar during realization of short-delayed conditioned reflex. We suggest that the local and distributed neural networks of the frontal cortex and hippocampus take part in the realization of cognitive behavior, in particularly in the processes of the decision making.     

Conditioned reflex and electrical activities of the hippocampus during the random use of heterogeneous triggering stimuli

In dogs with electrodes chronically implanted in the hippocampus, the conditioned activity, heart rate frequency and spectral characteristics of the hippocampal theta-rhythm were studied in conditions of irregular presentation after a preparatory stimulus now of alimentary and now of defensive triggering conditioned stimuli. It is shown that uncertainty of alimentary or defensive reinforcement is a stronger emotiogenic factor than the action of the triggering defensive conditioned stimulus. Changes in electrical hippocampal activity and autonomous activity depend, along with other factors, on forecasted volume of the forthcoming motor activity. The speed of instrumental conditioned reflexes formation correlates with the hippocampal theta-rhythm frequency, typical for the given animal.     

Instrumental heterogeneous responses to 2 successive complex stimuli with a common initial stimulus in the dog

Formation and achievement of heterogenous instrumental reflexes to two consecutive complex stimuli was studied in dogs. Under the action of conditioned complex stimulus tone--Pause--tone, the dogs may be trained not to have a motor response to the first tone presentation, but perform alimentary instrumental reaction only to its repeated administration. Introducing into the experiment not only alimentary but also defensive complex stimulus stone-pause--light resulted in a change in animal's reactions in such a sequence: at first alimentary instrumental reaction was disinhibited under the action of the preparatory stimulus and during the pause, then bieffector responses appeared, further on in most of the dogs motor defensive reactions mainly took place. Trigger stimuli evoked the adequate instrumental reaction.     

Classical conditioning and retention in normal and mutantDrosophila melanogaster

Summary By changing the conditioned discrimination paradigm of Quinn et al. (1974) from an instrumental procedure to a classical (Pavlovian) one, we have demonstrated strong learning in type flies. About 150 flies were sequestered in a closed chamber and trained by explosing them sequentially to two odors in air currents. Flies received twelve electric shock pulses in the presence of the first odor (CS+) but not in the presence of the second odor (CS–). To test for conditioned avoidance responses, flies were transported to a Tmaze choice point, between converging currents of the two odors. Typically, 95% of trained flies avoided the shock-associated odor (CS+).Acquisition of learning was a function of the number of shock pulses received during CS+ presentation and was asymptotic within one training cycle. Conditioned avoidance increased with increasing shock intensity or odor concentration and was very resistant to extinction. Learning was best when CS+ presentations overlap shock (delay conditioning) and then decreased with increasing CS-US interstimulus intervals. Shocking flies immediately before CS+ presentation (backward conditioning) produced no learning. Nonassociative control procedures (CS Alone, US Alone and Explicitly Unpaired) produced slight decreases in avoidance responses, but these affected both odors equally and did not alter our associative learning index (A).Memory in wild-type flies decayed gradually over the first seven hours after training and still was present 24 h later. The mutantsamnesiac, rutabaga anddunce showed appreciable learning acquisition, but their memories decayed very rapidly during the first 30 min. After this, the rates of decay slowed sharply; conditioned avoidance still was measurable at least three hours after training.Abbreviations OCT 3-octanol - MCH 4-methylcyclohexanol - C-S Canton-Special - CS conditioned stimulus - US unconditioned stimulus     

Tonic component of the conditioned reflex process and its functional role

Tonic background activity of 266 neurones in the hippocampus and different neocortical areas was studied in freely moving rabbits in the process of defensive and food instrumental conditioned performance and during switching-over of instrumental and classical food and defensive reflexes. Associations of CS and reinforcement evoke background activity changes in most of recorded cortical neurones preceding the development of other conditioned manifestations. Conditioned reflex was performed only after reaching the background firing rate of almost every examined neurone optimal for its realization. The performance of different conditioned reflexes was associated with different background activity levels of cortical neurones. The above mentioned data form the experimental basis for the identification of the tonic component in conditioned process which reflects tonic character of temporary connection formation and function.     

Activity of neurons of the motor zone of the cortex during elaboration of a local instrumental defensive reflex in the rabbit

During instrumental defensive reaction of wrist extension in response to a sound (conditioned) stimulus, two types of neuronal responses in the rabbit motor cortex were discovered. The first type was recorded in cells with activity not connected with electromyographic activity of wrist extensors. The reaction consisted in the appearance of inhibitory response at the place of the cancelled electrocutaneous stimulation at animal's performance of conditioned reaction to sound. The second type of responses was shown for a neurone with the activity significantly related to electromyographic activity. In this case the conditioned motor response was accompanied by enhancement of the cellular activation reaction to sound and the increase of spike activity in interstimuli intervals.     

Effects of an extinguished CS on competition with another CS

Three experiments were conducted using a conditioned taste aversion procedure with rats to examine the effect of nonreinforced presentations of a conditioned stimulus (CS) on its ability to compete with a target stimulus for manifest conditioned responding. Two CSs (A and B) were presented in a serial compound and then paired with the unconditioned stimulus. CS A was first paired with the US and then presented without the US (i.e., extinction) prior to reinforced presentation of the AB compound. Experiment 1 showed that A was poor at competing with B for conditioned responding when given conditioning and extinction prior to reinforcement of AB relative to a group that received both A and B for the first time during compound conditioning. That is, an extinguished A stimulus allowed greater manifest acquisition to B. Experiment 2 found that extinction treatment produced a poor CR to the pretrained and extinguished CS itself following compound conditioning. Experiment 3 found that interposing a retention interval after extinction of A and prior to compound conditioning enhanced A's ability to compete with B. The results of these experiments are discussed with regard to different theories of extinction and associative competition.     

Discriminative behavior and Pavlovian conditioning in the mollusc Pleurobranchaea

The buccal motor system in the sea slug Pleurobranchaea californica is multifunctional; similar sets of neurons and muscles generate different behaviors through similar electrophysiological motor patterns. Such multifunctional systems compromise the traditional practice of identifying a motor pattern and then using that pattern to indicate the behavior in reduced preparations. We address this issue in a series of experiments leading to the comparison of differential Pavlovian conditioning in whole animals with the conditioned behavior of the same animals during electrophysiological recording. Because differential conditioning requires two conditioned stimuli (CSs), we show here that each of two CSs activated the conditioned response from animals after they received the stimulus (CS+) paired with an unconditioned stimulus (UCS). Conditioning sessions consisted of 5 training trials with a 2-h intertrial interval. In one study, experimental animals received a 60-s CS+, derived from beer (Sbr), paired with a 50-s electrical shock UCS whose onset occurred 10 s after the CS+ onset; control animals received the Sbr and UCS explicitly unpaired. In a second study, animals received similar procedures as in the first but with a CS+ consisting of squid homogenate (Ssq). Tests with both CSs showed that animals did not discriminate between Sbr and Ssq before beginning conditioning, but did so afterward. Experimental animals exhibited robust food aversion (withdrawal and suppressed feeding) to the CS+, but retained strong appetitive responses to the CS they did not receive in training; response thresholds to the CS+ changed as much as 1000-fold by comparison to the preconditioning values. Control animals exhibited similar though significantly smaller behavioral changes as the experimental animals. Both stimuli evoked associatively learned responses, but Sbr produced greater experimental-control differences than Ssq did. Two accompanying papers show the results of using both CSs in differential conditioning, and describe the behavioral/electrophysiological comparisons.     

Duration of changes in electrical characteristics of command neurons after defensive conditioning in snails

Electrical characteristics of snail command neurons were studied during and after defensive conditioning. Tapping on the shell was used as a conditioned stimulus. A light air blow into the lung cavity orifice (pneumostome) was used as an unconditioned stimulus. The conditioned defensive reflex is known to be retained for 40 days. We have shown earlier the decrease in membrane and threshold potentials of command neurons after defensive conditioning (Gainutdinov et al., 1996). In these experiments it has been found that the decreased level of membrane and threshold potentials are maintained during 40 days after defensive reflex conditioning.     

Postnatal development of heart rate patterns elicited by an aversive CS and US in cats

Heart rate and motor responses were recorded in cats of different ages during classical conditioning. A deceleratory-acceleratory heart rate pattern observed during the CS-US interval in one- and four-week-old kittens is an alpha conditioned response, a potentiated original response to the CS. At eight weeks of age two new distinct patterns of pure acceleration or pure deceleration are acquired during conditioning and in the absence of motor learning. At 12 weeks of age and in adult subjects, heart rate patterns during the CS-US interval become more complex and conditioned motor responses can be observed. A covariance of HR acceleration and motor responses during the CS-US interval is absent in eight-week-old subjects, but quite high in 12-week-old subjects and adult cats. The data are interpreted as suggesting separate elicitatory mechanisms of HR and motor responses which may show synchrony later in ontogeny.     

Properties of olfactory conditioning in the housefly, Musca domestica

The housefly, Musca domestica, was conditioned to odours using the proboscis extension response to labellar stimulation with sucrose solution as an unconditioned response and the properties of conditioning were investigated. Among trials including forward pairing of the conditioned stimulus (CS) with the unconditioned stimulus (US), backward pairing and isolated presentations of CS and US, only forward pairing is effective on the acquisition of conditioning. Backward pairing combined with forward pairing does not influence the effectiveness of the forward pairing. CS given overlapping with a US presentation permits only weak conditioning. The acquisition of conditioning decreases with increase of the CS-US interval. In the differential conditioning situation to two odours, discriminative responses are observed. In the flies conditioned with one antenna, the conditioned response is elicited not only by stimulation of the antenna used for conditioning but also by stimulation of the antenna not used for conditioning, although the response using the former is higher than with the latter. The ability to be conditioned is reduced immediately after fastening on a clay bed and increases with time. Ability can also be improved by transection of the ventral nerve cord.     

Conditioning odor-shock associations in the black blowfly,Phormia regina

Discriminative classical conditioning of an olfactory avoidance response was demonstrated in the blowfly, Phormia regina.Learning indices were calculated as the fraction of flies avoiding the CS+ (conditioned stimulus paired with electric shock reinforcement) minus the fraction of flies avoiding the CS-(conditioned stimulus not paired with electric shock), averaged over two different groups of flies, in which reciprocal odors were used as the CS+. Avoidance responses to both odors presented simultaneously at a T-maze choice point yielded mean learning indices of zero for naive flies or pseudoconditioned (shock alone) or sensitized (odors alone) controls. In contrast, pairing an odor with electric shock produced a mean learning index significantly greater than zero. These results are similar to those reported for Drosophila melanogaster.Blow flies, however, showed much lower levels of associative learning than fruit flies.