Vector representation of associative learning

I. P. Pavlov [12] has shown that conditioned reflexes are selective both with respect to conditioned stimuli and to conditioned reflexes elicited by those conditioned stimuli. At the neuronal level selective aspects of conditioned stimuli are based on detectors selectively tuned to respective stimuli. The selective aspects of conditioned reflexes are due to command neurons representing specific unconditioned reflexes. It can be assumed that conditioned reflexes result from association between selective detectors and specific command neurons. The detectors activated by a conditioned stimulus constitute a combination of excitations--a detector excitation vector. The detector excitation vector acts on a command neuron via a set of plastic synapses--a synaptic weight vector. Plastic synapses are modified in the process of learning making command neuron selectively tuned to a specific conditioned stimulus. The selective tuning of a particular command neuron to a specific excitation vector referred to a conditioned stimulus is a basis of associative learning. The probabilities of conditioned reflexes elicited by conditioned and differential stimuli implicitly contain information concerning excitation vectors that encode respective stimuli. Contribution of the vector code to associative learning was explored combining differential color conditioning with intracellular recording from color-coding neurons. It was shown that colors in carps and monkeys are represented on a hypersphere in the four-dimensional space similar to human color space. The basis of the color space is constituted by red-green, blue-yellow, brightness and darkness neurons.     

Effect of streptomycin sulfate on the process of higher nervous activity recovery in dogs in the postanesthesia period]

The effect of streptomycin on recovery of the higher nervous activity during the postanesthesia period was studied on 3 dogs with the method of the conditioned reflexes. It was found that streptomycin sulphate administered in a dose of 25 mg per 1 kg body weight induced no changes in the conditioned reflexes of the non-anesthetized animals. After ether anesthesia disorders in the conditioned and unconditioned reflexes, as well as differentiation was observed during the postanesthesia period. On an average they normalized in 7, 6 and 2 days respectively from the moment of anesthesia. When streptomycin sulphate was used during the post anesthesia period, both the strength and the character of the disorders in the conditioned reflexes changed. In this case recovery of the conditioned and unconditioned reflexes was registered in 2 days, while that of the differential inhibition was registered in 3--7 days from the moment of anesthesia.     

Features of the formation of conditioned secretory reflexes in response to the stimulation of different areas of the caudate nucleus of the dog

Properties were studied of elaboration of conditioned alimentary secretory reflexes to threshold electric stimulation of the caudate nucleus in dogs. The rate of formation of such a reflex and its magnitude were considerably lower than in reflexes elaborated to distant stimuli. Latencies were longer; dynamics of conditioned and unconditioned secretory reactions was similar to that of reflexes to a weak stimulus--light. The motor component of the conditioned alimentary reaction, as a rule, was absent. Characteristics were revealed of formation of alimentary reflexes to stimulation of the dorsal and ventral parts of the head and body of the caudate nucleus.     

Relation between the level of conditioned reflex activity and concentration of serotonin in the blood of normal and neurotic dogs

Higher nervous activity of dogs was studied using Pavlovian method of alimentary salivary conditioned reflexes. Serotonin (5- hydroxytryptamine) content in the venous blood was defined by means of fluorescent spectrofluorimeter using orthophthalic dialdehyde. A high level of conditioned and unconditioned reflexes was accompanied by a low serotonin blood content, while a low level of reflexes was accompanied by a high serotonin content. Negative correlation is supposed to exist between the degree of activation of nervous processes and blood serotonin content. Blood serotonin content increased in dogs in experimental neurosis with expressed reduction of the level on alimentary conditioned and unconditioned reflexes.     

Effect of activating the putamen on alimentary conditioned reflexes in dogs

The influence was studied of the near-threshold high- and low-frequency stimulation of the putamen on achievement of alimentary conditioned reflexes in dogs. Both low- and high-frequency activation of the examined structure significantly changes the parameters of intermediate secretion, of the salivary conditioned reflexes, without influencing unconditioned ones. Unilateral stimulation disturbs the achievement of positive and inhibitory conditioned reflexes to a greater extent than bilateral one. Difference between the effects of low- and high-frequency stimulation has been revealed.     

The influence of electrocoagulation of the septum and section of the entorhinal cortex on general behaviour and memory in cats

In chronic experiments on cats it was shown that the lesion of the medial part of the septum does not result in the "septal syndrome"; the ratio of the different sleep-wakefulness cycle phases remains within the baseline values; the acquisition, retrieval and extinction of instrumental alimentary conditioned reflexes proceed normally; the delayed conditioned reflexes are impaired. Massive septal lesion, including its lateral part, leads to the development of the "septal syndrome"; there are changes in the structure and percentage of the different sleep-wakefulness cycle phases; the acquisition and extinction of instrumental alimentary reflexes with the sound discrimination are markedly retarded; the performance of delayed conditioned reflexes is completely destroyed. The section of the entorhinal cortex produces an increase in the number of repeated errors and perseverative movements during performance of instrumental alimentary reflexes, the deceleration of the acquisition and extinction of instrumental alimentary reflexes, complete disturbance of the delayed conditioned reflexes and does not affect the sleep-wakefulness cycle. The problems of the role of the hippocampus and its main inputs in the regulation of the short-term operative memory in the "pure form" as well as the significance of the descending influence of the hippocampus on the regulation of general animal behavior were also discussed.     

Conditioned reflex activity of pigeons as affected by an infra-low frequency alternating magnetic field

In experiments on 35 pigeons formation and realization was studied of alimentary motor conditioned reflexes under the influence of alternating magnetic field (AMF) with a frequency of 5 and 8 Hz and induction 5100 nTl. It has been found that under the action of such AMF, the percent of adequate responses lowers and the time of motor reaction during execution of motor alimentary conditioned reflexes and of delayed reactions increases. Realization of delayed reactions is disturbed more significantly than that of the present conditioned reflexes. AMF with a frequency of 8 Hz influences more expressively the pigeons conditioned activity in comparison with 5 Hz frequency.     

Conditioned alimentary motor reflexes in cats following destruction of the scorpula]

Bilateral ablation of the putamen results in temporary disappearance of natural as well as artificial conditioned motor reflexes in cats. Further training is necessary for their reestablishment. Restored conditioned reflexes appear with a long latency. After partial bilateral ablation of the putamen, animals that have been trained not only to press a pedal, but also to make a choice between a right or left feeding tray, lose the latter ability. After the reestablishment of conditioned reflexes, the animal makes a correct choice of side only in 68--70% of cases. After total bilateral ablation of the putamen the animals lose artificial conditioned reflexes. The results suggest that the putamen has a close relation to the mechanisms of learning and memory.     

Physiologic characteristics of systems of conditioned connections during urgent formation of a program of action]

Examination of preschool age children has shown that instantaneous formation of a system is possible only on the basis of integration of conditioned reflexes, which are differentiated by the nature or strength of reinforcement. Integration of previously elaborated conditioned reflexes is more successful if the initial systems of conditioned connections were in a state of conditioned tonic excitation of an optimal strength. Uniformly strong or uniformly weak stability of all reflexes in the system renders it inert, hence makes it a poor basis for instantaneous formation of a new system.     

Dynamics of the formation, reproduction and recognition of trace conditioned reflexes to positive and negative stimuli

The dynamics of formation, reproduction, and recognition of trace conditioned reflexes to positive and differentiation stimuli was studied on subjects of 15-17 years old. Formation and reproduction of such reflexes was found to occur under a close interaction of both levels of the higher nervous activity--recognized and unrecognized levels. Recognized reactions prevailed on unrecognized ones in cases of involvement of active attention. On the basis of this fact, the formation and reproduction of trace conditioned reflexes to positive stimuli has been supposed to occur with an active participation of the left hemisphere. The right hemisphere apparently plays a leading role in formation and reproduction of trace conditioned reflexes to differention stimuli to which the attention of the subjects was not fixed.     

Effect of a cyclic analog of enkephalin on learning and memory in the mouse

In experiments on mice, the effect of cyclic analogue of enkephalin (CAE) on the processes of learning and memory was studied in control animals and in animals with changed functional state of monoaminergic brain systems. Administration of the peptide to intact animals significantly accelerated the acquisition of conditioned reflexes of two-way avoidance and did not significantly affect the retention of these reflexes and their subsequent reproduction. Retention and reproduction of conditioned reflexes elaborated in one combination, was disturbed. Administration of iprazid did not eliminate the "accelerating effect" of CAE on the formation of conditioned reflexes of the two-way avoidance but sharply disturbed their retention. In such conditions, the amnesing iprazid effect increased still more. Besides, under CAE effect, the activity of acetylcholinesterase in the motor and especially in the visual cortex of the mice increased. The obtained data testify to an important role of the monoaminergic and cholinergic brain mechanisms in realization of CAE effects on the processes of learning and memory.     

Effect of tryptophan and its metabolites on the conditioned reflex activity of the honeybee

The effect of tryptophane and its derivatives on the rate of elaboration and transformation of conditioned reflexes (CR) to odour, with alimentary reinforcement, was studied in wild bees under two conditions: free movement of the bee or its immobilization (stress situation), by means of genetic models (mutations, successive blocking stages of kynurenin path of tryptophane metabolism). It was shown that mutations eliciting accumulation of free tryptophane and serotonin in the hemolymph of the bees and creating a deficit of kynurenins accelerate the transformation of conditioned reflexes and aggravate the depression of conditioned activity usually elicited in wild bees by monotonous prolonged presentation of conditioned signal. The injections of tryptophane and serotonin (5 mg) produce the same action. Mutations, eliciting accumulation in the hemolymph of the kynurenins (kynurenin and 3-hydroxikynurenin) accelerate, in conditions of immobilization, the formation of conditioned reflexes and delay the process of their transformation, and also contribute to maintainance of a higher (in comparison with the norm) level of the conditioned activity under monotonous presentation of the signal. The same action is produced by the injection of 1 mcg kynurenin.     

Changes in trace reactions of sensorimotor cortex and putamen neurons as affected by haloperidol

Experiments on conscious rabbits were made to elaborate motor conditioned reflexes through pairing stimuli with electrocutaneous reinforcement applied every 30 s. Neuronal activity in the sensorimotor cortex and putamen was recorded during formation and reproduction of the conditioned reflexes before and after haloperidol injection (0.2 mg/kg i. v.). In the putamen, haloperidol increased the number of neurons exhibiting trace conditioned activity and made the intensity and duration of these processes rise. The changes seen in the sensorimotor cortex were opposite in nature. Inhibition of trace conditioned activity in the sensorimotor cortex depended mainly on the decreased amplitude of the reaction conditioned component. The role of the dopaminergic system in the interaction of the neostriatum and sensorimotor cortex and in formation and reproduction of trace conditioned activity of both the structures is discussed.     

Effect of scopolamine on formation and fixation of temporary connections in rats with altered brain serotonin levels

The influence of scopolamine on elaboration and maintenance of conditioned reflexes of two-way avoidance was studied in rats under conditions of excess and deficit of serotonin in the brain. Administration of scopolamine to intact rats accelerated conditioning and did not prevent fixation of the reflex. Administration of scopolamine to animals with a lowered level of serotonin in the brain (by means of para-chlorophenylalanine) impaired conditioning and induced amnesia. In animals with ablated raphe nuclei, the same dose of scopolamine did not prevent elaboration and maintenance of conditioned reflexes. Accumulation of scopolamine in the brain by means of 5-oxytryptophan abolished acceleration of conditioning, which is specific for scopolamine, and affected the preservation of the reflexes. Against the background of the action of iprozid, scopolamine impaired the conditioning and tended to deteriorate the maintenance of conditioned reflexes. It is assumed that the serotoninergic system exerts a modulating influence on the activity of the brain cholinergic and cholinoreactive mechanisms.     

Effect of the type of reinforcement on conditioned reflex activity in male and female white rats

On 24 males and 26 females of white rats of a mixed line, a study was carried out of the speed of formation and consolidation of instrumental drinking and defensive conditioned reflexes, elaboration of differentiation, changes in conditioned activity by the use of stochastic stereotype and by changing the meanings of the conditioned signals to opposite. Conditioned reflexes were elaborated more rapidly in female rats at drinking reinforcement and in male rats--at the defensive one. Differentiations were elaborated more rapidly and were better expressed in females than in males at both types of reinforcement.     

Conditioned-reflex food selection in mongrel white rats exposed to high temperature]

Under condition of normal temperature the conditioned reflectory runnings of rats on the audible irritants were developed more quickly during dry food than damp one. Daily influence of high temperature during two hours and partially water deprivation resulted in reduction of the conditioned reflex which had been developed before during dry food. The reproduction of the conditioned reflexes during dry food failed. The essential changings in the conditioned reflexes during damp and dry food were not found when animals had become overheating without restriction of water consumption. During daily heat affecting at the end of the second week animals adapted to high temperature. This statement is confirmed by lowering the rectal temperature, decrease of the breath rate, daily water consumption and restoration of the activity of conditioned reflexes.     

Effect of successive lesions of the hippocampus and amygdaloid body on conditioned-reflex alimentary reactions in rabbits

Bilateral electrolytic lesions of the dorsal hippocamp and basolateral amygdalar complex impede the differential and extinctive inhibition. The damage of the corticomedial amygdala against a background of the dorsal hippocamp deficiency facilitates differentiation and extinction of alimentary reflexes induced by a decrease of the alimentary motivation and by weakening of alimentary conditioned reflexes. Lesions of the dorsal hippocamp after the corticomedial amygdala damage facilitates the training of positive alimentary reflexes, but weakens inhibitory conditioned reflexes.     

The vegetative component of a conditioned reflex]

Defensive and alimentary conditioned reflexes were studied on normal cats and cats with neural isolation of the neocortex. The cardiac component of the conditioned reflexes is elaborated in decorticated animals at a similar rate and is as steady as in normal cats. Motor conditioned reactions in decorticated cats are difficult to elaborate. Both in normal and decorticated cats unconditioned pain stimulation evokes tachycardia, while a conditioned signal, paired with this unconditioned stimulus, produces bradicardia. Ban assumption has been made that the primary conditioned reaction consists in the appearance of a certain emotional state which changes the cardiac rhythm in a typical way.     

Tonic component of the conditioned reflex process and its functional role

Tonic background activity of 266 neurones in the hippocampus and different neocortical areas was studied in freely moving rabbits in the process of defensive and food instrumental conditioned performance and during switching-over of instrumental and classical food and defensive reflexes. Associations of CS and reinforcement evoke background activity changes in most of recorded cortical neurones preceding the development of other conditioned manifestations. Conditioned reflex was performed only after reaching the background firing rate of almost every examined neurone optimal for its realization. The performance of different conditioned reflexes was associated with different background activity levels of cortical neurones. The above mentioned data form the experimental basis for the identification of the tonic component in conditioned process which reflects tonic character of temporary connection formation and function.     

Inhibitory effect of the amygdala on alimentary-conditioned reflexes in the dog

In experiments on dogs, changes of conditioned alimentary reflexes were studied under stimulation (50-100 mcA, 1, 40, 100 imp/s, 0.5 ms) of the basolateral area of amygdala before and after electrolytic ablation (5 mA, 60 s) of the head of the caudate nucleus. Stimulation of the amygdala, which elicited inhibition of conditioned secretory reflexes and prolongation of latencies in intact dogs leads to opposite - activating - influences after destruction of the caudate nucleus head. A conclusion is made on the participation of neurophysiological and neurochemical mechanisms of the caudate nucleus in transmission of inhibitory effects of the amygdala on alimentary conditioned reflexes.