Interval time-place learning by rats: varying reinforcement contingencies

Two experiments with rats were conducted to study interval time-place learning when the spatiotemporal contingencies of food availability were more similar to those likely to be encountered in natural environments, than those employed in prior research. In Experiment 1, food was always available on three levers on a variable ratio (VR) 35 schedule. A VR8 schedule was in effect on Lever 1 for 5 min, then on Lever 2 for 5 min, and so forth. While rats learned to restrict the majority of their responding to the lever that provided the highest density of reinforcement, they seemed to rely on a win-stay/lose-shift strategy rather than a timing strategy. In Experiment 2, the four levers provided food on variable ratios of 15, 8, 15, and 30, each for 3 min. As expected the rats learned these contingencies. A novel finding was that the rats had a spike in response rate immediately following a change from a higher to lower reinforcement density. It is concluded that rats exposed to spatiotemporal contingencies behave so as to maximize the rate of obtained reinforcement.     

Pigs shift too: foraging strategies and spatial memory in the domestic pig

In a previous experiment, we showed that domestic pigs, Sus scrofa, unlike many other species, performed accurately in a spatial memory task, where visits to a previously baited food trough were rewarded (win-stay). We investigated whether pigs have a predisposition for this strategy, by comparing their performance in a radial arm maze under either win-stay (N=10) or win-shift (N=10) reward contingencies. Contrary to our earlier results, only one of the animals in the win-stay condition was able to reach the imposed criterion level of accuracy. The performances of the other win-stay pigs did not deviate from random. All pigs in the win-shift condition reached criterion by day 25 of the experiment, and performed better than expected by chance. Analysis of the types of errors made matched our a priori predictions that shift movements would occur more frequently, especially within visits to the maze. We suggest that the difference in learning rates may reflect the fact that win-stay pigs needed to use two different rules, stay between trials and shift within trials, while win-shift pigs only needed to use the shift rule. In our previous study, win-stay pigs did not experience a conflict of rules and this may have facilitated stay learning. We found evidence of a recency effect in win-shift animals and a primacy effect in the win-stay group. However, we discuss the unsuitability of these specific terms in this type of experiment, and propose an alternative interpretation of the results. Copyright 2000 The Association for the Study of Animal Behaviour.     

Age-Related Changes of the Anxiety Level of Male and Female Rats in Elevated Cross-Maze Test

Age-related peculiarities of formation behavior in the elevated cross-maze was studied in male and female Wistar rats of 6 age groups: the 17-, 21-, 30-, and 36-day-old rat pups as well as adult animals. Recorded were duration of animal stay in the open arms of the maze and the number of hanging-down reactions, parameters of the level of anxiety. In the 17-day-old rat pups the anxiety level was higher than the older animals, the 17-day-old pups being characterized by frequent manifestation of freezing reaction. Duration of stay in the open arms of the maze increased in the 26-day-old rat pups. In the 21-day-old animals the number of hanging reactions rose as compared with the 17-day-old ones, but did not differ from that in the 26-day-old animals. The anxiety level in the 30-day-old rat pups was much lower than in animals of younger age groups. In the rats aged 36 days (the age directly preceding sexual maturation) there was a pronounced enhancement of anxiety, recorded using both parameters. In the 42-day-old animals an increased duration of stay in the open maze arms was again observed, which indicates a decrease of the anxiety level. The obtained data demonstrate complex non-linear development of this form of emotional behavior in ontogenesis and allow suggesting an important role of the hormonal-humoral system in its formation.     

Characteristics of the role of spatial memory in the choice reactions of white rats

Behaviour of the rats, previously learnt to come back to one and the same place of reinforcement was studied in conditions of periodical changes of this place. It was found that after detection of the new place of reinforcement, the rats could optimize their behaviour according to disposition of this place. Optimization of behaviour consisted in shifts of running direction towards the new reinforcement place and (or) in selective displacements before blinds, according to the places of reinforcement in the experiment. It is suggested that an increase of the role of working memory and apparatus of probabilistic prognosis at choice lies in the basis of optimization.     

Effect of the type of reinforcement on conditioned reflex activity in male and female white rats

On 24 males and 26 females of white rats of a mixed line, a study was carried out of the speed of formation and consolidation of instrumental drinking and defensive conditioned reflexes, elaboration of differentiation, changes in conditioned activity by the use of stochastic stereotype and by changing the meanings of the conditioned signals to opposite. Conditioned reflexes were elaborated more rapidly in female rats at drinking reinforcement and in male rats--at the defensive one. Differentiations were elaborated more rapidly and were better expressed in females than in males at both types of reinforcement.     

Behavioral tactics among rats in a radial maze

The experiments were carried out on rats of Wistar (W) and Krushinsky-Molodkina (KM) lines, differing in the level of task performance in conditions of multiple choice of food sources in a 12ray radial symmetrical maze. It is shown that in the radial maze, the rats of both lines use a number of behavioural tactics. To determine the influence of changes of environmental spatial characteristics while preserving the main experimental strategy--never revisit the places of reinforcement,--on the peculiarities of tactics manifestations maze modifications were elaborated. Besides the environmental procedure was changed. Under all conditions the rats of W line solved the task. According to the situation, they either preserved former tactics or developed some new ones. The rats of KM line could not solve the task in changed conditions. In most sessions, appearance or absence of given tactics was not adequate to new conditions. The presence of the necessary tactics not always facilitated the task solving. Thus, for the realization of adequate reactions, the presence of necessary tactics is not sufficient: their "tuning" is needed depending on situation. The possibility is supposed of genetic determination of rats ability to some tactics. However, it is emphasized, that tactics are not strongly fixed, as their realization depends on environmental conditions.     

Wireworms and the sugar-beet crop; field trials and observations

Observations on wireworms in the sugar-beet crop during 1937–40 indicated the importance of alternative food, such as buried turf, weeds, excess seedlings and interdrilled wheat in determining the degree of injury to the crop.
In 1938, out of thirty-six recorded fields growing sugar beet after ploughed-up grass only one suffered severe wireworm damage. Six of these fields were selected for resowing with sugar beet in 1939, and all suffered moderate or severe attacks. Several other fields in their first year from grass showed only slight damage. These observations were supported by an analysis of the Norfolk War Agricultural Committee crop records for 1940.
Seven trials were carried out in 1939 to determine the effect of increasing the seed rate from normal (about 14–16 lb./acre) to 17–25 lb., and of interdrilling with wheat. In three trials, increasing the seed rate gave significantly higher plant populations before singling. It gave significant increases after singling in one out of two trials. However, in the one trial harvested the increase in 'washed beet' was only 7.6% and 'total sugar' 15%. Interdrilling with wheat at 40–70 lb./acre gave significant increases in the plant population before singling in three out of five trials, and after singling in three out of four trials. Increased plant populations both before and after singling were obtained in two other trials with alternating treatments. Increased seed rate and interdrilled wheat together gave greatly improved plant populations before singling in each of two trials and after singling in the one trial where such an observation was possible.     

Effect of substance P on behavior in the rabbit and the activity of cortical neurons during training

Subcutaneous injection of substance P to rabbits in a dose of 250 mcg/kg elicited a transitory disappearance of motor reactions to painful reinforcing stimuli and a reduction of their probability to reinforced and inhibitory light flashes, as well as a protracted heart rate increase and decrease of respiration rate. One third of the neurones recorded decreased their background firing level and or excitatory components of the reactions to reinforcement and conditioned light flashes. The decrease was most distinctly seen in the sensorimotor cortex and less pronounced in the visual cortical area and hippocampus. The influence of the substance P on different types of cortical inhibition was not the same. Tonic inhibition of neuronal activity in response to reinforcement was enhanced. Bioelectrical parameters which reflect an enhancement of inhibitory hyperpolarization during elaboration of internal inhibition (i.e. inhibitory firing delays and corresponding background and evoked slow potentials oscillations) were not changed.     

Spatial learning in the nectarivorous bananaquit: juveniles versus adults

Both theory and previous studies suggest that nectarivores should learn to visit a flower in a new location more easily than to return to a flower in a position just visited. To test this hypothesis, both naive hand-reared juvenile and experienced adult bananaquits, Coereba flaveola were studied. Experimental results with experienced adults supported the hypothesis. Adults learned very quickly to switch to flowers in different locations (win-shift), but had difficulty learning to return to flowers in a position just visited (win-stay). However, naive juveniles learned win-shift and win-stay problems with equal facility. These results support the hypothesis, but suggest that bananaquits do not have a predetermined tendency to shift locations of flower visits. It suggests instead that their win-shift bias is a result of their previous experience.     

Two intertidal fish species use visual association learning to track the status of food patches in a radial maze

We tested fifteen-spined sticklebacks, Spinachia spinachia, and corkwing wrasse, Crenilabrus melops, for their ability to associate visual spatial cues with food sources in a radial maze and so to track renewal frequencies and productivity. When all locations contained food or were empty, subjects displayed win-shift or lose-shift behaviour by avoiding recently visited locations; this behaviour therefore appeared to be a basic trait. Both species readily learned food-cue associations, although with less efficiency as the diversity of cues increased. They used this information to distinguish food sources renewed within and between daily foraging bouts from those that remained empty. Moreover, both species distinguished between renewable food sources differing in productivity, preferentially visiting those containing more food. Reversal of cue roles caused an immediate decline in foraging efficiency, followed by rapid recovery as new food-cue associations were learned. Evidently, therefore, subjects tracked the status of potential food sources by continued sampling and could switch from win-shift to win-stay behaviour, when preferred locations were persistently revisited, as appropriate. The formation of food-cue associations, together with sampling and flexible use of win-shift and win-stay behaviour, would enable these rocky intertidal fish species to exploit patchily distributed food sources whose status changes during the tidal cycle. Copyright 2000 The Association for the Study of Animal Behaviour.     

Effect of 8-Br-cAMP on the formation of conditioned reflex behavior in the white rat

The influence of cAMP analogue 8-Br-cAMP on conditioning was studied in white rats. Two models of learning were used with different kinds of reinforcement, i. e. conditioned active avoidance and instrumental alimentary reactions in a complex maze. Intraventricular 8-Br-cAMP injection 4 or 24 hours before the beginning of learning improved the process of defensive as well as alimentary conditioning. Characteristics of formation of complex behaviour of experimental rats in a maze showed that under the influence of 8-Br-cAMP, not only conditioning was accelerated, but the process of optimal decision making itself was changed. The data obtained permit to suppose that 8-Br-cAMP first of all affects initially poorly learning rats.     

The characteristics of the neuronal reactions of the cat somatosensory cortex to a heteromodal complex conditioned signal]

On alert cats the change was studied of the activity of the neurones of the sensorimotor cortical area at instrumental reaction to a simultaneous heteromodal complex stimulus. It was shown that in the projection of distal limb areas a group could be singled out of neurones, which changed their activity in one direction depending on the character of presented signals. In these cells an increase of discharges frequency was observed in response to complex stimulus, consisting of light and sound signals. After the extinction of the motor reaction both to the complex stimulus and to its components neuronal reactions of lesser intensity was recorded, what determined the absence of the motor reaction. This group of neurones had receptive fields localized on distal limb areas, it was activated at fulfillment of the movement of catching the reinforcement and belonged to neurones of the pyramidal tract. The neurones with receptive fields on the whole limb surface or changing their activity at the animal pose change, had variable reactions to positive and differentiation stimuli.     

Performance correlates of social behavior and organization: Effects of group formation on operant performance in rhesus monkeys (M. mulatta)

The performance of six adult rhesus monkeys on a fixed interval 1-min reinforcement schedule was examined under conditions where the reinforcement probabilities were either 1.00 or .80. The animals were tested with a reinforcement probability of 1.00 immediately after removal from their social group, tested again several months later with reinforcement probabilities of 1.00 and .80, and then retested with a reinforcement probability of .80 before, during, and after the formation of a new social group with the six monkeys. The results supported an earlier report in which it was found that high ranking animals responded at a lower rate under a reinforcement probability of 1.00 than did low ranking animals and that the former also had a higher ratio of nonreinforced to reinforced responses than the lower ranked animals. These relationships were present in five of the six animals immediately after removal of the animals from their original group and during and after formation of the new group. They did not appear on tests conducted after the animals had been out of a social group for several months. A third result was a suppression of operant performance which appeared in all animals following group formation. The magnitude and duration of this effect was inversely related to social rank and the time the animal had been a member of the group. The data are discussed in terms of a carry-over of the effects of recent social experience on two factors: a more deliberate rate of response by higher ranking animals under 100% reinforcement and an inhibition of response bursting following omission of reinforcement by the lower ranking monkeys. Supported by USAMRDC Contract No. DADA 17-73-C-3007.     

Shifts in the psychophysical function in rats

The primary goal was to compare results from a free-operant procedure with pigeons [Machado, A., Guilhardi, P., 2000. Shifts in the psychometric function and their implications for models of timing. J. Exp. Anal. Behav. 74, 25-54, Experiment 2] with new results obtained with rats. The secondary goal was to compare the results of both experiments with dependent variables that were not used in the original publication. As in the original study with pigeons, rats were trained on a two-alternative free-operant psychophysical procedure in which left lever press responses were reinforced during the first and second quarters of a 60-s trial, and right lever press responses were reinforced during the third and fourth quarters of the trial. The quarters were reinforced according to four independent variable interval (VI) schedules of reinforcement. The VI duration was manipulated in each quarter, and shifts in the psychophysical functions that relate response rate with time since trial onset were measured. The results obtained with rats were consistent with those previously obtained with pigeons. In addition, results not originally reported were also consistent between rats and pigeons, and provided insights into the perception, memory, and decision processes in Scalar Expectancy Theory and Learning-to-Time Theory.     

Conditioned reactions and mediator-humoral shifts during neurotization in a probabilistic pain reinforcement situation

Substitution of regular partial reinforcement for random one (in both cases the reinforcement frequency was 50%) acted in some dogs as a neurotizing factor: they showed unrest, stable defensive reflexes disappeared, corresponding changes were observed in vegetative reactions. At the same time activation of the sympatho-adrenal system was recorded along with a drop in concentration of acetylcholine in peripheric blood. It is noted that the development of neurotic disturbances in dogs in these conditions were to a certain degree dependent of the dominating motivation.     

The hemispheric lateralization of the recognition of noisy visual stimuli in man

At tachistoscopic unilateral presentation of noisy visual stimuli and application of "yes-no" method in man predominance was found of the right hemisphere by the number and "yes" reaction time and of the left hemisphere by the number of responses "no". At verbal mnemic load preceding the presentation of visual patterns the left hemisphere asymmetry was observed by the number of "yes" responses and reactions time of both types. FMA was more clearly expressed in men in the first case and in women--in the second one. In more difficult conditions of recognition of several types of patterns, FMA was noticed mainly in women: initial left hemisphere advantage during the increase of the disturbance was changed to the right hemispheric one and appeared again. Preferential participation of the right hemisphere in singling out of the visual signal from noise is supposed. Possibility of the left hemispheric asymmetry manifestation was determined by the specificity and complexity of the visual task, by the level of the disturbance, presentation of competitive task and sexual composition of the group.     

Effects of blockade of dopaminergic D1/D2 receptors on behavior of impulsive and self-controlled rats

Selective antagonists of D1 and D2 receptors (SCH 23 390 and raclopride respectively) were injected to rats divided on the basis of preliminary experiments into groups of"self-controlled" (preference of valuable but delayed reinforcement) and "impulsive" (choice of less valuable but immediate reinforcement) animals. Number of omissions of reactions and their latencies were recorded. In "self-controlled" rats, both drugs increased the number of reactions for less valuable immediate reinforcement, i.e., increased impulsiveness, whereas practically did not change the behavior of "impulsive" animals. Introduction of SCH 23 390 to animals ofboth groups increased the number of reaction omissions the effect being stronger in "self-controlled" animals. Raclopride also increased the number of reaction omissions in "self-controlled" rats but only on the next day after the injection. In "impulsive" animals, both drugs increased the latencies of reactions.     

Toward a biophysical theory of organogenesis: Birefringence observations on regenerating leaves in the succulent,Graptopetalum paraguayense E. Walther

Polarity shifts occur during organogenesis. The histological criterion for polarity is the direction of cell division. The biophysical criterion is the orientation of reinforcing cellulose microfibrils which lie normal to the organ axis and which determine the preferred growth direction. Using cell pattern to deduce cell lineage, and polarized light to study cellulose alignment, both aspects of polarity were examined in the epidermis of regenerating G. paraguayense. In this system new leaves and a stem arise from parallel cell files on a mature leaf. Large (90°) shifts in polarity occur in regions of the epidermis to give the new organs radial symmetry in the surface plane (files radiating from a pole). Study of the shifts in the epidermis showed that, during certain stages, shifts in the division direction are accompanied by shifts in the cellulose deposition direction, as expected. The new cellulose orientation is parallel to the new cross wall. During normal organ extension, however, shifts in division direction do not bring on changes in cellulose pattern. Thus the coupling between the two kinds of polarity is facultative. This variable relation is used in a biophysical model which can account for the reorganization of cell file pattern and cellulose reinforcement pattern into the radial symmetry of the new organ.     

Genetic aspects of the hormonal modification of stress reactivity. I. The prenatal effect of hydrocortisone on the reactivity of the hypophyseoadrenal system of adult August and Wistar strain rats and their 1st generation hybrids

Influence of the alteration of corticosteroid equilibrium during prenatal development on the reactivity of the pituitary-adrenal system in adulthood was studied in August, Wistar rats and their F1 hybrids. The alteration of corticosteroid balance was caused by injections of hydrocortizone to female rats on the 16th and 18th day of gestation. Adult male-offsprings were investigated. The prenatal hydrocortizone treatment was capable of modifying the inherited peculiarities of the stress system. Interstrain differences in sensitivity to hormone were observed. Hormonal treatment decreased reactions of the endocrine system to an emotional stresser or intracerebral noradrenaline administration in Wistar rats, but not in August ones. Reciprocal hybrids were affected by the hormone, like Wistar rats. At the same time, treatment with hydrocortizone did not change the reactions of the pituitary-adrenal system of the rats of both strains under the conditions of "systemic" stress or intracerebral serotonin administration. Probably, hydrocortizone affected specific mechanisms of emotional reaction, connected with noradrenergic system of brain. Thus, the ability of prenatal hydrocortizone treatment to modify the reactivity of the pituitary-adrenal system in adult rats depends on the animal genotype. Sensitivity to the hormone is a dominant character.     

Training a new response using conditioned reinforcement

Some of the most frequently used methods in the study of conditioned reinforcement seem to be insufficient to demonstrate the effect. The clearest way to assess this phenomenon is the training of a new response. In the present study, rats were exposed to a situation in which a primary reinforcer and an arbitrary stimulus were paired and subsequently the effect of this arbitrary event was assessed by presenting it following a new response. Subjects under these conditions emitted more responses compared to their own responding before the pairing and to their responding on a similar operandum that was available concurrently that had no programmed consequences. Response rates also were higher compared to responding by subjects in similar conditions in which there was no contingency (a) between the arbitrary stimulus and the reinforcer, (b) between the response and the arbitrary stimulus or (c) both. Results are discussed in terms of necessary and sufficient conditions to study conditioned reinforcement.