Behavioral research in pigeons with ARENA: An Automated Remote Environmental Navigation Apparatus

Three experiments established the effectiveness of an Automated Remote Environmental Navigation Apparatus (ARENA) developed in our lab to study behavioral processes in pigeons. The technology utilizes one or more wireless modules, each capable of presenting colored lights as visual stimuli to signal reward and of detecting subject peck responses. In Experiment 1, subjects were instrumentally shaped to peck at a single ARENA module following an unsuccessful autoshaping procedure. In Experiment 2, pigeons were trained with a simultaneous discrimination procedure during which two modules were illuminated different colors; pecks to one color (S+) were reinforced while pecks to the other color (S−) were not. Pigeons learned to preferentially peck the module displaying the S+. In Experiment 3, two modules were lit the same color concurrently from a set of six colors in a conditional discrimination task. For three of the colors pecks to the module in one location (e.g., upper quadrant) were reinforced while for the remaining colors pecks at the other module (e.g., lower quadrant) were reinforced. After learning this discrimination, the color-reinforced location assignments were reversed. Pigeons successfully acquired the reversal. ARENA is an automated system for open-field studies and a more ecologically valid alternative to the touchscreen.     

Spatial serial conditioning maintained with minimal temporal contingency

Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatially informative conditioned stimuli in eliciting tracking behavior in pigeons. The experimental paradigm consisted of the simultaneous presentation of 2 key lights (CS2 and CTRL), followed by another key light (CS1), followed by food (the unconditioned stimulus or US). CS2 and CTRL were presented in 2 of 3 possible locations, randomly assigned; CS1 was always presented in the same location as CS2. CS2 was designed to signal the spatial, but not the temporal locus of CS1; CS1 signaled the temporal locus of the US. In experiment 1, differential pecking on CS2 was observed even when CS2 was present throughout the interval between consecutive presentations of CS1, but only in a minority of pigeons; prevalence of differential pecking was enhanced when CS2 duration was halved. A control condition verified that pecking on CS2 was not due to temporal proximity between CS2 and US. Experiment 2 demonstrated the reversibility of spatial conditioning between CS2 and CTRL. Asymptotic performance never involved tracking CTRL more than CS2 for any of 16 pigeons. It is inferred that pigeons learned the spatial association between CS2 and CS1, and that temporal contingency facilitated its expression as tracking behavior.     

Scaling relative incentive value: different adjustments to incentive downshift in pigeons and rats

Previous research suggests that pigeons and rats show differences in their behavioral adjustments in spaced-trial, incentive-downshift situations. Also, Papini and Pellegrini [Papini, M.R., Pellegrini, S., 2006. Scaling relative incentive value in consummatory behavior. Learn. Motiv. 37, 357-378] and Pellegrini and Papini [Pellegrini, S., Papini, M.R., 2007. Scaling relative incentive value in anticipatory behavior. Learn. Motiv. 38, 128-154] showed that changes in the rat's lever-pressing performance, runway running, and consumption of sucrose solutions after downshifts in incentive magnitude were a function of the ratio of postshift/preshift incentive magnitudes. Here, two experiments using a Pavlovian autoshaping procedure studied the adjustment of pigeons and rats to changes in incentive magnitude. In Experiment 1, pigeons received light-food pairings, whereas in Experiment 2, rats received lever-sucrose pairings. As a result, key-pecking and lever-pressing developed in each experiment, respectively. Preshift incentive magnitudes were downshifted so as to obtain postshift/preshift ratios of 0.125 and 0.25. Pigeons responded during the postshift phase according to the preshift incentive value and independently of the ratio value. However, rats showed ratio constancy, responding during the postshift in accordance with the postshift/preshift ratio, rather than with the absolute magnitudes of either the preshift or postshift incentives. These results support the comparative hypothesis that the mechanisms underlying ratio constancy during incentive downshifts are unique to mammals.     

Establishing a model for assessing DNA damage in murine brain cells as a molecular marker of chemotherapy-associated cognitive impairment

Aims

Chemotherapy-associated cognitive impairment often follows cancer chemotherapy. We explored chemotherapy-induced DNA damage in the brain cells of mice treated with 5-fluorouracil (5FU), an antineoplastic agent, to correlate the extent of DNA damage to behavioral functioning in an autoshaping-operant mouse model of chemotherapy-induced learning and memory deficits (Foley et al., 2008).

Main methods

Male, Swiss-Webster mice were injected once with saline or 75 mg/kg 5FU at 0, 12, and 24 h and weighed every 24 h. Twenty-four h after the last injection, the mice were tested in a two-day acquisition and the retention of a novel response task for food reinforcement. Murine brain cells were analyzed for the presence of single- and double-strand DNA breaks by the single cell gel electrophoresis assay (the Comet assay).

Key findings

We detected significant differences (p < 0.0001) for all DNA damage characteristics (DNA “comet” tail shape, migration pattern, tail moment and olive moments) between control mice cohort and 5FU-treated mice cohort: tail length – 119 vs. 153; tail moment – 101 vs. 136; olive moment – 60 vs. 82, correspondingly. We found a positive correlation between increased response rates (r = 0.52, p < 0.05) and increased rate of errors (r = 0.51, p < 0.05), and DNA damage on day 1. For all 15 mice (saline-treated and 5FU-treated mice), we found negative correlations between DNA damage and weight (r = − 0.75, p < 0.02).

Significance

Our results indicate that chemotherapy-induced DNA damage changes the physiological status of the brain cells and may provide insights to the mechanisms for cognitive impairment after cancer chemotherapy.     

A comparison of explicitly unpaired treatment and extinction: recovery of sign-tracking within a context renewal design

The present experiment compared the effectiveness of explicitly unpaired treatment and extinction in preventing the recovery of sign-tracking within a context renewal design. Three groups of rats were first trained on a sign-tracking procedure in Context A where insertions of a retractable lever were paired with food. In a second phase, the sign-tracking response was eliminated. One group received standard extinction of the CS in Context B, while another group received explicitly unpaired treatment in Context B where food was presented only during inter-trial intervals (and not paired with the lever). A third group received this explicitly unpaired treatment in Context A. After the sign-tracking response was eliminated, all groups received a test session in Context A where the lever was presented alone and no food was delivered at any time. Significantly more responding occurred in the group that received explicitly unpaired treatment in Context B than in either of the other groups. This demonstrates that there are situations where explicitly unpaired treatment is less effective than extinction in preventing the reappearance of previously eliminated responding.     

Using differential reinforcement to improve equine welfare: shaping appropriate truck loading and feet handling

Inappropriate behavior during common handling procedures with horses is often subject to aversive treatment. The present study replicated and extended previous findings using differential reinforcement to shape appropriate equine handling behavior. In Study 1, a multiple baseline across subjects design was used with four horses to determine first the effects of shaping target-touch responses and then successive approximations of full truck loading under continuous and intermittent schedules of reinforcement. Full loading responses were shaped and maintained in all four horses and occurrences of inappropriate behaviors reduced to zero. Generalization of the loading response was also observed to both a novel trainer and trailer. In Study 2, a changing criterion design was used to increase the duration of feet handling with one horse. The horse's responding reached the terminal duration criterion of 1 min and showed consistent generalization and one-week maintenance. Overall, the results of both studies support the use of applied equine training systems based on positive reinforcement for increasing appropriate behavior during common handling procedures.     

Summation and subtraction using a modified autoshaping procedure in pigeons

A modified autoshaping paradigm (significantly different from those previously reported in the summation literature) was employed to allow for the simultaneous assessment of stimulus summation and subtraction in pigeons. The response requirements and the probability of food delivery were adjusted such that towards the end of training 12 of 48 trials ended in food delivery, the same proportion as under testing. Stimuli (outlines of squares of three sizes and colors: A, B, and C) were used that could be presented separately or in any combination of two or three stimuli. Twelve of the pigeons (summation groups) were trained with either A, B, and C or with AB, BC, and CA, and tested with ABC. The remaining 12 pigeons (subtraction groups) received training with ABC but were tested with A, B, and C or with AB, BC, and CA. These groups were further subdivided according to whether stimulus elements were presented either in a concentric or dispersed manner. Summation did not occur; subtraction occurred in the two concentric groups. For interpretation of the results, configural theory, the Rescorla-Wagner model, and the composite-stimulus control model were considered. The results suggest different mechanisms responsible for summation and subtraction.     

Effect of US identity on elimination and recovery of autoshaped responding with explicitly unpaired and degraded contingency extinction procedures

The depressive effects of noncontingent and explicitly unpaired food unconditioned stimuli (USs) and the recovery from those effects on autoshaped responding were examined in a series of experiments with pigeons. In Experiments 1 and 2, responding to a keylight conditioned stimulus (CS) previously paired with food was depressed equally by explicitly unpaired presentations of either that same food or a different food. Furthermore, responding recovered equally following removal of the explicitly unpaired foods. In contrast, Experiments 3 and 4 showed that noncontingent presentations of a food US depressed responding more to a keylight CS paired with that same food than to a keylight CS paired with a different food. Moreover, removal of the noncontingent foods led to complete recovery but more rapid extinction of responding to the same keylight relative to the different keylight. The implications of these results for understanding the mechanisms underlying depression and recovery of responding following degraded contingency and explicitly unpaired extinction procedures are discussed.     

Recovery of Pavlovian sign-tracking (autoshaping) following the discontinuation of inter-trial interval food in rats

In pigeons, Pavlovian autoshaped keypecking produced by keylight-food pairings has been eliminated by introducing food during periods between CS presentations (i.e., during the inter-trial intervals). Keypecking eliminated in this manner reappears when the inter-trial USs are discontinued even though the CS is no longer paired with US. The present experiment investigated whether this recovery of responding produced by discontinuing unpaired inter-trial US presentations could be extended to another species, rats, within a Pavlovian sign-tracking paradigm. Rats were initially trained on a procedure where insertion of one retractable lever (CS(+)) was followed, response independently, with food, while insertion of another lever (CS(-)) was not paired with food. Rats quickly came to contact the CS(+) lever at high rates, but contacted the CS(-) lever infrequently. In the next phase, CS(+) was no longer followed by food. Explicitly unpaired food was presented only during the inter-trial intervals when both levers were absent. This treatment essentially eliminated the sign-tracking response. In the final phase, the unpaired inter-trial food presentations were discontinued while both CSs continued to be presented without food. This produced a significant recovery of the sign-tracking elicited by the CS(+) lever, extending the species generality of the Pavlovian resurgence phenomenon that has previously only been reported in pigeons, to rats.     

Comment on Gallistel: Behavior theory and information theory: Some parallels

In this article, Gallistel proposes information theory as an approach to some enduring problems in the study of operant and classical conditioning.