Differences in corticosterone level due to inter-food interval length: implications for schedule-induced polydipsia

The purpose of this study was to determine the effects of different food-reinforcement schedules on plasma corticosterone (CORT), and its possible involvement in the acquisition and maintenance of schedule-induced polydipsia (SIP). In Experiment 1, three groups of rats were submitted to two different fixed-interval (FI) schedules with inter-food intervals of 30 and 120 s, and to a massed-feeding presentation for 40 days until SIP was well stabilized. In Experiment 2, six groups of rats were exposed to the same schedules, FI 30s and FI 120s, and to the massed-feeding condition, but no water bottles were presented. CORT levels were determined on Days 3 and 40. Results of Experiment 1 indicated that FI 30s schedule, but not FI 120s or the massed-feeding condition, induces excessive drinking from Day 3. Results in Experiment 2 indicated that CORT levels were similar for all the groups on Day 3. However, only animals on the FI 30s schedule did increase their CORT levels on Day 40, with no variation in the hormone in the other two conditions, FI 120s and massed-feeding presentations. The data are discussed in terms of the implications of these results for hypotheses of SIP as anxiolitic behavior.     

Fixed interval and fixed time treadle pressing in the pigeon: A comparison with FI and FT keypecking

Experiment I used non-naive pigeons having previously performed on both keypecking and treadlepressing Fixed Interval schedules. In condition IT, treadlepressing was reinforced on successive Fixed Interval 60 seconds, Fixed Time 60 seconds and Fixed Interval 60 seconds schedules. Subsequently (condition IK), the same subjects pecked a key on an identical schedule sequence (FI60, FT60, FI60). In Experiment II, separate groups of naïve subjects were assigned either to treadlepressing (condition IIT) or keypecking (condition IIK) and to the same schedule sequence (FI60, FT60, FI60). Treadle pressing and keypecking decreased greatly in Fixed Time schedules. Curvature indices, pauses and running rates were less sensitive than response rates to the switching from one schedule to the other. Experiments I and II yielded similar results, experimental history accounting only for minor differences. The results were discussed in relation to interspecies differences in the temporal regulation of behavior and operant versus respondent control of the response and schedule-induced behaviour.     

Oscillations following periodic reinforcement

Three experiments examined behavior in extinction following periodic reinforcement. During the first phase of Experiment 1, four groups of pigeons were exposed to fixed interval (FI 16 s or FI 48 s) or variable interval (VI 16 s or VI 48 s) reinforcement schedules. Next, during the second phase, each session started with reinforcement trials and ended with an extinction segment. Experiment 2 was similar except that the extinction segment was considerably longer. Experiment 3 replaced the FI schedules with a peak procedure, with FI trials interspersed with non-food peak interval (PI) trials that were four times longer. One group of pigeons was exposed to FI 20 s PI 80 s trials, and another to FI 40 s PI 160 s trials. Results showed that, during the extinction segment, most pigeons trained with FI schedules, but not with VI schedules, displayed pause-peck oscillations with a period close to, but slightly greater than the FI parameter. These oscillations did not start immediately after the onset of extinction. Comparing the oscillations from Experiments 1 and 2 suggested that the alternation of reconditioning and re-extinction increases the reliability and earlier onset of the oscillations. In Experiment 3 the pigeons exhibited well-defined pause-peck cycles since the onset of extinction. These cycles had periods close to twice the value of the FI and lasted for long intervals of time. We discuss some hypotheses concerning the processes underlying behavioral oscillations following periodic reinforcement.     

An Assessment of Fixed Interval Timing in Free-Flying Honey Bees (Apis mellifera ligustica): An Analysis of Individual Performance

Interval timing is a key element of foraging theory, models of predator avoidance, and competitive interactions. Although interval timing is well documented in vertebrate species, it is virtually unstudied in invertebrates. In the present experiment, we used free-flying honey bees (Apis mellifera ligustica) as a model for timing behaviors. Subjects were trained to enter a hole in an automated artificial flower to receive a nectar reinforcer (i.e. reward). Responses were continuously reinforced prior to exposure to either a fixed interval (FI) 15-sec, FI 30-sec, FI 60-sec, or FI 120-sec reinforcement schedule. We measured response rate and post-reinforcement pause within each fixed interval trial between reinforcers. Honey bees responded at higher frequencies earlier in the fixed interval suggesting subject responding did not come under traditional forms of temporal control. Response rates were lower during FI conditions compared to performance on continuous reinforcement schedules, and responding was more resistant to extinction when previously reinforced on FI schedules. However, no “scalloped” or “break-and-run” patterns of group or individual responses reinforced on FI schedules were observed; no traditional evidence of temporal control was found. Finally, longer FI schedules eventually caused all subjects to cease returning to the operant chamber indicating subjects did not tolerate the longer FI schedules.     

"The stone which the builders rejected...": Delay of reinforcement and response rate on fixed-interval and related schedules

The article deals with response rates (mainly running and peak or terminal rates) on simple and on some mixed-FI schedules and explores the idea that these rates are determined by the average delay of reinforcement for responses occurring during the response periods that the schedules generate. The effects of reinforcement delay are assumed to be mediated by a hyperbolic delay of reinforcement gradient. The account predicts that (a) running rates on simple FI schedules should increase with increasing rate of reinforcement, in a manner close to that required by Herrnstein's equation, (b) improving temporal control during acquisition should be associated with increasing running rates, (c) two-valued mixed-FI schedules with equiprobable components should produce complex results, with peak rates sometimes being higher on the longer component schedule, and (d) that effects of reinforcement probability on mixed-FI should affect the response rate at the time of the shorter component only. All these predictions were confirmed by data, although effects in some experiments remain outside the scope of the model. In general, delay of reinforcement as a determinant of response rate on FI and related schedules (rather than temporal control on such schedules) seems a useful starting point for a more thorough analysis of some neglected questions about performance on FI and related schedules.     

Dishabituation with component transitions may contribute to the interactions observed during multiple schedules

Rates of responding by rats were usually higher during the variable interval (VI) 30-s component of a multiple VI 30-s fixed interval (FI) 30-s schedule than during the same component of a multiple VI 30-s VI 30-s schedule (Experiment 1). Response rates were also usually higher during the FI 30-s component of a multiple VI 30-s FI 30-s schedule than during the same component of a multiple FI 30-s FI 30-s schedule (Experiment 2). The differences in response rates were not observed when the components provided VI or FI 120-s schedules. These results were predicted by the idea that differences in habituation to the reinforcer between multiple schedules contribute to behavioral interactions, such as behavioral contrast. However, differences in habituation were not apparent in the within-session patterns of responding. Finding differences in response rates in both experiments violates widely-held assumptions about behavioral interactions, including that behavioral contrast does not occur for rats and that improving the conditions of reinforcement decreases, rather than increases, response rate in the alternative component.     

Rapid timing of transitions in inter-reinforcement interval duration in infants

Infants trained on FI schedules are able to adjust their post-reinforcement pause, but many sessions at a given parameter value are necessary before the FI cumulative record appears stable. We analysed transitions from one FI value to another from our earlier experiments. Infants were exposed to FI schedules from 10 to 80 s. Under these schedules, they showed long post-reinforcement pauses with most intervals involving the emission of a single, reinforced response. The passage from one FI value to another was unpredictable for infants. We observed rapid timing effects during transitions (passage from one FI value to another, from FI 10 s to FI 20 s, etc.). Wait times increased during the first session of the new FI value, and accurate adjustments of wait times quickly appeared. Dynamic effects observed were similar to those obtained from animals in experiments on rapid-timing effects.     

Constraining response output on conjunctive fixed-ratio 1 fixed-time reinforcement schedules: Effects on the postreinforcement pause

Two experiments used response-restriction procedures in order to test the independence of the factors determining response rate and the factors determining the size of the postreinforcement pause on interval schedules. Responding was restricted by response-produced blackout or by retracting the lever. In Experiment 1 with a Conjunctive FR 1 FT schedule, the blackout procedure reduced the postreinforcement pause more than the lever-retraction procedure did, and both procedures produced shorter pauses than did the schedule without response restriction. In Experiment 2 the interreinforcement interval was also manipulated, and the size of the pause was an increasing function of the interreinforcement interval, but the rate of increase was lower than that produced by fixed interval schedules of comparable interval durations. The assumption of functional independence of the postreinforcement pause and terminal rate in fixed interval schedules is questioned since data suggest that pause reductions resulted from constraining variation in response number compared to equivalent periodic schedules in which response number was allowed to vary.     

Psychological distance to reward: equating the number of stimulus and response segments

Psychological distance to reward, or the segmentation effect, refers to the preference for a terminal link of a concurrent-chains schedule consisting of a simple reinforcement schedule (e.g. fixed interval [FI] 30s) relative to its chained-schedule counterpart (e.g. chained FI 15s FI 15s). This experiment was conducted to examine whether the segmentation effect is due to the number of terminal-link stimulus and response segments per se. Three pigeons pecked under a concurrent-chains schedule in which identical variable-interval (VI) schedules operated in the initial links. In each session, half the terminal-link entries followed one initial-link key and the other half followed the other initial-link key. The initial-link keys correlated with the different terminal links were manipulated across conditions. In the first three conditions, each terminal link contained a chained fixed-time (FT) FT schedule, and in the final three conditions, each terminal link contained a chained FI FI schedule. In each condition, in one terminal link (alternating), the order of two key colors correlated with the different schedule segments alternated across terminal-link entries, whereas in the other terminal link (constant), the order of two other key colors was identical for each entry. With the chained FT FT schedule terminal links, there was indifference between the alternating and constant terminal links within and across pigeons, as indexed by initial-link choice proportions. In addition, terminal-link response rates were relatively low. With the chained FI FI schedule terminal links, for each pigeon, there was relatively more preference for the alternating terminal link and terminal-link response rates increased relative to conditions with the chained FT FT schedule terminal links. These data suggest that the segmentation effect is not due simply to the number of terminal-link stimulus or response segments per se, but rather to a required period of responding during a stimulus segment that never is paired with reinforcement.     

Effects of unpredictable changes in initial-link duration on choice and timing

Four pigeons responded in a concurrent-chains procedure in which terminal-link schedules were fixed-interval (FI) 10 s and FI 20 s. Across sessions, the location of the shorter terminal-link changed according to a pseudorandom binary sequence. Each session, the variable-interval initial-link schedule value was sampled from a uniform distribution that ranged from 0.01 to 30 s. On some terminal links, food was withheld to obtain measures of temporal control. Terminal-link delays determined choice (log initial-link response ratios) and timing (start and stop times on no-food trials) measures, which stabilized within the 1st half of each session. Preference for the shorter terminal-link delay was a monotonically decreasing function of initial-link duration. There was no evidence of control by initial-link durations from previous sessions.     

Interval timing in Siamese fighting fish (Betta splendens)

The present study evaluated the temporal performance of Siamese fighting fish (Betta splendens) given short-term exposure to four fixed interval (FI) schedules of reinforcement, FI 30, 60, 120, and 240 s, during which a reinforcer (mirror image) was given for the first response (swimming through a hoop) after the interval requirement had elapsed. Response levels were generally low early in an interval and increased as the interval elapsed; wait times and break points in an interval increased with increases in the FI requirement. The results were similar to that obtained with other species and different types of responses and reinforcers, and demonstrate that the procedure is a feasible method for studying interval timing in fish.     

Investigations of timing during the schedule and reinforcement intervals with wheel-running reinforcement

Across two experiments, a peak procedure was used to assess the timing of the onset and offset of an opportunity to run as a reinforcer. The first experiment investigated the effect of reinforcer duration on temporal discrimination of the onset of the reinforcement interval. Three male Wistar rats were exposed to fixed-interval (FI) 30-s schedules of wheel-running reinforcement and the duration of the opportunity to run was varied across values of 15, 30, and 60s. Each session consisted of 50 reinforcers and 10 probe trials. Results showed that as reinforcer duration increased, the percentage of postreinforcement pauses longer than the 30-s schedule interval increased. On probe trials, peak response rates occurred near the time of reinforcer delivery and peak times varied with reinforcer duration. In a second experiment, seven female Long-Evans rats were exposed to FI 30-s schedules leading to 30-s opportunities to run. Timing of the onset and offset of the reinforcement period was assessed by probe trials during the schedule interval and during the reinforcement interval in separate conditions. The results provided evidence of timing of the onset, but not the offset of the wheel-running reinforcement period. Further research is required to assess if timing occurs during a wheel-running reinforcement period.     

Effects of unsignaled delays of reinforcement on fixed-interval schedule performance

Key pecking of pigeons was maintained by a fixed-interval (FI) 61-s schedule. The effects of resetting and nonresetting unsignaled delays of reinforcement then were examined. The resetting delay was programmed as a differential-reinforcement-of-other-behavior schedule, and the nonresetting delay as a fixed-time schedule. Three delay durations (0.5, 1 and 10 s) were examined. Overall response rates were decreased by one and 10-s delays and increased by 0.5-s delays. Response patterns changed from positively accelerated to more linear when resetting or nonresetting 10-s delays were imposed, but remained predominantly positively accelerated when resetting and nonresetting 0.5- and 1-s delays were in effect. In general, temporal control, as measured by quarter-life values, changed less than overall response rates when delays of reinforcement were in effect. The response patterns controlled by FI schedules are more resilient to the nominally disruptive effects of delays of reinforcement than are corresponding overall response rates.     

Learning to stop or reset the internal clock

In the present experiments, after training rats in a standard fixed interval (FI) 30 s schedule, we induced a change in the strategy employed during gap trials, by presenting during FI with gaps training, 9-s interruptions of the FI discriminative stimulus in 40% of the trials; in one type of interruption, after the discriminative stimulus resumed, the FI was re-started; in the second type of interruption, the FI had to be completed considering the time before the interruption. The effect of these manipulations was tested in a peak-interval with gaps procedure. The main result was that the strategy employed during gap trials depended on the type of interruption experienced during the training phase, both in a comparison between subjects (experiment 1) and within subjects (experiment 2).     

Effects of Acute or Chronic Ethanol Exposure during Adolescence on Behavioral Inhibition and Efficiency in a Modified Water Maze Task

Ethanol is well known to adversely affect frontal executive functioning, which continues to develop throughout adolescence and into young adulthood. This is also a developmental window in which ethanol is misused by a significant number of adolescents. We examined the effects of acute and chronic ethanol exposure during adolescence on behavioral inhibition and efficiency using a modified water maze task. During acquisition, rats were trained to find a stable visible platform onto which they could escape. During the test phase, the stable platform was converted to a visible floating platform (providing no escape) and a new hidden platform was added in the opposite quadrant. The hidden platform was the only means of escape during the test phase. In experiment 1, adolescent animals received ethanol (1.0g/kg) 30min before each session during the test phase. In experiment 2, adolescent animals received chronic intermittent ethanol (5.0g/kg) for 16 days (PND30 To PND46) prior to any training in the maze. At PND72, training was initiated in the same modified water maze task. Results from experiment 1 indicated that acute ethanol promoted behavioral disinhibition and inefficiency. Experiment 2 showed that chronic intermittent ethanol during adolescence appeared to have no lasting effect on behavioral disinhibition or new spatial learning during adulthood. However, chronic ethanol did promote behavioral inefficiency. In summary, results indicate that ethanol-induced promotion of perseverative behavior may contribute to the many adverse behavioral sequelae of alcohol intoxication in adolescents and young adults. Moreover, the long-term effect of adolescent chronic ethanol exposure on behavioral efficiency is similar to that observed after chronic exposure in humans.     

Sensitive Periods for Song Acquisition from Tape Recordings and Live Tutors in the Swamp Sparrow,Melospiza georgiana

Sensitive periods for song acquisition by male swamp sparrows in the first year of life were compared, using two types of training protocol: 1) training with tape-recorded songs and, 2) training by exposure to live singing tutors. Subjects were exposed to a range of tutors and tape recordings on regularly changing schedules. Singing was recorded, and the time of acquisition was determined by the occurrence of imitations of particular models. The results obtained with tape- and live-tutoring were very similar. In both cases most learning occurred prior to 45–55 days of age. Some song acquisition occurred as late as 250–300 days of age.     

Exposure to estradiol before but not during acquisition of LiCl-induced conditioned taste avoidance accelerates extinction

Estradiol accelerates extinction of LiCl-induced conditioned taste avoidance when it is present continuously before and during acquisition. We have suggested that the effect of estradiol on extinction is due to its illness-associated, rather than learning-associated, properties. If this were the case, then one would expect estradiol to act before but not during acquisition. This expectation is based on previous work showing attenuation of learned taste avoidance when rats are given distal preexposure (greater than 24 h before conditioning) or proximal preexposure (less than 24 h before conditioning) to the illness-inducing agent LiCl before acquisition of a LiCl-induced conditioned taste avoidance. In three separate experiments, estradiol was administered during three different time periods via subcutaneous implantation of a 10-mm estradiol-filled capsule. In each experiment, the extinction of estradiol-treated females was compared to that of females implanted with empty capsules. In the first experiment, female rats were given distal exposure to estradiol before acquisition. Capsules were implanted 11 days before acquisition and were removed 2 days before acquisition. In the second experiment, female rats were given proximal exposure to estradiol before acquisition. Capsules were implanted 2.5 h before LiCl was paired with a sucrose solution and were removed 16.5 h later. In the third experiment, female rats were given exposure to estradiol during acquisition. Capsules were implanted at the same time as LiCl administration and were removed 18 h later. The only estradiol-treated females to show accelerated extinction were those given distal preexposure to estradiol in Experiment 1. These data do not support a learning-associated hypothesis and only partially support an illness-associated hypothesis. The failure to find accelerated extinction following proximal preexposure may reflect an inappropriate choice of the parameters used in the experiment or a difference in the stimulus properties of LiCl and estradiol that allow each to serve as conditioning and preexposure agents in conditioned taste avoidance paradigms [corrected].     

Stimulus magnitude effects on the extinction of conditioned consummatory responses to flavored sucrose solution in mice

Paradoxical extinction effects in the conditioned consummatory behavior of rodents have remained largely elusive. Here, appetitive flavor conditioning was studied to determine if a paradoxical magnitude of reinforcement extinction effect (MREE) can occur in the consummatory behavior of mice. During acquisition training of two experiments with factorial design, animals received daily access to either 32% or 4% sucrose solution, and goal tracking time was measured in one-minute bins. In Experiment 1 the solutions were flavored with either 5% or 0.5% almond essence and in Experiment 2 with 2% almond essence, but combined with continuous or partial schedules of reinforcement. During extinction tests of Experiment 1 and 2, water flavored with 0.5% or 2% almond was presented, respectively. Consummatory performance decreased more abruptly during the initial portion of the extinction sessions after training with 32% as compared to 4% sucrose solution. Furthermore, when given a choice test after extinction training (Experiment 2), animals trained with 32% sucrose, preferred the flavored solution, but animals trained with 4% preferred the unflavored solution. These results are interpreted as indicative of the occurrence of a paradoxical MREE in conditioned consummatory behaviors.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.