Resistance to change varies inversely with reinforcement context

We report two experiments which test whether resistance to prefeeding and satiation for a variable-interval (VI) schedule that delivers a constant rate of reinforcement varies inversely with the reinforcement rate for an alternative schedule. In Experiment 1, eight pigeons responded in a multiple schedule in which the red key was always associated with a VI 90-s schedule and the green key with either a richer (VI 18s) or leaner (VI 540s) schedule in different conditions. After baseline training in each condition, prefeeding test sessions were conducted in which 10g, 20g, 30g, 40g, and 50g food were provided one-hour prior to test. Additional baseline training was given between each test session. In Experiment 2, two groups of pigeons responded in a multiple schedule similar to Experiment 1. After baseline training, pigeons were exposed to a 5-h satiation test session in which the VI 90-s schedule was available continuously. Test sessions were conducted when pigeons were maintained at 85%, 95%, and 85% of their body weights in an ABA design. Results of both experiments showed that responding in the VI 90-s schedule that alternated with a leaner schedule during baseline was more resistant to prefeeding and satiation. These data rule out alternative explanations for results of previous studies, and confirm that resistance to change varies inversely with reinforcement context.     

Dishabituation with component transitions may contribute to the interactions observed during multiple schedules

Rates of responding by rats were usually higher during the variable interval (VI) 30-s component of a multiple VI 30-s fixed interval (FI) 30-s schedule than during the same component of a multiple VI 30-s VI 30-s schedule (Experiment 1). Response rates were also usually higher during the FI 30-s component of a multiple VI 30-s FI 30-s schedule than during the same component of a multiple FI 30-s FI 30-s schedule (Experiment 2). The differences in response rates were not observed when the components provided VI or FI 120-s schedules. These results were predicted by the idea that differences in habituation to the reinforcer between multiple schedules contribute to behavioral interactions, such as behavioral contrast. However, differences in habituation were not apparent in the within-session patterns of responding. Finding differences in response rates in both experiments violates widely-held assumptions about behavioral interactions, including that behavioral contrast does not occur for rats and that improving the conditions of reinforcement decreases, rather than increases, response rate in the alternative component.     

Effects of antianxiety and antipsychotic drugs on DRL responding for brain stimulation

Satiated rats could be trained to give stable rates of responding for rewarding stimulation of the lateral hypothalamus delivered on differential reinforcement of low rate (DRL) schedule requiring 2 to 8 sec interresponse intervals for reinforcement (DRL-2 to 8). The performance on a DRL-8 schedule was tested 30 min after the oral administration of benzodiazepines. Diazepam (5 and 10 mg/kg) and meprobamate (200 mg/kg) caused significant increases in response rates during the first 5 min of a session, but not thereafter. Bromazepam (1 and 5 mg/kg) also caused a significant increase in the rates during the first and second 5 min. On the other hand, chlorpromazine (20 mg/kg) caused no effect in the first 5 min but decrease in second and third 5 min. These results indicate that DRL schedules with a brain stimulation reward provided a useful tool for evaluation of antianxiety drugs. The advantage of the brain stimulation reward over food reward is that the possible effects of the drugs on hunger motivation need not be considered.     

Upcoming food-pellet reinforcement alters rats' lever pressing for liquid sucrose delivered by a progressive-ratio schedule

The present study investigated whether rats' responding for liquid-sucrose reinforcement delivered by a progressive-ratio (PR) schedule would be altered by the addition of food-pellet reinforcement available subsequent to the PR schedule. In Experiment 1, six rats lever pressed for 1% sucrose reinforcers delivered by a PR 3 schedule. In Experiment 2, six rats lever pressed for 5% sucrose delivered by a PR 5 schedule. In both experiments, baseline sessions consisted of 40min of exposure to the PR schedule. In the first treatment condition, a 25-min period of food-pellet reinforcement, delivered by a random-interval 60-s schedule, immediately followed the initial 40min. In the second treatment condition, the 25-min period of food-pellet reinforcement became available when 10min elapsed without the subject completing a ratio on the PR schedule. Results from both experiments showed that upcoming food-pellet reinforcement increased the number of ratios subjects completed on the PR schedule. Portions of the present results represent a partial replication of results reported by Baron and Derenne [J. Exp. Anal. Behav. 73 (2000) 291], who used a similar procedure. They also augment a growing body of research on positive induction.     

Low-intensity magnetic fields alter operant behavior in rats

The present study demonstrates that operant behavior is affected by a combination of a 60-Hz magnetic field and a magnetostatic field 2.6 X 10(-5) T (about half the geomagnetic field). Rats exposed to this combination for 30 min consistently exhibited changes in the rate and pattern of responding during the differential reinforcement of low rate (DRL) component of a multiple fixed ratio (FR) DRL reinforcement schedule. By contrast, there were no measurable changes following exposure to the static field alone or to the oscillating field alone, even with a 10-fold increase in intensity (5 X 10(-5) to 5 X 10(-4) Trms). A cyclotron resonance mechanism has been suggested as a possible explanation for the observation that weak static magnetic fields modify the response of in vitro brain tissue to low-frequency magnetic fields. The choice of static field intensity Bo and frequency nu in the present study follows from the cyclotron resonance condition nu = (1/2 pi)(q/m)Bo, for singly charged lithium, an element in extensive use in the clinical treatment of affective disorders in humans. The present research is consistent with a cellular cyclotron resonance mechanism and tends to imply a functional dependence of behavior on the geomagnetic field.     

Operant performance following tail-pinch in the rat: effects of d-amphetamine

To extend the investigation of tail-pinch induced behavioral changes, rats performing on a differential reinforcement of low rates of 10 sec (DRL10), a fixed-interval of 60 sec (F160), and a fixed-ratio of 20 (FR20) schedules were exposed to a paper clip applied to the tail. While a 10 min tail-pinch conducted 1 hr before operant sessions significantly altered the DRL10 behavior, this stressor had little effect on either F160 or FR20 responding. Marked DRL10 behavior performance changes following tail-pinch included increases in the number of lever presses, decreases in the number of the reinforcers, and disruption in the frequency distribution of inter-response times (IRT). These DRL10 operant deficits were diminished when the subject received a tail-pinch pretreatment followed by d-amphetamine treatment (0.2 and 2.0 mg/kg). In combination with biochemical data from others, the present results suggest that catecholamine systems are involved in modulation of DRL10 behavior following tail-pinch.     

Second-order schedules of drug injection.

Key-press responding of squirrel monkeys produced intravenous injections of cocaine under two simple types of schedule. Under a fixed ratio schedule, every 30th response produced an injection; steady responding at high rates of over one per second were maintained during each fixed-ratio component. Under a fixed-interval schedule, the first response occurring after a fixed time of 5 min produced an injection; there was a pause at the start of each interval and then progressively increasing responding until cocaine was injected at the end of the interval. Both squirrel monkeys and rhesus monkeys also were studied under second-order schedules of drug injection. Under one type of second-order schedule, studies only in squirrel monkeys, completion of each fixed-interval component produced only a 2 sec light; completion of the 10th fixed-interval component produced the brief light and an intravenous injection of cocaine. Under a second type of second-order schedule, each fixed-ratio component completed during a fixed time interval (5 or 60 min) produced only a 2-sec light; the first fixed-ratio component completed after the interval of time elapsed produced the brief light and an intravenous (squirrel monkeys) or intramuscular (rhesus monkeys) injection of cocaine. Under both types of second-order schedules, repeated sequences of responding were maintained during each session and characteristic fixed-interval or fixed-ratio patterns of responding were controlled by the brief visual stimuli.     

Comparative effects of pulsed and continuous-wave 2.8-GHz microwaves on temporally defined behavior

The effects of pulsed-(PW) and continuous-wave (CW) 2.8-GHz microwaves were compared on the performance of rodents maintained by a temporally defined schedule of positive reinforcement. The schedule involved food-pellet reinforcement of behavior according to a differential-reinforcement-of-low-rate (DRL) contingency. The rats were independently exposed to PW and to CW fields at power densities ranging from 1 to 15 mW/cm². Alterations of normal performance were more pronounced after a 30-minute exposure to the PW field than to the CW field. The rate of emission of appropriately timed responses declined after exposure to PW at 10 and 15 mW/cm², whereas exposure at the same power levels to the CW field did not consistently affect the rate of responding. Change in performance associated with microwave exposure was not necessarily related to a general decline in responding: in some instances, increases in overall rates of responding were observed.     

Effect of contingent auditory stimuli on concurrent schedule performance: an alternative punisher to electric shock

This study explored whether load auditory stimuli could be used as functional punishing stimuli in place of electric shock. Three experiments examined the effect of a loud auditory stimulus on rats’ responding maintained by a concurrent reinforcement schedule. In Experiment 1, overall response rate decreased when a concurrent 1.5 s tone presentation schedule was superimposed on the concurrent variable interval (VI) 180-s, VI 180-s reinforcement schedule. On the contrary, response rate increased when a click presentation schedule was added. In Experiment 2, the extent of the response suppression with a 1.5 s tone presentation varied as a function of the frequency of the reinforcement schedule maintaining responses; the leaner the schedule employed, the greater the response suppression. In Experiment 3, response suppression was observed to be inversely related to the duration of the tone; response facilitation was observed when a 3.0-s tone was used. In Experiments 1 and 2, a preference shift towards the alternative with richer reinforcement was observed when the tone schedule was added. In contrast, the preference shifted towards the leaner alternative when the click or longer duration stimulus was used. These results imply that both the type and duration of a loud auditory stimulus, as well as the reinforcement schedule maintaining responses, have a critical role in determining the effect of the stimuli on responding. They also suggest that a loud auditory stimulus can be used as a positive punisher in a choice situation for rats, when the duration of the tone is brief, and the reinforcement schedule maintaining responses is lean.     

Dopamine receptor antagonists reverse amphetamine-induced behavioral alteration on a differential reinforcement for low-rate (DRL) operant task in the rat

Previous studies have shown that amphetamine significantly alters operant responding on the behavior maintained on a schedule of differential reinforcement of low-rate (DRL). As such, behavioral deficiency of DRL responding has been observed by the drug-induced increase of non-reinforced responses and a leftward shift of inter-response time (IRT) curve on DRL responding in the rat. However, the neurochemical basis for amphetamine-induced DRL behavioral alternations remain to be elucidated. The present study was then designed to examine whether the effects of amphetamine were dependent on dopamine-subtyped receptors, this was carried out by the co-administration of the selective D1 and D2 receptor antagonists, SCH23390 and raclopride respectively. Rats were first trained to perform on DRL 10-sec task and then divided into four groups, which received separate types of double injections before the behavioral session. The four groups were the saline control group, the amphetamine alone group, the dopamine antagonist alone group, and the combination of [corrected] amphetamine and dopamine antagonist group. The saline control group performed DRL responding in an efficient manner with a major index for the peak time of the IRT curve, which was fairly localized within the 10-sec bin throughout the test phase. The subjects injected with amphetamine (1 mg/kg) significantly shortened IRT that led to a leftward shift of IRT curve, which was further revealed by a decreased peak time without significant effectiveness on the peak rate and burst response. Even though the group given SCH23390 or raclopride alone showed profound disruption on DRL behavior by flattening the IRT curve, the co-administration of amphetamine with SCH23390 or raclopride reversed the aforementioned amphetamine-induced behavioral deficiency on DRL task. Together, these results suggest that the dopamine D1 and D2 receptors are involved and important to the temporal regulation of DRL response under psychostimulant drug treatment. Furthermore, this highlights the involvement of the brain dopamine systems in the temporal regulation of DRL behavior performance.     

Effects of breaks in the interval cycle on temporal tracking in pigeons

Two experiments examined the effects of inserting a break in a cyclic interval schedule on the temporal control of keypecking responses in pigeons. In Experiment 1, pigeons were exposed to intervals that changed from 45 to 15s and returned to 45 s. A break was inserted between the last 15-s and following 45-s interval and was in effect for either 0, 60, or 120 s. Either a blackout of lights in the test chamber or turning off the response key alone signaled breaks. In Experiment 2, we examined the effects of a wider range of breaks-0, 120, and 360 s. Post-reinforcement pause (PRP) tracked changes in the interval requirement across all conditions. However, breaks in the schedule, even one lasting 360 s, did not disrupt the overall time course of responding. The only effect that a break had on temporal performance was an elevation in the rate of responding and a shorter PRP in the interval following a break. The results suggest that breaks did not affect the birds' memory for short intervals, and that the momentary increase in responding may be related to the reinforcement omission effect.     

Interval time-place learning by rats: varying reinforcement contingencies

Two experiments with rats were conducted to study interval time-place learning when the spatiotemporal contingencies of food availability were more similar to those likely to be encountered in natural environments, than those employed in prior research. In Experiment 1, food was always available on three levers on a variable ratio (VR) 35 schedule. A VR8 schedule was in effect on Lever 1 for 5 min, then on Lever 2 for 5 min, and so forth. While rats learned to restrict the majority of their responding to the lever that provided the highest density of reinforcement, they seemed to rely on a win-stay/lose-shift strategy rather than a timing strategy. In Experiment 2, the four levers provided food on variable ratios of 15, 8, 15, and 30, each for 3 min. As expected the rats learned these contingencies. A novel finding was that the rats had a spike in response rate immediately following a change from a higher to lower reinforcement density. It is concluded that rats exposed to spatiotemporal contingencies behave so as to maximize the rate of obtained reinforcement.     

Reinforcement omission in concurrent fixed-interval and random-interval schedules

The present experiment examined overall and local effects of omission of reinforcers in a choice situation. Pigeons' key-pecking responses were reinforced under concurrent fixed-interval and random-interval schedules of food presentation. After some weeks of baseline sessions in which the probability of reinforcement was 1.00, approximately 25% of food presentations from the fixed-interval schedule were omitted and replaced by timeout periods. In such omission sessions, the overall relative rates of responding to the fixed-interval schedule became lower than those in the baseline sessions. On the other hand, when relative rates of responding to the fixed-interval schedule in the omission sessions were calculated separately for fixed-interval cycles preceded by timeout periods and those preceded by food presentations, the relative rates in the former type of fixed-interval cycles were higher than those in the latter type for three out of four pigeons. These results mean that relative rates of responding cannot always be regarded as reflecting a relative value of an alternative, and that the overall effect of the omission of fixed-interval reinforcers is not reducible to the local effect of omission.     

Differential resurgence and response elimination

Resurgence refers to the transient recovery of previously reinforced, but presently not reinforced, responding when more recently reinforced responding is extinguished. The primary purpose of our research was to determine how differential resurgence results from the procedures used to eliminate that responding. There were three conditions in each of five experiments. In Condition 1, key pecking by pigeons was maintained under a two-component multiple variable-interval (VI) 30-s VI 30-s schedule. In Condition 2, this pecking was eliminated in different ways across components. In Condition 3, extinction was in effect for all responses, and resurgence of key pecking was compared across components. These three conditions were repeated for most pigeons, and the procedures used to eliminate responding in Condition 2 varied across experiments. In Experiment 1, there was greater resurgence, and an earlier onset of it, after a differential-reinforcement-of-other-behavior (DRO) schedule than after a VI schedule was correlated with pecking an alternative key. Experiments 2 and 3 showed that the differential resurgence in Experiment 1 probably was not due to conditional stimulus control or the periodicity of food delivery, respectively. In Experiment 4, there was no systematic difference in resurgence after either a DRO schedule or a VI schedule correlated with treadle pressing. In Experiment 5, there was greater resurgence, and/or an earlier onset of it, after a VI schedule correlated with treadle pressing than after a VI schedule correlated with pecking an alternative key. Taken together, the results showed that the reinforcement of an alternative key-peck response was the most effective means of reducing subsequent key-peck resurgence. The relation of these results to an understanding of resurgence is discussed.     

Constraining response output on conjunctive fixed-ratio 1 fixed-time reinforcement schedules: Effects on the postreinforcement pause

Two experiments used response-restriction procedures in order to test the independence of the factors determining response rate and the factors determining the size of the postreinforcement pause on interval schedules. Responding was restricted by response-produced blackout or by retracting the lever. In Experiment 1 with a Conjunctive FR 1 FT schedule, the blackout procedure reduced the postreinforcement pause more than the lever-retraction procedure did, and both procedures produced shorter pauses than did the schedule without response restriction. In Experiment 2 the interreinforcement interval was also manipulated, and the size of the pause was an increasing function of the interreinforcement interval, but the rate of increase was lower than that produced by fixed interval schedules of comparable interval durations. The assumption of functional independence of the postreinforcement pause and terminal rate in fixed interval schedules is questioned since data suggest that pause reductions resulted from constraining variation in response number compared to equivalent periodic schedules in which response number was allowed to vary.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

Is extinction the hallmark of operant discrimination?: Reinforcement and S effects

Using a successive discrimination procedure with rats, three experiments investigated the contribution of reinforcement rate and amount of S(Delta) exposure on the acquisition of an operant discrimination. S(D) components and were always 2 min in length, while S(Delta) (extinction) components were either 1 min or 4 min in length; responses in S(D) were reinforced on one of four schedules. In Experiment 1, each of eight groups were exposed to one possible combination of rate of reinforcement and S(Delta) component length. At every level of reinforcement, the 4 min S(Delta) groups acquired the discrimination more quickly. However, within each level of reinforcement, the proportions of responding in S(D) as a function cumulative S(Delta) exposure were equivalent, regardless of the number of reinforcers earned in S(D), suggesting that extinction is the "hallmark" of discrimination. Experiment 2 sought to replicate these results in a within-subjects design, and although the 4 min S(Delta) conditions always produced superior discriminations, the lack of discriminated responding in some conditions suggested that stimulus disparity was reduced. Experiment 3 clarified those results and extended the finding that the acquisition of operant discrimination closely parallels extinction of responding in S(Delta). In sum, it appears that higher reinforcement rates and longer S(Delta) exposure facilitate the acquisition of discriminated operant responding.     

Resistance to extinction, generalization decrement, and conditioned reinforcement

This study investigated generalization decrement during an extinction resistance-to-change test for pigeon key pecking using a two-component multiple schedule with equal variable-interval 3-min schedules and different reinforcer amounts (one component presented 2-s access to reinforcement and the other 8s). After establishing baseline responding, subjects were assigned to one of the two extinction conditions: hopper stimuli (hopper and hopper light were activated but no food was available) or Control (inactive hopper and hopper light). Responding in the 8-s component was more resistant to extinction than responding in the 2-s component, the hopper stimuli group was more resistant to extinction compared to the Control group, and an interaction between amount of reinforcement, extinction condition, and session block was present. This finding supports generalization decrement as a factor that influences resistance to extinction. Hopper-time data (the amount of time subjects spent with their heads in the hopper) were compared to resistance-to-change data in an investigation of the role of conditioned reinforcement on resistance to change.     

Properties of behavior under different random ratio and random interval schedules: A parametric study

Four pigeons were trained to peck a key under different values of a temporally defined independent variable (T) and different probabilities of reinforcement (p). Parameter T is a fixed repeating time cycle and p the probability of reinforcement for the first response of each cycle T. Two dependent variables were used: mean response rate and mean postreinforcement pause. For all values of p a critical value for the independent variable T was found (T=1 sec) in which marked changes took place in response rate and postreinforcement pauses. Behavior typical of random ratio schedules was obtained at T

1 sec and behavior typical of random interval schedules at T

1 sec.     

Effects of partial reinforcement and time between reinforced trials on terminal response rate in pigeon autoshaping

Partial reinforcement often leads to asymptotically higher rates of responding and number of trials with a response than does continuous reinforcement in pigeon autoshaping. However, comparisons typically involve a partial reinforcement schedule that differs from the continuous reinforcement schedule in both time between reinforced trials and probability of reinforcement. Two experiments examined the relative contributions of these two manipulations to asymptotic response rate. Results suggest that the greater responding previously seen with partial reinforcement is primarily due to differential probability of reinforcement and not differential time between reinforced trials. Further, once established, differences in responding are resistant to a change in stimulus and contingency. Secondary response theories of autoshaped responding (theories that posit additional response-augmenting or response-attenuating mechanisms specific to partial or continuous reinforcement) cannot fully accommodate the current body of data. It is suggested that researchers who study pigeon autoshaping train animals on a common task prior to training them under different conditions.