Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

The effect of second-half reinforcer type on responding for sucrose in the first half of the session

The present study investigated whether the sucrose-reinforced lever pressing of rats in the first half of a 50-min session would be sensitive to upcoming food-pellet reinforcement in the second half. In Experiment 1, the type of reinforcer in the first half of the session was always liquid sucrose and type of reinforcer in the second half (liquid sucrose or food pellets) varied across conditions. Sucrose concentration varied across groups (1, 5, or 25%). Results showed that rates and patterns of responding for 1%, and sometimes for 5%, sucrose reinforcers in the first half of the session were higher and steeper, respectively, when food-pellet, rather than sucrose, reinforcement occurred in the second half. Responding for 25% sucrose was not similarly affected. Experiment 2 replicated the results of Experiment 1 using a within-subjects design. Although the present results represent induction (i.e. the opposite of contrast), they are consistent with some results on consummatory contrast. They also further demonstrate that responding on interval schedules of reinforcement can be altered prospectively. By doing so, however, they pose potential problems for current theories for why operant response rates change within the session.     

Validity and reliability of peak tibial accelerations as real-time measure of impact loading during over-ground rearfoot running at different speeds

Studies seeking to determine the effects of gait retraining through biofeedback on peak tibial acceleration (PTA) assume that this biometric trait is a valid measure of impact loading that is reliable both within and between sessions. However, reliability and validity data were lacking for axial and resultant PTAs along the speed range of over-ground endurance running. A wearable system was developed to continuously measure 3D tibial acceleration and to detect PTAs in real-time. Thirteen rearfoot runners ran at 2.55, 3.20 and 5.10 m·s⁻¹ over an instrumented runway in two sessions with re-attachment of the system. Intraclass correlation coefficients (ICCs) were used to determine within-session reliability. Repeatability was evaluated by paired T-tests and ICCs. Concerning validity, axial and resultant PTAs were correlated to the peak vertical impact loading rate (LR) of the ground reaction force. Additionally, speed should affect impact loading magnitude. Hence, magnitudes were compared across speeds by RM-ANOVA. Within a session, ICCs were over 0.90 and reasonable for clinical measurements. Between sessions, the magnitudes remained statistically similar with ICCs ranging from 0.50 to 0.59 for axial PTA and from 0.53 to 0.81 for resultant PTA. Peak accelerations of the lower leg segment correlated to LR with larger coefficients for axial PTA (r range: 0.64–0.84) than for the resultant PTA per speed condition. The magnitude of each impact measure increased with speed. These data suggest that PTAs registered per stand-alone system can be useful during level, over-ground, rearfoot running to evaluate impact loading in the time domain when force platforms are unavailable in studies with repeated measurements.     

Visual stimulus compounding with pigeons

Eight pigeons responded to successively presented color and line stimuli correlated with different likelihoods of reinforcement (100, 50 and 10%). An intertriai interval was included during training for half of the birds. In Experiment 1, tests with superimposed compounds resulted in variable responding, but overall, rates of responding were intermediate to the rates controlled by the individual component stimuli. In Experiments 2a and 2b, tests with compounds of spatially separated stimuli yielded rates of responding that were intermediate to, and in some cases lower than, responding controlled by the individual component stimuli. These results suggest limitations to the generality of additive models of stimulus compounding when visual stimulus combinations are employed.     

The sampling distribution of kappa

Research on Herrnstein's single-schedule equation contains conflicting findings; some laboratories report variations in the k parameter with reinforcer value, and others report constancy. The reported variation in k typically occurs across very low reinforcer values, and constancy applies across higher values. Here, simulations were conducted assuming a wide range of reinforcer values, and the parameters of Herrnstein's equation were estimated for simulated responding. In the simulations, responses controlled by current reinforcement contingencies were added to other responses ('noise'), controlled by the experimental environment and by contingencies in effect at other times. Expected reinforcer rates were calculated by entering simulated responding into a reinforcement feedback function. These were then fitted using Herrnstein's hyperbola, and the sampling distributions of the two fitted parameters were studied. Both k and Re were underestimated by curve fitting when low-deprivation or reinforcer-quality conditions were simulated. Further simulations showed that k and Re were increasingly underestimated as the assumed noise level was increased, particularly when low-deprivation or reinforcer quality was assumed. It is concluded that reported variations in k from single schedules should not be taken to indicate that the asymptotic rate of responding depends on reinforcement parameters.     

Companion's effects upon resistance to change

In order to investigate the effects of a companion's presence on resistance to change, five rats were trained under a multiple schedule comprised of components with high versus low rate of water reinforcement. After response rates became stable, water was given to the subjects prior to the experimental sessions, and these were conducted both in the absence and in the presence of a companion, which also could be responding or merely present. Results showed that the companion's presence increased resistance to satiation, mainly during the component with the higher reinforcement rate. These results suggest that the effect of the companion's presence may interact with reinforcement rate in determining response rate and resistance to satiation.     

Resistance to change varies inversely with reinforcement context

We report two experiments which test whether resistance to prefeeding and satiation for a variable-interval (VI) schedule that delivers a constant rate of reinforcement varies inversely with the reinforcement rate for an alternative schedule. In Experiment 1, eight pigeons responded in a multiple schedule in which the red key was always associated with a VI 90-s schedule and the green key with either a richer (VI 18s) or leaner (VI 540s) schedule in different conditions. After baseline training in each condition, prefeeding test sessions were conducted in which 10g, 20g, 30g, 40g, and 50g food were provided one-hour prior to test. Additional baseline training was given between each test session. In Experiment 2, two groups of pigeons responded in a multiple schedule similar to Experiment 1. After baseline training, pigeons were exposed to a 5-h satiation test session in which the VI 90-s schedule was available continuously. Test sessions were conducted when pigeons were maintained at 85%, 95%, and 85% of their body weights in an ABA design. Results of both experiments showed that responding in the VI 90-s schedule that alternated with a leaner schedule during baseline was more resistant to prefeeding and satiation. These data rule out alternative explanations for results of previous studies, and confirm that resistance to change varies inversely with reinforcement context.     

Resistance to change as a function of concurrent reinforcer magnitude

Six pigeons responded on two keys in each of three signalled multiple-schedule components, and resistance to disruption of responding on one (target) key by extinction and by response-independent food presented during inter-component blackouts was studied. Alternative reinforcement of different magnitudes was contingent on pecking a non-target key in two components, and in the third only the target response was reinforced. Resistance to change varied with the overall quantity of reinforcement in the component, regardless of whether reinforcers were contingent on the target or non-target response, but did not differ across the two key locations. These results using different magnitudes of reinforcement confirm previous findings using rate of reinforcement as the variable, and suggest that resistance to change is dependent on stimulus-reinforcer rather than response-reinforcer contingencies.     

Prolonged microwave irradiation of rats: Effects on concurrent operant behavior

Two measures of performance were used to study the effects of pulse-modulated microwave radiation (PM MWR) on schedule-controlled operant behavior of rats: 1) cued (S^D), fixed-ratio (FR) bar pressing for food reinforcement; and 2) noncued (S^d) bar pressing in the absence of food reinforcement. The animals were irradiated and the behavioral data were obtained concurrently, during daily three-hour sessions, five days per week for six to nine weeks. Each experiment began with a two to three-week baseline interval of sham irradiation; a two to three-week interval of sham irradiation followed the irradiation phase. The irradiated animals were exposed to 1.3-Ghz PM MWR (pulse width of 1 microsecond at 600 pulses per second) at whole-body, average specific absorbed-dose rates of from 1.5–6.7 mW/g. Control and irradiated animals were tested in identical, cylindrical waveguide exposure/behavioral assemblies; different groups of irradiated and sham-irradiated animals were used for each dose rate. At 1.5 mW/g, the levels of S^D operant responding by control and irradiated animals were comparable, and showed similar progressive diminutions over the course of each daily session. S^d operant responding was more variable, but again comparable, with both groups showing similar, progressive declines in rate of responding during each session. At 3.6 mW/g, no specific effects on S^D operant response rates were observed. However, there was an initial and transient increase in the rate of extinction of S^d responding. At 6.7 mW/g, S^D response rates were slightly reduced, whereas there was a major reduction in noncued (S^d) operant responding followed by a sharp rebound during the first post-MWR week. This marked reduction in S^d operant responding at MWR onset was in contrast to the relative stability and persistence of FR responding for food reinforcement.     

Reward magnitude and timing in pigeons

We investigated the interaction of motivation and timing by manipulating the expected reward magnitude during a peak procedure. Four pigeons were tested with three different reward magnitudes, operationalized as duration of food access. Each stimulus predicted a different reward magnitude on a 5 s fixed-interval schedule. Trials with different reward magnitudes were randomly intermingled in a session. Most pigeons responded less often and started responding later on peak trials when a smaller reward was expected, but showed no differences in response termination or peak times. Reward magnitude was independently corroborated through unreinforced choice trials, when pigeons chose between the three stimuli presented simultaneously. These results contribute to a growing body of evidence that the expected reward magnitude influences the decision to start anticipatory responding in tasks where the reward becomes available after a fixed interval, but does not alter peak times, nor the decision to stop responding on peak trials.     

Reinforcement omission in concurrent fixed-interval and random-interval schedules

The present experiment examined overall and local effects of omission of reinforcers in a choice situation. Pigeons' key-pecking responses were reinforced under concurrent fixed-interval and random-interval schedules of food presentation. After some weeks of baseline sessions in which the probability of reinforcement was 1.00, approximately 25% of food presentations from the fixed-interval schedule were omitted and replaced by timeout periods. In such omission sessions, the overall relative rates of responding to the fixed-interval schedule became lower than those in the baseline sessions. On the other hand, when relative rates of responding to the fixed-interval schedule in the omission sessions were calculated separately for fixed-interval cycles preceded by timeout periods and those preceded by food presentations, the relative rates in the former type of fixed-interval cycles were higher than those in the latter type for three out of four pigeons. These results mean that relative rates of responding cannot always be regarded as reflecting a relative value of an alternative, and that the overall effect of the omission of fixed-interval reinforcers is not reducible to the local effect of omission.     

Operant behavior in dwarf hamsters (Phodopus campbelli): Effects of rate of reinforcement and reinforcer flavor variety

We investigated operant behavior in a novel species, the dwarf hamster (Phodopus campbelli). In two experiments, hamsters were trained to lever-press for food reinforcement. In Experiment 1, rate of reinforcement was manipulated across conditions using four variable-interval schedules of reinforcement (delivering one to eight reinforcers per min). As predicted, within-session decreases in responding were steepest on the richest schedule. In Experiment 2, lever-pressing was reinforced by either a constant or a variety of flavored food pellets. Within-session decreases in responding were steeper when the reinforcer flavor remained constant than when it was varied within the session. In both experiments, subjects hoarded most reinforcers in their cheek pouches rather than consuming them in the operant chambers. These results are incompatible with post-ingestive satiety variables as explanations for within-session decreases in operant responding and suggest that habituation to repeatedly presented reinforcers best accounts for subjects’ response patterns. Additionally, a mathematical model that describes behavior undergoing habituation also described the present results, thus strengthening the conclusion that habituation mediates the reinforcing efficacy of food.     

Fewer peak trials per session facilitate acquisition of peak responding despite elimination of response rate differences

It has been shown in previous research [Kaiser, D.H., 2008. The proportion of fixed interval trials to probe trials affects acquisition of the peak procedure fixed interval timing task. Behav. Process., 77 (1), 100-108] that rats acquired peak responding sooner when fewer peak trials were presented during sessions of training with the peak procedure timing task. One potential problem with that research was that there were large differences in response rates among the groups. The present experiment attempted to examine the effect of proportion of peak trials when differences in response rate were controlled. Two groups of rats were each simultaneously tested with two versions of the peak procedure. One group was tested with 10% peak trials per session, and the other group was tested with 50% peak trials per session. For both of the groups, one of the panel lights and levers was associated with the traditional peak procedure. The other panel light and lever was associated with a similar peak procedure; however, reinforcement was provided at the end of each peak trial. This manipulation eliminated differences in response rate among the groups, however, Group 10% acquired peak responding more quickly than Group 50%, effectively replicating previous work in the absence of a response bias.     

Comparative effects of pulsed and continuous-wave 2.8-GHz microwaves on temporally defined behavior

The effects of pulsed-(PW) and continuous-wave (CW) 2.8-GHz microwaves were compared on the performance of rodents maintained by a temporally defined schedule of positive reinforcement. The schedule involved food-pellet reinforcement of behavior according to a differential-reinforcement-of-low-rate (DRL) contingency. The rats were independently exposed to PW and to CW fields at power densities ranging from 1 to 15 mW/cm². Alterations of normal performance were more pronounced after a 30-minute exposure to the PW field than to the CW field. The rate of emission of appropriately timed responses declined after exposure to PW at 10 and 15 mW/cm², whereas exposure at the same power levels to the CW field did not consistently affect the rate of responding. Change in performance associated with microwave exposure was not necessarily related to a general decline in responding: in some instances, increases in overall rates of responding were observed.     

Superstitious responding and reinforcement rate under concurrent variable-interval extinction schedules

To examine superstitious responding, four pigeons key pecked under multiple concurrent variable-interval 45 s variable-interval 90 s concurrent variable-interval 90 s variable-interval 180 s schedules in the absence of a changeover delay. The two variable-interval 90 s schedules then were replaced by extinction, and key-peck responding during extinction was examined as a function of the prevailing reinforcement rate. During the first several sessions, extinction-key responding was maintained closer to baseline levels in the presence of the higher reinforcement rate, and this effect dissipated or even reversed with continued exposure to extinction. Although extinction-key responding generally decreased to near-zero levels after several sessions, in a few instances, it continued for 30 and 45 sessions. These results demonstrate how concurrent variable-interval extinction schedules can be used to investigate what often has been labeled superstitious responding.     

Inhibition of Histone Deacetylases Facilitates Extinction and Attenuates Reinstatement of Nicotine Self-Administration in Rats

Chromatin remodelling is integral to the formation of long-term memories. Recent evidence suggests that histone modification may play a role in the persistence of memories associated with drug use. The present series of experiments aimed to examine the effect of histone deacetylase (HDAC) inhibition on the extinction and reinstatement of nicotine self-administration. Rats were trained to intravenously self-administer nicotine for 12 days on a fixed-ratio 1 schedule. In Experiment 1, responding was then extinguished through removal of nicotine and response-contingent cues. After each extinction session, the HDAC inhibitor, sodium butyrate (NaB), was administered immediately, or six hours after each session. In Experiment 2, response-contingent cues remained available across extinction to increase rates of responding during this phase, and NaB was administered immediately after the session. Finally, in Experiment 3, the effect of NaB treatment on extinction of responding for sucrose pellets was assessed. Across all experiments reinstatement to the cue and/or the reward itself was then tested. In the first experiment, treatment with NaB significantly attenuated nicotine and nicotine + cue reinstatement when administered immediately, but not six hours after each extinction session. When administered after cue-extinction (Expt. 2), NaB treatment specifically facilitated the rate of extinction across sessions, indicating that HDAC inhibition enhanced consolidation of the extinction memory. In contrast, there was no effect of NaB on the extinction and reinstatement of sucrose-seeking (Expt. 3), indicating that the observed effects are specific to a drug context. These results provide the first demonstration that HDAC inhibition facilitates the extinction of responding for an intravenously self-administered drug of abuse and further highlight the potential of HDAC inhibitors in the treatment of drug addiction.     

Haloperidol, dynamics of choice, and the parameters of the matching law

The idea that dopamine mediates the reinforcing effects of stimuli persists in the field of neurosciences. The present study shows that haloperidol, a dopamine antagonist, does not eliminate the reinforcing value of food reinforcers. The ratio of reinforcers changed seven times across two levers within sessions, modeling a dynamic environment. The magnitude of the reinforcer was manipulated independently of the reinforcer ratio. Four doses of intraperitoneal haloperidol were assessed over periods of 12 daily sessions. Haloperidol did not impair the discrimination that the rats established between rich and lean levers; the response distributions favored the lever associated with the higher probability of reinforcement and the larger pellets. The parameters of the generalized matching law (bias and sensitivity) were used to estimate effects of haloperidol upon the motor system and upon the rats' motivation for food reinforcers.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

The “lunching” effect: Pigeons track motion towards food more than motion away from it

Four experiments measured pigeons’ pecking at a small touch-screen image (the CS) that moved towards or away from a source of food (the US). The image's effectiveness as a CS was dependent on its motion, direction, and distance relative to the US. Pecking to the CS increased with proximity to the US when the CS moved towards the US (Experiment 1). This held true even when a departing CS signalled a US of greater magnitude (Experiment 2). Response rates to stationary stimuli were greater the closer they were to the hopper; but rate was less than when the same spot was part of a motion towards food, and greater than when it was part of a motion away (Experiment 3). The rate of responding in all three cases (motion towards, stationary, motion away) decreased exponentially with distance from the hopper. The distance and motion effects observed under these Pavlovian contingencies were different when pecking to the spot was required for reinforcement (Experiment 4).