The role of place of reinforcer delivery in the appearance of positive induction when rats respond for 1% sucrose

Rats increase their rate of operant responding for 1% sucrose reinforcement in the first half of an experimental session if a high-valued reinforcer will be available in the second half. Previous research suggests that this induction effect occurs because the reinforcing value of the low-valued substance has increased. The present study investigated whether this increase may occur because of where the substances are delivered. Rats pressed a lever to earn 1% liquid-sucrose reinforcers in the first half of the session. In control conditions, they also pressed for 1% sucrose in the second half. In treatment conditions, they pressed for food-pellet (Experiment 1) or 32% sucrose (Experiment 2) reinforcers in the second half, with these reinforcers either being delivered to the same location as the 1% sucrose or to a different location. Upcoming food-pellet or 32% sucrose reinforcement increased rates of lever pressing for 1% sucrose in the first half of the session, with the largest increase observed when the high-valued reinforcer was delivered to the same location as the 1% sucrose. Qualitatively similar results were found with rates of consumption of 1% sucrose reinforcers in the first half of the session, which were measured in Experiment 2. The location to which reinforcers are delivered appears to be one of the factors that contributes to this induction effect. The present results may therefore identify one of the factors that determine whether differential conditions of reinforcement will lead to contrast or induction.     

Three tests of 'anticipatory responding' as an account for induction produced by upcoming food-pellet reinforcement

Previous research has demonstrated that rats' rates of lever pressing for low-concentration liquid-sucrose reinforcers are increased when food-pellet, rather than sucrose, reinforcement will be upcoming in the same session (i.e. induction). The present experiments were designed to determine whether this induction was the product of 'anticipatory responses' for the upcoming food pellets being added to the responses being made for the currently available sucrose reinforcement. Experiment 1 tested this idea by summing sucrose-reinforced responding and 'anticipatory responding' from different conditions and comparing the sum to responding from a third condition in which subjects responded for sucrose when food-pellet reinforcement was upcoming. The comparison yielded similar response rates. Experiment 2 employed a blackout, of different durations in different conditions, to delay the upcoming food-pellet reinforcement. Consistent with the anticipatory-responding account, the delay decreased the size of the induction. However, results from the blackouts were not entirely consistent with the anticipatory-responding explanation. Experiment 3 provided, in some conditions, sucrose and food-pellet reinforcement in the first and second halves of the session, respectively, for responding on separate levers. These conditions separated 'anticipatory responses' for the food pellets from responses for the sucrose reinforcers. However, induction in responding for sucrose was still present. Together, these experiments demonstrate that, although anticipatory responses may contribute to induction in some instances, they are not solely responsible for the effect.     

The effect of second-half reinforcer type on responding for sucrose in the first half of the session

The present study investigated whether the sucrose-reinforced lever pressing of rats in the first half of a 50-min session would be sensitive to upcoming food-pellet reinforcement in the second half. In Experiment 1, the type of reinforcer in the first half of the session was always liquid sucrose and type of reinforcer in the second half (liquid sucrose or food pellets) varied across conditions. Sucrose concentration varied across groups (1, 5, or 25%). Results showed that rates and patterns of responding for 1%, and sometimes for 5%, sucrose reinforcers in the first half of the session were higher and steeper, respectively, when food-pellet, rather than sucrose, reinforcement occurred in the second half. Responding for 25% sucrose was not similarly affected. Experiment 2 replicated the results of Experiment 1 using a within-subjects design. Although the present results represent induction (i.e. the opposite of contrast), they are consistent with some results on consummatory contrast. They also further demonstrate that responding on interval schedules of reinforcement can be altered prospectively. By doing so, however, they pose potential problems for current theories for why operant response rates change within the session.     

Upcoming food-pellet reinforcement alters rats' lever pressing for liquid sucrose delivered by a progressive-ratio schedule

The present study investigated whether rats' responding for liquid-sucrose reinforcement delivered by a progressive-ratio (PR) schedule would be altered by the addition of food-pellet reinforcement available subsequent to the PR schedule. In Experiment 1, six rats lever pressed for 1% sucrose reinforcers delivered by a PR 3 schedule. In Experiment 2, six rats lever pressed for 5% sucrose delivered by a PR 5 schedule. In both experiments, baseline sessions consisted of 40min of exposure to the PR schedule. In the first treatment condition, a 25-min period of food-pellet reinforcement, delivered by a random-interval 60-s schedule, immediately followed the initial 40min. In the second treatment condition, the 25-min period of food-pellet reinforcement became available when 10min elapsed without the subject completing a ratio on the PR schedule. Results from both experiments showed that upcoming food-pellet reinforcement increased the number of ratios subjects completed on the PR schedule. Portions of the present results represent a partial replication of results reported by Baron and Derenne [J. Exp. Anal. Behav. 73 (2000) 291], who used a similar procedure. They also augment a growing body of research on positive induction.     

Duration, response, and location: the influence of upcoming 32% sucrose on rats' licking or lever pressing for 1% liquid sucrose

The present study investigated whether rats' rates of licking or pressing a lever for 1% liquid sucrose delivered by a continuous reinforcement schedule would decrease (contrast) or increase (induction) when the upcoming period would allow access to 32% sucrose and whether such changes would be influenced by how long each substance was available. In Experiment 1, different groups of rats licked a spout or pressed a lever for 1% sucrose in the first half of the session and, in different conditions, for 1% or 32% sucrose in the second half. Across conditions, halves of the session were 3, 6, 12, or 24 min long. Upcoming 32% sucrose significantly decreased rates of licking at each duration whereas it increased rates of lever pressing except when access duration was 3 min. Experiment 2 replicated Experiment 1 with the exception that rats that licked did so from the same spout in both halves of the session and rats that pressed a lever collected the sucrose reinforcers in the different halves at different locations. In these procedures, upcoming 32% sucrose significantly increased rates of licking. Significant, but small, increases in rates of lever pressing were still observed. The present results suggest that continuous reinforcement or duration of access to sucrose are not primary determinants of whether contrast or induction is observed. Rather, they suggest that the type of behavior (licking versus pressing a lever) and the location at which the substances are collected and consumed play a large role in which effect occurs.     

Stimulus change dis-habituates operant responding supported by water reinforcers

The present experiment examined whether habituation contributes to within-session decreases in operant responding for water reinforcers. The experiment asked if this responding can be dishabituated, a fundamental property of habituated behavior. During baseline, rats’ lever pressing was reinforced by water on a variable interval 15-s schedule. During experimental conditions, rats responded on the same schedule and a new stimulus was introduced for 5 min at 15, 30 or 45 min into the 60-min session. The new stimulus was extinction, continuous reinforcement or flashing lights in different conditions. Rate of responding primarily decreased within the session during baseline. Introducing a new stimulus sometimes suppressed (extinction, continuous reinforcement) and sometimes increased (flashing lights) responding while it was in effect. The new stimulus increased responding after it ended and before it was presented in the session. The results are incompatible with the idea that non-habituation satiety factors (e.g., cellular hydration and blood volume) contributed to within-session changes in responding. These satiety factors should increase with increases in consumption, decrease with decreases in consumption and remain constant with constant consumption of water. Nevertheless, all stimulus changes increased operant responding for water. These results support the idea that habituation contributes to within-session decreases in responding for water reinforcers.     

Responding for sucrose and wheel-running reinforcement: effect of pre-running

Six male albino Wistar rats were placed in running wheels and exposed to a fixed interval 30-s schedule that produced either a drop of 15% sucrose solution or the opportunity to run for 15s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. To assess the effect of pre-running, animals were allowed to run for 1h prior to a session of responding for sucrose and running. Results showed that, after pre-running, response rates in the later segments of the 30-s schedule decreased in the presence of a wheel-running stimulus and increased in the presence of a sucrose stimulus. Wheel-running rates were not affected. Analysis of mean post-reinforcement pauses (PRP) broken down by transitions between successive reinforcers revealed that pre-running lengthened pausing in the presence of the stimulus signaling wheel running and shortened pauses in the presence of the stimulus signaling sucrose. No effect was observed on local response rates. Changes in pausing in the presence of stimuli signaling the two reinforcers were consistent with a decrease in the reinforcing efficacy of wheel running and an increase in the reinforcing efficacy of sucrose. Pre-running decreased motivation to respond for running, but increased motivation to work for food.     

Extended exposure to a discriminated,limited-hold temporal schedule does not produce stimulus control

Four rats were exposed to two different stimuli (either lights or tones), each stimulus being correlated with independent probabilities of water delivery in a temporally defined schedule. The schedule consisted of a 60 s T cycle with 30 s t(D) and t(-) successive subcycles; t(D) was correlated with a probability of water delivery of 1.0 and t(-) was correlated with a probability of water delivery of 0.0. The schedule was maintained during 180 sessions and extended for 25 extra sessions omitting the stimulus in t(-). The four rats showed low frequencies of responding, response frequency being slightly higher in t(-) than in t(D). The percentage of lost reinforcers was independent of response frequency. The rats which lost less reinforcers were those which obtained more water deliveries during the first 15 cycles of each session. These results show that stimulus control does not develop in limited-hold temporal schedules, and that response-reinforcer effectiveness may depend on the initial contact with reinforcers in the first cycles of the session.     

Habituation contributes to the decline in wheel running within wheel-running reinforcement periods

Habituation appears to play a role in the decline in wheel running within an interval. Aoyama and McSweeney [Aoyama, K., McSweeney, F.K., 2001. Habituation contributes to within-session changes in free wheel running. J. Exp. Anal. Behav. 76, 289-302] showed that when a novel stimulus was presented during a 30-min interval, wheel-running rates following the stimulus increased to levels approximating those earlier in the interval. The present study sought to assess the role of habituation in the decline in running that occurs over a briefer interval. In two experiments, rats responded on fixed-interval 30-s schedules for the opportunity to run for 45 s. Forty reinforcers were completed in each session. In the first experiment, the brake and chamber lights were repeatedly activated and inactivated after 25 s of a reinforcement interval had elapsed to assess the effect on running within the remaining 20 s. Presentations of the brake/light stimulus occurred during nine randomly determined reinforcement intervals in a session. In the second experiment, a 110 dB tone was emitted after 25 s of the reinforcement interval. In both experiments, presentation of the stimulus produced an immediate decline in running that dissipated over sessions. No increase in running following the stimulus was observed in the first experiment until the stimulus-induced decline dissipated. In the second experiment, increases in running were observed following the tone in the first session as well as when data were averaged over several sessions. In general, the results concur with the assertion that habituation plays a role in the decline in wheel running that occurs within both long and short intervals.     

Excitatory backward conditioning in an appetitive conditioned reinforcement preparation with rats

Four experiments were conducted to examine appetitive backward conditioning in a conditioned reinforcement preparation. In all experiments, off-line classical conditioning was conducted following lever-press training on two levers. Presentations of a sucrose solution by a liquid dipper served as an unconditioned stimulus (US) and two auditory stimuli served as conditioned stimuli (CSs); one was paired with the US in either a forward (Experiment 1a) or a backward (Experiments 1b, 2, and 3) relationship, and the other served as a control CS, which was not paired with the US. In testing, each lever-press response produced a presentation of one of the CSs instead of appetitive reinforcers. The response to a lever was facilitated, compared to the response to another lever, when the response produced the backward CS presentation as well as when it produced the forward CS presentation; that is, the backward CS served as an excitatory conditioned reinforcer.     

Haloperidol, dynamics of choice, and the parameters of the matching law

The idea that dopamine mediates the reinforcing effects of stimuli persists in the field of neurosciences. The present study shows that haloperidol, a dopamine antagonist, does not eliminate the reinforcing value of food reinforcers. The ratio of reinforcers changed seven times across two levers within sessions, modeling a dynamic environment. The magnitude of the reinforcer was manipulated independently of the reinforcer ratio. Four doses of intraperitoneal haloperidol were assessed over periods of 12 daily sessions. Haloperidol did not impair the discrimination that the rats established between rich and lean levers; the response distributions favored the lever associated with the higher probability of reinforcement and the larger pellets. The parameters of the generalized matching law (bias and sensitivity) were used to estimate effects of haloperidol upon the motor system and upon the rats' motivation for food reinforcers.     

Response strategies during acquisition of serial learning in pigeons (Columba livia)

Pigeons were exposed on fixed duration sessions to four chromatic stimuli and trained to perform a 2-item sequence. A detailed analysis of incorrect responses performed on each trial prior to completion of the sequence led to distinguish three learning stages. Already on initial sessions animals responded significantly more frequently to relevant stimuli than to irrelevant ones indicating stimulus control by salience. During an intermediary stage, responding to item 2 increased significantly and animals started an increasing number of trials with item 2, suggesting stimulus control by recency. On the final session the correct sequence outnumbered significantly the reverse sequence, suggesting control by order, while recency and salience effects were present to a lesser extent. Repeated pecks, i.e. consecutive pecks on the same cue, occurred on the four cues on the first session and decreased significantly on the last session for irrelevant colours. In addition, when key pecks were followed by a brief sound signal, repeats on relevant stimuli decreased while efficient colour pecks (i.e. when repeats were ignored) on these stimuli increased. These findings are discussed in the light of those obtained in traditional chaining paradigms.     

Habituation and the reinforcing effectiveness of visual stimuli

The term "sensory reinforcer" has been used to refer to sensory stimuli (e.g. light onset) that are primary reinforcers in order to differentiate them from other more biologically important primary reinforcers (e.g. food and water). Acquisition of snout poke responding for a visual stimulus (5s light onset) with fixed ratio 1 (FR 1), variable-interval 1min (VI 1min), or variable-interval 6min (VI 6min) schedules of reinforcement was tested in three groups of rats (n=8/group). The VI 6min schedule of reinforcement produced a higher response rate than the FR 1 or VI 1min schedules of visual stimulus reinforcement. One explanation for greater responding on the VI 6min schedule relative to the FR 1 and VI 1min schedules is that the reinforcing effectiveness of light onset habituated more rapidly in the FR 1 and VI 1min groups as compared to the VI 6min group. The inverse relationship between response rate and the rate of visual stimulus reinforcement is opposite to results from studies with biologically important reinforcers which indicate a positive relationship between response and reinforcement rate. Rapid habituation of reinforcing effectiveness may be a fundamental characteristic of sensory reinforcers that differentiates them from biologically important reinforcers, which are required to maintain homeostatic balance.     

Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

Environmental enrichment decreases responding for visual novelty

Previous research has demonstrated that rats reared in an enriched condition (EC) with novel objects and social partners self-administer less amphetamine compared to rats raised in an isolated condition (IC). However, it is unclear if the enrichment-induced decrease in stimulant self-administration generalizes to non-drug rewards such as those provided by novel environmental stimuli. In the current study, EC, IC, and social condition (SC) rats were raised from 21 to 51 days of age before being tested in a two-lever operant conditioning chamber in which responding on one lever (active lever) resulted in illumination of a cue light. In Experiment 1, rats were initially assessed for baseline responding (no contingency) and then the contingent light was introduced. EC rats responded less than IC rats for the contingent light stimulus; however, EC rats also displayed a lower rate of baseline responding. In Experiment 2, rats were trained initially to lever press for a sucrose reward to decrease differences in baseline responding. While sucrose pretraining decreased baseline response differences between groups, EC rats still responded less for the contingent light stimulus than IC or SC rats. These results suggest that environmental enrichment decreases the incentive value of visual novelty.     

Responding for sucrose and wheel-running reinforcement: effect of body weight manipulation

As body weight increases, the excitatory strength of a stimulus signaling an opportunity to run should weaken to a greater degree than that of a stimulus signaling an opportunity to eat. To test this hypothesis, six male albino Wistar rats were placed in running wheels and exposed to a fixed interval 30-s schedule that produced either a drop of 15% sucrose solution or the opportunity to run for 15s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. The effect of varying body weight on responding maintained by these two reinforcers was investigated by systematically increasing and decreasing post-session food amounts. The initial body weight was 335 g. Body weights were increased to approximately 445 g and subsequently returned to 335 g. As body weight increased, overall and local lever-pressing rates decreased while post-reinforcement pauses lengthened. Analysis of post-reinforcement pauses and local lever-pressing rates in terms of transitions between successive reinforcers revealed that local response rates in the presence of stimuli signaling upcoming wheel and sucrose reinforcers were similarly affected. However, pausing in the presence of the stimulus signaling a wheel-running reinforcer lengthened to a greater extent than did pausing in the presence of the stimulus signaling sucrose. This result suggests that as body weight approaches ad-lib levels, the likelihood of initiation of responding to obtain an opportunity to run approaches zero and the animal "rejects" the opportunity to run in a manner similar to the rejection of less preferred food items in studies of food selectivity.     

Extinguished operant responding shows stimulus specificity

The experiment tested for stimulus specificity in extinguished operant responding. Eight pigeons pecked keys for food reinforcers delivered by a variable interval (VI) 60-s schedule. The key was illuminated with red light during some sessions and white light during others. Then, responding was placed on extinction. During some sessions of extinction, the color of the key light remained constant throughout the session (red or white). During other sessions the color changed at 30 min into the session (red to white or white to red). Response rate increased after the change of key color in extinction. If it is assumed that key color is part of the stimulus to which subjects habituate, then these results are consistent with McSweeney and Swindell's [J. Gen. Psychol. 129 (2002) 364] suggestion that responding declines in extinction partly because subjects habituate to the stimuli that support conditioned responding. Habituation is relatively specific to the exact nature of the stimulus presented. Therefore, changes in the stimulus violate stimulus specificity and restore habituated responding. The results are also consistent with other theories that attribute extinction to a reduction of stimulus control [e.g., Psychol. Bull. 114 (1993) 80; J. Exp. Psychol.: Anim. Behav. Process. 16 (1990) 235], but considerations such as parsimony and testability favor the habituation hypothesis over these theories.     

Latent contextual inhibition of the cardiac component in the startle reaction to a sound stimulus in rats

Heart rate (HR), freezing score, and motor component were estimated during acoustic startle (ASR) habituation (two sessions with 24-hour interval, 10 trials in a session). It was shown that rats previously exposed to the experimental context (once for 5 min 24 h before training) demonstrated HR decrease in response to the first stimulus and tachycardia in response to the 4th-10th stimuli during the first session. The interstimulus HR declined from the 4th to the 6th trials. The same profile of cardiovascular response was observed in this group at the beginning of the second session with the following (to the 7th trial) habituation of tachycardia. These rats didn't demonstrate the intertrial HR decrease during the second session. Nonadapted rats responded by bradycardia to the 1st and 2nd trials of the first session. The response didn't change for tachycardia with continuation of stimuli presentation. Tachycardia appeared only in response to the 7th-10th trials of the second session and didn't habituate. The intertrial HR level decreased in this group only during the second session. The results are discussed in terms of contextual latent inhibition of the cardiac acoustic startle response.     

Serial conditional discrimination and temporal bisection in rats selectively lesioned in the dentate gyrus

In positive serial conditional discrimination, animals respond during a target stimulus when it is preceded by a feature stimulus, but they do not respond when the same target stimulus is presented alone. Moreover, the feature and target stimuli are separated from each other by an empty interval. The present work aimed to investigate if two durations (4 or 16 s) of the same feature stimulus (light) could modulate the operant responses of rats to different levers (A and B) during a 5-s target stimulus (tone). In the present study, lever A was associated with the 4-s light, and lever B was associated with the 16-s light. A 5-s empty interval was included between the light and the tone. In the same training procedure, the rats were also presented with the 5-s tone without the preceding light stimuli. In these trials, the responses were not reinforced. We evaluated the hippocampal involvement of these behavioral processes by selectively lesioning the dentate gyrus with colchicine. Once trained, the rats were submitted to a test using probe trials without reinforcement. They were presented with intermediate durations of the feature stimulus (light) to obtain a temporal bisection curve recorded during the exposure to the target stimuli. The rats from both groups learned to respond with high rates during tones preceded by light and with low rates during tones presented alone, which indicated acquisition of the serial conditional discrimination. The rats were able to discriminate between the 4- and 16-s lights by correctly choosing lever A or B. In the test, the temporal bisection curves from both experimental groups showed a bisection point at the arithmetic mean between 4 and 16 s. Such processes were not impaired by the dentate gyrus lesion. Thus, our results showed that different durations of a feature stimulus could result in conditional properties. However, this processing did not appear to depend on the dentate gyrus alone.     

Implicit Versus Explicit Local Contextual Processing

We investigated the effects of implicit local contextual processing using behavioral and electrophysiological measures. EEG recording blocks consisted of targets preceded by either randomized sequences of standards or by sequences including a predictive sequence signaling the occurrence of a target event. Subjects performed two sessions: in the first the regularity of the predictive sequence was implicit, while in the second this regularity was made explicit. Subjects pressed a button in response to targets. Both the implicit and explicit sessions showed shorter reaction times and peak P3b latencies for predicted versus random targets, although to a greater extent in the explicit session. In both sessions the middle and last most-informative stimuli of the three-standard predictive sequence induced a significant larger P3b compared with randomized standards. The findings show that local contextual information is processed implicitly, but that this modulation was significantly greater when subjects were explicitly instructed to attend to target-predictive contextual information. The findings suggest that top-down attentional networks have a role in modulating the extent to which contextual information is utilized.