The reinforcing property and the rewarding aftereffect of wheel running in rats: a combination of two paradigms

Wheel running reinforces the behavior that generates it and produces a preference for the context that follows it. The goal of the present study was to demonstrate both of these effects in the same animals. Twelve male Wistar rats were first exposed to a fixed-interval 30 s schedule of wheel-running reinforcement. The operant was lever-pressing and the reinforcer was the opportunity to run for 45 s. Following this phase, the method of place conditioning was used to test for a rewarding aftereffect following operant sessions. On alternating days, half the rats responded for wheel-running reinforcement while the other half remained in their home cage. Upon completion of the wheel-running reinforcement sessions, rats that ran and rats that remained in their home cages were placed into a chamber of a conditioned place preference (CPP) apparatus for 30 min. Each animal received six pairings of a distinctive context with wheel running and six pairings of a different context with their home cage. On the test day, animals were free to move between the chambers for 10 min. Results showed a conditioned place preference for the context associated with wheel running; however, time spent in the context associated with running was not related to wheel-running rate, lever-pressing rate, or post-reinforcement pause duration.     

Quantifying Social Motivation in Mice Using Operant Conditioning

In this protocol, social motivation is measured in mice through a pair of operant conditioning paradigms. To conduct the experiments, two-chambered shuttle boxes were equipped with two operant levers (left and right) and a food receptacle in one chamber, which was then divided from the second chamber by an automated guillotine door covered by a wire grid. Different stimulus mice, rotated across testing days, served as a social stimulus behind the wire grid, and were only visible following the opening of the guillotine door. Test mice were trained to lever press in order to open the door and gain access to the stimulus partner for 15 sec. The number of lever presses required to obtain the social reward progressively increased on a fixed schedule of 3. Testing sessions ended after test mice stopped lever pressing for 5 consecutive minutes. The last reinforced ratio or breakpoint can be used as a quantitative measure of social motivation. For the second paradigm, test mice were trained to discriminate between left and right lever presses in order to obtain either a food reward or the social reward. Mice were rewarded for every 3 presses of each respective lever. The number of food and social rewards can be compared as a measurement of the value placed upon each reward. The ratio of each reward type can also be compared between mouse strains and the change in this ratio can be monitored within testing sessions to measure satiation with a given reward type. Both of these operant conditioning paradigms are highly useful for the quantification of social motivation in mouse models of autism and other disorders of social behavior.     

Rats smell: odour-mediated local enhancement, in a vertical movement two-action test

In two experiments, hungry rats, Rattus norvegicus, were present in one side of an operant chamber while a conspecific demonstrator in the adjacent compartment moved a single lever either up or down for a food reward. During a subsequent test session, in which these rats were allowed access to the lever for the first time, all responses were rewarded regardless of their direction. In experiment 1, rats that were prevented from observing the direction of lever movement by means of a screen showed a reliable demonstrator-consistent response bias, while rats that had observed the direction of lever movement and in addition had access to any odour cues deposited on the lever did not. In experiment 2, each rat observed another rat (the ‘viewed’ demonstrator) moving a lever either up or down. They were then transferred into the test compartment of a different operant chamber in which another rat (the ‘box’ demonstrator) had moved the lever in the same direction as the viewed demonstrator or in the opposite direction. These observer rats showed a reliable preference for their box demonstrator's direction, but responded in the opposite direction to their viewed demonstrator. Taken together, the results of these experiments suggest that directional responding by rats in a vertical movement two-action test is influenced by demonstrator-deposited odour cues in addition to visual experience of a demonstrator's behaviour. Furthermore, while odour-mediated local enhancement gave rise to demonstrator-consistent responding, visual observation of a conspecific appeared to have the reverse effect. Copyright 2002 The Association for the Study of Animal Behaviour. Published by Elsevier Science Ltd. All rights reserved.     

Rats Work for Food They then Reject: Support for the Information-primacy Approach to Learned Industriousness

There is good evidence that in many situations, animals prefer to work for food even when identical food is freely available. This phenomenon is called ‘learned industriousness’ or ‘contrafreeloading’ and has been found in several species. This study shows that wild rats will also work hard for contaminated food that they associate with sickness and subsequently reject, even when wholesome food is continuously available at no extra cost. Seven wild rats (Rattus novegicus) lived for 4 wk in cages containing two operant levers and associated pellet dispensers. The rats earned all their food by lever pressing for 45-mg food pellets on a variable-interval 10 s (VI10s) schedule in each dispenser. After 1 wk, pellets containing a sub-lethal dose of an acute rodenticide were available for 12 h (the test period) from the preferred dispenser, before being replaced by normal food pellets. This procedure was repeated 1 wk and 4 wk later. The number of lever presses, pellets delivered, and pellets consumed at each dispenser were recorded for 12 h prior to the test period, during the 12-h test period, and 12 h after the test period. The rats quickly learned to shift their feeding preference during the test period away from the dispenser that provided the rodenticide pellets. However, during the second half of the test period, lever pressing at this dispenser increased, even though the pellets thereby obtained were still rejected. This divergence between the lever pressing rate and the pellet consumption rate increased over the three trials. This ‘learned-industriousness’ behaviour is not easily explained by the self-reinforcing hypothesis, by the obligate species-specific response hypothesis, or as some artefact of the operant situation. It is suggested that the lever pressing towards the end of the trial, for pellets that were rejected, enabled the animals to gather information about a rare, but very important, event, namely, the presence of dangerous food at a previously preferred and normally safe feeding site. The data lend support to the information-primacy theory of learned industriousness.     

Passive immunization against nicotine attenuates nicotine discrimination

Ten rats were trained in a two lever operant chamber to press different levers after a nicotine injection (0.14 mg/kg s.c.) or a saline injection on an FR10 schedule. The rats were then injected i.p. with either 150 mg nicotine-specific IgG or the same amount of control IgG from non-immunized rabbits. On successive days, they were retested with both levers active after a saline injection, a full training dose of nicotine and a half dose of nicotine (0.07 mg/kg s.c.). After saline injection, both groups pressed the saline lever almost exclusively. After each of the nicotine doses, the immunized rats performed a significantly lower percentage of their lever presses on the nicotine lever than did non-immunized rats. The results suggest that passive immunization can interfere with the stimulus properties of nicotine.     

Stimulus properties of clonidine in chronically morphine treated rats trained to a morphine-saline discrimination

In an operant behavior procedure of lever pressing on an FR 10 schedule of food reinforcement, morphine dependent and nondependent rats were trained to respond on a lever on one side of the food tray after a morphine (10 mg/kg i.p.) injection and to respond on a lever on the alternate side after a saline injection. Following discrimination training, in both dependent and nondependent rats saline was generalized to various doses of clonidine (10, 30 and 50 micrograms/kg i.p.). A response inhibition of about 65% was obtained with the highest dose. It was concluded that, even if clonidine can suppress signs of narcotic withdrawal, the internal state induced by morphine in an abstinent rat does differ from the one induced by clonidine in the same animal.     

Cues paired with either rapid or slower self-administered cocaine injections acquire similar conditioned rewarding properties

The faster drugs of abuse reach the brain, the more addictive they can be. It is not known why this is. Environmental stimuli associated with drugs can promote the development and persistence of addiction by invigorating and precipitating drug-seeking behaviour. We determined, therefore, whether cues associated with the self-administration of rapidly delivered cocaine (injected intravenously over 5 versus 90 seconds) would acquire greater conditioned rewarding properties, as assessed by the performance of an operant response reinforced solely by the cues. Rats nose-poked for intravenous cocaine infusions delivered either over 5 or 90 seconds. Discrete visual cues accompanied each infusion. The rats could then press a lever to obtain the cues--now a conditioned reward--or an inactive lever. Rats in both the 5- and 90-second groups pressed more on the active versus inactive lever following extensive (24 sessions) but not following limited (3 sessions) self-administration training. There were no group differences in this behaviour. Following withdrawal from cocaine self-administration, lever discrimination progressively abated in both groups and was lost by withdrawal day 30. However, the rewarding properties of the cues were not "forgotten" because on withdrawal days 32-33, amphetamine selectively enhanced active-lever pressing, and did so to a similar extent in both groups. Thus, cues paired with rapid or slower cocaine delivery acquire similar conditioned rewarding properties. We conclude, therefore, that the rapid delivery of cocaine to the brain promotes addiction by mechanisms that might not involve a greater ability of drug cues to control behaviour.     

Effects of conditioned fear and environmental novelty on plasma beta-endorphin in the rat

The levels of rat plasma beta-endorphin-like immunoreactivity following a 30 min exposure to (1) an unfamiliar operant chamber, (2) an unfamiliar operant chamber providing a VI-5 second schedule of 3 mA, 1 sec footshocks, or (3) a familiar chamber providing no shocks, but previously paired with unavoidable shocks were compared to control values from animals left undisturbed in their familiar home cages. The shocked group showed ten-fold elevations of beta-endorphin-like immunoreactivity compared to the undisturbed control animals, while conditioned rats showed a smaller two-fold elevation when re-exposed to a chamber in which they had previously been shocked. Two of five rats exposed merely to an unfamiliar chamber showed elevations, but there was no statistically reliable group effect. Such procedures may be useful for controlled and parametric studies of the mobilization of pituitary or brain pools of beta-endorphin under conditions involving merely anticipation of pain rather than the actual activation of ascending nervous pain pathways.     

Comparison of anorectic drugs in rats trained to discriminate between satiation and deprivation

Eight male rats were trained to discriminate between the internal states produced by food deprivation of 3 hours (satiation) and that produced by food deprivation of 27 hours duration (deprivation). One lever, in a two-lever operant chamber, had to be pressed to receive reinforcement in the satiation state, whereas pressing the other lever was required when the rat was in the deprivation state. Once the rats were trained, increasing the number of hours of food deprivation, from 1 to 48 hours, resulted in more deprivation-appropriate lever responses in the two-lever operant task. Administration of doses of fenfluramine (0.5-1.5 mg.kg), its active metabolite norfenfluramine (0.25-1.0 mg/kg) or d-amphetamine (0.5-1.5 mg/kg) produced a dose-responsive decrease in deprivation-appropriate responses when each drug/dose was injected (i.p.) 15 min prior to deprivation (27 hours) testing. Norfenfluramine was 1.5 times more potent than fenfluramine which was 1.5 times more potent than amphetamine.     

Voluntary exercise impairs initial delayed spatial alternation performance in estradiol treated ovariectomized middle-aged rats

Estrogens differentially modulate behavior in the adult female rodent. Voluntary exercise can also impact behavior, often reversing age associated decrements in memory processes. Our research group has published a series of papers reporting a deficit in the acquisition of an operant working memory task, delayed spatial alternation (DSA), following 17β-estradiol treatment to middle-aged ovariectomized (OVX) rats. The current study examined if voluntary exercise could attenuate the 17β-estradiol induced deficits on DSA performance. OVX 12-month old Long–Evans rats were implanted with a Silastic capsule containing 17β-estradiol (10% in cholesterol: low physiological range) or with a blank capsule. A subset of the 17β-estradiol and OVX untreated rats were given free access to a running wheel in their home cage. All rats were tested for 40 sessions on the DSA task. Surprisingly, we found running wheel access to impair initial acquisition of the DSA task in 17β-estradiol treated rats, an effect not seen in OVX untreated rats given running wheel access. This deficit was driven by an increase in perseverative responding on a lever no longer associated with reinforcement. We also report for the first time a 17β-estradiol induced impairment on the DSA task following a long intertrial delay (18-sec), an effect revealed following more extended testing than in our previous studies (15 additional sessions). Overall, running wheel access increased initial error rate on the DSA task in 17β-estradiol treated middle-aged OVX rats, and failed to prevent the 17β-estradiol induced deficits in performance of the operant DSA task in later testing sessions.     

Percentage reward in an operant analogue to foraging

Pigeons (Columba livia) responding on an operant, conditioning analogue to foraging could either accept or reject a variable-interval 20-s schedule which always led to food or a variable-interval 5-s schedule which led to food on only a percentage of trials. The probability of accepting the certain alternative increased as the percentage of food trials for the uncertain alternative decreased. The probability of accepting the uncertain alternative increased with the percentage of food trials for this alternative. Subjects receiving all of their food in the experiment (‘closed economy’) and those requiring supplementation (‘open economy’) preferred whichever alternative provided the higher overall mean rate of reinforcement.     

A Procedure to Observe Context-induced Renewal of Pavlovian-conditioned Alcohol-seeking Behavior in Rats

Environmental contexts in which drugs of abuse are consumed can trigger craving, a subjective Pavlovian-conditioned response that can facilitate drug-seeking behavior and prompt relapse in abstinent drug users. We have developed a procedure to study the behavioral and neural processes that mediate the impact of context on alcohol-seeking behavior in rats. Following acclimation to the taste and pharmacological effects of 15% ethanol in the home cage, male Long-Evans rats receive Pavlovian discrimination training (PDT) in conditioning chambers. In each daily (Mon-Fri) PDT session, 16 trials each of two different 10 sec auditory conditioned stimuli occur. During one stimulus, the CS+, 0.2 ml of 15% ethanol is delivered into a fluid port for oral consumption. The second stimulus, the CS-, is not paired with ethanol. Across sessions, entries into the fluid port during the CS+ increase, whereas entries during the CS- stabilize at a lower level, indicating that a predictive association between the CS+ and ethanol is acquired. During PDT each chamber is equipped with a specific configuration of visual, olfactory and tactile contextual stimuli. Following PDT, extinction training is conducted in the same chamber that is now equipped with a different configuration of contextual stimuli. The CS+ and CS- are presented as before, but ethanol is withheld, which causes a gradual decline in port entries during the CS+. At test, rats are placed back into the PDT context and presented with the CS+ and CS- as before, but without ethanol. This manipulation triggers a robust and selective increase in the number of port entries made during the alcohol predictive CS+, with no change in responding during the CS-. This effect, referred to as context-induced renewal, illustrates the powerful capacity of contexts associated with alcohol consumption to stimulate alcohol-seeking behavior in response to Pavlovian alcohol cues.     

How rats process spatiotemporal information in the face of distraction

How rats process spatiotemporal information in the face of distraction was assessed. Rats were trained on a time-place learning task in which the location of food availability depended on the amount of time elapsed since the beginning of the training session. In each training session each of four levers provided food pellets for 5 min on an intermittent schedule. In probe sessions interspersed with the final training sessions, the rats were presented with a second highly preferred food source-a piece of cheese-at various times into the session. Rats choose the correct lever after the cheese distraction, but it appeared that their internal clock had stopped during the cheese consumption period. Thus rats' internal clock, like that of pigeons, displays the properties of 'stop', 'reset', and 'restart'. Rat-pigeon differences in timing processes may be restricted to circadian or time of day timing. Present results also suggest that rats process spatial and temporal information separately.     

Effects of noise on the performance of rats in an operant discrimination task

Two experiments examined the effect of the presentation of an irregular, moderate intensity auditory stimulus ('noise') on the performance of rats in an operant discrimination task. In Experiment 1, rats first learned to press a lever in the presence of a visual stimulus but not in its absence. Discrimination performance was impaired during subsequent exposure to noise. In Experiment 2, different groups of rats learned the discrimination task under a noise or a no-noise condition. Thereafter, all rats were tested under each noise condition. Discrimination performance was best when the noise condition at test was identical to the noise condition at training. These results were discussed in the framework of arousal, distraction, generalization decrement, and contextual occasion setting. They point to the necessity of using a 2x2 factorial design in human and animal research on noise effects, with noise condition at training (noise present or absent) and noise condition at test (noise present or absent) as factors.     

Extinction of an appetitive operant response after administration of MSH

Hungry rats were trained to press a lever in order to obtain food on a fixed ratio (FR) or variable ratio (VR) of reinforcement. Rats trained on the FR schedule and injected with synthetic α-MSH had delayed extinction of the task as compared with control rats injected with diluent. The results show that MSH affects the behavior of rats in another type of behavioral situation involving an appetitive operant response.     

Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

Quantitative data on training new world primates to urinate

This study assessed the effectiveness of operant conditioning in training three species of captive callitrichid primates (Leontopithecus rosalia, Callithrix geoffroyi, and Saguinus imperator) to urinate on demand. There were three goals to the study: 1) to develop a system for quantitatively assessing positive reinforcement training; 2) to ascertain whether or not positive reinforcement techniques can be used to train callitrichid monkeys to urinate on demand, and if so, how many training sessions are required; and 3) to determine the effect on urination behavior of the trainer entering the cage to collect a urine sample. Positive reinforcement with a continuous reinforcement schedule was used to capture a natural behavior: urination. Training sessions (30 min each) were conducted at dawn thrice weekly during five consecutive phases: habituation, control, training (animals were rewarded for urinating), maintenance (animals had reached a defined training criteria and continued to be rewarded for urinating), and collection (animals were rewarded for urinating, and the trainer entered the cage to collect the sample). The numbers of 30-min training sessions required to train the three monkey species (L. rosalia, C. geoffroyi, and S. imperator) were five, six, and eight, respectively. For the three species, the mean number of urinations per animal was significantly greater during the training, maintenance, and collection phases compared to the control phase. However, the three species differed significantly in the manner in which the rates of urination changed across the five phases. A higher proportion of subjects urinated during the training, maintenance, and collection phases compared to the control phase. Latency to first urination varied significantly across the five phases, with significantly reduced latencies to urinate during the training, maintenance, and collection phases compared to the control phase. The entry of the trainer into the cage to collect the urine sample did not appear to alter urination behavior. We demonstrate that operant conditioning techniques, which typically incur minimal cost, time investment, and disturbance, can be used to increase the quantity of urine samples collected for physiological analysis, the proportion of animals that urinate, and the speed of sample collection.     

Ethanol seeking by long evans rats is not always a goal-directed behavior

Background

Two parallel and interacting processes are said to underlie animal behavior, whereby learning and performance of a behavior is at first via conscious and deliberate (goal-directed) processes, but after initial acquisition, the behavior can become automatic and stimulus-elicited (habitual). With respect to instrumental behaviors, animal learning studies suggest that the duration of training and the action-outcome contingency are two factors involved in the emergence of habitual seeking of “natural” reinforcers (e.g., sweet solutions, food or sucrose pellets). To rigorously test whether behaviors reinforced by abused substances such as ethanol, in particular, similarly become habitual was the primary aim of this study.

Methodology/Principal Findings

Male Long Evans rats underwent extended or limited operant lever press training with 10% sucrose/10% ethanol (10S10E) reinforcement (variable interval (VI) or (VR) ratio schedule of reinforcement), or with 10% sucrose (10S) reinforcement (VI schedule only). Once training and pretesting were complete, the impact of outcome devaluation on operant behavior was evaluated after lithium chloride injections were paired with the reinforcer, or unpaired 24 hours later. After limited, but not extended instrumental training, lever pressing by groups trained under VR with 10S10E and under VI with 10S was sensitive to outcome devaluation. In contrast, responding by both the extended and limited training 10S10E VI groups was not sensitive to ethanol devaluation during the test for habitual behavior.

Conclusions/Significance

Operant behavior by rats trained to self-administer an ethanol-sucrose solution showed variable sensitivity to a change in the value of ethanol, with relative insensitivity developing sooner in animals that received time-variable ethanol reinforcement during training sessions. One important implication, with respect to substance abuse in humans, is that initial learning about the relationship between instrumental actions and the opportunity to consume ethanol-containing drinks can influence the time course for the development or expression of habitual ethanol seeking behavior.     

A Novel Procedure for Evaluating the Reinforcing Properties of Tastants in Laboratory Rats: Operant Intraoral Self-administration

This paper describes a novel method for studying the bio-behavioral basis of addiction to food. This method combines the surgical component of taste reactivity with the behavioral aspects of operant self-administration of drugs. Under very brief general anaesthesia, rats are implanted with an intraoral (IO) cannula that allows delivery of test solutions directly in the oral cavity. Animals are then tested in operant self-administration chambers whereby they can press a lever to receive IO infusions of test solutions. IO self-administration has several advantages over experimental procedures that involve drinking a solution from a spout or operant responding for solid pellets or solutions delivered in a receptacle. Here, we show that IO self-administration can be employed to study self-administration of high fructose corn syrup (HFCS). Rats were first tested for self-administration on a progressive ratio (PR) schedule, which assesses the maximum amount of operant behavior that will be emitted for different concentrations of HFCS (i.e. 8%, 25%, and 50%). Following this test, rats self-administered these concentrations on a continuous schedule of reinforcement (i.e. one infusion for each lever press) for 10 consecutive days (1 session/day; each lasting 3 hr), and then they were retested on the PR schedule. On the continuous reinforcement schedule, rats took fewer infusions of higher concentrations, although the lowest concentration of HFCS (8%) maintained more variable self-administration. Furthermore, the PR tests revealed that 8% had lower reinforcing value than 25% and 50%. These results indicate that IO self-administration can be employed to study acquisition and maintenance of responding for sweet solutions. The sensitivity of the operant response to differences in concentration and schedule of reinforcement makes IO self-administration an ideal procedure to investigate the neurobiology of voluntary intake of sweets.