Species differences between rats and pigeons in choices with probabilistic and delayed reinforcers

An adjusting-delay procedure was used to study rats' choices with probabilistic and delayed reinforcers, and to compare them with previous results from pigeons. A left lever press led to a 5-s delay signaled by a light and a tone, followed by a food pellet on 50% of the trials. A right lever press led to an adjusting delay signaled by a light followed by a food pellet on 100% of the trials. In some conditions, the light and tone for the probabilistic reinforcer were present only on trials that delivered food. In other conditions, the light and tone were present on all trials that the left lever was chosen. Similar studies with pigeons [Mazur, J.E., 1989. Theories of probabilistic reinforcement. J. Exp. Anal. Behav. 51, 87-99; Mazur, J.E., 1991. Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. J. Exp. Anal. Behav. 63, 139-150] found that choice of the probabilistic reinforcer increased dramatically when the delay-interval stimuli were omitted on no-food trials, but this study found no such effect with the rats. In other conditions, the probability of food was varied, and comparisons to previous studies with pigeons indicated that rats showed greater sensitivity to decreasing reinforcer probabilities. The results support the hypothesis that rats' choices in these situations depend on the total time between a choice response and a reinforcer, whereas pigeons' choices are strongly influenced by the presence of delay-interval stimuli.     

Effect of short-term prefeeding and body weight on wheel running and responding reinforced by the opportunity to run in a wheel

A biobehavioural analysis of activity anorexia suggests that the motivation for physical activity is regulated by food supply and body weight. In the present experiment, food allocation was varied within subjects by prefeeding food-deprived rats 0, 5, 10 and 15 g of food before sessions of lever pressing for wheel-running reinforcement. The experiment assessed the effects of prefeeding on rates of wheel running, lever pressing, and postreinforcement pausing. Results showed that prefeeding animals 5 g of food had no effect. Prefeeding 10 g of food reduced lever pressing for wheel running and rates of wheel running without a significant change in body weight; the effect was, however, transitory. Prefeeding 15 g of food increased the animals' body weights, resulting in a sustained decrease of wheel running and lever pressing, and an increase in postreinforcement pausing. Overall the results indicate that the motivation for physical activity is regulated by changes in local food supply, but is sustained only when there is a concomitant change in body weight.     

Haloperidol, dynamics of choice, and the parameters of the matching law

The idea that dopamine mediates the reinforcing effects of stimuli persists in the field of neurosciences. The present study shows that haloperidol, a dopamine antagonist, does not eliminate the reinforcing value of food reinforcers. The ratio of reinforcers changed seven times across two levers within sessions, modeling a dynamic environment. The magnitude of the reinforcer was manipulated independently of the reinforcer ratio. Four doses of intraperitoneal haloperidol were assessed over periods of 12 daily sessions. Haloperidol did not impair the discrimination that the rats established between rich and lean levers; the response distributions favored the lever associated with the higher probability of reinforcement and the larger pellets. The parameters of the generalized matching law (bias and sensitivity) were used to estimate effects of haloperidol upon the motor system and upon the rats' motivation for food reinforcers.     

Dopaminergic Modulation of Effort-Related Choice Behavior as Assessed by a Progressive Ratio Chow Feeding Choice Task: Pharmacological Studies and the Role of Individual Differences

Mesolimbic dopamine (DA) is involved in behavioral activation and effort-related processes. Rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. In the present study, the effects of several drug treatments were assessed using a progressive ratio (PROG)/chow feeding concurrent choice task. With this task, rats can lever press on a PROG schedule reinforced by a preferred high-carbohydrate food pellet, or alternatively approach and consume the less-preferred but concurrently available laboratory chow. Rats pass through each ratio level 15 times, after which the ratio requirement is incremented by one additional response. The DA D₂ antagonist haloperidol (0.025–0.1 mg/kg) reduced number of lever presses and highest ratio achieved but did not reduce chow intake. In contrast, the adenosine A_2A antagonist MSX-3 increased lever presses and highest ratio achieved, but decreased chow consumption. The cannabinoid CB1 inverse agonist and putative appetite suppressant AM251 decreased lever presses, highest ratio achieved, and chow intake; this effect was similar to that produced by pre-feeding. Furthermore, DA-related signal transduction activity (pDARPP-32(Thr34) expression) was greater in nucleus accumbens core of high responders (rats with high lever pressing output) compared to low responders. Thus, the effects of DA antagonism differed greatly from those produced by pre-feeding or reduced CB1 transmission, and it appears unlikely that haloperidol reduces PROG responding because of a general reduction in primary food motivation or the unconditioned reinforcing properties of food. Furthermore, accumbens core signal transduction activity is related to individual differences in work output.     

Do peptide-induced changes in feeding occur because of changes in motivation to eat?

The usual paradigm in which peptides are tested for their effect on food intake involves measuring intake of readily available food. In the lever press apparatus, the subjects must "work" to get food. Such work has traditionally been used as a means of measuring motivation. Mice were trained to press a lever for milk reinforcement. After achieving a stable level of performance, we tested the effects of gastrin-related peptide (GRP), bombesin (BBS) and cholecystokinin octapeptide (CCK-8) on lever pressing. All three peptides suppressed lever pressing for milk reinforcement. Prefeeding mice with milk increased the suppression of lever pressing to a greater extent in peptide-treated mice than in saline-treated mice. As the duration of prefeeding increased, lever pressing decreased. When mice were required to make more lever presses to obtain milk, both saline- and CCK-8-treated mice increased their lever pressing. However, saline-treated mice pressed at a higher rate than CCK-8-treated mice. Unlike the results obtained with saline and CCK-8, administration of a known gustatory adversant, lithium chloride, suppressed lever pressing to the same degree in mice fed or not fed prior to training. The results are consistent with the hypothesis that these peptides act as satiety agents.     

Reinforcement context and resistance to change

Eight pigeons responded in a multiple variable-interval (VI) schedule in which a constant component always delivered 40rft/h, and an alternated component was either rich (200rft/h) or lean (6.67rft/h) in different conditions. Four tests of resistance to change were conducted in each condition: prefeeding, full extinction, constant-component-only extinction, and response-independent food. Resistance to both prefeeding and full extinction in the constant component varied inversely with the reinforcement rate in the alternated component, but resistance to response-independent food did not. The extinction and response-independent food results were consistent with [J. Exp. Psychol.: Anim. Behav. Proc. 25 (1999) 256] behavioral momentum model. Maintaining reinforcement in the alternated component increased resistance to extinction in the constant component, as predicted by the behavioral momentum model but not accounts of multiple-schedule performance based on [J. Exp. Anal. Behav. 13 (1970) 243] equation. Overall, the momentum model gave a good account of the results with the exception of the prefeeding data. Possible ways to reconcile the prefeeding results with behavioral momentum theory are considered.     

Alterations in time-place learning induced by lesions to the rat medial prefrontal cortex

This experiment examined the effect of medial prefrontal lesions on time-place learning in the rat. During the first phase, prior to lesioning, rats received training on an interval time-place task. Food was available on each of four levers for 3 consecutive min of a 12-min session. The levers provided food in the same sequence on all trials. Rats restricted the majority of their presses on each lever to the time in each session when it provided food and were able to anticipate when a lever was going to provide food. During the second phase some rats received lesions that were restricted to the medial prefrontal cortex. Following these very restricted lesions, rats continued pressing a lever after it stopped providing food (i.e. perseverated, as if their internal clock was running slow). The third phase involved changing the order in which the levers provided food. Lesions had no discernable effect on the rats' ability to learn the correct sequence of food availability. However, this change made the rats' timing perseveration even more noticeable. Our results suggest the medial prefrontal cortex is not necessary for acquisition of time-place sequencing information. However, lesions do appear to produce perseveration on components of the sequence.     

A general method for evaluating incubation of sucrose craving in rats

For someone on a food-restricted diet, food craving in response to food-paired cues may serve as a key behavioral transition point between abstinence and relapse to food taking. Food craving conceptualized in this way is akin to drug craving in response to drug-paired cues. A rich literature has been developed around understanding the behavioral and neurobiological determinants of drug craving; we and others have been focusing recently on translating techniques from basic addiction research to better understand addiction-like behaviors related to food. As done in previous studies of drug craving, we examine sucrose craving behavior by utilizing a rat model of relapse. In this model, rats self-administer either drug or food in sessions over several days. In a session, lever responding delivers the reward along with a tone+light stimulus. Craving behavior is then operationally defined as responding in a subsequent session where the reward is not available. Rats will reliably respond for the tone+light stimulus, likely due to its acquired conditioned reinforcing properties. This behavior is sometimes referred to as sucrose seeking or cue reactivity. In the present discussion we will use the term "sucrose craving" to subsume both of these constructs. In the past decade, we have focused on how the length of time following reward self-administration influences reward craving. Interestingly, rats increase responding for the reward-paired cue over the course of several weeks of a period of forced-abstinence. This "incubation of craving" is observed in rats that have self-administered either food or drugs of abuse. This time-dependent increase in craving we have identified in the animal model may have great potential relevance to human drug and food addiction behaviors. Here we present a protocol for assessing incubation of sucrose craving in rats. Variants of the procedure will be indicated where craving is assessed as responding for a discrete sucrose-paired cue following extinction of lever pressing within the sucrose self-administration context (Extinction without cues) or as responding for sucrose-paired cues in a general extinction context (Extinction with cues).     

Serial conditional discrimination and temporal bisection in rats selectively lesioned in the dentate gyrus

In positive serial conditional discrimination, animals respond during a target stimulus when it is preceded by a feature stimulus, but they do not respond when the same target stimulus is presented alone. Moreover, the feature and target stimuli are separated from each other by an empty interval. The present work aimed to investigate if two durations (4 or 16 s) of the same feature stimulus (light) could modulate the operant responses of rats to different levers (A and B) during a 5-s target stimulus (tone). In the present study, lever A was associated with the 4-s light, and lever B was associated with the 16-s light. A 5-s empty interval was included between the light and the tone. In the same training procedure, the rats were also presented with the 5-s tone without the preceding light stimuli. In these trials, the responses were not reinforced. We evaluated the hippocampal involvement of these behavioral processes by selectively lesioning the dentate gyrus with colchicine. Once trained, the rats were submitted to a test using probe trials without reinforcement. They were presented with intermediate durations of the feature stimulus (light) to obtain a temporal bisection curve recorded during the exposure to the target stimuli. The rats from both groups learned to respond with high rates during tones preceded by light and with low rates during tones presented alone, which indicated acquisition of the serial conditional discrimination. The rats were able to discriminate between the 4- and 16-s lights by correctly choosing lever A or B. In the test, the temporal bisection curves from both experimental groups showed a bisection point at the arithmetic mean between 4 and 16 s. Such processes were not impaired by the dentate gyrus lesion. Thus, our results showed that different durations of a feature stimulus could result in conditional properties. However, this processing did not appear to depend on the dentate gyrus alone.     

Rats Work for Food They then Reject: Support for the Information-primacy Approach to Learned Industriousness

There is good evidence that in many situations, animals prefer to work for food even when identical food is freely available. This phenomenon is called ‘learned industriousness’ or ‘contrafreeloading’ and has been found in several species. This study shows that wild rats will also work hard for contaminated food that they associate with sickness and subsequently reject, even when wholesome food is continuously available at no extra cost. Seven wild rats (Rattus novegicus) lived for 4 wk in cages containing two operant levers and associated pellet dispensers. The rats earned all their food by lever pressing for 45-mg food pellets on a variable-interval 10 s (VI10s) schedule in each dispenser. After 1 wk, pellets containing a sub-lethal dose of an acute rodenticide were available for 12 h (the test period) from the preferred dispenser, before being replaced by normal food pellets. This procedure was repeated 1 wk and 4 wk later. The number of lever presses, pellets delivered, and pellets consumed at each dispenser were recorded for 12 h prior to the test period, during the 12-h test period, and 12 h after the test period. The rats quickly learned to shift their feeding preference during the test period away from the dispenser that provided the rodenticide pellets. However, during the second half of the test period, lever pressing at this dispenser increased, even though the pellets thereby obtained were still rejected. This divergence between the lever pressing rate and the pellet consumption rate increased over the three trials. This ‘learned-industriousness’ behaviour is not easily explained by the self-reinforcing hypothesis, by the obligate species-specific response hypothesis, or as some artefact of the operant situation. It is suggested that the lever pressing towards the end of the trial, for pellets that were rejected, enabled the animals to gather information about a rare, but very important, event, namely, the presence of dangerous food at a previously preferred and normally safe feeding site. The data lend support to the information-primacy theory of learned industriousness.     

Laughing Rats Are Optimistic

Emotions can bias human decisions- for example depressed or anxious people tend to make pessimistic judgements while those in positive affective states are often more optimistic. Several studies have reported that affect contingent judgement biases can also be produced in animals. The animals, however, cannot self-report; therefore, the valence of their emotions, to date, could only be assumed. Here we present the results of an experiment where the affect-contingent judgement bias has been produced by objectively measured positive emotions. We trained rats in operant Skinner boxes to press one lever in response to one tone to receive a food reward and to press another lever in response to a different tone to avoid punishment by electric foot shock. After attaining a stable level of discrimination performance, the animals were subjected to either handling or playful, experimenter-administered manual stimulation – tickling. This procedure has been confirmed to induce a positive affective state in rats, and the 50-kHz ultrasonic vocalisations (rat laughter) emitted by animals in response to tickling have been postulated to index positive emotions akin to human joy. During the tickling and handling sessions, the numbers of emitted high-frequency 50-kHz calls were scored. Immediately after tickling or handling, the animals were tested for their responses to a tone of intermediate frequency, and the pattern of their responses to this ambiguous cue was taken as an indicator of the animals'' optimism. Our findings indicate that tickling induced positive emotions which are directly indexed in rats by laughter, can make animals more optimistic. We demonstrate for the first time a link between the directly measured positive affective state and decision making under uncertainty in an animal model. We also introduce innovative tandem-approach for studying emotional-cognitive interplay in animals, which may be of great value for understanding the emotional-cognitive changes associated with mood disorders.     

A Procedure to Study the Effect of Prolonged Food Restriction on Heroin Seeking in Abstinent Rats

In human drug addicts, exposure to drug-associated cues or environments that were previously associated with drug taking can trigger relapse during abstinence. Moreover, various environmental challenges can exacerbate this effect, as well as increase ongoing drug intake.The procedure we describe here highlights the impact of a common environmental challenge, food restriction, on drug craving that is expressed as an augmentation of drug seeking in abstinent rats.Rats are implanted with chronic intravenous i.v. catheters, and then trained to press a lever fori.v. heroin over a period of 10-12 days. Following the heroin self-administration phase the rats are removed from the operant conditioning chambers and housed in the animal care facility for a period of at least 14 days. While one group is maintained under unrestricted access to food (sated group), a second group (FDR group) is exposed to a mild food restriction regimen that results in their body weights maintained at 90% of their nonrestricted body weight. On day 14 of food restriction the rats are transferred back to the drug-training environment, and a drug-seeking test is run under extinction conditions (i.e. lever presses do not result in heroin delivery).The procedure presented here results in a highly robust augmentation of heroin seeking on test day in the food restricted rats. In addition, compared to the acute food deprivation manipulations we have used before, the current procedure is a more clinically relevant model for the impact of caloric restriction on drug seeking. Moreover, it might be closer to the human condition as the rats are not required to go through an extinction-training phase before the drug-seeking test, which is an integral component of the popular reinstatement procedure.     

Female mini-pig performance of temporal response differentiation, incremental repeated acquisition, and progressive ratio operant tasks

Increased knowledge of the cognitive abilities of mini-pigs is needed due to their increasing use in behavioral neuroscience research. Here, six female Yucatan mini-pigs performed tasks thought to measure timing behavior (temporal response differentiation, TRD), learning (incremental repeated acquisition, IRA), and motivation (progressive ratio, PR). Daily 30-min sessions for food reinforcers required a lever press be maintained for at least 10 but no longer than 14s (TRD), learning a new sequence of lever presses each test day (IRA) or an escalating number of presses for subsequent reinforcers (PR). All animals performed PR two days/week while three performed TRD five days/week and the other three performed IRA five days/week. Over the four test weeks, no animal completed TRD training and only one appeared to progress. For this task, lever press maintenance appeared difficult since by choice, the pigs used a front hoof, rather than the snout, to press the lever. IRA subjects showed gradually increasing performance with response rates comparable to those of rats but below those of children and monkeys and accuracy below that for rats. PR response rates were higher than those typically reported for rats, but lower than for adult rhesus monkeys or children. Physical differences in the way that each species responds likely account for these differences.     

Motivational state and reward content determine choice behavior under risk in mice

Risk is a ubiquitous feature of the environment for most organisms, who must often choose between a small and certain reward and a larger but less certain reward. To study choice behavior under risk in a genetically well characterized species, we trained mice (C57BL/6) on a discrete trial, concurrent-choice task in which they must choose between two levers. Pressing one lever (safe choice) is always followed by a small reward. Pressing the other lever (risky choice) is followed by a larger reward, but only on some of the trials. The overall payoff is the same on both levers. When mice were not food deprived, they were indifferent to risk, choosing both levers with equal probability regardless of the level of risk. In contrast, following food or water deprivation, mice earning 10% sucrose solution were risk-averse, though the addition of alcohol to the sucrose solution dose-dependently reduced risk aversion, even before the mice became intoxicated. Our results falsify the budget rule in optimal foraging theory often used to explain behavior under risk. Instead, they suggest that the overall demand or desired amount for a particular reward determines risk preference. Changes in motivational state or reward identity affect risk preference by changing demand. Any manipulation that increases the demand for a reward also increases risk aversion, by selectively increasing the frequency of safe choices without affecting frequency of risky choices.     

Perseverative responding in male and female Wistar rats: effects of gonadal hormones

Response perseveration was investigated in an experimental procedure which has previously been shown to be sensitive to pharmacologically induced behavioral perseveration and response stereotypy. Different groups of intact, gonadectomized, and gonadectomized plus chronically testosterone-treated male and female Wistar rats were exposed to this procedure in which reinforcers were randomly assigned to one of two levers in an operant chamber. One response on the lever to which the reinforcer was assigned was sufficient to produce a food pellet. Response perseveration, defined as the percentage of trials on which more than one response on the lever not selected for reinforcement was made prior to switching to the selected lever was highest in testosterone-treated subjects. Females made more responses on the lever which had been selected for food on the preceding trial, suggesting that females may be more sensitive than males to the consequences of their behavior. This behavioral difference between the sexes may be mediated by the male hormone testosterone.     

The inhibitory effect of pretrial reinforcement on instrumental conditioning

It has been shown previously that pretrial feeding retards acquisition of an instrumental response. The present experiment tested three hypotheses for this effect: priming, overshadowing and conditioned inhibition. Rats were trained in a runway task with a partial schedule of food reinforcement. Rats that were prefed immediately prior to rewarded trials showed a decrement in acquisition when compared with subjects prefed 180 seconds pretrial. Other subjects prefed immediately prior to nonrewarded trials showed a similar decrement in acquisition, even though the pretrial and goal reinforcers occurred on separate trials. Thus, the adverse effects of prefeeding occurred in the absence of conditions necessary for priming or overshadowing to occur. The results suggest there may be an inhibitory aftereffect of food rewards which can become conditioned to subsequent stimuli.     

Effect of tonic pain on schedule specific feeding behaviour

Food deprivation produces analgesia. This response is reversed i.e. pain sensitivity is lowered, when the food deprived rats are fed. In the present study the effect of chronic pain on the motivation to get food, in food deprived rats, was observed. In ten rats the effect of formalin and morphine plus formalin on the motivation to get food was studied. Injection of formalin significantly (P < 0.01) decreased the number of lever presses from 450 +/- 30 to 225 +/- 25. However, after injecting morphine the effect was reversed. The present study shows reduced internal drive to procure food by the food deprived animals, when they were under chronic pain. The effect was blocked by morphine, suggesting the role of opioids in modulating the motivation for getting food.     

One-trial instrumental conditioning in rats

A new method for a single-trial operant conditioning task with food reward in rats is described. The non-contingent reward of the first random lever press resulted in a higher response rate in both 24 and 48-hour retention tests as compared to contingently rewarded individuals. The latency to press the lever was shorter in non-contingently rewarded subjects than in contingently rewarded rats. The response rate in the first 5-min interval of the 24-hour retention test was higher in non-contingently rewarded subjects. The neuroleptic haloperidol (500 micrograms/kg., i.p.) given immediately following the "event to be remembered" significantly depresses the response rate compared to that for saline-treated controls. The advantages of the new method are discussed with respect to its applicability for memory research in animals and especially in neurophysiology and psychopharmacology.     

60 Hz electric fields and incandescent light as aversive stimuli controlling the behavior of rats responding under concurrent schedules of reinforcement

Several reports have shown that animals will sometimes engage in behaviors that reduce their exposure to a 60 Hz electric field (E-field). The field, therefore, can function as an aversive stimulus. In other studies, the E-field at equivalent strengths failed to function as an aversive stimulus. The present experiment, using rats, demonstrates how factors other than field strength can influence whether a subject engages in behavior that reduces field exposure. The general design consisted of giving the rat a choice between two alternatives, one of which sometimes included an added stimulus. Each subject was trained to press each of two levers to obtain food. Pressing one lever was reinforced intermittently under a variable interval 2 min schedule (VI 2); pressing the other lever was reinforced by a second VI 2 schedule operating independently of the first. Under this concurrent schedule the rat spent 50% of the daily 50 min session responding to each of the levers, indicating that they were equally “valued.” Next, while the schedules remained in effect, the first response to one of the levers turned on a 100 kV/m E-field which remained on until the rat pressed the other lever. The time spent responding under the schedule associated with the field was reduced by about 5–10%. When the procedure was changed so that no lever presses produced food, i.e., extinction, but the added stimulus contingency remained, the rats spent even less time in the presence of the field. Similar outcomes were observed during both the concurrent food or extinction schedules when incandescent light was used. Thus, both an E-field and incandescent light functioned as aversive stimuli, but the magnitude of the aversiveness was small. Aversiveness depended not only on stimulus intensity, but also on behavioral factors. Bioelectromagnetics 19:210–221, 1998. © 1998 Wiley-Liss, Inc.