Food motivated behavior of melanocortin-4 receptor knockout mice under a progressive ratio schedule

Melanocortin-4 receptor knockout (MC4RKO) mice are hyperphagic and develop obesity under free feeding conditions. We reported previously that MC4RKO mice did not maintain hyperphagia and as a result lost weight when required to press a lever to obtain food on a fixed ratio procurement schedule. To assess the generality of this result, we tested MC4RKO mice and their heterozygous and wild type littermates using progressive ratio (PR) schedules that are believed to be sensitive indicators of motivation. Mice lived in operant chambers and obtained all of their food (20mg pellets) via lever press responding. Food was available according to a PR schedule so that within a meal, food became progressively more costly, and we expected this would provide a stringent test of mechanisms controlling meal size. The schedule reset after either 3 or 20min of no responding, so defining meals, and the highest ratio completed before the reset was defined as the breakpoint. The average daily number of meals was lower and mean size of meals was higher at the 20 compared with the 3min reset condition. Mean daily food intake did not differ between the two reset criteria but did differ as a function of genotype, with MC4RKO mice eating about 25% more than heterozygous or wild type mice. Hyperphagia in the MC4RKO mice was characterized primarily by larger meals (higher breakpoints) and they emitted about twice as many responses as wild type mice. Thus, using a PR schedule, MC4RKO mice exhibit hyperphagia, and show a high level of motivation to support large meal sizes.     

Shift of circadian feeding pattern by high-fat diets is coincident with reward deficits in obese mice

Recent studies provide evidence that high-fat diets (HF) trigger both i) a deficit of reward responses linked to a decrease of mesolimbic dopaminergic activity, and ii) a disorganization of circadian feeding behavior that switch from a structured meal-based schedule to a continuous snacking, even during periods normally devoted to rest. This feeding pattern has been shown to be a cause of HF-induced overweight and obesity. Our hypothesis deals with the eventual link between the rewarding properties of food and the circadian distribution of meals. We have investigated the effect of circadian feeding pattern on reward circuits by means of the conditioned-place preference (CPP) paradigm and we have characterized the rewarding properties of natural (food) and artificial (cocaine) reinforcers both in free-feeding ad libitum HF mice and in HF animals submitted to a re-organized feeding schedule based on the standard feeding behavior displayed by mice feeding normal chow ("forced synchronization"). We demonstrate that i) ad libitum HF diet attenuates cocaine and food reward in the CPP protocol, and ii) forced synchronization of feeding prevents this reward deficit. Our study provides further evidence that the rewarding impact of food with low palatability is diminished in mice exposed to a high-fat diet and strongly suggest that the decreased sensitivity to chow as a positive reinforcer triggers a disorganized feeding pattern which might account for metabolic disorders leading to obesity.     

Quantifying Social Motivation in Mice Using Operant Conditioning

In this protocol, social motivation is measured in mice through a pair of operant conditioning paradigms. To conduct the experiments, two-chambered shuttle boxes were equipped with two operant levers (left and right) and a food receptacle in one chamber, which was then divided from the second chamber by an automated guillotine door covered by a wire grid. Different stimulus mice, rotated across testing days, served as a social stimulus behind the wire grid, and were only visible following the opening of the guillotine door. Test mice were trained to lever press in order to open the door and gain access to the stimulus partner for 15 sec. The number of lever presses required to obtain the social reward progressively increased on a fixed schedule of 3. Testing sessions ended after test mice stopped lever pressing for 5 consecutive minutes. The last reinforced ratio or breakpoint can be used as a quantitative measure of social motivation. For the second paradigm, test mice were trained to discriminate between left and right lever presses in order to obtain either a food reward or the social reward. Mice were rewarded for every 3 presses of each respective lever. The number of food and social rewards can be compared as a measurement of the value placed upon each reward. The ratio of each reward type can also be compared between mouse strains and the change in this ratio can be monitored within testing sessions to measure satiation with a given reward type. Both of these operant conditioning paradigms are highly useful for the quantification of social motivation in mouse models of autism and other disorders of social behavior.     

Obese OLETF rats exhibit increased operant performance for palatable sucrose solutions and differential sensitivity to D2 receptor antagonism

CCK-1-receptor-deficient Otsuka Long-Evans Tokushima fatty (OLETF) rats are hyperphagic and exhibit a greater preference for sucrose compared with lean controls [Long-Evans Tokushima Otsuka (LETO)]. To directly assess motivation to work for sucrose reward in this model of obesity and type 2 diabetes, we examined the operant performance of OLETF rats at nondiabetic and prediabetic stages (14 and 24 wk of age, respectively) on fixed-ratio (FR) and progressive-ratio (PR) schedules of reinforcement. To evaluate the involvement of dopamine systems, the effects of the D1 receptor antagonist SCH23390 (100 and 200 nmol/kg ip) and the D2 receptor antagonist raclopride (200 and 400 nmol/kg ip), were also tested on PR responding for sucrose. Compared with age-matched LETO rats, 14-wk-old OLETF rats emitted more licks on the "active" empty spout operant on the FR-10 schedule of reinforcement to obtain 0.01 M and 0.3 M sucrose and completed higher ratio requirements on the PR schedule to gain access to 0.3 M and 1.0 M sucrose. At 24 wk, this effect was limited to 1.0 M sucrose. Both antagonists were potent in reducing operant responding to 0.3 M sucrose in both strains at both ages, and there was no strain effect to SCH23390 at either age. OLETF rats, on the other hand, showed an increased sensitivity to the higher dose of raclopride, resulting in reduced responding to sucrose reinforcement at 24 wk. Taken together, these findings provide the first direct evidence for an increased motivation for sucrose reward in the OLETF rats and suggest altered D2 receptor regulation with the progression of obesity and prediabetes.     

How Many Calories Are on Our Plate? Expected Fullness,Not Liking,Determines Meal‐size Selection

The availability of highly palatable food is thought to stimulate the selection of larger meals (leading to weight gain and obesity). In this article, we explore aspects of this proposition. Specifically, we scrutinize two basic assumptions: (i) palatable energy‐dense foods are more rewarding (desired), and (ii) these palatable foods are selected in relatively larger portions. In combination with palatability, we also consider the relative role for “expected satiation”—the extent to which a food is expected to deliver satiation. A total of 17 commonly consumed foods were assessed by 28 normal‐weight participants at lunchtime. Critically, our measure of food reward and expected satiation involves comparisons between foods based on equicaloric portions. When assessed in this way, we find that food reward and ideal portion sizes (in kcal) are both closely associated with expected satiation, but not with “expected liking.” Low expected satiation (not expected liking) predicts the selection of large portion sizes (in kcal) and foods with this characteristic tend to be more energy dense and are regarded as less (not more) rewarding (when compared calorie for calorie). Together, these findings challenge the role of palatability in meal‐size selection and they highlight the importance of expected satiation, a “nonaffective” component of food reward.     

A Novel Procedure for Evaluating the Reinforcing Properties of Tastants in Laboratory Rats: Operant Intraoral Self-administration

This paper describes a novel method for studying the bio-behavioral basis of addiction to food. This method combines the surgical component of taste reactivity with the behavioral aspects of operant self-administration of drugs. Under very brief general anaesthesia, rats are implanted with an intraoral (IO) cannula that allows delivery of test solutions directly in the oral cavity. Animals are then tested in operant self-administration chambers whereby they can press a lever to receive IO infusions of test solutions. IO self-administration has several advantages over experimental procedures that involve drinking a solution from a spout or operant responding for solid pellets or solutions delivered in a receptacle. Here, we show that IO self-administration can be employed to study self-administration of high fructose corn syrup (HFCS). Rats were first tested for self-administration on a progressive ratio (PR) schedule, which assesses the maximum amount of operant behavior that will be emitted for different concentrations of HFCS (i.e. 8%, 25%, and 50%). Following this test, rats self-administered these concentrations on a continuous schedule of reinforcement (i.e. one infusion for each lever press) for 10 consecutive days (1 session/day; each lasting 3 hr), and then they were retested on the PR schedule. On the continuous reinforcement schedule, rats took fewer infusions of higher concentrations, although the lowest concentration of HFCS (8%) maintained more variable self-administration. Furthermore, the PR tests revealed that 8% had lower reinforcing value than 25% and 50%. These results indicate that IO self-administration can be employed to study acquisition and maintenance of responding for sweet solutions. The sensitivity of the operant response to differences in concentration and schedule of reinforcement makes IO self-administration an ideal procedure to investigate the neurobiology of voluntary intake of sweets.     

Alcohol Reward Is Increased after Roux-en-Y Gastric Bypass in Dietary Obese Rats with Differential Effects following Ghrelin Antagonism

Roux-en-Y gastric bypass (RYGB) is one of the most successful treatments for severe obesity and associated comorbidities. One potential adverse outcome, however, is increased risk for alcohol use. As such, we tested whether RYGB alters motivation to self-administer alcohol in outbred dietary obese rats, and investigated the involvement of the ghrelin system as a potential underlying mechanism. High fat (60%kcal from fat) diet-induced obese, non-diabetic male Sprague Dawley rats underwent RYGB (n = 9) or sham operation (Sham, n = 9) and were tested 4 months after surgery on a progressive ratio-10 (PR10) schedule of reinforcement operant task for 2, 4, and 8% ethanol. In addition, the effects of the ghrelin-1a-receptor antagonist D-[Lys3]-GHRP-6 (50, 100 nmol/kg, IP) were tested on PR10 responding for 4% ethanol. Compared to Sham, RYGB rats made significantly more active spout responses to earn reward, more consummatory licks on the ethanol spout, and achieved higher breakpoints. Pretreatment with a single peripheral injection of D-[Lys3]-GHRP-6 at either dose was ineffective in altering appetitive or consummatory responses to 4% ethanol in the Sham group. In contrast, RYGB rats demonstrated reduced operant performance to earn alcohol reward on the test day and reduced consummatory responses for two subsequent days following the drug. Sensitivity to threshold doses of D-[LYS3]-GHRP-6 suggests that an augmented ghrelin system may contribute to increased alcohol reward in RYGB. Further research is warranted to confirm applicability of these findings to humans and to explore ghrelin-receptor targets for treatment of alcohol-related disorders in RYGB patients.     

Neuropeptide Y-induced operant responding for sucrose is not mediated by dopamine

Neuropeptide Y (NPY) induces feeding in previously satiated animals after injection into the hypothalamus, especially the perifornical region (PFH). NPY also appears to have rewarding properties as evidenced by its ability to produce a conditioned place preference following injection into the nucleus accumbens (N.Acc), an effect ostensibly mediated by mesolimbic dopamine (DA). Since the progressive-ratio (PR) operant schedule has also been used to assess an organism’s motivation to respond for rewarding stimuli, we tested the possibility that NPY increases PR responding for sucrose pellets. Adult male rats were injected with NPY (0–235 pmol) bilaterally through cannulae aimed to terminate in the PFH. This produced a dose-dependent increase in the total number of responses made and the number of reinforcers earned. The DA receptor blocker, α-flupenthixol (FLU)(0–0.2 mg/kg intraperitoneally), attenuated both NPY(156 pmol)-induced and drug-free PR responding while having no effect on NPY(156 pmol)-induced free-feeding. FLU injected directly into the N.Acc (0–5 μg) also failed to reduce sucrose free-feeding. These results suggest that distinct reward mechanisms are activated during PFH NPY-induced feeding vs. PR responding, since FLU disrupted the latter but not the former.     

Operant model of frustrated expected reward in mice

One aspect of the addictive process that has not been thoroughly investigated is the consequence of the frustrated state occurring when the drug is not available. The present study aimed to validate a novel operant model of frustrated expected reward in mice. C57BL/6J mice were trained in operant conditioning maintained by chocolate-flavoured pellets or cocaine. After the completion of high rates of responding on a progressive ratio schedule, the reward was unexpectedly withheld. The consequences of this frustrated behaviour on anxiety, aggressiveness, perseveration, extinction and reinstatement were investigated. Mice exposed to the frustrated event perseverated in the operant responses and showed increased aggressiveness in the resident-intruder test. These animals also showed higher rates of cue-induced reinstatement of drug seeking. The present study provides a reliable operant model in mice to evaluate a frustrated state following reward unavailability. This animal model could be useful to study the behavioural and neurochemical consequences related to the emotional states generated during the omission of a highly expected reward.     

食物成瘾及其神经环路调控机制

食物成瘾是指人们对某些特定食物（高度加工、可口、高热量的食物）的依赖性达到难以控制的程度,并表现出一系列成瘾样的行为学变化,具有强迫性、长期性和反复性的特点。食物成瘾可引起肥胖症,而且是大部分人不能维持减肥效果或坚持限制性饮食以保持健康体重的核心因素。深入理解食物成瘾及其神经生物学机制,将为干预食物成瘾以改善肥胖提供准确的靶点。食物成瘾的诊断标准是耶鲁大学食物成瘾量表,而食物成瘾的动物模型为小鼠食物自我管理模型。外侧下丘脑-腹侧被盖区-伏隔核神经环路、腹侧被盖区-前边缘皮质-伏隔核神经环路和外侧隔核-结节核神经环路是调控食物成瘾的关键神经环路机制。     

Relaxin‐3 receptor (Rxfp3) gene deletion reduces operant sucrose‐ but not alcohol‐responding in mice

The pervasive use of refined sugars in highly accessible, palatable foods and persistent exposure to reinforcing food‐associated cues has contributed to overconsumption of sugar‐rich diets and the current obesity epidemic in Western society. We have shown previously that brain relaxin‐3 mRNA levels positively correlate with sucrose and alcohol intake, and that central antagonism of relaxin‐3 receptors (RXFP3) attenuates alcohol self‐administration and alcohol‐seeking in rats, but food‐seeking behaviour and palatable food consumption in mice. To further examine the relationship between motivated appetitive behaviours and relaxin‐3/RXFP3 signalling, we investigated the effect of Rxfp3 gene deletion in C57BL/6J mice on sucrose and alcohol self‐administration and cue‐induced reinstatement (RNST) of sucrose‐ and alcohol‐seeking. Acquisition and maintenance of sucrose and alcohol self‐administration was assessed in male wild‐type (WT) and Rxfp3 knockout (KO) (C57BL/6J^{RXFP3TM1/DGen}) littermate mice using fixed ratio (FR) schedules of reinforcement. Mice were subsequently challenged with a progressive ratio (PR) test to measure motivation and, following extinction training, re‐exposed to reward‐associated cues to evaluate RNST of active lever‐responding. Wild‐type and Rxfp3 KO mice displayed similar acquisition of FR1 sucrose self‐administration, but Rxfp3 KO mice responded less when the instrumental requirement was increased to FR3. These mice also showed a lower breakpoint for sucrose and attenuated cue‐induced RNST of sucrose‐seeking. Notably, no marked genotype differences in alcohol‐responding were observed. In mice, endogenous relaxin‐3/RXFP3 signalling promotes self‐administration of sucrose under high response requirements and cue‐induced RNST of sucrose‐seeking, but does not apparently regulate motivation to consume alcohol or alcohol‐seeking behaviour.     

Stress and sex influences on food-seeking behaviors

Objective: Stress increases the drive to consume calorically dense preferred foods suggesting an exogenous factor that may induce caloric overconsumption and weight gain. As females show heightened stress sensitivity and present with increased rates of obesity, we hypothesized that stress‐induced increases in the motivation for preferred foods may be a sex‐specific predisposing factor for weight gain. Methods and Procedures: To investigate this hypothesis, we have developed a buried food paradigm that permits the measurement of sex differences and effects of chronic variable stress (CVS) on the latency to uncover and the consumption of a preferred food pellet without the requisite caloric restriction required in traditional operant conditioning tasks. Results: In our studies, females consistently showed latencies that were twice as fast as males to locate the buried pellet in limited access tests. Interestingly, during stress exposure, male latencies decreased to that of control female levels. Male and female mice showed a significant effect of stress, three‐ and fourfold, respectively, on increased consumption of the preferred food during testing. Discussion: These results support a basal sex difference in behaviors toward a preferred food, and a possible role of stress sensitivity in the drive and intake of such foods. Sex differences in the role stress plays in these behaviors may provide insight into underlying mechanisms related to an increased obesity risk.     

Measuring behavioral momentum

The metaphor of behavioral momentum proposes that when ongoing operant behavior is disrupted, changes in response rate are directly related to a force-like aspect of the disruptor and inversely proportional to behavioral mass. Several data sets suggest that differential resistance to change between the components of a multiple schedule satisfies the requirements of a ratio scale and is additive when different disruptors and different dimensions of reinforcement are combined. Differential resistance also provides a basis for scaling force in relation to rate of food presentation between components as a disruptor, and for scaling mass in relation to food rate within a component as a reinforcer. Preference in concurrent chains with terminal links identical to multiple-schedule components also meets the requirements of ratio-scale measurement, is additive when different dimensions of reinforcement are combined, and provides convergent measurement of behavioral mass.     

CART peptide and the mesolimbic dopamine system

Over the past decade, CART peptide has been commonly associated with the rewarding and reinforcing properties of drugs of abuse and natural rewards such as food. The mesolimbic dopamine system is the predominant pathway involved in mediating reward and reinforcement. Many behavioral and neuroanatomical studies have been conducted in order to further elucidate the importance of CART-containing neurons within the mesolimbic dopamine system. This chapter will review the current knowledge of the localization, synaptic connectivity and neurochemical content of CART peptidecontaining neurons in nuclei of the mesolimbic reward pathway. These nuclei include the nucleus accumbens (NA), ventral midbrain, and the lateral hypothalamus (LH). In conclusion, an interconnected CART-containing loop between the NA, ventral midbrain and LH has evolved from these neuroanatomical studies that may have functional implications for CART peptide's involvement in reward and reinforcement.     

Extinction of an appetitive operant response after administration of MSH

Hungry rats were trained to press a lever in order to obtain food on a fixed ratio (FR) or variable ratio (VR) of reinforcement. Rats trained on the FR schedule and injected with synthetic α-MSH had delayed extinction of the task as compared with control rats injected with diluent. The results show that MSH affects the behavior of rats in another type of behavioral situation involving an appetitive operant response.     

Effects of antianxiety and antipsychotic drugs on DRL responding for brain stimulation

Satiated rats could be trained to give stable rates of responding for rewarding stimulation of the lateral hypothalamus delivered on differential reinforcement of low rate (DRL) schedule requiring 2 to 8 sec interresponse intervals for reinforcement (DRL-2 to 8). The performance on a DRL-8 schedule was tested 30 min after the oral administration of benzodiazepines. Diazepam (5 and 10 mg/kg) and meprobamate (200 mg/kg) caused significant increases in response rates during the first 5 min of a session, but not thereafter. Bromazepam (1 and 5 mg/kg) also caused a significant increase in the rates during the first and second 5 min. On the other hand, chlorpromazine (20 mg/kg) caused no effect in the first 5 min but decrease in second and third 5 min. These results indicate that DRL schedules with a brain stimulation reward provided a useful tool for evaluation of antianxiety drugs. The advantage of the brain stimulation reward over food reward is that the possible effects of the drugs on hunger motivation need not be considered.     

Extending mathematical principles of reinforcement into the domain of behavioral pharmacology

Mathematical principles of reinforcement (MPR) attempts to integrate the empirical laws of reinforcement schedules that have accumulated over the decades. MPR is based on three principles: incentives excite behavior; there are temporal constraints on responding; and coupling of responses to reinforcers strengthens behavior [Behav. Brain Sci. 17 (1994) 105]. In the present paper MPR is extended into the domain of behavioral pharmacology, specifically to model the effects of D-amphetamine on operant behavior. In Experiment 1a, a five-component multiple fixed-ratio schedule was designed to generate behavioral baselines that were subsequently used to assess drug effect. In Experiments 1b and 1c, the quality and quantity of reinforcer were manipulated. The data generated by the three experiments were consistent with MPR. In Experiment 2, MPR was used to model the effects of D-amphetamine on rats responding under the five-component multiple fixed-ratio schedule. According to the model, the rate-decreasing effects of D-amphetamine were due primarily to motor disruption and secondarily to increased impulsivity; at the highest dosages, D-amphetamine also may have decreased the incentive value of food.     

Intra-accumbens baclofen, but not muscimol, increases second order instrumental responding for food reward in rats

Stimulation of either GABA(A) or GABA(B) receptors within the nucleus accumbens shell strongly enhances food intake in rats. However the effects of subtype-selective stimulation of GABA receptors on instrumental responses for food reward are less well characterized. Here we contrast the effects of the GABA(A) receptor agonist muscimol and GABA(B) receptor agonist baclofen on instrumental responding for food using a second order reinforcement schedule. Bilateral intra-accumbens administration of baclofen (220-440 pmol) stimulated responding but a higher dose (660 pmol) induced stereotyped oral behaviour that interfered with responding. Baclofen (220-660 pmol) also stimulated intake of freely available chow. Muscimol (220-660 pmol) was without effect on responding for food on this schedule but did stimulate intake of freely available chow. Unilateral administration of either baclofen or muscimol (220 pmol) induced similar patterns of c-fos immunoreactivity in several hypothalamic sites but differed in its induction in the central nucleus of the amygdala. We conclude that stimulation of GABA(A) or GABA(B) receptors in the nucleus accumbens shell of rats produces clearly distinguishable effects on operant responding for food.     

Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement

Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a "reward prediction error" (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function.