Ovarian hormones modulate 'compulsive' lever-pressing in female rats

Life events related to the female hormonal cycle may trigger the onset of obsessive-compulsive disorder (OCD) or exacerbate symptoms in women already suffering from it. These observations suggest a possible role for ovarian hormones in the course of this disorder. Yet, the mechanisms that may subserve the modulatory effect of ovarian hormones are currently unknown. The aim of the present study was therefore to test the role of ovarian hormones in the signal attenuation rat model of OCD. Experiment 1 compared the behavior of pre-pubertal and adult male and female rats in the model, and found no age and sex differences in compulsive responding. Experiment 2 found that compulsive responding fluctuates along the estrous cycle, being highest during late diestrous and lowest during estrous. Acute administration of estradiol to pre-pubertal female rats was found to attenuate compulsive behavior (Experiment 3), and withdrawal from chronic administration of estradiol was shown to increase this behavior (Experiment 4). These findings extend the use of the signal attenuation model of OCD to female rats, and by demonstrating that the model is sensitive to the levels of ovarian hormones, provide the basis for using the model to study the role of ovarian hormones in OCD. In addition, the present findings support the hypothesis that the increased risk of onset and exacerbation of OCD in women post-partum may be a result of the decrease in the level of estradiol, which was elevated during pregnancy.     

The effects of naloxone,diprenorphine, and diazepam on responding suppressed by pre-shock and pre-food stimuli

The lever-pressing of rats was reinforced with food according to a variable-interval 1-min schedule. In one group, occasional illumination of cue lights for 30-sec periods was followed by a brief electric shock; responding was suppressed during these periods. Naloxone (0.01–10 mg/kg) did not change the degree to which responding was suppressed during the pre-shock stimulus. Diprenorphine (0.1–10 mg/kg) slightly attenuated suppression, and diazepam (1.0–3.0 mg/kg) increased responding during the stimulus to normal levels. These results confirm that opiate antagonists do not always enhance the effects of shock on behavior. In a second group, occasional illumination of the cue lights for 20-sec periods was followed by delivery of free food pellets. Responding was also suppressed during the pre-food stimulus. Neither naloxone nor diprenorphine had any effect on response rate during this stimulus. In contrast to the results of earlier studies using benzodiazepines, diazepam (1.0–3.0 mg/kg) produced a marked attenuation of response suppression during the pre-food stimulus.     

A general method for evaluating incubation of sucrose craving in rats

For someone on a food-restricted diet, food craving in response to food-paired cues may serve as a key behavioral transition point between abstinence and relapse to food taking. Food craving conceptualized in this way is akin to drug craving in response to drug-paired cues. A rich literature has been developed around understanding the behavioral and neurobiological determinants of drug craving; we and others have been focusing recently on translating techniques from basic addiction research to better understand addiction-like behaviors related to food. As done in previous studies of drug craving, we examine sucrose craving behavior by utilizing a rat model of relapse. In this model, rats self-administer either drug or food in sessions over several days. In a session, lever responding delivers the reward along with a tone+light stimulus. Craving behavior is then operationally defined as responding in a subsequent session where the reward is not available. Rats will reliably respond for the tone+light stimulus, likely due to its acquired conditioned reinforcing properties. This behavior is sometimes referred to as sucrose seeking or cue reactivity. In the present discussion we will use the term "sucrose craving" to subsume both of these constructs. In the past decade, we have focused on how the length of time following reward self-administration influences reward craving. Interestingly, rats increase responding for the reward-paired cue over the course of several weeks of a period of forced-abstinence. This "incubation of craving" is observed in rats that have self-administered either food or drugs of abuse. This time-dependent increase in craving we have identified in the animal model may have great potential relevance to human drug and food addiction behaviors. Here we present a protocol for assessing incubation of sucrose craving in rats. Variants of the procedure will be indicated where craving is assessed as responding for a discrete sucrose-paired cue following extinction of lever pressing within the sucrose self-administration context (Extinction without cues) or as responding for sucrose-paired cues in a general extinction context (Extinction with cues).     

Effect of Cafeteria Diet History on Cue-, Pellet-Priming-, and Stress-Induced Reinstatement of Food Seeking in Female Rats

Background

Relapse to unhealthy eating habits is a major problem in human dietary treatment. The individuals most commonly seeking dietary treatment are overweight or obese women, yet the commonly used rat reinstatement model to study relapse to palatable food seeking during dieting primarily uses normal-weight male rats. To increase the clinical relevance of the relapse to palatable food seeking model, here we pre-expose female rats to a calorically-dense cafeteria diet in the home-cage to make them overweight prior to examining the effect of this diet history on cue-, pellet-priming- and footshock-induced reinstatement of food seeking.

Methods

Post-natal day 32 female Long-Evans rats had seven weeks of home-cage access to either chow only or daily or intermittent cafeteria diet alongside chow. Next, they were trained to self-administer normally preferred 45 mg food pellets accompanied by a tone-light cue. After extinction, all rats were tested for reinstatement induced by discrete cue, pellet-priming, and intermittent footshock under extinction conditions.

Results

Access to daily cafeteria diet and to a lesser degree access to intermittent cafeteria diet decreased food pellet self-administration compared to chow-only. Prior history of these cafeteria diets also reduced extinction responding, cue- and pellet-priming-induced reinstatement. In contrast, modest stress-induced reinstatement was only observed in rats with a history of daily cafeteria diet.

Conclusion

A history of cafeteria diet does not increase the propensity for cue- and pellet-priming-induced relapse in the rat reinstatement model but does appear to make rats more susceptible to footshock stress-induced reinstatement.     

Behavioral flexibility in a mouse model for obsessive‐compulsive disorder: Impaired Pavlovian reversal learning in SAPAP3 mutants

Obsessive‐compulsive disorder (OCD) is characterized by obsessive thinking, compulsive behavior and anxiety, and is often accompanied by cognitive deficits. The neuropathology of OCD involves dysregulation of cortical‐striatal circuits. Similar to OCD patients, SAPAP3 knockout mice 3 (SAPAP3^?/?) exhibit compulsive behavior (grooming), anxiety and dysregulated cortical‐striatal function. However, it is unknown whether SAPAP3^?/? display cognitive deficits and how these different behavioral traits relate to one another. SAPAP3^?/? and wild‐type (WT) littermates were trained in a Pavlovian conditioning task pairing visual cues with the delivery of sucrose solution. After mice learned to discriminate between a reward‐predicting conditioned stimulus (CS+) and a non‐reward stimulus (CS?), contingencies were reversed (CS+ became CS? and vice versa). Additionally, we assessed grooming, anxiety and general activity. SAPAP3^?/? acquired Pavlovian approach behavior similarly to WT, albeit less vigorously and with a different strategy. However, unlike WT, SAPAP3^?/? were unable to adapt their behavior after contingency reversal, exemplified by a lack of re‐establishing CS+ approach behavior (sign tracking). Surprisingly, such behavioral inflexibility, decreased vigor, compulsive grooming and anxiety were unrelated. This study shows that SAPAP3^?/? are capable of Pavlovian learning, but lack flexibility to adapt associated conditioned approach behavior. Thus, SAPAP3^?/? not only display compulsive‐like behavior and anxiety, but also cognitive deficits, confirming and extending the validity of SAPAP3^?/? as a suitable model for the study of OCD. The observation that compulsive‐like behavior, anxiety and behavioral inflexibility were unrelated suggests a non‐causal relationship between these traits and may be of clinical relevance for the treatment of OCD.     

Mere expectation to move causes attenuation of sensory signals

When a part of the body moves, the sensation evoked by a probe stimulus to that body part is attenuated. Two mechanisms have been proposed to explain this robust and general effect. First, feedforward motor signals may modulate activity evoked by incoming sensory signals. Second, reafferent sensation from body movements may mask the stimulus. Here we delivered probe stimuli to the right index finger just before a cue which instructed subjects to make left or right index finger movements. When left and right cues were equiprobable, we found attenuation for stimuli to the right index finger just before this finger was cued (and subsequently moved). However, there was no attenuation in the right finger just before the left finger was cued. This result suggests that the movement made in response to the cue caused 'postdictive' attenuation of a sensation occurring prior to the cue. In a second experiment, the right cue was more frequent than the left. We now found attenuation in the right index finger even when the left finger was cued and moved. This attenuation linked to a movement that was likely but did not in fact occur, suggests a new expectation-based mechanism, distinct from both feedforward motor signals and postdiction. Our results suggest a new mechanism in motor-sensory interactions in which the motor system tunes the sensory inputs based on expectations about future possible actions that may not, in fact, be implemented.     

60 Hz electric fields and incandescent light as aversive stimuli controlling the behavior of rats responding under concurrent schedules of reinforcement

Several reports have shown that animals will sometimes engage in behaviors that reduce their exposure to a 60 Hz electric field (E-field). The field, therefore, can function as an aversive stimulus. In other studies, the E-field at equivalent strengths failed to function as an aversive stimulus. The present experiment, using rats, demonstrates how factors other than field strength can influence whether a subject engages in behavior that reduces field exposure. The general design consisted of giving the rat a choice between two alternatives, one of which sometimes included an added stimulus. Each subject was trained to press each of two levers to obtain food. Pressing one lever was reinforced intermittently under a variable interval 2 min schedule (VI 2); pressing the other lever was reinforced by a second VI 2 schedule operating independently of the first. Under this concurrent schedule the rat spent 50% of the daily 50 min session responding to each of the levers, indicating that they were equally “valued.” Next, while the schedules remained in effect, the first response to one of the levers turned on a 100 kV/m E-field which remained on until the rat pressed the other lever. The time spent responding under the schedule associated with the field was reduced by about 5–10%. When the procedure was changed so that no lever presses produced food, i.e., extinction, but the added stimulus contingency remained, the rats spent even less time in the presence of the field. Similar outcomes were observed during both the concurrent food or extinction schedules when incandescent light was used. Thus, both an E-field and incandescent light functioned as aversive stimuli, but the magnitude of the aversiveness was small. Aversiveness depended not only on stimulus intensity, but also on behavioral factors. Bioelectromagnetics 19:210–221, 1998. © 1998 Wiley-Liss, Inc.     

Feedback control strategies for spatial navigation revealed by dynamic modelling of learning in the Morris water maze

The Morris water maze is an experimental procedure in which animals learn to escape swimming in a pool using environmental cues. Despite its success in neuroscience and psychology for studying spatial learning and memory, the exact mnemonic and navigational demands of the task are not well understood. Here, we provide a mathematical model of rat swimming dynamics on a behavioural level. The model consists of a random walk, a heading change and a feedback control component in which learning is reflected in parameter changes of the feedback mechanism. The simplicity of the model renders it accessible and useful for analysis of experiments in which swimming paths are recorded. Here, we used the model to analyse an experiment in which rats were trained to find the platform with either three or one extramaze cue. Results indicate that the 3-cues group employs stronger feedback relying only on the actual visual input, whereas the 1-cue group employs weaker feedback relying to some extent on memory. Because the model parameters are linked to neurological processes, identifying different parameter values suggests the activation of different neuronal pathways.     

Carbon Disulfide Mediates Socially-Acquired Nicotine Self-Administration

The social environment plays a critical role in smoking initiation as well as relapse. We previously reported that rats acquired nicotine self-administration with an olfactogustatory cue only when another rat consuming the same cue was present during self-administration. Because carbon disulfide (CS₂) mediates social learning of food preference in rodents, we hypothesized that socially acquired nicotine self-administration is also mediated by CS₂. We tested this hypothesis by placing female adolescent Sprague-Dawley rats in operant chambers equipped with two lickometers. Licking on the active spout meeting a fixed-ratio 10 schedule triggered the concurrent delivery of an i.v. infusion (saline, or 30 µg/kg nicotine, free base) and an appetitive olfactogustatory cue containing CS₂ (0–500 ppm). Rats that self-administered nicotine with the olfactogustatory cue alone licked less on the active spout than on the inactive spout. Adding CS₂ to the olfactogustatory cue reversed the preference for the spouts. The group that received 500 ppm CS₂ and the olfactogustatory cue obtained a significantly greater number of nicotine infusions than other groups. After extinction training, the original self-administration context reinstated nicotine-seeking behavior in all nicotine groups. In addition, in rats that received the olfactogustatory cue and 500 ppm CS₂ during SA, a social environment where the nicotine-associated olfactory cue is present, induced much stronger drug-seeking behavior compared to a social environment lacking the olfactogustatory cue. These data established that CS₂ is a critical signal that mediates social learning of nicotine self-administration with olfactogustatory cues in rodents. Additionally, these data showed that the social context can further enhance the drug-seeking behavior induced by the drug-taking environment.     

A comparison of responses and stimuli as time markers

A rat's behavior, as well as a stimulus, may be a time marker. But do they lead to similar performance? Eight rats were trained on a 20-s DRL procedure in which head-entry responses were time markers, i.e., each head-entry response indicated that food would not be delivered for 20 s. Concurrently, eight rats were trained on a control procedure in which light stimuli, yoked to the responses of a rat in the DRL procedure, were time markers, i.e., each light stimulus indicated that food would not be delivered for 20 s. A comparison of performance between the two groups showed a lower response rate in the DRL procedure than in the yoked control procedure. However, similar response patterns between the two groups were observed, suggesting that rats anticipated the food similarly with a stimulus or a response as the time marker.     

Responding for sucrose and wheel-running reinforcement: effect of body weight manipulation

As body weight increases, the excitatory strength of a stimulus signaling an opportunity to run should weaken to a greater degree than that of a stimulus signaling an opportunity to eat. To test this hypothesis, six male albino Wistar rats were placed in running wheels and exposed to a fixed interval 30-s schedule that produced either a drop of 15% sucrose solution or the opportunity to run for 15s as reinforcing consequences for lever pressing. Each reinforcer type was signaled by a different stimulus. The effect of varying body weight on responding maintained by these two reinforcers was investigated by systematically increasing and decreasing post-session food amounts. The initial body weight was 335 g. Body weights were increased to approximately 445 g and subsequently returned to 335 g. As body weight increased, overall and local lever-pressing rates decreased while post-reinforcement pauses lengthened. Analysis of post-reinforcement pauses and local lever-pressing rates in terms of transitions between successive reinforcers revealed that local response rates in the presence of stimuli signaling upcoming wheel and sucrose reinforcers were similarly affected. However, pausing in the presence of the stimulus signaling a wheel-running reinforcer lengthened to a greater extent than did pausing in the presence of the stimulus signaling sucrose. This result suggests that as body weight approaches ad-lib levels, the likelihood of initiation of responding to obtain an opportunity to run approaches zero and the animal "rejects" the opportunity to run in a manner similar to the rejection of less preferred food items in studies of food selectivity.     

Role of conditioned reinforcers in the initiation, maintenance and extinction of drug-seeking behavior.

The development of a secondary reinforcer as a result of associating a neutral stimulus (buzzer) with intravenous (IV) doses of morpine was studied in rats. Secondary reinforcement developed in the absence of physical dependence and followed the association of the stimulus with either response-contingent or non-contingent injections of morphine. Strength of the conditioned reinforcer, measured in terms of responding on a lever for the stimulus plus infusion of saline solution, was proportional to the unit dosage of morphine employed in pairings of buzzer and drug. When extinction of the lever-press response for IV morphine was conducted (by substituting saline for morphine solution) in the absence of the conditioned reinforcing stimulus, it was seen later that the stimulus could still elicit lever responses, until it too had been present for a sufficient interval of non-reinforced responding. Similarly, extinction of the response for morphine by blocking its action with naloxone in the absence of the stimulus did not eliminate the conditioned reinforcement. Another study showed that a passive, subcutaneous (SC) dose of morphine served to maintain lever-pressing on a contingency of buzzer plus saline infusion. Furthermore, the stimuli resulting from the presence of morphine (after a SC injection) were able to reinstate the lever-responding with only the buzzer-saline contingency when such responses had previously been extinguished. Moreover, it was shown that d-amphetamine could restore responding under the same conditions, and that morphine could also do so for rats in which the primary reinforcer had been d-amphetamine. It is suggested that animal data such as these show that procedures designed for the elimination of human drug-taking behavior must take into account secondary reinforcers as well as the primary reinforcer(s).     

用条件性逃避反应建立简易的大鼠耳鸣检测方法

目的：用较简单的行为实验建立检测动物耳鸣的方法。方法：按照巴甫洛夫条件反射原理,参照Jastreboff的方法,建立“中断背景声音-大鼠逃跑”的条件反射;不再给电击,观察不同组别大鼠条件反射消退过程的行为表现,用公认的水杨酸耳鸣造模法来验证本方法的可靠性。结果：水杨酸组动物停止背景声音时不出现或较少出现逃跑反应,因为大鼠耳内仍有声音存在(耳鸣声),即条件刺激时有耳鸣的动物出现的逃跑反应次数小于无耳鸣的对照动物。结论：本实验设计可检测动物是否有耳鸣。     

Contrasting the overexpectation and extinction effects

After many target stimulus (X)-unconditioned stimulus (US) pairings, further conditioning of X in the presence of another well-established signal for the US (A) disrupts X's behavioral control. Some researchers have argued that the mechanism underlying this so-called overexpectation effect is similar to that underlying extinction (a reduction in X's behavioral control due to X-alone presentations). Three conditioned suppression experiments with rats as subjects compared overexpectation and extinction. Experiment 1 replicated the basic overexpectation effect by showing that A disrupts responding to X more than does a previously neutral stimulus. Experiment 2 found that posttraining context exposure disrupts extinction but not overexpectation. Experiment 3 suggested that overexpectation and extinction are differentially sensitive to the effects of overtraining (compound reinforced or nonreinforced, respectively), such that extinction is enhanced by increases in the amount of nonreinforced trials and overexpectation is unaffected. These results are inconsistent with the view that overexpectation and extinction are driven by a common mechanism.     

Mathematical and computational analysis of adaptation via feedback inhibition in signal transduction pathways

We perform a systematic analysis of mechanisms of feedback regulation that underlie short-term adaptation in intracellular signaling systems. Upon receiving an external cue, these systems generate a transient response that quickly returns to basal levels even if the stimulus persists. Signaling pathways capable of short-term adaptation are found in systems as diverse as the high osmolarity response of yeast, gradient sensing in Dictyostelium, and the cytokine response in vertebrates. Using mathematical analysis and computational experiments, we compare different feedback architectures in terms of response amplitude and duration, ability to adapt, and response to variable stimulus levels. Our analysis reveals three important features of these systems: 1), multiple step signaling cascades improve sensitivity to low doses by an effect distinct from signal amplification; 2), some feedback architectures act as signal transducers converting stimulus strength into response duration; and 3), feedback deactivation acts as a dose-dependent switch between transient and sustained responses. Finally, we present characteristic features for each form of feedback regulation that can aid in their identification.     

Marble Burying and Nestlet Shredding as Tests of Repetitive,Compulsive-like Behaviors in Mice

Obsessive-compulsive disorder (OCD) and autism spectrum disorders (ASD) are serious and debilitating psychiatric conditions and each constitutes a significant public health concern, particularly in children. Both of these conditions are highlighted by the repeated expression of meaningless behaviors. Individuals with OCD often show checking, frequent hand washing, and counting. Children with ASDs also engage in repetitive tapping, arm or hand flapping, and rocking. These behaviors can vary widely in intensity and frequency of expression. More intense forms of repetitive behaviors can even result in injury (e.g. excessive grooming, hand washing, and self-stimulation). These behaviors are therefore very disruptive and make normal social discourse difficult. Treatment options for repetitive behaviors in OCD and ASDs are somewhat limited and there is great interest in developing more effective therapies for each condition. Numerous animal models for evaluating compulsive-like behaviors have been developed over the past three decades. Perhaps the animal models with the greatest validity and ease of use are the marble burying test and the nestlet shredding test. Both tests take advantage of the fact that the target behaviors occur spontaneously in mice. In the marble burying test, 20 marbles are arrayed on the surface of clean bedding. The number of marbles buried in a 30 min session is scored by investigators blind to the treatment or status of the subjects. In the nestlet shredding test, a nestlet comprised of pulped cotton fiber is preweighed and placed on top of cage bedding and the amount of the nestlet remaining intact after a 30 min test session is determined. Presently, we describe protocols for and show movie documentation of marble burying and nestlet shredding. Both tests are easily and accurately scored and each is sensitive to small changes in the expression of compulsive-like behaviors that result from genetic manipulations, disease, or head injury.     

The temporal pattern of responding in conditioned bar-press suppression: the role of the context switch and training mode

The present study examined the temporal pattern of responding in a conditioned bar-press suppression task in rats. Rats were exposed to either a 30-s or a 120-s conditioned stimulus (CS) followed by a footshock. Training took place either while the rats were lever-pressing for water (online), or with the lever removed from the box (offline). They were then exposed to the CS while they were lever-pressing for water, either in the training context or in a different context. Bar-press suppression during the CS was constant across the duration of the CS during training, but was restricted to the initial portion of the CS at the time of testing, especially when subjects were tested in a different context. Those results replicate the reactive (as opposed to anticipatory) pattern observed in a lick suppression procedure by Jozefowiez et al. (2011) and indicate that a change in context at the time of testing might be critical for its expression.     

Investigations on drug produced and subjectively experienced discriminative stimuli. 2. Loperamide, an antidiarrheal devoid of narcotic cue producing actions.

By means of a new behavioral procedure effectively controlling the narcotic stimulus properties of drugs, it was found that the oral administration of fentanyl, morphine, codeine and diphenoxylate produced the narcotic cue. The new antidiarrheal loperamide did not produce this cue in rats as sensitive as being able to detect 0.005 mg/kg s.c. fentanyl. The results are discussed in terms of drug abuse liability.     

Issues in the extinction of specific stimulus-outcome associations in Pavlovian conditioning

This paper reviews a variety of studies designed to examine the effects of extinction upon control by specific stimulus-outcome (S-O) associations in Pavlovian conditioning. Studies conducted with rats in a magazine approach conditioning paradigm have shown that control by specific S-O associations is normally unaffected by extinction treatments, although other aspects of conditioned responding seem affected in a more enduring way. However, recent work suggests that extinction can undermine control by such associations if it is administered after the conditioned stimulus is weakly encoded. The results from these studies suggest that it may be important to consider multiple response systems in assessing the impact of extinction. Studies conducted with the flavor preference learning paradigm in rats also show that specific S-O associations can be undermined by procedures that involve presenting a flavor cue in the absence of its associated nutrient. These findings provide no support for the view that flavor preference learning necessarily entails some unique learning process that differs from more conventional processes. As in other situations, some of these effects likely involve a masking process, but the extent to which masking or true associative weakening occurs in extinction more generally is a topic that is not well understood. Finally, we present some data to suggest that extinction also involves conditional "occasion-setting" control by contextual cues. Special procedures are recommended in assessing such learning when the goal is to distinguish this form of learning from other more conventional mechanisms of extinction.     

Can Honey Bees Learn the Removal of a Stimulus as a Conditioning Cue?

Experiments investigated a Pavlovian conditioning situation where the presence and absence of the stimulus are reversed temporally with respect to the presentation of a reward. Instead of a conditioned stimulus (e.g. odor) signaling the presence of a reward, the stimulus (e.g. odor) is present in the environment except just prior to the presence of the reward. Thus, the absence of the stimulus, or offset of the stimulus (e.g. absence of odor), serves as a conditioned stimulus and is the reward cue. Honey bees (Apis mellifera) were used as a model invertebrate system, and the proboscis‐conditioning paradigm was used as the test procedure. Using both simple Pavlovian conditioning and discrimination‐learning protocols, animals learned to associate the onset of an odor as conditioned stimuli when paired with a sucrose reward. They could also learn to associate the onset of a puff of air with a sucrose reward. However, bees could not associate the offset of an order stimulus with the presentation of a sucrose reward in either a simple conditioning or a discrimination‐learning situation. These results support the model that a very different cognitive architecture is used by invertebrates to deal with certain environmental situations, including signaled avoidance.