Rats' memory for event duration in delayed matching-to-sample with nonspatial comparison response alternatives

Previous research has suggested that using stationary and moving levers as nonspatial response alternatives can significantly enhance the speed of acquiring a temporal discrimination in rats. In Experiment 1, rats were trained to discriminate 2 and 8s of magazine light illumination by responding to either a stationary lever or a moving lever with a cue light illuminated above it. Rats learned to discriminate event durations at a high level of accuracy after 25 sessions of training. During subsequent delay tests, rats exhibited a strong choose-long bias, indicating that they were timing from the onset of the magazine light until the entry of levers into the chamber. This occurred regardless of whether intertrial intervals and delay intervals were dark or illuminated. On test trials in which the sample was omitted, rats responded as if the short sample had been presented. In Experiment 2, the rats received extensive training with dark and illuminated variable delay intervals (1-4 s). However, they continued to exhibit a tendency to time from the onset of the magazine light until entry of the levers into the chamber. Although the use of stationary/uncued and moving/cued levers as response alternatives enhanced the speed of acquisition of the event duration discrimination in rats, additional procedural modifications will be necessary to prevent rats from timing during the delay interval.     

Characterization of radiation-induced performance decrement using a two-lever shock-avoidance task

Rats were trained to perform a task involving responses on two levers. Responding on an avoidance lever delayed the onset of electrical footshock for 20 sec and responding on a warning lever turned on a light for 60 sec. When the light was on, the task on the avoidance lever was changed from unsignaled shock avoidance to signaled shock avoidance by preceding the shocks with 5-sec warning tones. The animals preferred the signaled avoidance condition. After 100 Gy of 60Co irradiation, the animals were less able to avoid shock, an effect from which the animals recovered somewhat over 90 min. The response rate on the avoidance lever remained at or above control rates, while the response rate on the warning lever showed an initial increase, followed by a decrease below baseline. The increase in responding on the avoidance lever occurred in bursts just after presentation of the shocks. The data suggest that under these experimental conditions a subject will not respond appropriately to avoid shock or acquire cues that can facilitate the avoidance of shock. The effects, however, do not reflect an inability to perform the required movements but instead appear to reflect some characteristic of the task associated with a particular lever.     

Responding maintained by primary reinforcing visual stimuli is increased by nicotine administration in rats

Nicotine has been shown to increase responding maintained by turning off a houselight. To examine whether this effect extends to other primary reinforcing visual stimuli, the present study assessed whether nicotine would increase responding maintained by the illumination, and not just the darkening, of a visual stimulus. One group of rats (n = 4) was initially trained to press two levers, using food as a consequence, while a separate group of rats (n = 4) was initially trained to press one lever. After training, all rats pressed an active lever to turn on or turn off a houselight for 10 s, while presses on an inactive lever had no programmed consequences. A third group of rats (n = 4) were never trained to press either of the two levers and did not experience any programmed consequences for pressing. Although nicotine slightly increased lever pressing on both levers in the third group, nicotine resulted in much greater increases in responding maintained by the visual stimuli in the first two groups. Nicotine selectively increased responding maintained by visual stimuli, regardless of which levers were originally trained and regardless of whether those stimuli consisted of turning on or turning off a houselight, suggesting that nicotine enhances the value of primary reinforcing visual stimuli.     

High reinforcing efficacy of nicotine in non-human primates

Although tobacco appears highly addictive in humans, there has been persistent controversy about the ability of its psychoactive ingredient nicotine to induce self-administration behavior in laboratory animals, bringing into question nicotine's role in reinforcing tobacco smoking. Because of ethical difficulties in inducing nicotine dependence in na?ve human subjects, we explored reinforcing effects of nicotine in experimentally-naive non-human primates given access to nicotine for periods of time up to two years. Five squirrel monkeys with no experimental history were allowed to intravenously self-administer nicotine by pressing one of two levers. The number of presses on the active lever needed to obtain each injection was fixed (fixed-ratio schedule) or increased progressively with successive injections during the session (progressive-ratio schedule), allowing evaluation of both reinforcing and motivational effects of nicotine under conditions of increasing response cost. Over time, a progressive shift toward high rates of responding on the active lever, but not the inactive lever, developed. The monkeys' behavior was clearly directed toward nicotine self-administration, rather than presentation of environmental stimuli associated with nicotine injection. Both schedules of reinforcement revealed a high motivation to self-administer nicotine, with monkeys continuing to press the lever when up to 600 lever-presses were needed for each injection of nicotine. Thus, nicotine, by itself, in the absence of behavioral or drug-exposure history, is a robust and highly effective reinforcer of drug-taking behavior in a non-human primate model predictive of human behavior. This supports the use of nicotinic ligands for the treatment of smokers, and this novel preclinical model offers opportunities to test future medications for the treatment of nicotine dependence.     

60 Hz electric fields and incandescent light as aversive stimuli controlling the behavior of rats responding under concurrent schedules of reinforcement

Several reports have shown that animals will sometimes engage in behaviors that reduce their exposure to a 60 Hz electric field (E-field). The field, therefore, can function as an aversive stimulus. In other studies, the E-field at equivalent strengths failed to function as an aversive stimulus. The present experiment, using rats, demonstrates how factors other than field strength can influence whether a subject engages in behavior that reduces field exposure. The general design consisted of giving the rat a choice between two alternatives, one of which sometimes included an added stimulus. Each subject was trained to press each of two levers to obtain food. Pressing one lever was reinforced intermittently under a variable interval 2 min schedule (VI 2); pressing the other lever was reinforced by a second VI 2 schedule operating independently of the first. Under this concurrent schedule the rat spent 50% of the daily 50 min session responding to each of the levers, indicating that they were equally “valued.” Next, while the schedules remained in effect, the first response to one of the levers turned on a 100 kV/m E-field which remained on until the rat pressed the other lever. The time spent responding under the schedule associated with the field was reduced by about 5–10%. When the procedure was changed so that no lever presses produced food, i.e., extinction, but the added stimulus contingency remained, the rats spent even less time in the presence of the field. Similar outcomes were observed during both the concurrent food or extinction schedules when incandescent light was used. Thus, both an E-field and incandescent light functioned as aversive stimuli, but the magnitude of the aversiveness was small. Aversiveness depended not only on stimulus intensity, but also on behavioral factors. Bioelectromagnetics 19:210–221, 1998. © 1998 Wiley-Liss, Inc.     

Rats' memory for event duration: differential effects of delaying the discriminative choice cue as opposed to the opportunity to execute the choice response

Rats were trained to discriminate short or long durations of houselight illumination using a choice procedure. During the test phase of each trial, the left and right levers were presented with an auditory cue above one of them on (cued lever) while the other was off (uncued lever). The auditory cue was presented immediately after sample offset and the levers were inserted after the auditory cue had been presented for 2 s. For half of the rats, the correct response following the short sample was to press the cued lever, while following the long sample, it was to press the uncued lever. This was reversed for the remaining rats. Following acquisition of the discrimination, two different types of delay tests were administered. In the first set, the delay between offset of the sample and onset of the auditory cue was manipulated (Cue Delay Test). In the second set, the delay between onset of the auditory cue and entry of the levers into the chamber was manipulated (Response Delay Test). Cue Delay testing resulted in a choose-long bias at the longer delays. Response Delay testing did not result in a systematic response bias and there was little forgetting over the delay interval. These data suggest that the rats did not stop the internal clock when the nominal sample was offset, but allowed it to keep running until the auditory cue was presented. The data from the Response Delay Test indicate that either a response decision was made based on the clock reading as soon as the auditory cue was presented, or the clock reading itself was retained over the delay with no subjective shortening and little forgetting.     

Spatial associative memory: a possible species difference in rats and pigeons

Previous research has shown that pigeons can remember which of four spatially distinct responses was last reinforced, for at least 72 h. The present study sought to replicate this finding using rats. Rats were tested in an operant chamber containing four spatially distinct levers. In each session one lever was randomly selected to provide reinforcement for 15 min. This reinforced period was preceded by a non-reinforced period that was 30 s long, on average. During the non-reinforced period the amount the rat pressed on the previously reinforced lever was compared to responding on the other three levers, and was taken as a measure of memory. Sessions were separated either by 17 min, 24 or 72 h. Unlike pigeons, rats responded at chance levels following each of these retention intervals. This finding adds to previous research suggesting differences in cognitive processes in rats and pigeons.     

Naltrindole,an opioid delta receptor antagonist,blocks cocaine-induced facilitation of responding for rewarding brain stimulation

Recent experimental results have led to the suggestion that opioid antagonists can modulate the reinforcing properties of cocaine. In this experiment, rats were fixed with chronically indwelling bipolar electrodes for stimulation of the medial forebrain bundle (MFB) as it courses through the hypothalamus. Rats were taught to press a lever for brief trains of electrical stimulation of the MFB. Subsequently, they were allowed to press for varying intensities of stimulation daily until their response rates were stable. Cocaine (5 mg/kg, s.c.) enhanced the rate of pressing for lower intensities of brain stimulation. Naltrindole (3 mg/kg, i.p.) had no effect on response rate alone but blocked the cocaine-induced facilitation of pressing for rewarding brain stimulation. An implication that can be drawn from these data is that naltrindole, or other delta-selective opioid antagonists, might be effective as medicines for use in treating cocaine abuse.     

Comparison of 60-Hz electric fields and incandescent light as aversive stimuli controlling the behavior of rats

Rats were exposed to two procedures which enabled them to press a lever to turn off a 90 or 100 kV/m 60-Hz electric field or, later in the study, illumination from an incandescent lamp. Under one procedure, a response turned off the stimulus for a fixed duration, after which the stimulus was turned on again. A response during the off-period restarted the fixed duration. None of the rats turned the field off reliably. Next, under an alternative procedure, pressing one lever turned the field off; pressing the other lever turned it back on; responding under those conditions differed little from that seen at 0 kV/m. Under both procedures, when illumination from an incandescent lamp served as the stimulus, each rat did turn the stimulus off, and performances varied with stimulus intensity. The results show that a 100 kV/m 60-Hz electric field is not sufficient to function as an aversive stimulus under two procedures where illumination from a lamp does function as an aversive stimulus.     

Delayed matching-to-position performance in C57BL/6N mice

Delayed matching-to-sample is one of the most frequently employed behavioral tasks for assessing spatial working memory in animals. Although the advantages of the task have been widely acknowledged and it is used in the study of a variety of species, its application to mice has been rare. In the present study, we reported the efficacy of a delayed matching-to-position task in C57BL mice lever-pressing in an operant-conditioning chamber. Each trial started with the press of a back lever, followed by the presentation of either a left or right front lever. When the ratio requirement for presses to the front lever (sample) was met, a delay interval started. Delay interval continued until the mice made the first response after the elapse of the programmed delay interval. This was followed by the presentation of a choice of left or right front levers. The choice of the same front lever as the sample was reinforced, whereas the other was not. The proportion of correct choices showed a delay-dependent decrement. A higher ratio of response requirement to the sample resulted in increased accuracy, but the duration of the intertrial interval had no effect. Preceding trials also influenced response accuracy, indicating proactive interference. Overall, the results replicated the effects of parametric manipulations reported in other species, and thus, our findings validate the efficacy of the task for assessing spatial working memory in laboratory mice.     

Interval time-place learning by rats: varying reinforcement contingencies

Two experiments with rats were conducted to study interval time-place learning when the spatiotemporal contingencies of food availability were more similar to those likely to be encountered in natural environments, than those employed in prior research. In Experiment 1, food was always available on three levers on a variable ratio (VR) 35 schedule. A VR8 schedule was in effect on Lever 1 for 5 min, then on Lever 2 for 5 min, and so forth. While rats learned to restrict the majority of their responding to the lever that provided the highest density of reinforcement, they seemed to rely on a win-stay/lose-shift strategy rather than a timing strategy. In Experiment 2, the four levers provided food on variable ratios of 15, 8, 15, and 30, each for 3 min. As expected the rats learned these contingencies. A novel finding was that the rats had a spike in response rate immediately following a change from a higher to lower reinforcement density. It is concluded that rats exposed to spatiotemporal contingencies behave so as to maximize the rate of obtained reinforcement.     

Selective interaction of drugs with a discriminable stimulus associated with narcotic actions

Rats were trained to bar press on either one of two levers depending on whether they received an injection of morphine (10 mg/kg) or saline. The rats responded on the morphine-correct lever when injected with another narcotic, fentanyl, but responded on the saline-correct lever when injected with a narcotic antagonist or another CNS active, but non-narcotic, drug (e.g., amphetamine, apomorphine). The narcotic antagonist, naloxone, prevented the occurrence of the narcotic discriminable stimulus, but the rats responded on the morphine-correct lever when injected with morphine plus any of a number of potent CNS active, but non-narcotic compounds. These results are discussed with reference to the specificity of this procedure for detecting drugs with narcotic agonist or antagonist properties.     

Reinforcer concentration effects on a fixed-interval schedule

Four rats received training on a mixed FI 30-s FI 150-s schedule, where the different FI values were associated with different levers. During baseline, the reinforcer was a 30% concentration of condensed milk. During subsequent testing sessions, the reinforcer concentration was varied within sessions over values of 10, 30, 50, and 70%. Measures of behaviour were taken from the FI 30-s lever during trials where the reinforcer was delivered for responses on the other lever. Increasing the reinforcer concentration which began the interval (a) increased the time to start responding in the interval, and (b) increased the location of the response peak on the FI 30-s lever (often to values well above 30s). Response rate at the peak, and spread of the response rate versus time function, changed much less with reinforcer concentration. The data are discussed relative to predictions derived from Scalar Expectancy Theory, the Behavioural Theory of Timing, and the Tuned-trace model.     

The dynamic properties of mammalian skeletal muscle

The dynamic characteristics of the rat gracilis anticus muscle at 17.5°C have been determined by isotonic and isometric loading. For a fixed initial length these characteristics were represented either as a family of length-velocity phase trajectories at various isotonic afterloads or as a series of force-velocity curves at different lengths. An alternate method of viewing these data, the length-external load-velocity phase space, was also generated. When the muscle was allowed to shorten from different initial lengths, the velocity of shortening achieved at a given length was lower for longer initial lengths. The amount of departure was also dependent upon the isotonic load, the greater the load the greater the departure. The departures were not caused by changes in the elastic elements of the muscle or fatigue in the ordinary sense. When the behavior of the muscle was investigated at different frequencies of stimulation, the shortening velocity was a function of the number of stimulating pulses received by the muscle at a given frequency. The shortening velocity of the rat gracilis anticus muscle is, therefore, not only a function of load and length, but also of an additional variable related to the time elapsed from onset of stimulation.     

Quantifying Social Motivation in Mice Using Operant Conditioning

In this protocol, social motivation is measured in mice through a pair of operant conditioning paradigms. To conduct the experiments, two-chambered shuttle boxes were equipped with two operant levers (left and right) and a food receptacle in one chamber, which was then divided from the second chamber by an automated guillotine door covered by a wire grid. Different stimulus mice, rotated across testing days, served as a social stimulus behind the wire grid, and were only visible following the opening of the guillotine door. Test mice were trained to lever press in order to open the door and gain access to the stimulus partner for 15 sec. The number of lever presses required to obtain the social reward progressively increased on a fixed schedule of 3. Testing sessions ended after test mice stopped lever pressing for 5 consecutive minutes. The last reinforced ratio or breakpoint can be used as a quantitative measure of social motivation. For the second paradigm, test mice were trained to discriminate between left and right lever presses in order to obtain either a food reward or the social reward. Mice were rewarded for every 3 presses of each respective lever. The number of food and social rewards can be compared as a measurement of the value placed upon each reward. The ratio of each reward type can also be compared between mouse strains and the change in this ratio can be monitored within testing sessions to measure satiation with a given reward type. Both of these operant conditioning paradigms are highly useful for the quantification of social motivation in mouse models of autism and other disorders of social behavior.     

Passive immunization against nicotine attenuates nicotine discrimination

Ten rats were trained in a two lever operant chamber to press different levers after a nicotine injection (0.14 mg/kg s.c.) or a saline injection on an FR10 schedule. The rats were then injected i.p. with either 150 mg nicotine-specific IgG or the same amount of control IgG from non-immunized rabbits. On successive days, they were retested with both levers active after a saline injection, a full training dose of nicotine and a half dose of nicotine (0.07 mg/kg s.c.). After saline injection, both groups pressed the saline lever almost exclusively. After each of the nicotine doses, the immunized rats performed a significantly lower percentage of their lever presses on the nicotine lever than did non-immunized rats. The results suggest that passive immunization can interfere with the stimulus properties of nicotine.     

Motivational state and reward content determine choice behavior under risk in mice

Risk is a ubiquitous feature of the environment for most organisms, who must often choose between a small and certain reward and a larger but less certain reward. To study choice behavior under risk in a genetically well characterized species, we trained mice (C57BL/6) on a discrete trial, concurrent-choice task in which they must choose between two levers. Pressing one lever (safe choice) is always followed by a small reward. Pressing the other lever (risky choice) is followed by a larger reward, but only on some of the trials. The overall payoff is the same on both levers. When mice were not food deprived, they were indifferent to risk, choosing both levers with equal probability regardless of the level of risk. In contrast, following food or water deprivation, mice earning 10% sucrose solution were risk-averse, though the addition of alcohol to the sucrose solution dose-dependently reduced risk aversion, even before the mice became intoxicated. Our results falsify the budget rule in optimal foraging theory often used to explain behavior under risk. Instead, they suggest that the overall demand or desired amount for a particular reward determines risk preference. Changes in motivational state or reward identity affect risk preference by changing demand. Any manipulation that increases the demand for a reward also increases risk aversion, by selectively increasing the frequency of safe choices without affecting frequency of risky choices.     

The Role of the Lateral Habenula in Punishment

The lateral habenula (LHb) is a small epithalamic structure that projects via the fasciculus retroflexus to the midbrain. The LHb is known to modulate midbrain dopamine (DA) neurons, including inhibition of ventral tegmental area (VTA) neurons via glutamatergic excitation of the GABAergic rostromedial tegmental nucleus (RMTg). A variety of lines of evidence show activity in LHb and the LHb-RMTg pathway is correlated with, and is sufficient to support, punishment learning. However, it is not immediately clear whether LHb is necessary for punishment. Here we used a within-subjects punishment task to assess the role of LHb in the acquisition and expression of punishment as well as in aversive choice. Rats that pressed two individually presented levers for pellet rewards rapidly suppressed responding to one lever if it also caused footshock deliveries (punished lever) but continued pressing a second lever that did not cause footshock (unpunished lever). Infusions of an AMPA receptor antagonist (NBQX) into LHb had no effect on the acquisition or expression of this punishment, or on aversive choice, but did increase locomotion. Infusion of the sodium channel blocker bupivacaine likewise had no effect on expression of punishment. However, infusion of the calcium channel blocker mibefradil did affect expression of punishment by significantly decreasing the latency with which rats responded on the punished lever and significantly increasing unpunished lever-pressing. Taken together, these findings indicate that the LHb plays a limited role in punishment, influencing only latency to respond. This role is linked to calcium channel permeability and not AMPA receptor or sodium channel permeability.     

Alterations in time-place learning induced by lesions to the rat medial prefrontal cortex

This experiment examined the effect of medial prefrontal lesions on time-place learning in the rat. During the first phase, prior to lesioning, rats received training on an interval time-place task. Food was available on each of four levers for 3 consecutive min of a 12-min session. The levers provided food in the same sequence on all trials. Rats restricted the majority of their presses on each lever to the time in each session when it provided food and were able to anticipate when a lever was going to provide food. During the second phase some rats received lesions that were restricted to the medial prefrontal cortex. Following these very restricted lesions, rats continued pressing a lever after it stopped providing food (i.e. perseverated, as if their internal clock was running slow). The third phase involved changing the order in which the levers provided food. Lesions had no discernable effect on the rats' ability to learn the correct sequence of food availability. However, this change made the rats' timing perseveration even more noticeable. Our results suggest the medial prefrontal cortex is not necessary for acquisition of time-place sequencing information. However, lesions do appear to produce perseveration on components of the sequence.     

Rats do not respond differently in the presence of stimuli signaling wheel-running reinforcers of different durations

Rats were exposed to a fixed interval 30 s schedule that produced opportunities to run of equal or unequal durations to assess the effect of differences in duration on responding. Each duration was signaled by a different stimulus. Wheel-running reinforcer duration pairs were 30 s 30 s, 50 s 10 s, and 55 s 5 s. An analysis of median postreinforcement pause duration and mean local lever-pressing rates broken down by previous reinforcer duration and duration of signaled upcoming reinforcer showed that postreinforcement pause duration was affected by the duration of the previous reinforcer but not by the stimulus signaling the duration of the upcoming reinforcer. Local lever-pressing rates were not affected by either previous or upcoming reinforcer duration. In general, the results are consistent with indifference between these durations obtained using a concurrent choice procedure.