Pavlovian biconditional discrimination learning in the C57BL/6J mouse

Four experiments using mice examined acquisition of Pavlovian biconditional discriminations in which two stimulus compounds were paired with food (AX+ and BY+) and two were not (AY- and BX-). Temporally asynchronous compounds were generated by using contextual stimuli (Experiment 1) and 15-s discrete visual cues (Experiments 2A, 2B and 3) to disambiguate when embedded noise or tone stimuli would be paired with food. When food pellets followed both reinforced compounds, successful acquisition was obtained in Experiment 1 but not in Experiments 2A and 2B even though the order of trials was modeled after that used in Experiment 1. However, when differential outcomes followed the reinforced compounds in Experiment 3, acquisition was obtained with discrete cue stimulus compounds. The implications of these results for modulatory models of conditional discrimination learning in animals are discussed.     

Characterizing the effects of d-amphetamine on temporal discrimination

Although the effects of dopamine agonists on temporal discrimination have been widely studied, conclusions as to their behavioral and neurophysiological effects are difficult due to a number of discrepant findings in the literature. This study examined whether a previously unexplored procedural difference could account for some of these discrepancies. In three experiments, pigeons categorized the duration of temporal samples during two variants of the interval-bisection procedure. In the position variant, responses to a side key that corresponded to the sample duration produced food. In the color-matching variant, responses to the key color that corresponded to the sample duration produced food. Across experiments, d-amphetamine produced a general disruption of temporal discrimination not accompanied by over or underestimation of time in both procedures. This effect occurred whether pigeons were exposed to both procedures within session (Experiment 1) or across conditions (Experiments 2 and 3) and whether the pigeons were drug experienced (Experiments 1 and 2) or naïve (Experiment 3). Analyses of the cumulative normal functions fitted to the proportion-long response data indicated that d-amphetamine produced its effects by selectively decreasing stimulus control, rather than by affecting timing.     

A comparison of the effects of discriminative and Pavlovian inhibitors and excitors on instrumental responding

In two experiments, the effects of Pavlovian or discriminative conditioned inhibitors on operant responding were investigated in rats. Experiment 1 found that a Pavlovian conditioned inhibitor for food suppressed food-reinforced lever pressing more than a non-differentially trained control stimulus did. Experiment 2 demonstrated that an operant discriminative inhibitor produced greater suppression of lever pressing than a Pavlovian conditioned inhibitor. Experiment 2 also found that compounding an operant discriminative stimulus (SD) for food-reinforced responding with another SD for food-reinforced responding resulted in more additive summation than when an SD was compounded with a Pavlovian conditioned excitor for food. The results of these experiments support two-factor theories that postulate that incentive and response discriminative processes summate algebraically when the processes are inhibitory or excitatory.     

Variation of bar-press duration: Where do new responses come from?

Instrumental learning involves both variation and selection: variation of what the animal does, and selection by reward from among the variation. Four experiments with rats suggested a rule about how variation is controlled by recent events. Experiment 1 used the peak procedure. Measurements of bar-press durations showed a sharp increase in mean duration after the time that food was sometimes given. The increase was triggered by the omission of expected food. Our first explanation of the increase was that it was a frustration effect. Experiment 2 tested this explanation with a procedure in which the first response of a trial usually produced food, ending the trial. In Experiment 2, unlike Experiment 1, omission of expected food did not produce a large increase in bar-press duration, which cast doubt on the frustration explanation. Experiments 3 and 4 tested an alternative explanation: a decrease in expectation of reward increases variation. Both used two signals associated with different probabilities of reward. Bar presses were more variable in duration during the signal with the lower probability of reward, supporting this alternative. These experiments show how variation can be studied with ordinary equipment and responses.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

Differential resurgence and response elimination

Resurgence refers to the transient recovery of previously reinforced, but presently not reinforced, responding when more recently reinforced responding is extinguished. The primary purpose of our research was to determine how differential resurgence results from the procedures used to eliminate that responding. There were three conditions in each of five experiments. In Condition 1, key pecking by pigeons was maintained under a two-component multiple variable-interval (VI) 30-s VI 30-s schedule. In Condition 2, this pecking was eliminated in different ways across components. In Condition 3, extinction was in effect for all responses, and resurgence of key pecking was compared across components. These three conditions were repeated for most pigeons, and the procedures used to eliminate responding in Condition 2 varied across experiments. In Experiment 1, there was greater resurgence, and an earlier onset of it, after a differential-reinforcement-of-other-behavior (DRO) schedule than after a VI schedule was correlated with pecking an alternative key. Experiments 2 and 3 showed that the differential resurgence in Experiment 1 probably was not due to conditional stimulus control or the periodicity of food delivery, respectively. In Experiment 4, there was no systematic difference in resurgence after either a DRO schedule or a VI schedule correlated with treadle pressing. In Experiment 5, there was greater resurgence, and/or an earlier onset of it, after a VI schedule correlated with treadle pressing than after a VI schedule correlated with pecking an alternative key. Taken together, the results showed that the reinforcement of an alternative key-peck response was the most effective means of reducing subsequent key-peck resurgence. The relation of these results to an understanding of resurgence is discussed.     

Effect of US identity on elimination and recovery of autoshaped responding with explicitly unpaired and degraded contingency extinction procedures

The depressive effects of noncontingent and explicitly unpaired food unconditioned stimuli (USs) and the recovery from those effects on autoshaped responding were examined in a series of experiments with pigeons. In Experiments 1 and 2, responding to a keylight conditioned stimulus (CS) previously paired with food was depressed equally by explicitly unpaired presentations of either that same food or a different food. Furthermore, responding recovered equally following removal of the explicitly unpaired foods. In contrast, Experiments 3 and 4 showed that noncontingent presentations of a food US depressed responding more to a keylight CS paired with that same food than to a keylight CS paired with a different food. Moreover, removal of the noncontingent foods led to complete recovery but more rapid extinction of responding to the same keylight relative to the different keylight. The implications of these results for understanding the mechanisms underlying depression and recovery of responding following degraded contingency and explicitly unpaired extinction procedures are discussed.     

Enhancement of performances in a learning task in suckler calves after weaning and relocation: Motivational versus cognitive control?: A pilot study

Weaning in suckler calves influences performance in a learning task. The aim of the present study was to investigate whether the improved performance after weaning, including relocation, is due to differences in motivation for the reward or in learning abilities. Forty Aubrac calves were used; half of them were weaned from their dams at around eight months, the other half were weaned one month later. After weaning, calves were housed in groups of four in a new setting. From the day after weaning of the last group of calves, the animals were subjected to two tests: (1) an arena test, (2) a T-maze test where one arm led to either a social or a food reward. The T-maze test consisted of three sessions: in Session 1, trials were conducted until the animal acquired the task (i.e. did not take the unrewarded arm on three consecutive trials); in Session 2, the motivation for the reward was assessed via the walking time of the animal to reach the reward; in Session 3, the place of reward was reversed and the animals were trained until they acquired the new task.

Calves weaned for one day explored more (P < 0.05) and had lower heart rates during the arena test (P < 0.05) compared to the ones weaned for one month. During the T-maze test, calves weaned for one month versus one day did not differ in their capacities to learn the initial route (Session 1) or in their motivation for either the social or food reward (Session 2). Calves weaned for one day learned significantly faster (P < 0.05) the reversed route (Session 3) than calves weaned for one month. Hence, the better performances at reversal in the T-maze by calves that have just been weaned cannot be accounted for by a higher motivation for the reward. A better cognitive control of their behaviour due to a lower stress state is suggested by our results.     

Effect of contingent auditory stimuli on concurrent schedule performance: an alternative punisher to electric shock

This study explored whether load auditory stimuli could be used as functional punishing stimuli in place of electric shock. Three experiments examined the effect of a loud auditory stimulus on rats’ responding maintained by a concurrent reinforcement schedule. In Experiment 1, overall response rate decreased when a concurrent 1.5 s tone presentation schedule was superimposed on the concurrent variable interval (VI) 180-s, VI 180-s reinforcement schedule. On the contrary, response rate increased when a click presentation schedule was added. In Experiment 2, the extent of the response suppression with a 1.5 s tone presentation varied as a function of the frequency of the reinforcement schedule maintaining responses; the leaner the schedule employed, the greater the response suppression. In Experiment 3, response suppression was observed to be inversely related to the duration of the tone; response facilitation was observed when a 3.0-s tone was used. In Experiments 1 and 2, a preference shift towards the alternative with richer reinforcement was observed when the tone schedule was added. In contrast, the preference shifted towards the leaner alternative when the click or longer duration stimulus was used. These results imply that both the type and duration of a loud auditory stimulus, as well as the reinforcement schedule maintaining responses, have a critical role in determining the effect of the stimuli on responding. They also suggest that a loud auditory stimulus can be used as a positive punisher in a choice situation for rats, when the duration of the tone is brief, and the reinforcement schedule maintaining responses is lean.     

No enhanced recognition memory,but better source memory for faces of cheaters

Previous studies sought to test for the existence of a “cheater-detection module” by testing for enhanced memory for the faces of cheaters, but past results have been inconclusive. Here, we present four experiments showing that old–new discrimination was not affected by whether a face was associated with a history of cheating, trustworthy or irrelevant behavior. In contrast, source memory for faces associated with a history of cheating (i.e., memory for the cheating context in which the face was encountered) was consistently better than source memory for other types of faces. This pattern held under a variety of conditions, including different types of judgments participants made about the stimulus persons (attractiveness in Experiment 1; likeability in Experiments 2–4), different retention intervals (a few minutes in Experiments 1, 2 and 4; 1 week in Experiment 3), whether the behaviors were exceptional or ordinary (Experiments 1–3) and whether the social status of the characters was low or high (Experiment 4). Given no differences in old–new discrimination, enhanced source memory for faces of cheaters may be useful for avoiding cheaters in future interactions.     

A simple spatial alternation task for assessing memory function in zebrafish

A series of studies was initiated to examine learning and memory function in the zebrafish (Danio rerio) by using a simple spatial alternation paradigm for a food reward. Fish were fed on alternating sides of a divided fish tank, with a red card displayed on one side serving as a visual means of orientation. Although responses were recorded at cue (light tap on the tank), 5 s after cue (as food was delivered), and 5 s after food delivery, the learning test was choice of a correct side of the tank to receive food. Therefore, an accurate level of an animal's achievement of the spatial task was represented by responses at food delivery. Data collected from 11 separate experiments indicated that zebrafish learned to alternate for a food reward. Further, statistical analysis showed that the zebrafish learned the task in the first half of the experiment as exhibited by a calculated t1/2 of 13.9 trials. Zebrafish could recall the task after a short period of 10 days with no testing. The alternating behavior was extinguished by withholding the food reward. Thus, the spatial alternation task can be learned easily by zebrafish, and may be useful in addressing learning and memory functions in vertebrate animals using zebrafish as a model organism.     

Testing for episodic-like memory in rats in the absence of time of day cues: replication of Babb and Crystal

Two experiments were performed to look for evidence of episodic-like memory in rats. On each of a series of trials on an eight-arm radial maze, rats in two groups entered four open arms in Phase 1, with reward pellets on three arms and a favored reward (chocolate in Experiment 1 and cheese in Experiment 2) on the remaining arm. Phase 2 retention tests were given 30 min or 4 h after Phase 1, with all eight arms open. The four arms not entered in Phase 1 all contained reward pellets, and the three arms that contained pellets in Phase 1 were empty. In the replenish short group, the favored reward was replenished at the same location where it was found in Phase 1 at the 30 min retention interval but was absent (Experiment 1) or degraded (Experiment 2) at the 4 h retention interval. In the replenish long group, the favored reward was replenished at the 4 h retention interval but not at the 30 min retention interval. Over a number of daily trials that randomly mixed short and long delays, rats in both experiments learned to return earlier to the arm containing the favored reward at the retention interval when it was replenished than at the retention interval when it was absent or degraded. These results replicate earlier findings [Babb, S.J., Crystal, J.D., 2005, Discrimination of what, when, and where: implications for episodic-like memory in rats. Learn. Mot., 36, 177-189] and provide evidence of episodic-like memory in rats.     

Is extinction the hallmark of operant discrimination?: Reinforcement and S effects

Using a successive discrimination procedure with rats, three experiments investigated the contribution of reinforcement rate and amount of S(Delta) exposure on the acquisition of an operant discrimination. S(D) components and were always 2 min in length, while S(Delta) (extinction) components were either 1 min or 4 min in length; responses in S(D) were reinforced on one of four schedules. In Experiment 1, each of eight groups were exposed to one possible combination of rate of reinforcement and S(Delta) component length. At every level of reinforcement, the 4 min S(Delta) groups acquired the discrimination more quickly. However, within each level of reinforcement, the proportions of responding in S(D) as a function cumulative S(Delta) exposure were equivalent, regardless of the number of reinforcers earned in S(D), suggesting that extinction is the "hallmark" of discrimination. Experiment 2 sought to replicate these results in a within-subjects design, and although the 4 min S(Delta) conditions always produced superior discriminations, the lack of discriminated responding in some conditions suggested that stimulus disparity was reduced. Experiment 3 clarified those results and extended the finding that the acquisition of operant discrimination closely parallels extinction of responding in S(Delta). In sum, it appears that higher reinforcement rates and longer S(Delta) exposure facilitate the acquisition of discriminated operant responding.     

Dogs choose a human informant: Metacognition in canines

The presence of metacognition in animals has been suggested by the observation that non-human primates will seek out information about the location of a hidden reward before responding. In experiment 1, dogs failed to make an information-seeking response that involved re-positioning themselves in space so that they could view a cue that indicated the location of food. In experiments 2 and 3, dogs were allowed to choose between two people, an informant that pointed to the location of food and a non-informant that provided no information. Dogs showed a clear preference for the informant, even when choice of the informant led to no greater chance of reward than choice of the non-informant. In a procedure that involves human communication, dogs show information-seeking behavior.     

Dopamine agonists and antagonists can produce an attenuation of response bias in a temporal discrimination task depending on discriminability of target duration

The current study examined the effects of the D2 agonist (quinpirole) and D2 antagonist (eticlopride) on temporal discrimination performance in a conditional discrimination task (Experiment I) and a delayed conditional discrimination task (Experiment II). In both experiments rats discriminated between a scheduled stimulus duration of 3 s versus 9 s. Consistent with previous reports, overall discrimination performance decreased in a dose-dependent manner with both drugs. Changes in response bias (the tendency to choose-short or choose-long irrespective of actual stimulus duration), however, were best characterized in terms of both drugs tending to attenuate the bias effects normally observed during baseline drug-free performance. Specifically, the 'choose-short' bias observed in Experiment I and at a relatively short, 0.1 s, delay in Experiment II became less extreme with increasing doses. In addition, the 'choose-long' bias observed at a relatively long, 6 s, delay in Experiment II also became less extreme with increasing doses. Thus, whether there was an apparent shift from a short response bias to long, or vice versa, was the product of the delay interval between stimulus presentation and choice rather than whether the drug in question was a D2 agonist or antagonist. Such an attenuation of bias may have arisen because of subjects confounding the delay interval with the actual discriminative stimulus duration.     

Reward magnitude and timing in pigeons

We investigated the interaction of motivation and timing by manipulating the expected reward magnitude during a peak procedure. Four pigeons were tested with three different reward magnitudes, operationalized as duration of food access. Each stimulus predicted a different reward magnitude on a 5 s fixed-interval schedule. Trials with different reward magnitudes were randomly intermingled in a session. Most pigeons responded less often and started responding later on peak trials when a smaller reward was expected, but showed no differences in response termination or peak times. Reward magnitude was independently corroborated through unreinforced choice trials, when pigeons chose between the three stimuli presented simultaneously. These results contribute to a growing body of evidence that the expected reward magnitude influences the decision to start anticipatory responding in tasks where the reward becomes available after a fixed interval, but does not alter peak times, nor the decision to stop responding on peak trials.     

Response patterns of bonnet macaques following up to 75 weeks of continuous access to social-video and food rewards

Three individually housed bonnet macaque males were given 75 weeks of continuous access to a joystick task with a reward choice of either viewing live color video of a bonnet group or obtaining a banana-flavored food treat. Here we report data for weeks 44-75 following a change in the stimulus group displayed in the video. The new stimulus group enhanced responding to the video for two subjects over the entire 32 weeks of this study, although there was some decline across weeks, and the video continued to be an effective reward for the duration of the study for all subjects.     

Appetitive differential conditioning of the rabbit's jaw movement response. Effects of cue similarity and US magnitude

Two experiments examined appetitive differential conditioning of the rabbit's jaw movement response (JMR) in a two-phase procedure. The first phase entailed reinforced training with one conditioned stimulus (CS+), and the second phase involved intermixed presentations of CS+ and an unreinforced stimulus (CS-). In Experiment 1, CS+ was a 600-Hz tone, and CS- was either a 660-, 1,000-, or 2,100-Hz tone. In Experiment 2, the magnitude of the water unconditioned stimulus (US) paired with CS+ was either 1, 3, or 9 ml. The experiments revealed that 1) the level of responding to CS- rose for several days and then declined over the remainder of training; 2) the physical similarity between CS+ and CS- directly affected the level of responding to CS- but had no discernable effect on the level of responding to CS+; and 3) US magnitude positively affected the level of responding to CS+ and, to a lesser extent, CS-. The results are discussed in terms of their implications for Spence's gradient interaction theory and Pavlov's external inhibition hypothesis.     

Effects of conditioning history on selective stimulus control by elements of compound discriminative stimuli

Effects of prior discrimination training on stimulus control by color and shape dimensions of compound stimuli were studied with college students. In Phase 1, single-stimulus discrimination training was conducted for two values of color and shape. Phase 2 discrimination training employed two 2-dimensional compound stimuli composed of the color and shape stimuli trained in Phase 1. For conflict-compound stimuli, the stimulus-response-consequence contingency was altered between phases for one stimulus dimension (target dimension), but not for the other, non-target, dimension. Level of congruence (100%, 25%, and 0%) of the contingency for the target dimension between phases was manipulated across groups. When each stimulus value was tested in Phase 3, level of Phase-2-consistent responding to the target dimension varied with level of Phase-1-to-Phase-2 congruence. In Experiment 2, training history for the non-target dimension was altered across three conditions: (a) Correlated with reinforcement, as in Experiment 1, (b) No-Training, or (c) Not-Correlated. Phase-2-consistent responding to the target cue in Phase 3 was lower under the latter conditions than under the Correlated condition, indicating that the non-target dimension modulated control by the target dimension, consistent with stimulus competition. The data suggest elemental, rather than configural processing of the compound stimuli during Phase 2.     

Associative symmetry and stimulus-class formation by pigeons: The role of non-reinforced baseline relations

Two experiments tested the assumption of Urcuioli's (2008) theory of pigeons’ equivalence-class formation that consistent non-reinforcement of certain stimulus combinations in successive matching juxtaposed with consistent reinforcement of other combinations generates stimulus classes containing the elements of the reinforced combinations. In Experiment 1, pigeons were concurrently trained on symbolic (AB) and two identity (AA and BB) successive tasks in which half of all identity trials ended in non-reinforcement but all AB trials were reinforced, contingent upon either responding or not responding to the comparisons. Subsequent symmetry (BA) probe trials showed evidence of symmetry in one of four pigeons. In Experiment 2, pigeons learned three pair-comparison tasks in which left versus right spatial choices were reinforced after the various sample-comparison combinations comprising AB, AA, and BB conditional discriminations. Non-differentially reinforced BA probe trials following acquisition showed some indication of symmetrical choice responding. The overall results contradict the theoretical predictions derived from Urcuioli (2008) and those from Experiment 2 challenge other stimulus-class analyses as well.