Effects of an extinguished CS on competition with another CS

Three experiments were conducted using a conditioned taste aversion procedure with rats to examine the effect of nonreinforced presentations of a conditioned stimulus (CS) on its ability to compete with a target stimulus for manifest conditioned responding. Two CSs (A and B) were presented in a serial compound and then paired with the unconditioned stimulus. CS A was first paired with the US and then presented without the US (i.e., extinction) prior to reinforced presentation of the AB compound. Experiment 1 showed that A was poor at competing with B for conditioned responding when given conditioning and extinction prior to reinforcement of AB relative to a group that received both A and B for the first time during compound conditioning. That is, an extinguished A stimulus allowed greater manifest acquisition to B. Experiment 2 found that extinction treatment produced a poor CR to the pretrained and extinguished CS itself following compound conditioning. Experiment 3 found that interposing a retention interval after extinction of A and prior to compound conditioning enhanced A's ability to compete with B. The results of these experiments are discussed with regard to different theories of extinction and associative competition.     

Dopamine agonists and antagonists can produce an attenuation of response bias in a temporal discrimination task depending on discriminability of target duration

The current study examined the effects of the D2 agonist (quinpirole) and D2 antagonist (eticlopride) on temporal discrimination performance in a conditional discrimination task (Experiment I) and a delayed conditional discrimination task (Experiment II). In both experiments rats discriminated between a scheduled stimulus duration of 3 s versus 9 s. Consistent with previous reports, overall discrimination performance decreased in a dose-dependent manner with both drugs. Changes in response bias (the tendency to choose-short or choose-long irrespective of actual stimulus duration), however, were best characterized in terms of both drugs tending to attenuate the bias effects normally observed during baseline drug-free performance. Specifically, the 'choose-short' bias observed in Experiment I and at a relatively short, 0.1 s, delay in Experiment II became less extreme with increasing doses. In addition, the 'choose-long' bias observed at a relatively long, 6 s, delay in Experiment II also became less extreme with increasing doses. Thus, whether there was an apparent shift from a short response bias to long, or vice versa, was the product of the delay interval between stimulus presentation and choice rather than whether the drug in question was a D2 agonist or antagonist. Such an attenuation of bias may have arisen because of subjects confounding the delay interval with the actual discriminative stimulus duration.     

Excitatory backward conditioning in an appetitive conditioned reinforcement preparation with rats

Four experiments were conducted to examine appetitive backward conditioning in a conditioned reinforcement preparation. In all experiments, off-line classical conditioning was conducted following lever-press training on two levers. Presentations of a sucrose solution by a liquid dipper served as an unconditioned stimulus (US) and two auditory stimuli served as conditioned stimuli (CSs); one was paired with the US in either a forward (Experiment 1a) or a backward (Experiments 1b, 2, and 3) relationship, and the other served as a control CS, which was not paired with the US. In testing, each lever-press response produced a presentation of one of the CSs instead of appetitive reinforcers. The response to a lever was facilitated, compared to the response to another lever, when the response produced the backward CS presentation as well as when it produced the forward CS presentation; that is, the backward CS served as an excitatory conditioned reinforcer.     

The effects of cue competition on timing in pigeons

We studied the effects of cue competition on timing in both overshadowing and blocking operant procedures with pigeons. A white center key delivered reward when pecked 30 s after a red or green sidekey was presented and 10 s after presentation of the alternate color on the other sidekey. In Experiment 1, key presentations were concurrent during training trials for overshadow-condition pigeons, while side key presentations were separated across training trials for control birds. In Experiment 2, half of the birds (Blocking group) were given pre-exposure trials to either the 10-s or 30-s sidekey condition. Both blocking-condition and control birds were then given trials of concurrent side key presentations. Peak time curves were compared between experimental and control conditions. The results showed blocking of timing accuracy of a long (30-s) stimulus by a short (10-s) stimulus, but no evidence for overshadowing of timing accuracy.     

Visual discrimination learning in zebrafish (Danio rerio)

Three experiments demonstrated visual discrimination learning in zebrafish (Danio rerio). In each experiment, zebrafish were given a choice between two visually distinct arms of a T-maze. Choice of one stimulus was always followed by a food reward, but choice of the other stimulus was not rewarded. Different colored sleeves fitted around the arms of the T-maze were used in Experiments 1 (green and purple) and 2 (red and blue). The stimuli used in Experiment 3 were white sleeves lined with horizontal or vertical black stripes. In all three experiments, zebrafish acquired a significant preference for the stimulus that led to a food reward. Experiments 1 and 2 also showed that zebrafish could learn a reversal of the discrimination. Finally, the effect of discontinuing food rewards was examined after reversal training in Experiment 2 and after initial discrimination training in Experiments 1 and 3. Non-reinforcement led to a decrease in correct responding in Experiments 2 and 3 independent of stimulus identity, but to an asymmetrical pattern of responding in Experiment 1. The median latency to make a choice response decreased over the course of acquisition in all three experiments; during extinction, median response times did not change at all in Experiment 1 and increased only very slightly in Experiment 2, but showed a substantial increase in Experiment 3. The implications of these results for the zebrafish as a model system for genetic studies of learning and memory are discussed.     

Spatial serial conditioning maintained with minimal temporal contingency

Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatially informative conditioned stimuli in eliciting tracking behavior in pigeons. The experimental paradigm consisted of the simultaneous presentation of 2 key lights (CS2 and CTRL), followed by another key light (CS1), followed by food (the unconditioned stimulus or US). CS2 and CTRL were presented in 2 of 3 possible locations, randomly assigned; CS1 was always presented in the same location as CS2. CS2 was designed to signal the spatial, but not the temporal locus of CS1; CS1 signaled the temporal locus of the US. In experiment 1, differential pecking on CS2 was observed even when CS2 was present throughout the interval between consecutive presentations of CS1, but only in a minority of pigeons; prevalence of differential pecking was enhanced when CS2 duration was halved. A control condition verified that pecking on CS2 was not due to temporal proximity between CS2 and US. Experiment 2 demonstrated the reversibility of spatial conditioning between CS2 and CTRL. Asymptotic performance never involved tracking CTRL more than CS2 for any of 16 pigeons. It is inferred that pigeons learned the spatial association between CS2 and CS1, and that temporal contingency facilitated its expression as tracking behavior.     

A pitfall for the expectancy theory of human eyelid conditioning

Two simple eyeblink conditioning experiments with random intermittent reinforcement schedules were performed. In Experiment 1, subjects had to rate their expectancy for an unconditioned stimulus (US) on a seven-level scale prior to each trial. As anticipated, expectancy for US increased with a successive conditioned stimulus (CS) alone, and decreased with successive CS-US pairings. However, Experiments 1 and 2 showed that the frequency of eyeblink conditioned responses (CRs) evolved in a direction opposite to that of expectancy changes: CRs increased, whereas expectancy for US decreased, and vice versa. The possible effect of sensitization on eyeblink response was ruled out by the lack of a run effect in an unpaired control group in Experiment 2. These results tend to disconfirm the expectancy theory of conditioning. Although they were explicitly predicted by the conventional "strength" theory of conditioning, an alternative interpretation is proposed within a cognitive framework.     

Appetitive differential conditioning of the rabbit's jaw movement response. Effects of cue similarity and US magnitude

Two experiments examined appetitive differential conditioning of the rabbit's jaw movement response (JMR) in a two-phase procedure. The first phase entailed reinforced training with one conditioned stimulus (CS+), and the second phase involved intermixed presentations of CS+ and an unreinforced stimulus (CS-). In Experiment 1, CS+ was a 600-Hz tone, and CS- was either a 660-, 1,000-, or 2,100-Hz tone. In Experiment 2, the magnitude of the water unconditioned stimulus (US) paired with CS+ was either 1, 3, or 9 ml. The experiments revealed that 1) the level of responding to CS- rose for several days and then declined over the remainder of training; 2) the physical similarity between CS+ and CS- directly affected the level of responding to CS- but had no discernable effect on the level of responding to CS+; and 3) US magnitude positively affected the level of responding to CS+ and, to a lesser extent, CS-. The results are discussed in terms of their implications for Spence's gradient interaction theory and Pavlov's external inhibition hypothesis.     

Evidence of associative blocking during foraging in the social wasp Vespula germanica

While foraging, Vespula germanica usually return to abundant food sites. During this relocation behavior, these wasps learn to identify contextual cues associated with food position. We analyzed associative blocking in this species, that is, how an association with a conditioned stimulus (CS1) blocks subsequent learning when a novel stimulus (CS2) is added on a second foraging visit. Three groups of wasps (A, B, and C; total 74 individual wasps) were observed while collecting meat during one or two consecutive visits. In group A, an environmental cue (CS1) was paired with food placed at a specific site, and on the second visit, a second cue (CS2) was added while food remained in the same position. In a subsequent testing phase, CS1 was removed and the food source displaced nearby. We then recorded the number of hovers performed over the empty dish (previously baited). Group A wasps appeared to ignore the addition of CS2 on their second visit because they performed fewer hovers over the learned site. For group A, the duration of the decision-making process to finally fly toward the baited dish was shorter than when CS1 and CS2 were presented together on their first visit (group B). This is the first study to demonstrate the occurrence of associative blocking in vespids, confirming that a prior foraging experience influences subsequent food relocation in V. germanica. Our findings reveal that first learning episodes block further associations with novel contextual cues, contributing to understanding of complex cognitive processes involved in V. germanica´s foraging behavior.     

Salience modulation and associative inhibition interaction: Short but not long exposure to similar stimuli protects the salience of the unique elements

In three experiments, rats were given preexposure to two similar flavour compounds, AX and BX. Following preexposure, conditioning trials took place in which AX was paired with an illness-induced unconditioned stimulus. Animals that were given short alternated preexposure to AX and BX, showed higher generalization of conditioned aversion to AX to a new compound, AN, than animals that were given blocked preexposure (short and long) and long alternated preexposure (Experiments 1 and 2); and showed less preference for A when they were given a choice between A and X (Experiment 3). These results have been taken to indicate that the salience of the A element is well preserved after short alternated preexposure, but declines when preexposure goes on for some more trials. The results reported support the notion that perceptual learning is a multi-determined phenomenon that depends on salience modulation processes after relatively short preexposure, and on an associative inhibition mechanism after prolonged preexposure.     

Stimulus representation in SOP: II. An application to inhibition of delay

The componential extension of SOP accounts for conditioned response (CR) timing in Pavlovian conditioning by assuming that learning accrues with relative independence to stimulus elements that are differentially occasioned during the duration of the conditioned stimulus (CS). SOP, using a competitive learning rule and the assumption that temporal learning emerges via resolution of what is equivalent to an "AX+BX-" discrimination, predicts a progressive increase in the latency of the CR over training, or what Pavlov refer to as "inhibition of delay." Other componential models, which use noncompetitive learning rules, do not predict inhibition of delay. Either type of model makes the prediction indicated, independently of the length of the CS-unconditioned stimulus (US) interval. We report two experiments that demonstrated inhibition of delay when rabbits were trained with relatively long, but not with short, CS-US intervals. To account for this divergence, we assumed that the SOP stimulus trace involves two kinds of elements, some with a temporally distributed pattern of activity over the duration of the CS duration, and some with a randomly distributed pattern. This stimulus representation, not only allows for inhibition of delay with long but not short CS-US intervals, but in combination with SOP's performance rule deduces CR's with "Weber variability."     

Temporal discrimination in a long operant chamber

Pigeons were placed in a long chamber equipped with one key and feeder at each end side and one key and houselight at the middle. To obtain food the birds had to choose one side key after a short signal and the other side key after a long signal. The signals consisted of the illumination of the center key and the houselight and were initiated by a peck at the center key. The chamber had sensitive floor panels that enabled us to measure the location of the bird during the signals. In Experiment 1, after the birds learned the discrimination we reversed the assignment of keys to signals. In Experiment 2, we examined performance on two pairs of discriminations holding the same ratio. In Experiment 3, after the pigeons learned to discriminate two signals, we changed the duration of the long signal. The results showed that (a) the birds' motion during the signal was highly stereotypical, i.e. the birds moved to the short side, waited a few seconds, and then departed to, and stayed on the long side; (b) this motion pattern predicted the results of generalization tests with novel durations; (c) the mean of the times of departure from the short side approached its steady state values quicker than the standard deviation and consequently superposition of behavioral measures became stronger with training; (d) only the duration of the short signal influenced significantly the moment the birds departed from the short side; finally (e) the times of arrival at and departure from the short side were positively correlated, but the times of arrival and residence at the short side were negatively correlated.     

Reinstatement of short-latency responses after asymptotic Pavlovian conditioning training by the presentation of an extraneous stimulus

The purpose of this study was to examine whether the progressive disappearance of short-latency conditioned responses, or inhibition of delay, observed in Pavlovian conditioning with long inter-stimulus intervals, could be reverted by the presentation of a novel stimulus. In one experiment, two groups of rabbits received extensive training with a short (250 ms) or a long (1500 ms) tone that overlapped and terminated with a periorbital shock unconditioned stimulus. After training, the presentation of an extraneous stimulus prior to tone onset produced a reinstatement of short latency CRs in the group trained with the long CS, but did not affect CR latency in the group trained with the short CS. This finding is consistent with Pavlov's (1927) view that conditioning with long conditioned stimuli involves the acquisition of response tendencies in the early portion of the stimulus that are subsequently suppressed by the development of an inhibitory process.     

The role of temporal generalization in a temporal discrimination task

Two experiments trained rats to discriminate two or three stimulus durations using a temporal discrimination task. A standard peak shift effect was observed when training was administered with short versus long signals in Experiment 1. Both discrimination accuracy scores and the generalization gradients revealed that shorter intervals were discriminated more accurately, which may be due to the scalar property of timing. In Experiment 2, three signals (short, medium, and long) were associated with three different responses, or two of the intervals were associated with one response (short and long or short and medium) and the other interval with a different response. Here, the short/medium versus long discrimination was learned most readily of the three tasks. The results of both experiments indicated a strong contribution of learning of individual durations combined with scalar generalization gradients, but Experiment 2 indicated that categorical encoding of durations may have also been operating.     

Autoshaping in the rat: conditioned licking response to a stimulus that signals sucrose reinforcement

The present experiments were designed to determine if repeated presentations of an empty sipper tube (the conditioned stimulus or CS) with the response-independent delivery of a sucrose solution (the unconditioned stimulus or US) from a second spout results in the development of Pavlovian conditioned responding. In Experiment 1, rats in the experimental condition received paired CS-US presentations whereas subjects in the control condition were exposed to random presentations of CS and US. In Experiment 2, an additional control condition (CS alone) was included and, to encourage generalized responding between the US and CS, the CS tube was filled with water for all groups. The results of both experiments indicate that the CS-directed responding in the paired CS-US condition was Pavlovian in nature. Thus, the present procedure serves as an autoshaping task in which conditioned licking is generated.     

Intertrial interval as a contextual stimulus

Four experiments with rats investigated whether the time between appetitive conditioning trials can serve as a discriminative cue for responding during the next conditional stimulus (CS). In Experiment 1, rats that received extinction trials with a 4-min intertrial interval (ITI) showed spontaneous recovery after a retention interval of 16 min, whereas rats that received extinction with a 16-min ITI did not. Experiments 2 and 3 investigated more explicit discriminations between the 4- and 16-min ITIs. When a 16-min ITI signaled that the CS would be reinforced and a 4-min ITI signaled that it would not, the ITIs modulated responding to the CS. But when the 4-min ITI signaled reinforcement and the 16-min ITI did not, there was less evidence of modulation by the ITIs. This asymmetry was due at least partly to a difficulty in performance rather than learning. Experiment 4 investigated similar discriminations with 1- and 4-min ITIs. Here the results took a different form: time in the reinforced ITI elicited responding directly, but did not modulate responding to the CS. ITI can function as a contextual cue, and the results suggest new similarities between the processes behind interval timing and associative learning.     

Effect of contingent auditory stimuli on concurrent schedule performance: an alternative punisher to electric shock

This study explored whether load auditory stimuli could be used as functional punishing stimuli in place of electric shock. Three experiments examined the effect of a loud auditory stimulus on rats’ responding maintained by a concurrent reinforcement schedule. In Experiment 1, overall response rate decreased when a concurrent 1.5 s tone presentation schedule was superimposed on the concurrent variable interval (VI) 180-s, VI 180-s reinforcement schedule. On the contrary, response rate increased when a click presentation schedule was added. In Experiment 2, the extent of the response suppression with a 1.5 s tone presentation varied as a function of the frequency of the reinforcement schedule maintaining responses; the leaner the schedule employed, the greater the response suppression. In Experiment 3, response suppression was observed to be inversely related to the duration of the tone; response facilitation was observed when a 3.0-s tone was used. In Experiments 1 and 2, a preference shift towards the alternative with richer reinforcement was observed when the tone schedule was added. In contrast, the preference shifted towards the leaner alternative when the click or longer duration stimulus was used. These results imply that both the type and duration of a loud auditory stimulus, as well as the reinforcement schedule maintaining responses, have a critical role in determining the effect of the stimuli on responding. They also suggest that a loud auditory stimulus can be used as a positive punisher in a choice situation for rats, when the duration of the tone is brief, and the reinforcement schedule maintaining responses is lean.     

Characterizing the effects of d-amphetamine on temporal discrimination

Although the effects of dopamine agonists on temporal discrimination have been widely studied, conclusions as to their behavioral and neurophysiological effects are difficult due to a number of discrepant findings in the literature. This study examined whether a previously unexplored procedural difference could account for some of these discrepancies. In three experiments, pigeons categorized the duration of temporal samples during two variants of the interval-bisection procedure. In the position variant, responses to a side key that corresponded to the sample duration produced food. In the color-matching variant, responses to the key color that corresponded to the sample duration produced food. Across experiments, d-amphetamine produced a general disruption of temporal discrimination not accompanied by over or underestimation of time in both procedures. This effect occurred whether pigeons were exposed to both procedures within session (Experiment 1) or across conditions (Experiments 2 and 3) and whether the pigeons were drug experienced (Experiments 1 and 2) or naïve (Experiment 3). Analyses of the cumulative normal functions fitted to the proportion-long response data indicated that d-amphetamine produced its effects by selectively decreasing stimulus control, rather than by affecting timing.     

Renewal and reinstatement of the conditioned but not the unconditioned response following habituation of the unconditioned stimulus

Research on the inhibition of learned fear currently relies almost exclusively on one specific procedure, namely extinction of the conditioned stimulus (CS). Importantly, however, learned fear responses can be reduced by a number of other procedures, including habituation of the unconditioned stimulus (US). We recently demonstrated that reductions in learned fear following US habituation, like CS extinction, were subject to both renewal and reinstatement (Storsve et al., 2010). The present study further investigates the associative and non-associative processes shared between habituation and extinction. Given that habituation is typically context-independent (Mackintosh, 1987), in the present study we directly compared renewal and reinstatement of both a conditioned response (CR; freezing) and an unconditioned response (UR; startle) following habituation. It was found that the reduction in conditioned freezing resulting from habituation was context specific (i.e., a change in context led to a renewal of the conditioned fear response; Experiment 1) and was attenuated when a pre-test shock was given (i.e., reinstatement of conditioned fear was observed; Experiment 2). In contrast, habituation of an unconditioned response elicited by the US (i.e., a startle response) was unaffected by either a change in test context or administration of a pre-test shock. This dissociation in the effects of habituation on learned and unlearned responses is discussed in relation to theories of fear extinction.     

Do Changes in the Pace of Events Affect One-Off Judgments of Duration?

Five experiments examined whether changes in the pace of external events influence people’s judgments of duration. In Experiments 1a–1c, participants heard pieces of music whose tempo accelerated, decelerated, or remained constant. In Experiment 2, participants completed a visuo-motor task in which the rate of stimulus presentation accelerated, decelerated, or remained constant. In Experiment 3, participants completed a reading task in which facts appeared on-screen at accelerating, decelerating, or constant rates. In all experiments, the physical duration of the to-be-judged interval was the same across conditions. We found no significant effects of temporal structure on duration judgments in any of the experiments, either when participants knew that a time estimate would be required (prospective judgments) or when they did not (retrospective judgments). These results provide a starting point for the investigation of how temporal structure affects one-off judgments of duration like those typically made in natural settings.