Associative symmetry and stimulus-class formation by pigeons: The role of non-reinforced baseline relations

Two experiments tested the assumption of Urcuioli's (2008) theory of pigeons’ equivalence-class formation that consistent non-reinforcement of certain stimulus combinations in successive matching juxtaposed with consistent reinforcement of other combinations generates stimulus classes containing the elements of the reinforced combinations. In Experiment 1, pigeons were concurrently trained on symbolic (AB) and two identity (AA and BB) successive tasks in which half of all identity trials ended in non-reinforcement but all AB trials were reinforced, contingent upon either responding or not responding to the comparisons. Subsequent symmetry (BA) probe trials showed evidence of symmetry in one of four pigeons. In Experiment 2, pigeons learned three pair-comparison tasks in which left versus right spatial choices were reinforced after the various sample-comparison combinations comprising AB, AA, and BB conditional discriminations. Non-differentially reinforced BA probe trials following acquisition showed some indication of symmetrical choice responding. The overall results contradict the theoretical predictions derived from Urcuioli (2008) and those from Experiment 2 challenge other stimulus-class analyses as well.     

The role of common reinforced comparison responses in acquired sample equivalence

Different samples occasioning the same reinforced comparison response in matching-to-sample are interchangeable for one another outside of original training. The present studies were designed to verify the role of these common responses in producing acquired sample equivalence by explicitly varying the presence or absence of this commonality during training. In each of the two experiments, one group of pigeons made the same reinforced choice response following multiple sample stimuli, whereas controls either made different reinforced choices following each sample (Experiment 1) or reinforced choices after only two of four center-key stimuli (Experiment 2). Later, two of the original samples/center-key stimuli were established as conditional cues for new comparison responses, after which the ability of the remaining samples/center-key stimuli to occasion those new responses was assessed. Following common-response training, matching accuracy was higher on class-consistent than on class-inconsistent transfer tests, whereas accuracy in the controls was generally intermediate between these two extremes, a pattern similar to that reported in the human paired-associate literature. These findings confirm that occasioning the same reinforced choice response is one means by which disparate samples become functionally equivalent.     

Habituation and the reinforcing effectiveness of visual stimuli

The term "sensory reinforcer" has been used to refer to sensory stimuli (e.g. light onset) that are primary reinforcers in order to differentiate them from other more biologically important primary reinforcers (e.g. food and water). Acquisition of snout poke responding for a visual stimulus (5s light onset) with fixed ratio 1 (FR 1), variable-interval 1min (VI 1min), or variable-interval 6min (VI 6min) schedules of reinforcement was tested in three groups of rats (n=8/group). The VI 6min schedule of reinforcement produced a higher response rate than the FR 1 or VI 1min schedules of visual stimulus reinforcement. One explanation for greater responding on the VI 6min schedule relative to the FR 1 and VI 1min schedules is that the reinforcing effectiveness of light onset habituated more rapidly in the FR 1 and VI 1min groups as compared to the VI 6min group. The inverse relationship between response rate and the rate of visual stimulus reinforcement is opposite to results from studies with biologically important reinforcers which indicate a positive relationship between response and reinforcement rate. Rapid habituation of reinforcing effectiveness may be a fundamental characteristic of sensory reinforcers that differentiates them from biologically important reinforcers, which are required to maintain homeostatic balance.     

Visual stimulus compounding with pigeons

Eight pigeons responded to successively presented color and line stimuli correlated with different likelihoods of reinforcement (100, 50 and 10%). An intertriai interval was included during training for half of the birds. In Experiment 1, tests with superimposed compounds resulted in variable responding, but overall, rates of responding were intermediate to the rates controlled by the individual component stimuli. In Experiments 2a and 2b, tests with compounds of spatially separated stimuli yielded rates of responding that were intermediate to, and in some cases lower than, responding controlled by the individual component stimuli. These results suggest limitations to the generality of additive models of stimulus compounding when visual stimulus combinations are employed.     

Extinguished operant responding shows stimulus specificity

The experiment tested for stimulus specificity in extinguished operant responding. Eight pigeons pecked keys for food reinforcers delivered by a variable interval (VI) 60-s schedule. The key was illuminated with red light during some sessions and white light during others. Then, responding was placed on extinction. During some sessions of extinction, the color of the key light remained constant throughout the session (red or white). During other sessions the color changed at 30 min into the session (red to white or white to red). Response rate increased after the change of key color in extinction. If it is assumed that key color is part of the stimulus to which subjects habituate, then these results are consistent with McSweeney and Swindell's [J. Gen. Psychol. 129 (2002) 364] suggestion that responding declines in extinction partly because subjects habituate to the stimuli that support conditioned responding. Habituation is relatively specific to the exact nature of the stimulus presented. Therefore, changes in the stimulus violate stimulus specificity and restore habituated responding. The results are also consistent with other theories that attribute extinction to a reduction of stimulus control [e.g., Psychol. Bull. 114 (1993) 80; J. Exp. Psychol.: Anim. Behav. Process. 16 (1990) 235], but considerations such as parsimony and testability favor the habituation hypothesis over these theories.     

Reward magnitude and timing in pigeons

We investigated the interaction of motivation and timing by manipulating the expected reward magnitude during a peak procedure. Four pigeons were tested with three different reward magnitudes, operationalized as duration of food access. Each stimulus predicted a different reward magnitude on a 5 s fixed-interval schedule. Trials with different reward magnitudes were randomly intermingled in a session. Most pigeons responded less often and started responding later on peak trials when a smaller reward was expected, but showed no differences in response termination or peak times. Reward magnitude was independently corroborated through unreinforced choice trials, when pigeons chose between the three stimuli presented simultaneously. These results contribute to a growing body of evidence that the expected reward magnitude influences the decision to start anticipatory responding in tasks where the reward becomes available after a fixed interval, but does not alter peak times, nor the decision to stop responding on peak trials.     

Temporal discrimination learning by pigeons

Memory for time by animals appears to undergo a systematic shortening. This so-called choose-short effect can be seen in a conditional temporal discrimination when a delay is inserted between the sample and comparison stimuli. We have proposed that this temporal shortening may result from a procedural artifact in which the delay appears similar to the intertrial interval and thus, produces an inadvertent ambiguity or 'instructional failure'. When this ambiguity is avoided by distinguishing the intertrial interval from the delay, as well as the samples from the delay, the temporal shortening effect and other asymmetries often disappear. By avoiding artifacts that can lead to a misinterpretation of results, we may understand better how animals represent time. An alternative procedure for studying temporal discriminations is with the psychophysical bisection procedure in which following conditional discrimination training, intermediate durations are presented and the point of subjective equality is determined. Research using the bisection procedure has shown that pigeons represent temporal durations not only as their absolute value but also relative to durations from which they must be discriminated. Using this procedure, we have also found that time passes subjectively slower when animals are required to respond to the to-be-timed stimulus.     

Stimulus change dis-habituates operant responding supported by water reinforcers

The present experiment examined whether habituation contributes to within-session decreases in operant responding for water reinforcers. The experiment asked if this responding can be dishabituated, a fundamental property of habituated behavior. During baseline, rats’ lever pressing was reinforced by water on a variable interval 15-s schedule. During experimental conditions, rats responded on the same schedule and a new stimulus was introduced for 5 min at 15, 30 or 45 min into the 60-min session. The new stimulus was extinction, continuous reinforcement or flashing lights in different conditions. Rate of responding primarily decreased within the session during baseline. Introducing a new stimulus sometimes suppressed (extinction, continuous reinforcement) and sometimes increased (flashing lights) responding while it was in effect. The new stimulus increased responding after it ended and before it was presented in the session. The results are incompatible with the idea that non-habituation satiety factors (e.g., cellular hydration and blood volume) contributed to within-session changes in responding. These satiety factors should increase with increases in consumption, decrease with decreases in consumption and remain constant with constant consumption of water. Nevertheless, all stimulus changes increased operant responding for water. These results support the idea that habituation contributes to within-session decreases in responding for water reinforcers.     

Effects of prefeeding, extinction, and distraction during sample and comparison presentation on sensitivity to reinforcer frequency in matching to sample

The present experiment examined the effects of several test manipulations on discrimination, accuracy and sensitivity to reinforcer frequency in a conditional discrimination. Four pigeons responded on a multiple schedule of matching to sample procedures in which the reinforcer-frequency ratio for correct comparison choice responding was varied across components within session from 1:9 to 9:1. Following stability, the effects of prefeeding, extinction, and distraction during sample and comparison presentation were assessed. Discrimination accuracy decreased under prefeeding, extinction, and distraction during sample presentation. Sensitivity to reinforcer frequency decreased under prefeeding and extinction. Decreases in sensitivity were positively related to decreases in discrimination accuracy. The decreases in discrimination accuracy and sensitivity under prefeeding and extinction are interpreted as being due to decreases in attending to the sample and comparison stimuli, respectively, possibly mediated by motivational effects of these manipulations. This interpretation is consistent with current conceptualizations of the contingencies that govern conditional-discrimination performance.     

The role of terminal-link stimuli in concurrent-chain schedules: revisited using a behavioral-history procedure

A behavioral-history procedure was used to study the function of terminal-link stimuli as conditioned reinforcers in multiple concurrent-chain schedules of reinforcement. First, three pigeons were exposed to multiple concurrent-chain schedules in which the two multiple-schedule components were correlated with a blue and a white stimulus, respectively. In each component the initial links were equal independent variable-interval (VI) 15 s schedules. A fixed-interval (FI) 10 s schedule operated on the red key in one terminal link while extinction operated on the green key in the alternative terminal link. When large preferences for the red stimulus had been established, two tests were conducted. In the terminal-link test, under new initial-link stimuli--purple and brown--an FI 10 s schedule operated for both the red and green terminal-link stimuli. In the subsequent initial-link test, the blue and white initial-link stimuli were reintroduced, and, as in the terminal-link test, FI 10s operated for both the red and the green terminal-link stimuli. In the terminal-link test, the three pigeons showed no preference for the terminal links with the red stimulus, but showed clear and consistent preferences for the red stimulus when blue and white stimuli were reintroduced as initial-link stimuli in the initial-link test. This suggests that there are multiple sources of control over initial-link response allocation in concurrent-chains, including control by both terminal- and initial-link stimuli.     

Determinants of tonic and phasic reactions in transswitching

Forty-eight college students were assigned randomly to four groups in a 2 X 2 factorial arrangement of phasic conditional stimuli (same vs. different) and tonic conditional stimuli (same vs. different) to receive 2 days of classical conditioning with a transswitching procedure. Tonic stimuli were a 5-minute projected white triangle or circle; phasic stimuli were a 5-second red or green square superimposed over the tonic stimuli. There were six tonic stimulus segments each day, separated by 20-second periods of no stimulus, three containing six trials of the phasic stimulus paired with shock and three containing six trials of the phasic stimulus alone, in the counterbalanced order. Tonic responding at the onset of the tonic stimuli or during brief periods following its onset were recorded, along with phasic responses to the phasic stimuli. Responses included magnitude of skin conductance responses, frequency of unelicited skin conductance responses, and tonic heart rate. Both skin conductance measures of responding to the tonic stimuli differentiated significantly between positive and negative tonic segments during Day 2, but only in the group with two different tonic stimuli and one phasic stimulus ("standard" transswitching). This supported the hypothesis that tonic stimulus differentiation would be absent when two different phasic stimuli were present. The heart rate data did not support this hypothesis, showing tonic differentiation in both groups with two tonic stimuli. Phasic differentiation controlled by the different phasic stimuli was observed on Day 1; on Day 2, phasic differentiation was present only in the group with two tonic and one phasic stimuli and the group with one tonic and two phasic stimuli.(ABSTRACT TRUNCATED AT 250 WORDS)     

Matching-to-sample by pigeons: the dissociation of comparison choice frequency from the probability of reinforcement

It has been proposed that comparison choice in matching-to-sample should depend on two factors, the relative probability of reinforcement associated with each of the comparison stimuli and the conditional probability of each comparison stimulus being correct given presentation of one of the samples. DiGian and Zentall [DiGian, K.A., Zentall, T.R., 2007. Matching-to-sample in pigeons: in the absence of sample memory, sample frequency is a better predictor of comparison choice than the probability of reinforcement for comparison choice. Learn Behav. 35, 242-261] have shown that sample frequency together with the probability of choosing each of the comparison stimuli in training can influence comparison choice when delays are introduced, when the number of reinforcements associated with each of the comparison stimuli is equated. Furthermore, Zentall and Clement [Zentall, T.R., Clement, T.S., 2002. Memory mechanisms in pigeons: Evidence of base-rate neglect. J. Exp. Psych.: Anim. Behav. Proc. 28, 111-115] have found that sample frequency can affect comparison choice when delays are introduced independently of the number of choices of each of the comparison stimuli in training and the number of reinforcements associated with each of the comparison stimuli is equated. In the present experiment we found that the probability of choosing each of the comparison stimuli in training can affect comparison choice when delays are introduced, independently of sample frequency and when the number of reinforcements associated with each of the comparison stimuli is equated. Together, these experiments suggest that when the sample is not available, there is a partial dissociation between comparison choice and the probability of reinforcement associated with each of the comparison stimuli.     

A comparison of two methods for assessing critical flicker fusion frequency in hens

This paper compared two general methods for assessing critical fusion frequency in hens (gallus gallus domesticus). The first method was a conditional discrimination procedure with the stimuli presented successively. The second was a two-alternative forced-choice procedure with the stimuli presented simultaneously. It was found that both methods of stimulus presentation gave comparable results suggesting that either method is useful when investigating psychophysics in animals. The results also show that hens’ critical fusion frequency is considerably higher than that of humans which may account for hens’ inability to recognise images presented on standard computer or television monitors.     

Differential resurgence and response elimination

Resurgence refers to the transient recovery of previously reinforced, but presently not reinforced, responding when more recently reinforced responding is extinguished. The primary purpose of our research was to determine how differential resurgence results from the procedures used to eliminate that responding. There were three conditions in each of five experiments. In Condition 1, key pecking by pigeons was maintained under a two-component multiple variable-interval (VI) 30-s VI 30-s schedule. In Condition 2, this pecking was eliminated in different ways across components. In Condition 3, extinction was in effect for all responses, and resurgence of key pecking was compared across components. These three conditions were repeated for most pigeons, and the procedures used to eliminate responding in Condition 2 varied across experiments. In Experiment 1, there was greater resurgence, and an earlier onset of it, after a differential-reinforcement-of-other-behavior (DRO) schedule than after a VI schedule was correlated with pecking an alternative key. Experiments 2 and 3 showed that the differential resurgence in Experiment 1 probably was not due to conditional stimulus control or the periodicity of food delivery, respectively. In Experiment 4, there was no systematic difference in resurgence after either a DRO schedule or a VI schedule correlated with treadle pressing. In Experiment 5, there was greater resurgence, and/or an earlier onset of it, after a VI schedule correlated with treadle pressing than after a VI schedule correlated with pecking an alternative key. Taken together, the results showed that the reinforcement of an alternative key-peck response was the most effective means of reducing subsequent key-peck resurgence. The relation of these results to an understanding of resurgence is discussed.     

Discrimination of cartoons and photographs in pigeons: effects of scrambling of elements

Four groups of pigeons were trained on four visual discrimination tasks using people photographs, pigeon photographs, cartoons of people, and cartoons of pigeons. After completion of the discrimination, the subjects were tested with new stimuli in the same stimulus categories but never used during the training, and scrambled stimuli in which elements of the original stimulus were spatially randomized. The subjects showed generalization to the new stimuli except for the people cartoons. When scrambled stimuli were presented, the subjects showed suppression of responding to the photographs but not to the people cartoon. These results suggest that the pigeons recognized both the elements and spatial arrangement of the photographs but ignored the spatial arrangement of the human cartoons.     

Occasion setting in Pavlovian ambiguous target discriminations

Rats were trained in a Pavlovian serial ambiguous target discrimination, in which a target cue was reinforced if it was preceded by one stimulus (P-->T+) but was not reinforced if it was preceded by another stimulus (N-->T-). Test performance indicated that stimulus control by these features was weaker than that acquired by features trained within separate serial feature positive (P-->T+, T-) and serial feature negative (N-->W-, W+) discriminations. The form of conditioned responding and the patterns of transfer observed suggested that the serial ambiguous target discrimination was solved by occasion setting. The data are discussed in terms of the use of retrospective coding strategies when solving Pavlovian serial conditional discriminations, and the acquisition of special properties by both feature and target stimuli.     

Importance of pause between spider courtship vibrations and general problems using synthetic stimuli in behavioural studies

Effectiveness of natural stimuli (recorded and replayed male vibratory courtship signals) in eliciting a female's vibratory response was compared with that of synthetic stimuli in a plant-dwelling spider (Cupiennius salei). Specifically, the role of interseries (pauses between consecutive male series) was evaluated. Effectiveness was assessed by the number of responding females and the number of responses per female per stimulus. In case of both synthetic and natural stimuli, effectiveness increases with increasing duration of interseries in both measures. Interseries are thus represented in the female's innate releasing mechanism. However, synthetic stimuli are less effective (about 55%) than natural stimuli (set 100%). With decreasing interseries, the number of female responses per unit time sharply increases in case of playback of natural stimuli, but only slightly in case of synthetic stimuli. Since males courting on plants decrease interseries as soon as a female responds, thus facilitating their orientation, the data obtained with natural stimuli much better fit natural male courtship behaviour. This finding brings into question the validity of the synthetic stimulus. In the bioacoustics literature there is neither consensus on the effectiveness of a synthetic stimulus necessary to qualify it for behavioural analysis nor on how to measure effectiveness. We propose three measures : the percentage of responding animals, the action pattern of the response and the number of responses. It may be crucial, particularly when addressing evolutionary questions, to use either natural stimuli or synthetic stimuli (nearly) as effective as natural stimuli to avoid biased sampling of experimental animals and results difficult to interpret in biological terms.     

Attention, the presolution period, and choice accuracy in pigeons

Six pigeons were trained first on a color then on a form discrimination; four other pigeons were trained first on form and then on color. One of two colors or one of two forms (sample stimuli) appeared in the center of a touch sensitive monitor for 5 pigeons and in the center and in 16 other locations for 5 other pigeons. A peck anywhere within the region in which the sample stimuli appeared produced two white disks (comparison stimuli), one on the left and one on the lower right corners of the screen. Correct left-right choices provided food. Although of no consequence, the location of pecks in presence of the sample was predictive of the pigeon's subsequent choice. Accuracy, choice of the correct comparison stimulus, was greater when the sample stimuli appeared in the center as well as 16 other locations than when it appeared only in the center. The presolution period, the period of chance accuracy prior to evidence of discrimination learning, was decreased on each task following training on the other task. This evidence of facilitation following an extra-dimensional shift was attributed to continued relevance of the conditions under which the first task was learned. The duration of the presolution period was inversely related to asymptotic accuracy-data accounted for by Heinemann's (1983) theory of information processing during the presolution period.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

Locomotor activity in a novel environment predicts both responding for a visual stimulus and self-administration of a low dose of methamphetamine in rats

There is evidence that visual stimuli used to signal drug delivery in self-administration procedures have primary reinforcing properties, and that drugs of abuse enhance the reinforcing properties of such stimuli. Here, we explored the relationships between locomotor activity, responding for a visual stimulus, and self-administration of methamphetamine (METH). Rats were classified as high or low responders based on activity levels in a novel locomotor chamber and were subsequently tested for responding to produce a visual stimulus followed by self-administration of a low dose of METH (0.025 mg/kg/infusion) paired with the visual stimulus. High responder rats responded more for the visual stimulus than low responder rats indicating that the visual stimulus was reinforcing and that operant responding for a visual stimulus has commonalities with locomotor activity in a novel environment. Similarly, high responder rats responded more for METH paired with a visual stimulus than low responder rats. Because of the reinforcing properties of the visual stimulus, it was not possible to determine if the rats were responding to produce the visual stimulus, METH or the combination. We speculate that responding to produce sensory reinforcers may be a measure of sensation seeking. These results indicate that visual stimuli have unconditioned reinforcing effects which may have a significant role in acquisition of drug self-administration, a role that is not yet well understood.