Visual discrimination learning in zebrafish (Danio rerio)

Three experiments demonstrated visual discrimination learning in zebrafish (Danio rerio). In each experiment, zebrafish were given a choice between two visually distinct arms of a T-maze. Choice of one stimulus was always followed by a food reward, but choice of the other stimulus was not rewarded. Different colored sleeves fitted around the arms of the T-maze were used in Experiments 1 (green and purple) and 2 (red and blue). The stimuli used in Experiment 3 were white sleeves lined with horizontal or vertical black stripes. In all three experiments, zebrafish acquired a significant preference for the stimulus that led to a food reward. Experiments 1 and 2 also showed that zebrafish could learn a reversal of the discrimination. Finally, the effect of discontinuing food rewards was examined after reversal training in Experiment 2 and after initial discrimination training in Experiments 1 and 3. Non-reinforcement led to a decrease in correct responding in Experiments 2 and 3 independent of stimulus identity, but to an asymmetrical pattern of responding in Experiment 1. The median latency to make a choice response decreased over the course of acquisition in all three experiments; during extinction, median response times did not change at all in Experiment 1 and increased only very slightly in Experiment 2, but showed a substantial increase in Experiment 3. The implications of these results for the zebrafish as a model system for genetic studies of learning and memory are discussed.     

Interval duration effects on blocking in appetitive conditioning

Three experiments examined absolute (Experiment 1) and relative (Experiments 2a and 2b) duration effects on blocking. In Experiment 1, rats were pretrained with a short or long conditioned stimulus (CS1) followed by food, after which they were given reinforced short-short or long-long CS1-CS2 simultaneous compounds. Compared to overshadowing control groups, both pretrained groups displayed blocking, and there was no clear effect of absolute stimulus duration on the magnitude of blocking. In Experiments 2a and 2b, the rats received partially overlapping short-long CS1-CS2 compounds. In both experiments, a long CS1 blocked a short CS2, but not vice versa. This was the case when the long CS1 was nine times (Experiment 2a) or only 1.5 times (Experiment 2b) the duration of the short CS2. The pattern of results is most consistent with a real-time model of conditioning, such as the Sutton and Barto [Sutton, R.S., Barto, A.G., 1990. Time derivative models of Pavlovian reinforcement. In: Gabriel, M.R., Moore, J.W. (Eds.), Learning and Computational Neuroscience: Foundations of Adaptive Networks. MIT Press, Cambridge, MA, 497-537] temporal difference model.     

Effects of an extinguished CS on competition with another CS

Three experiments were conducted using a conditioned taste aversion procedure with rats to examine the effect of nonreinforced presentations of a conditioned stimulus (CS) on its ability to compete with a target stimulus for manifest conditioned responding. Two CSs (A and B) were presented in a serial compound and then paired with the unconditioned stimulus. CS A was first paired with the US and then presented without the US (i.e., extinction) prior to reinforced presentation of the AB compound. Experiment 1 showed that A was poor at competing with B for conditioned responding when given conditioning and extinction prior to reinforcement of AB relative to a group that received both A and B for the first time during compound conditioning. That is, an extinguished A stimulus allowed greater manifest acquisition to B. Experiment 2 found that extinction treatment produced a poor CR to the pretrained and extinguished CS itself following compound conditioning. Experiment 3 found that interposing a retention interval after extinction of A and prior to compound conditioning enhanced A's ability to compete with B. The results of these experiments are discussed with regard to different theories of extinction and associative competition.     

Instrumental outcome devaluation with representation-mediated conditioning

In three experiments, rats were trained to perform two instrumental behaviours (R1 and R2) in the presence of discriminative stimuli (Sd1 and Sd2, respectively) to obtain a common food outcome (O1). Acquisition of the two discriminations was followed by switching the outcome accompanying R2 performance from O1 to a new one (O2). Experiment 1 showed paired presentations of O2 with a lithium chloride (LiCl) injection resulted in a reduction in the R2 performance. In the subsequent two experiments, each Sd was paired with LiCl injection and its effects on outcome consumption and instrumental performance were investigated. A reduction in the O2 consumption subsequent to the Sd devaluation was found in Experiments 2 and 3. Experiment 3 revealed a reduced R2 performance in an extinction test, following the animals’ consummatory access to the outcomes in training context. These results demonstrate representation-mediated outcome devaluation in the course of the Sd devaluation.     

Visual stimulus compounding with pigeons

Eight pigeons responded to successively presented color and line stimuli correlated with different likelihoods of reinforcement (100, 50 and 10%). An intertriai interval was included during training for half of the birds. In Experiment 1, tests with superimposed compounds resulted in variable responding, but overall, rates of responding were intermediate to the rates controlled by the individual component stimuli. In Experiments 2a and 2b, tests with compounds of spatially separated stimuli yielded rates of responding that were intermediate to, and in some cases lower than, responding controlled by the individual component stimuli. These results suggest limitations to the generality of additive models of stimulus compounding when visual stimulus combinations are employed.     

Excitatory backward conditioning in an appetitive conditioned reinforcement preparation with rats

Four experiments were conducted to examine appetitive backward conditioning in a conditioned reinforcement preparation. In all experiments, off-line classical conditioning was conducted following lever-press training on two levers. Presentations of a sucrose solution by a liquid dipper served as an unconditioned stimulus (US) and two auditory stimuli served as conditioned stimuli (CSs); one was paired with the US in either a forward (Experiment 1a) or a backward (Experiments 1b, 2, and 3) relationship, and the other served as a control CS, which was not paired with the US. In testing, each lever-press response produced a presentation of one of the CSs instead of appetitive reinforcers. The response to a lever was facilitated, compared to the response to another lever, when the response produced the backward CS presentation as well as when it produced the forward CS presentation; that is, the backward CS served as an excitatory conditioned reinforcer.     

US specificity of occasion setting: Hierarchical or configural learning?

Four experiments in rats examined whether occasion setters and target CSs play qualitatively different roles in occasion-setting discriminations. Two visual occasion setters, A and B, signalled reinforcement of two auditory target CSs, x and y, with sucrose and oil (A…x→suc, B…y→oil, A-, B-, x-, y-); in addition two transfer CSs w and z were paired with sucrose and oil (w→suc, z→oil). When w and z were substituted for x and y (A…w, B…w, A…z, B…z) more responding was observed when both stimuli had been paired with the same outcome (Experiments 1 and 3a). No effect was observed when two visual "pseudo-occasion setters", C and D (paired with sucrose and oil in a trace relation to the US:C…→suc, D…→oil), were substituted for the occasion setters A and B (C…x, D…x, C…y, D…y; Experiments 2, 3b and 4). These results could not be explained in terms of Pavlovian summation: responding to combinations of Pavlovian CSs paired with same or different outcomes was either the same, or lower when both stimuli had been paired with the same outcome (Experiment 4). Implications of these results for theories of occasion setting and configural learning are discussed.     

Effect of US identity on elimination and recovery of autoshaped responding with explicitly unpaired and degraded contingency extinction procedures

The depressive effects of noncontingent and explicitly unpaired food unconditioned stimuli (USs) and the recovery from those effects on autoshaped responding were examined in a series of experiments with pigeons. In Experiments 1 and 2, responding to a keylight conditioned stimulus (CS) previously paired with food was depressed equally by explicitly unpaired presentations of either that same food or a different food. Furthermore, responding recovered equally following removal of the explicitly unpaired foods. In contrast, Experiments 3 and 4 showed that noncontingent presentations of a food US depressed responding more to a keylight CS paired with that same food than to a keylight CS paired with a different food. Moreover, removal of the noncontingent foods led to complete recovery but more rapid extinction of responding to the same keylight relative to the different keylight. The implications of these results for understanding the mechanisms underlying depression and recovery of responding following degraded contingency and explicitly unpaired extinction procedures are discussed.     

Reaction times identify a Pavlovian component in a two-choice discrimination

Six pigeons discriminated on discrete trials between two colors. In Experiment 1, two luminous spots were both either blue or green and the reinforced responses were “peck left” for blue and “peck right” for green. In Experiment 2, the hue of a center spot controlled subsequent choice pecks to left or right. In both experiments response bias was manipulated in two ways. During stimulus frequency (“SF”) sessions correct responses brought food on 40% of trials; in “imbalanced” blocks of sessions one hue appeared on 80% of trials and the other on 20%. During reinforcement probability (“RNF”) sessions the hues appeared equally often, but in imbalanced blocks the hues signaled different reinforcement probabilities, either 64% or 16%. In “balanced” control blocks the hues appeared equally often and were both reinforced at 40%. The experiments gave similar results. When bias was computed from choice percentages the imbalanced conditions yielded substantial response bias, and the amount of bias was about the same under RNF and SF treatments. However, reaction times (RTs) gave a different outcome. RNF imbalance slowed responses directed at the less reinforced stimulus, but SF imbalance had little RT effect (Experiment 1) or no effect (Experiment 2). These results suggest that choice was controlled by an instrumental stimulus-response-reinforcement association, whereas RTs were controlled by a Pavlovian stimulus-reinforcement association.     

Pavlovian conditioning with proximal stimuli

This experiment was conducted with the objective of demonstrating that the effective stimuli in Pavlovian Conditioning are not environmental stimuli but internal physiological processes elicited by environmental input (proximal stimuli). In order to achieve the objective, afterimages in color vision were used: looking at a diffuse lightened circle after seeing a red circle yields an image of a green circle. A differential conditioning paradigm with two sequential compounds was run. In one group (G+B-: n1 = 10), a red circle followed by a green circle was paired with shock, whereas a red circle followed by a blue circle remained unpaired. A second group (G-B+: n2 = 10) received red-blue paired trials and unpaired red-green trials. Immediately after that training, subjects were tested with a new, never trained sequential compound: a red circle followed by a diffuse lightened circle. Furthermore, they were tested with the already trained compounds. Taking the environmental point of view, the never trained stimulus should elicit an orienting response lying in between the excitatory reaction to the paired stimulus and the inhibitory reaction to the unpaired stimulus. From the proximal point of view, the diffuse light should elicit an excitatory reaction in group G+B- and an inhibitory reaction in group G-B+. Electrodermal conditioned anticipatory and omission responses were measured. The results supported the proximal hypothesis. Hence, defining input in environmental terms may be the wrong way. Instead, in conceptualizing the stimulus in conditioning, the following should be considered: the processing organism itself is creating the effective stimuli.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

Blocked and test-stimulus exposure effects in perceptual learning re-examined

Three experiments re-examined the effects of blocked or alternated exposure to the conditioning and test stimuli and the effect of simple exposure to the test stimulus, on stimulus generalization. In all experiments rats received conditioning where a compound flavor, AX, was paired with LiCl-induced illness. All rats were tested for generalization with another flavor, BX. In Experiment 1, rats that received alternating exposure to the two flavor compounds, AX and BX, prior to conditioning showed less generalization to BX than rats that received no exposure. Exposure to BX or AX alone was also somewhat effective in reducing generalization. In Experiment 2 blocked exposure to AX and BX prior to conditioning was effective in reducing generalization, as was alternated exposure, and extended exposure to BX was more effective than the other procedures. In Experiment 3, exposure to X alone prior to conditioning produced generalization equal to that produced by alternated or blocked exposure and replicated the effect of extended exposure to BX found in the previous experiment. The relevance of the results to the theories proposed by McLaren and Macintosh [Anim. Learn. Behav. 28 (2000) 211] and Hall [Q. J. Exp. Psychol. B 56 (2003) 43] is discussed.     

Serial order of conditional stimuli as a discriminative cue for Pavlovian conditioning

The serial order in which events occur can be a signal for different outcomes and therefore might be a determinant of how an animal should respond. In this report, we propose a novel design for studying serial order learning in Pavlovian conditioning. In both Experiments 1a and 1b, hungry rats were trained with successively presented pairs of auditory and visual stimuli (e.g., A --> B) using four different stimuli (A-D). Four orders were paired with food (A --> B, B --> C, C --> D, D --> A) while the reversals were extinguished (B --> A, C --> B, D --> C, A --> D). An analysis of responding from the second element of each pair showed that the rats discriminated trial types that preceded food from those that did not. A replication of the effect using a completely counterbalanced design is described in Experiment 1b. These results suggest that rats can use the serial or temporal order of two sequentially presented non-overlapping elements as the basis for discrimination. Two associative accounts are suggested as possible mechanisms for solving the discrimination.     

Distractor effects upon habituation of complex stimuli

In two experiments, rats were given serial forward (the target followed by the distractor) or backward (the distractor followed by the target) exposure to two compound flavor stimuli that could be either similar (Salt-X/AX) or dissimilar (Salt-X/AY, Experiment 1; Salt/AX, Experiment 2). Following pre-exposure, the Salt element was presented in a compound with a novel flavor, N. The salience or effectiveness of the Salt element was then assessed by presenting the new flavor, N, under a state of salt appetite. Experiments 1 and 2 revealed that the order of presentation modulated the habituation of the Salt element only when the distractor was similar to the target: the Salt element was more salient after forward than backward pre-exposure. In the groups Dissimilar the order of pre-exposure was irrelevant; however, when the Salt element was presented in compound with a second element (Salt-X, Experiment 1), its salience was preserved, whereas when it was presented alone (Salt, Experiment 2) its salience was significantly reduced. These results, which are discussed in terms of Wagner (1981) theory of habituation, inform about the way in which stimuli presented closely in time are processed.     

Salience modulation and associative inhibition interaction: Short but not long exposure to similar stimuli protects the salience of the unique elements

In three experiments, rats were given preexposure to two similar flavour compounds, AX and BX. Following preexposure, conditioning trials took place in which AX was paired with an illness-induced unconditioned stimulus. Animals that were given short alternated preexposure to AX and BX, showed higher generalization of conditioned aversion to AX to a new compound, AN, than animals that were given blocked preexposure (short and long) and long alternated preexposure (Experiments 1 and 2); and showed less preference for A when they were given a choice between A and X (Experiment 3). These results have been taken to indicate that the salience of the A element is well preserved after short alternated preexposure, but declines when preexposure goes on for some more trials. The results reported support the notion that perceptual learning is a multi-determined phenomenon that depends on salience modulation processes after relatively short preexposure, and on an associative inhibition mechanism after prolonged preexposure.     

Differential resurgence and response elimination

Resurgence refers to the transient recovery of previously reinforced, but presently not reinforced, responding when more recently reinforced responding is extinguished. The primary purpose of our research was to determine how differential resurgence results from the procedures used to eliminate that responding. There were three conditions in each of five experiments. In Condition 1, key pecking by pigeons was maintained under a two-component multiple variable-interval (VI) 30-s VI 30-s schedule. In Condition 2, this pecking was eliminated in different ways across components. In Condition 3, extinction was in effect for all responses, and resurgence of key pecking was compared across components. These three conditions were repeated for most pigeons, and the procedures used to eliminate responding in Condition 2 varied across experiments. In Experiment 1, there was greater resurgence, and an earlier onset of it, after a differential-reinforcement-of-other-behavior (DRO) schedule than after a VI schedule was correlated with pecking an alternative key. Experiments 2 and 3 showed that the differential resurgence in Experiment 1 probably was not due to conditional stimulus control or the periodicity of food delivery, respectively. In Experiment 4, there was no systematic difference in resurgence after either a DRO schedule or a VI schedule correlated with treadle pressing. In Experiment 5, there was greater resurgence, and/or an earlier onset of it, after a VI schedule correlated with treadle pressing than after a VI schedule correlated with pecking an alternative key. Taken together, the results showed that the reinforcement of an alternative key-peck response was the most effective means of reducing subsequent key-peck resurgence. The relation of these results to an understanding of resurgence is discussed.     

Effects of handling and pair management on reproduction in Japanese quail (Coturnix coturnix )

Three experiments were designed to study the effects of handling, pairing, and frequency of mating opportunities on reproduction in Japanese quail (Coturnix coturnix ) when the sexes were caged separately except during the 90 minute mating periods. In Experiments 1 and 2, 48 females and 48 males were allocated randomly to one of four treatments: 1) continuously paired, 2) paired daily with the same male, 3) paired daily with a different male, and 4) paired every third day with the same male. In Experiment 3, 44 males and 44 females used in Experiments 1 and 2 were again assigned randomly to one of four treatments: 1) continuously paired, 2) paired continuously but the females were handled at the beginning and end of a 90 minute period every third day to simulate the handling associated with moving birds between cages for mating, 3) paired every third day with the same male, and 4) paired every third day with a different male. In Experiments 1 and 3, the females were introduced into the males' cages, while in Experiment 2 males were introduced into the females' cages. In Experiment 1, the females paired every 1 or 3 days with the same males had fewer eggs with embryonic development than continously paired females. In Experiment 2, a reduced number of eggs with embryonic development was observed only in fermales paired every 3 days with the same male. In Experiment 1, more eggs hatched from continuously paired females than from females paired every third day with the same male. In Experiment 3, the females paired every third day with the same males had fewer settable, developing, or hatching eggs. In conclusion, it was found that when the sexes need to be caged separately, it is better to expose the females to different males.     

Associative symmetry and stimulus-class formation by pigeons: The role of non-reinforced baseline relations

Two experiments tested the assumption of Urcuioli's (2008) theory of pigeons’ equivalence-class formation that consistent non-reinforcement of certain stimulus combinations in successive matching juxtaposed with consistent reinforcement of other combinations generates stimulus classes containing the elements of the reinforced combinations. In Experiment 1, pigeons were concurrently trained on symbolic (AB) and two identity (AA and BB) successive tasks in which half of all identity trials ended in non-reinforcement but all AB trials were reinforced, contingent upon either responding or not responding to the comparisons. Subsequent symmetry (BA) probe trials showed evidence of symmetry in one of four pigeons. In Experiment 2, pigeons learned three pair-comparison tasks in which left versus right spatial choices were reinforced after the various sample-comparison combinations comprising AB, AA, and BB conditional discriminations. Non-differentially reinforced BA probe trials following acquisition showed some indication of symmetrical choice responding. The overall results contradict the theoretical predictions derived from Urcuioli (2008) and those from Experiment 2 challenge other stimulus-class analyses as well.     

Frequent Words Do Not Break Continuous Flash Suppression Differently from Infrequent or Nonexistent Words: Implications for Semantic Processing of Words in the Absence of Awareness

Continuous flash suppression (CFS) has been used as a paradigm to probe the extent to which word stimuli are processed in the absence of awareness. In the two experiments reported here, no evidence is obtained that word stimuli are processed up to the semantic level when suppressed through CFS. In Experiment 1, word stimuli did not break suppression faster than their pseudo-word variants nor was suppression time modulated by word frequency. Experiment 2 replicated these findings, but more critically showed that differential effects can be obtained with this paradigm using a simpler stimulus. In addition, pixel density of the stimuli did prove to be related to suppression time in both experiments, indicating that the paradigm is sensitive to differences in detectability. A third and final experiment replicated the well-known face inversion effect using the same set-up as Experiments 1 and 2, thereby demonstrating that the employed methodology can capture more high-level effects as well. These results are discussed in the context of previous evidence on unconscious semantic processing and two potential explanations are advanced. Specifically, it is argued that CFS might act at a level too low in the visual system for high-level effects to be observed or that the widely used breaking CFS paradigm is merely ill-suited to capture effects in the context of words.     

Effect of contingent auditory stimuli on concurrent schedule performance: an alternative punisher to electric shock

This study explored whether load auditory stimuli could be used as functional punishing stimuli in place of electric shock. Three experiments examined the effect of a loud auditory stimulus on rats’ responding maintained by a concurrent reinforcement schedule. In Experiment 1, overall response rate decreased when a concurrent 1.5 s tone presentation schedule was superimposed on the concurrent variable interval (VI) 180-s, VI 180-s reinforcement schedule. On the contrary, response rate increased when a click presentation schedule was added. In Experiment 2, the extent of the response suppression with a 1.5 s tone presentation varied as a function of the frequency of the reinforcement schedule maintaining responses; the leaner the schedule employed, the greater the response suppression. In Experiment 3, response suppression was observed to be inversely related to the duration of the tone; response facilitation was observed when a 3.0-s tone was used. In Experiments 1 and 2, a preference shift towards the alternative with richer reinforcement was observed when the tone schedule was added. In contrast, the preference shifted towards the leaner alternative when the click or longer duration stimulus was used. These results imply that both the type and duration of a loud auditory stimulus, as well as the reinforcement schedule maintaining responses, have a critical role in determining the effect of the stimuli on responding. They also suggest that a loud auditory stimulus can be used as a positive punisher in a choice situation for rats, when the duration of the tone is brief, and the reinforcement schedule maintaining responses is lean.