The effect of intertrial interval food presentions on pigeons' delayed matching to sample accuracy

Parallel effects of temporal variables on autoshaping and on delayed matching to sample performance suggest that delayed matching, like autoshaping, might depend upon the within-trial expectancy of reinforcement relative to the overall expectancy of reinforcement in the session. This possibility was assessed by presenting free food at different times during a 30-sec intertrial interval (ITI) in a delayed matching to sample procedure with pigeons. In three conditions a single free food presentation occurred, either early, mid-way, or late in each ITI; in another condition, three food presentations occurred during each ITI, one at each time location. Relative to a baseline condition, in which free food never occurred during the ITI, only food presentations late in the ITI produced a significant disruption in accuracy, and this effect occurred only at the longest of three delays tested. Three free food presentations in each ITI disrupted accuracy only to the same degree as a single, late, ITI food presentation. Thus, accuracy was affected by the temporal location rather than the frequency of ITI food presentations. These effects appear to differ from those of ITI food presentations on autoshaping and do not seem to be understandable in terms of changes in the background expectancy of reinforcement. It was suggested instead that food presented late in the ITI might disrupt subsequent memory processes.     

The effects of changes in consequences on hens' performance in delayed-matching-to-sample tasks

A delayed-matching-to-sample (DMTS) task was used to investigate remembering with domestic hens. In Conditions 1 and 3 of Experiment 1, six hens responded under a mixed-delay procedure with delays of 0.25, 2, and 8 s. In Condition 2, the reinforcer for correct responding was delayed for 6 s after each correct matching response on 2-s delay trials. In Condition 1, discrimination performance decreased monotonically over the three delays. With the delay to the reinforcer, the decreases were non-monotonic as a result of the considerable drop in the accuracy of discrimination on the 2-s delay trials. Performance at the 2-s delay did not recover completely in Condition 3. In Conditions 1 and 3 of Experiment 2, five hens responded under a mixed-delay procedure with delays of 0, 4, and 16 s. In Condition 2 no reinforcers were provided for correct responding on 0- and 16-s delay trials. When reinforcers were available on all trials discrimination performance decreased monotonically with delay. There were non-monotonic changes in discrimination with delay when there was extinction at two delays resulting mainly from a large drop in discrimination performance at 0 s. In addition, response latencies increased markedly at the two delays associated with extinction. Performance recovered completely in Condition 3. The data support the ideas that remembering involves a temporal discrimination that the effects of delaying reinforcement and removing reinforcement may differ, and that the measurement of response latencies may be a useful tool in DMTS procedures.     

Intertrial interval as a contextual stimulus

Four experiments with rats investigated whether the time between appetitive conditioning trials can serve as a discriminative cue for responding during the next conditional stimulus (CS). In Experiment 1, rats that received extinction trials with a 4-min intertrial interval (ITI) showed spontaneous recovery after a retention interval of 16 min, whereas rats that received extinction with a 16-min ITI did not. Experiments 2 and 3 investigated more explicit discriminations between the 4- and 16-min ITIs. When a 16-min ITI signaled that the CS would be reinforced and a 4-min ITI signaled that it would not, the ITIs modulated responding to the CS. But when the 4-min ITI signaled reinforcement and the 16-min ITI did not, there was less evidence of modulation by the ITIs. This asymmetry was due at least partly to a difficulty in performance rather than learning. Experiment 4 investigated similar discriminations with 1- and 4-min ITIs. Here the results took a different form: time in the reinforced ITI elicited responding directly, but did not modulate responding to the CS. ITI can function as a contextual cue, and the results suggest new similarities between the processes behind interval timing and associative learning.     

Investigations of timing during the schedule and reinforcement intervals with wheel-running reinforcement

Across two experiments, a peak procedure was used to assess the timing of the onset and offset of an opportunity to run as a reinforcer. The first experiment investigated the effect of reinforcer duration on temporal discrimination of the onset of the reinforcement interval. Three male Wistar rats were exposed to fixed-interval (FI) 30-s schedules of wheel-running reinforcement and the duration of the opportunity to run was varied across values of 15, 30, and 60s. Each session consisted of 50 reinforcers and 10 probe trials. Results showed that as reinforcer duration increased, the percentage of postreinforcement pauses longer than the 30-s schedule interval increased. On probe trials, peak response rates occurred near the time of reinforcer delivery and peak times varied with reinforcer duration. In a second experiment, seven female Long-Evans rats were exposed to FI 30-s schedules leading to 30-s opportunities to run. Timing of the onset and offset of the reinforcement period was assessed by probe trials during the schedule interval and during the reinforcement interval in separate conditions. The results provided evidence of timing of the onset, but not the offset of the wheel-running reinforcement period. Further research is required to assess if timing occurs during a wheel-running reinforcement period.     

The Neural Mechanisms Underlying the Decision to Rest in the Presence of Fatigue: A Magnetoencephalography Study

Adequate rest is essential to avoid fatigue and disruption of homeostasis. However, the neural mechanisms underlying the decision to rest are not well understood. In the present study, we aimed to clarify the neural mechanisms of this decision-making process using magnetoencephalography. Fifteen healthy volunteers participated in decision and control experiments performed in a cross-over fashion. In the decision experiment, participants performed 1,200 reverse Stroop test trials and were intermittently asked to decide whether they wanted to take a rest or continue. In the control experiments, participants performed 1,200 reverse Stroop test trials and were instructed to press a response button intermittently without making any decision. Changes in oscillatory brain activity were assessed using a narrow-band adaptive spatial filtering method. The levels of decrease in theta (4–8 Hz) band power in left Brodmann''s area (BA) 31, alpha (8–13 Hz) band power in left BA 10 and BA 9, and beta (13–25 Hz) band power in right BA 46 and left BA 10 were greater in trials when the participant opted to rest (rest trials) than those in control trials. The decrease in theta band power in BA 31 in the rest trials was positively correlated with the subjective level of fatigue after the decision experiment. These results demonstrated that the dorsolateral prefrontal cortex, frontal pole, and posterior cingulate cortex play a role in the decision to rest in the presence of fatigue. These findings may help clarify the neural mechanisms underlying fatigue and fatigue-related problems.     

What Determines Auditory Distraction? On the Roles of Local Auditory Changes and Expectation Violations

Both the acoustic variability of a distractor sequence and the degree to which it violates expectations are important determinants of auditory distraction. In four experiments we examined the relative contribution of local auditory changes on the one hand and expectation violations on the other hand in the disruption of serial recall by irrelevant sound. We present evidence for a greater disruption by auditory sequences ending in unexpected steady state distractor repetitions compared to auditory sequences with expected changing state endings even though the former contained fewer local changes. This effect was demonstrated with piano melodies (Experiment 1) and speech distractors (Experiment 2). Furthermore, it was replicated when the expectation violation occurred after the encoding of the target items (Experiment 3), indicating that the items'' maintenance in short-term memory was disrupted by attentional capture and not their encoding. This seems to be primarily due to the violation of a model of the specific auditory distractor sequences because the effect vanishes and even reverses when the experiment provides no opportunity to build up a specific neural model about the distractor sequence (Experiment 4). Nevertheless, the violation of abstract long-term knowledge about auditory regularities seems to cause a small and transient capture effect: Disruption decreased markedly over the course of the experiments indicating that participants habituated to the unexpected distractor repetitions across trials. The overall pattern of results adds to the growing literature that the degree to which auditory distractors violate situation-specific expectations is a more important determinant of auditory distraction than the degree to which a distractor sequence contains local auditory changes.     

Part-Based and Configural Processing of Owner's Face in Dogs

Dogs exhibit characteristic looking patterns when looking at human faces but little is known about what the underlying cognitive mechanisms are and how much these are influenced by individual experience. In Experiment 1, seven dogs were trained in a simultaneous discrimination procedure to assess whether they could discriminate a) the owner''s face parts (eyes, nose or mouth) presented in isolation and b) whole faces where the same parts were covered. Dogs discriminated all the three parts of the owner''s face presented in isolation, but needed fewer sessions to reach the learning criterion for the eyes than for both nose and mouth. Moreover, covering the eyes region significantly disrupted face discriminability compared to the whole face condition while such difference was not found when the nose or mouth was hidden. In Experiment 2, dogs were presented with manipulated images of the owner''s face (inverted, blurred, scrambled, grey-scale) to test the relative contribution of part-based and configural processing in the discrimination of human faces. Furthermore, by comparing the dogs enrolled in the previous experiment and seven ‘naïve’ dogs we examined if the relative contribution of part-based and configural processing was affected by dogs'' experience with the face stimuli. Naïve dogs discriminated the owner only when configural information was provided, whereas expert dogs could discriminate the owner also when part-based processing was necessary. The present study provides the first evidence that dogs can discriminate isolated internal features of a human face and corroborate previous reports of salience of the eyes region for human face processing. Although the reliance on part-perception may be increased by specific experience, our findings suggest that human face discrimination by dogs relies mainly on configural rather than on part-based elaboration.     

Effects of atropine on operant test battery performance in rhesus monkeys.

The acute behavioral effects of atropine sulfate were assessed using a battery of complex food-reinforced operant tasks that included: temporal response differentiation (TRD, n = 7); delayed matching-to-sample (DMTS, n = 6), progressive ratio (PR, n = 8), incremental repeated acquisition (IRA, n = 8), and conditioned position responding (CPR, n = 8). Performance in these tasks is thought to depend primarily upon specific brain functions such as time perception, short-term memory and attention, motivation, learning, and color and position discrimination, respectively. Atropine sulfate (0.01-0.56 mg/kg iv), given 15-min pretesting, produced significant dose-dependent decreases in the number of reinforcers obtained in all tasks. Response rates decreased significantly at greater than or equal to 0.03 mg/kg for the learning and discrimination tasks, at greater than or equal to 0.10 mg/kg for the motivation and short-term memory and attention tasks, and at greater than or equal to 0.30 mg/kg for the time perception task. Response accuracies were significantly decreased at doses greater than or equal to 0.10 mg/kg for the learning, discrimination, and short-term memory and attention tasks, and at greater than or equal to 0.30 mg/kg for the time perception task. Thus, the order of task sensitivity to any disruption by atropine is learning = color and position discrimination greater than time perception = short-term memory and attention = motivation (IRA = CPR greater than TRD = DMTS = PR). Thus in monkeys, the rates of responding in operant tasks designed to model learning and color and position discrimination were the most sensitive measures to atropine's behavioral effects. Accuracy in these same task was also disrupted but at higher doses. These data support the hypothesis that cholinergic systems play a greater role in the speed (but not accuracy) of performance of our learning and discrimination tasks compared to all other tasks. Accuracy of responding in these and the short-term memory task, all of which involve the use of lights as visual stimuli, was more sensitive to disruption by atropine than those tasks which did not utilize such strong visual stimuli.     

Response-reinforcer relations and resistance to change

Behavioral momentum theory suggests that the relation between a response and a reinforcer (i.e., response-reinforcer relation) governs response rates and the relation between a stimulus and a reinforcer (i.e., stimulus-reinforcer relation) governs resistance to change. The present experiments compared the effects degrading response-reinforcer relations with response-independent or delayed reinforcers on resistance to change in conditions with equal stimulus-reinforcer relations. In Experiment 1, pigeons responded on equal variable-interval schedules of immediate reinforcement in three components of a multiple schedule. Additional response-independent reinforcers were available in one component and additional delayed reinforcers were available in another component. The results showed that resistance to disruption was greater in the components with added reinforcers than without them (i.e., better stimulus-reinforcer relations), but did not differ for the components with added response-independent and delayed reinforcement. In Experiment 2, a component presenting immediate reinforcement alternated with either a component that arranged equal rates of reinforcement with a proportion of those reinforcers being response independent or a component with a proportion of the reinforcers being delayed. Results showed that resistance to disruption tended to be either similar across components or slightly lower when response-reinforcer relations were degraded with either response-independent or delayed reinforcers. These findings suggest that degrading response-reinforcer relations can impact resistance to change, but that impact does not depend on the specific method and is small relative to the effects of the stimulus-reinforcer relation.     

Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

Pattern discrimination by the honeybee: disruption as a cue

The discrimination of pattern disruption in freely flying honeybees (Apis mellifera) was examined. Bees were trained to discriminate at a fixed distance between a regularly repeated black/white pattern and the same pattern at a different magnification in targets of the same angular size. The locations of areas of black were regularly shuffled to make them useless as cues. The results of the experiments indicate that the bees discriminate the disruption of the pattern as a whole, irrespective of the actual pattern. Bees trained to prefer a larger period transfer to an even larger period, when given a forced choice with a pair of patterns of differing disruption from those they were trained on, as if their spontaneous preference has not been overcome. Bees trained to prefer a smaller period, however, prefer the former negative pattern rather than transfer to an even smaller period. These results show that the bees do not rely solely on learning the absolute period of a pattern nor the relative disruption of two patterns, and they are confused when these two cues conflict in tests with unfamiliar targets. Bees can discriminate between fields of view that differ in average disruption as a generalized cue, irrespective of pattern. Accepted: 7 April 1997     

Changing rates of reinforcement perturbs the flow of time

This experiment tested the hypothesis that changes in rate of reinforcement affect the rate of an internal pacemaker as suggested by the Behavioral Theory of Timing (BeT: Killeen and Fetterman, 1988). Pigeons were trained to discriminate durations of 10 s and 20 s, and then exposed to higher or lower rates of freely delivered reinforcers. When returned to the discrimination task, judgments were reliably biased in the predicted directions: those returning from a richer context judged standard durations to be longer than did those returning from a poorer context. These results validate a key assumption of BeT, and provide an explanation of how changing tempos of life bias the perception of time.     

Acquisition versus Consolidation of Auditory Perceptual Learning Using Mixed-Training Regimens

Learning is considered to consist of two distinct phases–acquisition and consolidation. Acquisition can be disrupted when short periods of training on more than one task are interleaved, whereas consolidation can be disrupted when a second task is trained after the first has been initiated. Here we investigated the conditions governing the disruption to acquisition and consolidation during mixed-training regimens in which primary and secondary amplitude modulation tasks were either interleaved or presented consecutively. The secondary task differed from the primary task in either task-irrelevant (carrier frequency) or task-relevant (modulation rate) stimulus features while requiring the same perceptual judgment (amplitude modulation depth discrimination), or shared both irrelevant and relevant features but required a different judgment (amplitude modulation rate discrimination). Based on previous literature we predicted that acquisition would be disrupted by varying the task-relevant stimulus feature during training (stimulus interference), and that consolidation would be disrupted by varying the perceptual judgment required (task interference). We found that varying the task-relevant or -irrelevant stimulus features failed to disrupt acquisition but did disrupt consolidation, whereas mixing two tasks requiring a different perceptual judgment but sharing the same stimulus features disrupted both acquisition and consolidation. Thus, a distinction between acquisition and consolidation phases of perceptual learning cannot simply be attributed to (task-relevant) stimulus versus task interference. We propose instead that disruption occurs during acquisition when mixing two tasks requiring a perceptual judgment based on different cues, whereas consolidation is always disrupted regardless of whether different stimulus features or tasks are mixed. The current study not only provides a novel insight into the underlying mechanisms of perceptual learning, but also has practical implications for the optimal design and delivery of training programs that aim to remediate perceptual difficulties.     

Discrimination,discounting and impulsivity: a role for an informational constraint

Feeding animals often prefer small, quickly delivered rewards over larger, more delayed rewards. Students of feeding behaviour typically explain this behaviour by saying that animals discount delayed benefits. Temporal discounting implies that delayed benefits are worth less than immediate benefits. This paper presents a new explanation of short-sighted decision-making called the discrimination advantage model that does not rely on discounting. A new model that includes several possible causes of discounting is developed. This model has many interesting features, but it cannot account for two empirical results: the strength of the 'discounting' effect and the fact that the time between choice presentations (the intertrial interval or ITI) has no effect. This leads to the conclusion that although discounting may be important it is probably not a complete explanation of the experimental facts. In the discrimination advantage model the observation that the ITI does not affect choice is seen as a strategy to make a cleaner discrimination between delayed alternatives in a noisy world. A simple example shows that when discrimination is imperfect a short-sighted choice rule can, in some situations, lead to a higher long-term rate than a rule that actually compares long-term rates. This idea is developed and extended in several ways.     

Role of stimulus-stimulus pairing in matching-to-sample procedure: cross-species comparison of humans and pigeons

The present experiment examined whether, in a matching-to-sample (MTS) procedure, a relation between two stimuli, a sample and a comparison, could be established as a result of just stimulus–stimulus pairing, even if back up reinforcers were never provided for the conditional relation between the sample and comparison stimuli, but rather only for the comparison stimulus. A procedure called “pseudo matching-to-sample” was used in which, when S1 was presented as a sample stimulus, two comparison stimuli (C1 and C2) were presented, and only responses to C1 were reinforced. Conversely, when S2 was presented, only responses to C3 (and not C4) were reinforced. In other words, organisms experiencing this procedure could discriminate C1 from C2, and C3 from C4, by simple discrimination without regard to the conditional sample stimuli. In order to examine cross-species differences, responding by humans in this procedure was compared to that by pigeons. Although the humans developed a discriminative function for the sample stimuli, that is, the humans’ responding was affected by both the sample stimuli and the reinforcers, responding by the pigeons was affected solely by the reinforcers. These data suggest that, in this procedure, humans (but not pigeons) are able to learn relations among stimuli simply as a result of stimulus–stimulus pairing.     

Effects of retention interval on performance in a numerical reproduction task

The retention interval (RI) between the sample and production phase in a numerical reproduction task was varied to determine whether a "produce-small" effect would be obtained with increased delays. Four pigeons were trained with a retention interval of 2s, and then tested with intervals of 0.5s and 8s. Results showed a number-dependent, "produce-large" effect-response number increased when RI was increased-analyses of average response number and accuracy suggested RI affected responding most on the 2-flash trials with an 8-s RI. Additionally, discrimination between trial types decreased as RI increased. Existing explanations for the "choose-short/small" effect appear unable to account for these results; however the "produce-large" effect may be attributed to a disruption in stimulus control over responding.     

Die Auswirkung der Übungsverteilung auf das Lernen und Vergessen bei Carassius auratus auratus Linné3

The significance of massed and distributed practice in discrimination learning to criterion by goldfish was studied. All animals were trained to discriminate between 6 horizontal black and white stripes (positive stimulus) and 2 vertical black and white stripes (negative stimulus). 5 groups of animals, 12 Ss each, got different training programs. Groups varied in number of trials per day (30, 10, 5 successive trials) and in distribution of trials over the day (30 trials given in blocks of 5 with ITI of 1 h or 5 trials, each spaced by an ITI of 1 h). In general animals with a small number of massed trials/day were superior in early acquisition period. When trials/day were spaced the method proved to be more efficient. The training method showed no effect concerning retention.     

Memory for Brief, Widely Spaced Odor Presentations in the Rat

Rats trained on a series of 16 novel 2-odor discrimination tasksusing a 10-s intertrial interval (ITI) rapidly improved in performanceand made only 0—3 errors by the end of the test series.They were then tested on other novel pairs of odors, but witha 10- and a 30-min interval between trials. There was no decrementin performance accuracy in the longer ITI tests and, in mostcases, criterion performance was achieved after making zeroor 1 error after the first (information) trial. These resultsdemonstrate that rats have the capacity to remember for at least30 min whether a single brief presentation of a novel odor wasfollowed by a reward.     

Effects of prefeeding, intercomponent-interval food, and extinction on temporal discrimination and pacemaker rate

This experiment investigated the effects of nonpharmacological disruption on temporal discrimination. Pigeons responded on a multiple schedule composed of fixed interval, color-matching, and temporal-discrimination components. The effects of three different disruptors (prefeeding, intercomponent-interval food, and extinction) were assessed. All disruptors decreased response rates during the fixed interval. Prefeeding and intercomponent-interval food had unsystematic effects on response patterning during the fixed interval, whereas extinction increased the relative response rate in the initial portions of the fixed interval. Accuracy of color matching was decreased by prefeeding and was not systematically affected by intercomponent-interval food and extinction. In the temporal-discrimination component, all disruptors flattened the psychophysical functions relating proportion long responses to sample duration. This result indicates a general disruption of temporal discrimination. In addition, parameter estimates derived from the behavioral theory of timing indicated all disruptors decreased pacemaker rate, a result consistent with the predictions of the theory. These results highlight the similarities between disruption of temporal discrimination by pharmacological and nonpharmacological manipulations.