Effect of signaling reinforcement on resistance to change in a multiple schedule

This study evaluated the effect of a signal on resistance to change using a multiple schedule of reinforcement. Experiment 1 presented pigeons with three schedules: a signaled delay to reinforcement schedule (a two-link chain schedule with a variable-interval 120-s initial link followed by a 5-s fixed-time schedule), an unsignaled delay schedule (a comparable two-link tandem schedule), and an immediate, zero-delay variable-interval 125-s schedule. Two separate disruption procedures assessed resistance to change: extinction and adding a variable-time 20-s schedule of reinforcement to the inter-component interval. Resistance to change tests were conducted twice, once with the signal stimulus (the terminal link of the chain schedule) present and once with it absent. Results from both disruption procedures showed that signal absence reduced resistance to change for the pre-signal stimulus. In probe choice tests subjects strongly preferred the signal stimulus over the unsignaled stimulus and exhibited no reliable preference when given a choice between the signal stimulus and immediate stimulus. Experiment 2 presented two equal signaled schedules where, during resistance to change tests, the signal remained for one schedule and was removed for the second. Resistance to change was consistently lower when the signal was absent.     

Effects of d-amphetamine on behavior maintained by signaled and unsignaled delays to reinforcement

Four pigeons responded under a progressive-delay procedure. In a signaled-delay condition, a chained variable interval (VI) 30-s progressive time (PT) 4-s schedule was arranged; in an unsignaled-delay condition, a tandem VI 30-s PT 4-s schedule was arranged. Two pigeons experienced a signaled-unsignaled-signaled sequence; whereas, two pigeons experienced an unsignaled-signaled-unsignaled sequence. Effects of saline and d-amphetamine were determined under each condition. At intermediate doses (1.0 and 1.78 m/kg) delay functions were shallower, area under the curve was increased, and, when possible, break points were increased compared to saline; these effects were not systematically related to signaling conditions. These effects on control by delay often were accompanied by decreased response rates at 0 s. These results suggest that stimulus conditions associated with the delay may not play a crucial role in effects of d-amphetamine and other stimulants on behavior controlled by reinforcement delay.     

Effect of unsignaled delays between stimuli in a chain schedule on responding and resistance to change

Behavioral momentum theory is an evolving theoretical account of the strength of behavior. One challenge for the theory is determining the role of signal stimuli in determining response strength. This study evaluated the effect of an unsignaled delay between the initial link and terminal link of a two-link chain schedule on resistance to change using a multiple schedule of reinforcement. Pigeons were presented two different signaled delay to reinforcement schedules. Both schedules employed a two-link chain schedule with a variable interval 120-s initial link followed by a 5-s fixed time terminal link schedule. One of the schedules included a 5-s unsignaled delay between the initial link and the terminal link. Resistance to change was assessed with two separate disruption procedures: extinction and adding a variable time 20-s schedule of reinforcement to the inter-component interval. Baseline responding was lower in the schedule with the unsignaled delay but resistance to change for the initial link was unaffected by the unsignaled delay. The results suggest that not all unsignaled delays are equal in their effect on resistance to change.     

Response-reinforcer relations and resistance to change

Behavioral momentum theory suggests that the relation between a response and a reinforcer (i.e., response-reinforcer relation) governs response rates and the relation between a stimulus and a reinforcer (i.e., stimulus-reinforcer relation) governs resistance to change. The present experiments compared the effects degrading response-reinforcer relations with response-independent or delayed reinforcers on resistance to change in conditions with equal stimulus-reinforcer relations. In Experiment 1, pigeons responded on equal variable-interval schedules of immediate reinforcement in three components of a multiple schedule. Additional response-independent reinforcers were available in one component and additional delayed reinforcers were available in another component. The results showed that resistance to disruption was greater in the components with added reinforcers than without them (i.e., better stimulus-reinforcer relations), but did not differ for the components with added response-independent and delayed reinforcement. In Experiment 2, a component presenting immediate reinforcement alternated with either a component that arranged equal rates of reinforcement with a proportion of those reinforcers being response independent or a component with a proportion of the reinforcers being delayed. Results showed that resistance to disruption tended to be either similar across components or slightly lower when response-reinforcer relations were degraded with either response-independent or delayed reinforcers. These findings suggest that degrading response-reinforcer relations can impact resistance to change, but that impact does not depend on the specific method and is small relative to the effects of the stimulus-reinforcer relation.     

The role of terminal-link stimuli in concurrent-chain schedules: revisited using a behavioral-history procedure

A behavioral-history procedure was used to study the function of terminal-link stimuli as conditioned reinforcers in multiple concurrent-chain schedules of reinforcement. First, three pigeons were exposed to multiple concurrent-chain schedules in which the two multiple-schedule components were correlated with a blue and a white stimulus, respectively. In each component the initial links were equal independent variable-interval (VI) 15 s schedules. A fixed-interval (FI) 10 s schedule operated on the red key in one terminal link while extinction operated on the green key in the alternative terminal link. When large preferences for the red stimulus had been established, two tests were conducted. In the terminal-link test, under new initial-link stimuli--purple and brown--an FI 10 s schedule operated for both the red and green terminal-link stimuli. In the subsequent initial-link test, the blue and white initial-link stimuli were reintroduced, and, as in the terminal-link test, FI 10s operated for both the red and the green terminal-link stimuli. In the terminal-link test, the three pigeons showed no preference for the terminal links with the red stimulus, but showed clear and consistent preferences for the red stimulus when blue and white stimuli were reintroduced as initial-link stimuli in the initial-link test. This suggests that there are multiple sources of control over initial-link response allocation in concurrent-chains, including control by both terminal- and initial-link stimuli.     

The effects of naloxone,diprenorphine, and diazepam on responding suppressed by pre-shock and pre-food stimuli

The lever-pressing of rats was reinforced with food according to a variable-interval 1-min schedule. In one group, occasional illumination of cue lights for 30-sec periods was followed by a brief electric shock; responding was suppressed during these periods. Naloxone (0.01–10 mg/kg) did not change the degree to which responding was suppressed during the pre-shock stimulus. Diprenorphine (0.1–10 mg/kg) slightly attenuated suppression, and diazepam (1.0–3.0 mg/kg) increased responding during the stimulus to normal levels. These results confirm that opiate antagonists do not always enhance the effects of shock on behavior. In a second group, occasional illumination of the cue lights for 20-sec periods was followed by delivery of free food pellets. Responding was also suppressed during the pre-food stimulus. Neither naloxone nor diprenorphine had any effect on response rate during this stimulus. In contrast to the results of earlier studies using benzodiazepines, diazepam (1.0–3.0 mg/kg) produced a marked attenuation of response suppression during the pre-food stimulus.     

Psychological distance to reward: equating the number of stimulus and response segments

Psychological distance to reward, or the segmentation effect, refers to the preference for a terminal link of a concurrent-chains schedule consisting of a simple reinforcement schedule (e.g. fixed interval [FI] 30s) relative to its chained-schedule counterpart (e.g. chained FI 15s FI 15s). This experiment was conducted to examine whether the segmentation effect is due to the number of terminal-link stimulus and response segments per se. Three pigeons pecked under a concurrent-chains schedule in which identical variable-interval (VI) schedules operated in the initial links. In each session, half the terminal-link entries followed one initial-link key and the other half followed the other initial-link key. The initial-link keys correlated with the different terminal links were manipulated across conditions. In the first three conditions, each terminal link contained a chained fixed-time (FT) FT schedule, and in the final three conditions, each terminal link contained a chained FI FI schedule. In each condition, in one terminal link (alternating), the order of two key colors correlated with the different schedule segments alternated across terminal-link entries, whereas in the other terminal link (constant), the order of two other key colors was identical for each entry. With the chained FT FT schedule terminal links, there was indifference between the alternating and constant terminal links within and across pigeons, as indexed by initial-link choice proportions. In addition, terminal-link response rates were relatively low. With the chained FI FI schedule terminal links, for each pigeon, there was relatively more preference for the alternating terminal link and terminal-link response rates increased relative to conditions with the chained FT FT schedule terminal links. These data suggest that the segmentation effect is not due simply to the number of terminal-link stimulus or response segments per se, but rather to a required period of responding during a stimulus segment that never is paired with reinforcement.     

Segmentation and the pairing hypothesis

The effect of stimulus contiguity and response contingency on responding in chain schedules was examined in two experiments. In Experiment 1, four pigeons were trained on two simple three-link chain schedules that alternated within sessions. Initial links were correlated with a variable-interval 30s schedule, and middle and terminal links were correlated with interdependent variable-interval 30s variable-interval 30s schedules. The combined duration of the interdependent schedules summed to 60s. The two chains differed with respect to signaling of the schedule components: a two-stimulus chain had one stimulus paired with the initial link and one stimulus paired with both the middle and the terminal link, while a three-stimulus chain had a different stimulus paired with the each of the three links. The results showed that the two-stimulus chain maintained lower initial-link responding than the three-stimulus chain. In Experiment 2, four pigeons were exposed to three separate conditions, the two- and three-stimulus chains of Experiment 1 and a three-stimulus chain that had a 3s delay to terminal-link entry from the middle-link response that produced it. The two-stimulus chain maintained lower initial-link responding than the three-stimulus chain, as in Experiment 1, and a similar initial-link responding was maintained by the two-stimulus chain and the three-stimulus chain with the delay contingency. The results demonstrate that a stimulus noncontiguous with food can maintain responding that is sometimes greater than a stimulus contiguous with food, depending on the response contingency for terminal-link entry. The results are contrary to the pairing hypothesis of conditioned reinforcement.     

Psychological distance to reward in monkeys

A concurrent-chains schedule was employed to examine crab-eating macaques' choice between segmented and unsegmented fixed-interval 30-s schedules. A stimulus change occurred during one of the fixed-interval schedules (segmented schedule), while no stimulus change occurred during the other (unsegmented schedule). The subjects were exposed to three consecutive stimulus-change conditions, in an attempt to explore whether correlation of the stimulus changes with a fixed interval of nonreinforcement affects the preference between the alternatives. When the stimulus change always occurred at a half point of the segmented schedule (the first and third conditions), all subjects preferred the fixed-interval schedule without stimulus changes. This replicated previous findings with pigeons and humans. On the other hand, when the intervals before and after the stimulus change varied on every entry to the segmented schedule with the sum of them being constant (the second condition), the subjects were indifferent to the alternatives. These results are consistent with the view that the preference for unsegmented schedules over segmented ones might be due to aversiveness which the initial component in the segmented schedule possesses as a result of its correlation with a fixed interval of nonreinforcement.     

Response-cost punishment via token loss with pigeons

Two experiments were conducted to investigate punishment via response-contingent removal of conditioned token reinforcers (response cost) with pigeons. In Experiment 1, key pecking was maintained on a two-component multiple second-order schedule of token delivery, with light emitting diodes (LEDs) serving as token reinforcers. In both components, responding produced tokens according to a random-interval 20-s schedule and exchange periods according to a variable-ratio schedule. During exchange periods, each token was exchangeable for 2.5-s access to grain. In one component, responses were conjointly punished according to fixed-ratio schedules of token removal. Response rates in this punishment component decreased to low levels while response rates in the alternate (no-punishment) component were unaffected. Responding was eliminated when it produced neither tokens nor exchange periods (Extinction), but was maintained at moderate levels when it produced tokens in the signaled absence of food reinforcement, suggesting that tokens served as effective conditioned reinforcers. In Experiment 2, the effect of the response-cost punishment contingency was separated from changes in the density of food reinforcement. This was accomplished by yoking either the number of food deliveries per component (Yoked Food) or the temporal placement of all stimulus events (tokens, exchanges, food deliveries) (Yoked Complete), from the punishment to the no-punishment component. Response rates decreased in both components, but decreased more rapidly and were generally maintained at lower levels in the punishment component than in the yoked component. In showing that the response-cost contingency had a suppressive effect on responding in addition to that produced by reductions in reinforcement density, the present results suggest that response-cost punishment shares important features with other forms of punishment.     

Validity and reliability of agility tests in junior Australian football players

Young, W, Farrow, D, Pyne, D, McGregor, W, and Handke, T. Validity and reliability of agility tests in junior Australian football players. J Strength Cond Res 25(12): 3399-3403, 2011-The importance of sport-specific stimuli in reactive agility tests (RATs) compared to other agility tests is not known. The purpose of this research was to determine the validity and reliability of agility tests. Fifty junior Australian football players aged 15-17 years, members of either an elite junior squad (n = 35) or a secondary school team (n = 15), were assessed on a new RAT that involved a change of direction sprint in response to the movements of an attacking player projected in life size on a screen. These players also underwent the planned Australian Football League agility test, and a subgroup (n = 13) underwent a test requiring a change of direction in response to a left or right arrow stimulus. The elite players were significantly better than the school group players on the RAT (2.81 ± 0.08 seconds, 3.07 ± 0.12 seconds; difference 8.5%) but not in the arrow stimulus test or planned agility test. The data were log transformed and the reliability of the new RAT estimated using typical error (TE) expressed as a coefficient of variation. The TE for the RAT was 2.7% (2.0-4.3, 90% confidence interval) or 0.07 seconds (0.5-1.0), with an intraclass correlation coefficient (ICC) of 0.33. For the test using the arrow stimulus, the TE was 3.4% (2.4-6.2), 0.09 (0.06-0.15) seconds, and ICC was 0.10. The sport-specific stimulus provided by the new RAT is a crucial component of an agility test; however, adoption of the new RAT for routine testing is likely to require more accessible equipment and several familiarization trials to improve its reliability.     

Adaptation of differential sensitivity of auditory system neurons to amplitude modulation after abrupt change of signal level

Impulse activity of neurons of brainstem auditory nuclei (medulla dorsal nucleus and midbrain torus semicircularis) of the grass frog (Rana temporaria) was recorded under action of long amplitude-modulated tonal signals. After adaptation of neuronal response to acting stimulus (30–60 s after its onset), we performed a sharp change (by 20–40 dB) of the mean signal level with preservation of unchanged frequency and depth of modulation. We also recorded a change of density impulsation and of degree of its synchronization with the modulation period as well as the phase of maximum reaction at the modulation period and phase of the response every 2 or 4 s. In the adapted state, the sharp change of the mean level had been provided, while maintaining frequency and depth unchanged. During the adaptation to long signals with small modulation indexes the firing rate continuously decreased, but synchronization with envelope usually increased considerably. A sharp rise in the mean level resulted in an increase of firing rate, which could be accompanied either by a continuation of synchronization growth (the effect is more typical of the dorsal nucleus) or by a sharp fall in synchrony with its subsequent slow recovery (the effect is more typical of the torus semicircularis). Nature of the changes following the change of the intensity of the reaction could depend on the signal parameters (initial level, magnitude of the jump, frequency and depth of modulation). The connection between the observed physiological data and the psychophysics of differential intensity coding is discussed.     

Electrical nature of the taxis signal in cyanobacteria

Electrical events after a light-dark stimulus were studied in the multicellular organism Phormidium uncinatum. Normally, such a stimulus causes the gliding trichome to reverse direction. By directing a large light spot on the end of a batch of trichomes and then switching it off, we achieved synchronization of the trichomes, since the "head" is much more sensitive than the "tail." The abrupt disappearance of a uniform light produced a depolarization wave which initiated at the head, as registered by externally applied electrodes. The second stimulus produced a depolarization of the opposite direction, reflecting the reorientation of the trichomes. No electrical response was observed at Ca2+ concentrations less than or equal to 10(-8) M. Factors causing oscillatory reversals, i.e., a combination of Ca2+ and A23187, or a viscous environment also abolished the electrical signal. Changes in an externally applied electrical field (4 V/cm2) had little effect on the motile behavior of P. uncinatum or Oscillatoria princeps. However, in the presence of 5 microM Ca2+-1 microM A23187, all the trichomes reversed synchronously to the anode after a change in polarity of an externally applied electrical field. We suggest that an increased Ca2+ concentration together with a change in delta psi (or delta mu H+) represents the taxis signal in cyanobacteria.     

Characteristics of the increased response to electrical stimulation of ileum preparations from morphine pretreated guinea pigs.

The relationship between electrical stimulus voltage or pulse duration and the tension generated in the resulting contractions has been studied in control and morphine tolerant guinea pig ileum preparations. A greater maximal tension was observed in the morphine tolerant preparations. Since the response of the preparations to exogenous applied acetylcholine was unchanged, the increase in tension probably reflected an increase in the amount of acetylcholine released by each stimulus. No change in threshold voltage for stimulation was observed. A neuronally mediated, opiate insensitive, component of the response to electrical stimulation has been demonstrated. This component was unchanged in morphine tolerant preparations. Naloxone did not affect the relationship between stimulus pulse duration and response tension in control or morphine tolerant preparations. These results provide further evidence that morphine tolerance is associated with general changes in the properties of opiate sensitive neurons which can be demonstrated in the absence of opiate drugs.     

短声特性对豚鼠圆窗记录的N_1N_2反应的影响

研究了不同刺激声强情况下短声特性(极性、波形及相应频谱)改变对豚鼠圆窗记录的N_1N_2反应的影响。发现:①在低声强时,若维持刺激声强不变而使短声波形改变对N_1无影响,但是对N_2有轻微的影响。而高声强时,若维持刺激声强不变而使短声波形改变将引起N_N_2反应较为显著的变化。②不仅是短声的疏相,而且其密相对N_1N_2的形成有贡献。③N_1N_2反应不仅与短声刺激强度有关,而且还与短声的其它参数(如波宽等)有关。并就各项结果进行了讨论。     

Interweaving and overlapping of evoked potentials

The refractory effect of one stimulus upon the response to a closely following stimulus in a different modality is much less than upon the response to a stimulus in the same modality. It is therefore far more efficient to record responses to stimuli in different modalities concurrently than to record each one separately. We evaluated 2 techniques for concurrent recording. Interweaving involves recording the response to one stimulus in the intervals between recording responses to other stimuli. Overlapping occurs when two or more responses are at times being simulateneously recorded. Interweaving and overlapping reduced the time required to record auditory brain-stem responses, short-latency somatosensory evoked potentials and pattern-reversal visual evoked potentials by a factor of 3 over the time required to record each response separately. Overlapping caused no significant change in the evoked potentials. Depending upon the actual timing schedule, interweaving may distort the evoked potentials if later parts of the response to one stimulus override the evoked potential to a following stimulus. Filtering and randomization of stimulus timing may attenuate the effects of these overriding potentials.     

Reinforcer satiation and resistance to change of responding maintained by qualitatively different reinforcers

In previous research on resistance to change, differential disruption of operant behavior by satiation has been used to assess the relative strength of responding maintained by different rates or magnitudes of the same reinforcer in different stimulus contexts. The present experiment examined resistance to disruption by satiation of one reinforcer type when qualitatively different reinforcers were arranged in different contexts. Rats earned either food pellets or a 15% sucrose solution on variable-interval 60-s schedules of reinforcement in the two components of a multiple schedule. Resistance to satiation was assessed by providing free access either to food pellets or the sucrose solution prior to or during sessions. Responding systematically decreased more relative to baseline in the component associated with the satiated reinforcer. These findings suggest that when qualitatively different reinforcers maintain responding, relative resistance to change depends upon the relations between reinforcers and disrupter types.     

Frame of reference transformations in motion perception during smooth pursuit eye movements

Smooth pursuit eye movements change the retinal image velocity of objects in the visual field. In order to change from a retinocentric frame of reference into a head-centric one, the visual system has to take the eye movements into account. Studies on motion perception during smooth pursuit eye movements have measured either perceived speed or perceived direction during smooth pursuit to investigate this frame of reference transformation, but never both at the same time. We devised a new velocity matching task, in which participants matched both perceived speed and direction during fixation to that during pursuit. In Experiment 1, the velocity matches were determined for a range of stimulus directions, with the head-centric stimulus speed kept constant. In Experiment 2, the retinal stimulus speed was kept approximately constant, with the same range of stimulus directions. In both experiments, the velocity matches for all directions were shifted against the pursuit direction, suggesting an incomplete transformation of the frame of reference. The degree of compensation was approximately constant across stimulus direction. We fitted the classical linear model, the model of Turano and Massof (2001) and that of Freeman (2001) to the velocity matches. The model of Turano and Massof fitted the velocity matches best, but the differences between de model fits were quite small. Evaluation of the models and comparison to a few alternatives suggests that further specification of the potential effect of retinal image characteristics on the eye movement signal is needed.     

Evaluation of a fast forward rotating shift schedule in the steel industry with a special focus on ageing and sleep

The aim of this study was to explore the effect of a change in the speed and direction of shift rotation on the sleep and wakefulness of younger and older workers. A continuous three-shift schedule was changed from a slow backward rotating (EEE-MMMNNN-----) to a fast forward rotating system (MMEENN----). Sixteen subjects (mean age 42 years) were studied before and one year after the change in schedule. Two age groups were compared: ten younger men (mean age 35 years) and six older men (mean age 53 years). The effects of the new work schedule were evaluated by a questionnaire (modified SSI), and on-site registrations with an actigraph and sleep log for one shift cycle (10-15 days) before and after the new schedule. After the change in schedule, subjective sleep problems decreased and alertness increased during the morning shifts. The change in schedule influenced sleep differently in the two age-groups. Both the subjective and objective quality of sleep improved among the older workers. The results indicate that a fast forward rotating shift schedule is more suitable for older workers than a slower backward rotating system.     

Studies on opsonized zymozan, FMLP, carbachol, PMA and A23187 stimulated respiratory burst of human PMNLs

The O2- production as a marker of the respiratory burst was investigated under various stimulations in polymorphonuclear leukocytes of healthy young and aged subjects. Stimulation of the respiratory burst in the cells of elderly by specific agents (opsonized zymozan, N-formyl-methionyl-leucyl-phenylalanine, carbachol) resulted in a diminished response while it remained unchanged on the effect of non-specific stimulation (A23187, phorbol myristate acetate) comparing to young subjects. To elucidate the postreceptor signal transduction mechanism involved in respiratory burst stimulation various inhibitors were used as follows: neomycin (for phospholipase C enzyme), mepacrine (for phospholipase A2 enzyme) and pertussis toxin (for GTP binding regulatory protein). The results suggest that phospholipase C as well as phospholipase A2 could be involved in the postreceptor signal transduction depending on the stimulus, but the impairment of the pertussis toxin sensitive GTP binding protein with aging might explain the decrease response of the respiratory burst after stimulating the different receptors.