Rapid acquisition of preference in concurrent schedules: effects of reinforcement amount

Four pigeons were trained on concurrent variable-interval 30-s schedules. Relative reinforcer amounts arranged across the two alternatives were varied across sessions according to a pseudorandom binary sequence [cf., Hunter, I., Davison, M., 1985. Determination of a behavioral transfer function: white-noise analysis of session-to-session response-ratio dynamics on concurrent VI schedules. J. Exp. Anal. Behav. 43, 43-59]; the ratios (left/right) were either 1/7 or 7/1. Reinforcer amount was manipulated by varying the number of 1.2s hopper presentations. Sessions ended after 30 reinforcers (15 for each alternative). After approximately 30 sessions, response ratios for all pigeons began to track the changes in amount ratio (i.e., subjects' responding showed a moderate increase in sensitivity of responding to reinforcer amount). Characteristics of responding were similar to procedures in which reinforcer rate and immediacy have been manipulated, although sensitivity estimates for amount were lower than those previously obtained with rate and immediacy. This procedure may serve as a useful method for studying the effects of certain environmental manipulations (e.g., drug administration) on sensitivity to reinforcer amount.     

Choice in a variable environment: Effects of d-amphetamine on sensitivity to reinforcement

Four pigeons responded under a 7-component mixed schedule in which each component arranged a different left:right reinforcer ratio (27:1, 9:1, 3:1, 1:1, 1:3, 1:9, 1:27). Components were unsignaled, and the order within each session was randomly determined. After extensive exposure to these contingencies, effects of a range of doses of d-amphetamine (0.3-5.6 mg/kg) on estimates of sensitivity to reinforcement at several levels of analysis were assessed. Under non-drug conditions, the structure of choice was similar to that previously reported under this procedure. That is, responding adjusted within components to the reinforcer ratio in effect (i.e., sensitivity estimates were higher in the 2nd than in the 1st half of components), and individual reinforcers produced “preference pulses” (i.e., each food presentation produced an immediate, local, shift in preference toward the response that just produced food). Although there was a general tendency for d-amphetamine to reduce overall sensitivity to reinforcement, the size of this effect and its reliability varied across pigeons. Further analysis, however, revealed that intermediate d-amphetamine doses consistently reduced sensitivity immediately following reinforcer presentations; that is, these doses consistently attenuated preference pulses.     

Comparing the generalized matching law and contingency discriminability model as accounts of concurrent schedule performance using residual meta-analysis

To compare the generalized matching law (Baum, W.M., 1974b. On two types of deviation from the matching law: bias and undermatching. J. Exp. Anal. Behav. 22, 231-242) and contingency discriminability model (Davison, M., Jenkins, P.E., 1985. Stimulus discriminability, contingency discriminability, and schedule performance. Anim. Learn. Behav. 13, 77-84) as accounts of concurrent schedule performance, we conducted a residual meta-analysis of response- and time-allocation data from 20 studies (n's=886 and 774, respectively). Both models were fitted to the individual-subject data from each study, and residuals were obtained. Polynomial regressions were then performed on the pooled residuals to determine whether systematic trends were present as a function of predicted values. For the contingency discriminability model, the cubic coefficients were positive and statistically significant for both response- and time-allocation data. By contrast, no statistically significant systematic trend was obtained in the residuals for the generalized matching law. These results suggest that the relationship between log response allocation and log reinforcer allocation does not deviate significantly from linearity over an approximate range of +1.25 to -1.25 log units, consistent with the generalized matching law. Although qualitative criteria are also important in comparing models of behavioral phenomena, residual meta-analysis provides a powerful quantitative methodology for model selection and should prove useful in future research.     

The effect of prefeeding on fixed-ratio pausing is jointly determined by past and upcoming reinforcer magnitudes

Pausing within multiple fixed-ratio schedules differing in reinforcer magnitude is jointly controlled by both past and upcoming conditions of reinforcement. Abrupt shifts from a just-received large reinforcer to a signaled upcoming small reinforcer (i.e., a negative incentive shift) produce marked disruptions in responding, as indexed by extended pausing. The purpose of this experiment was to determine if reducing the level of food deprivation via prefeeding enhanced these disruptive effects. Five Long Evans rats lever-pressed according to a fixed-ratio schedule. Half of the components ended in a relatively large reinforcer (three 45-mg food pellets) and half ended in a relatively small reinforcer (one pellet). Components alternated irregularly, yielding four transitions between reinforcers: small-small, small-large, large-small (the negative incentive shift), and large-large. During five, 1-session prefeeding probes, rats were given 12 g of food in their home cages 1 h prior to the start of the session. Under steady-state conditions, negative incentive shifts engendered the longest pausing. Prefeeding produced large absolute and relative increases in pausing during negative incentive shifts, and small increases in pausing in the other transitions. The results are interpreted within a resistance to change framework.     

Variance matters: The shape of a datum

In the quantitative analysis of behaviour, choice data are most often plotted and analyzed as logarithmic transforms of ratios of responses and of ratios of reinforcers according to the generalized-matching relation, or its derivatives such as conditional-discrimination models. The relation between log choice ratios and log reinforcer ratios has normally been found using ordinary linear regression, which minimizes the sums of the squares of the y deviations from the fitted line. However, linear regression of this type requires that the log choice data be normally distributed, of equal variance for each log reinforcer ratio, and that the x (log reinforcer ratio) measures be fixed with no variance. We argue that, while log transformed choice data may be normally distributed, log reinforcer ratios do have variance, and because these measures derive from a binomial process, log reinforcer ratio distributions will be non-normal and skewed to more extreme values. These effects result in ordinary linear regression systematically underestimating generalized-matching sensitivity values, and in faulty parameter estimates from non-linear regression to assume hyperbolic and exponential decay processes. They also lead to model comparisons, which assume equal normally distributed error around every data point, being incorrect. We describe an alternative approach that can be used if the variance in choice is measured.     

Human choice behaviour in a frequently changing environment

The present experiment provided a replication in humans of an experimental procedure that has been used frequently with nonhumans to investigate choice behaviour in a changing environment. Six volunteers played a computer game, which required tracking of a moving balloon on two simultaneously available response panels for monetary reinforcers. Each of the 15 sessions randomly arranged the following concurrent variable-interval reinforcement schedules, which were in effect until six reinforcers had been obtained: 27:1, 9:1, 3:1, 1:1, 1:3, 1:9, and 1:27. Although many aspects of human performance appeared to be qualitatively similar to that of nonhumans on this procedure, such as the rapid preference shifts towards the within-session reinforcer ratios and the presence of local effects of reinforcers, values of sensitivity to reinforcement were very variable in the present study, as commonly reported in human choice studies. Future variations and refinements of the experimental methods are needed to explore how this variability may be reduced.     

A two-stage model for concurrent sequences

Schneider and Davison [Schneider, S.M., Davison, M., 2005. Demarcated response sequences and the generalised matching law. Behav. Proc. 70, 51–61] showed that the generalised matching law applied to concurrent free-operant two-response sequences. When sufficient temporal spacing is required between the responses, however, neither the response-level nor the sequence-level forms of the generalised matching law provide good fits. An alternative “two-stage sensitivity” model with fewer free parameters features two types of sensitivity to the reinforcement contingencies on sequences. When temporal spacing between the responses is long, the “response distribution sensitivity” parameter describes sensitivity only of the individual responses to the sequence-level contingencies. At a threshold level, this sensitivity reaches a maximum. When spacing is shorter than threshold, the “response order sensitivity” parameter reflects a new sensitivity to the order of the responses within sequences. As this sensitivity approaches its maximum, sequence matching is achieved. For both stages, a changeover parameter describes bias against sequences that require changeovers between the two responses. The model fit data ranging from near-response matching with long minimum inter-response times (IRTs) to sequence matching with no minimum IRTs, using two species and a variety of sequence reinforcer distributions. Rats differed from pigeons in achieving sequence matching only at a nonzero minimum IRT. In a comparison based on pigeon data with no minimum IRT, the two-stage sensitivity model was more efficient than the generalised matching law according to the Akaike criterion. The logic of the model suggests a new way of understanding the mechanisms underlying behavioural units.     

Four-alternative choice violates the constant-ratio rule

Six pigeons responded on a four-key concurrent variable-interval schedule in which a 27:9:3:1 distribution of reinforcers between the keys changed every 10 reinforcers. Their behaviour quickly came under the control of this changing four-way reinforcer ratio. However, preference between a pair of keys depended not only on the relative reinforcer rates on those keys, but also on the absolute levels of those rates. This contradicts the constant-ratio rule that underpins the matching approach to choice, but is predicted by a contingency-discriminability model that assumes that organisms may occasionally misattribute reinforcers to a response that did not produce them. Reinforcers produced strong preference pulses, or transient increases in responding on the just-reinforced key. Despite accurate tracking of the reinforcer ratio, reinforcers obtained late in components and from leaner keys still produced strong pulses, suggesting both extended and local control of behaviour. Patterns of switching between keys were graded and similarly controlled by the reinforcer rates on each key. Whether considered in terms of switching, local preference pulses, or extended preference, behaviour was controlled by a rapidly changing four-way reinforcer ratio in a graduated, continuous manner that is unlikely to be explained by a simple heuristic such as fix-and-sample.     

Amount-dependent temporal discounting?

Amount-dependent temporal discounting has been demonstrated for human choice between outcomes differing in amount and delay. In the only study to date with non-humans, Grace reported no evidence for amount-dependent temporal discounting with pigeons in a concurrent-chains procedure. The present experiments repeated Grace's procedure but with modifications to enhance the discrimination between small and large magnitude outcomes. In Experiment 1, sensitivity of pigeons' initial-link choice to the terminal link delay ratio was greater with large reinforcer durations in the terminal links than with small reinforcer durations. This result is consistent with a greater rate of temporal discounting for larger reinforcers (the reverse of the result for humans), but can also be explained as enhanced discrimination of delay ratios with larger reinforcer durations. The results of a second experiment supported Grace's conclusion that amount-dependent temporal discounting does not characterize pigeons' choice in concurrent chains. Because reinforcer amount was held constant between choice alternatives in the present experiments and that of Grace, but varied in the human studies, our results question whether prior demonstrations of amount-dependent discounting reflect the effects of reinforcer delay or of reinforcer amount. Differences in the procedures used to study discounting in humans (titration procedures) and non-humans (concurrent chains) may contribute to the divergent results across species.     

Effects of prefeeding, extinction, and distraction during sample and comparison presentation on sensitivity to reinforcer frequency in matching to sample

The present experiment examined the effects of several test manipulations on discrimination, accuracy and sensitivity to reinforcer frequency in a conditional discrimination. Four pigeons responded on a multiple schedule of matching to sample procedures in which the reinforcer-frequency ratio for correct comparison choice responding was varied across components within session from 1:9 to 9:1. Following stability, the effects of prefeeding, extinction, and distraction during sample and comparison presentation were assessed. Discrimination accuracy decreased under prefeeding, extinction, and distraction during sample presentation. Sensitivity to reinforcer frequency decreased under prefeeding and extinction. Decreases in sensitivity were positively related to decreases in discrimination accuracy. The decreases in discrimination accuracy and sensitivity under prefeeding and extinction are interpreted as being due to decreases in attending to the sample and comparison stimuli, respectively, possibly mediated by motivational effects of these manipulations. This interpretation is consistent with current conceptualizations of the contingencies that govern conditional-discrimination performance.     

Dynamics of choice and frequency of environment change

Recent research has examined the effects on behavioral adjustment of a range of within-session changes in the reinforcer ratio available from two alternatives. Regularities between extended patterns of behavior (choice) and a distribution of food deliveries (expressed as a food-rate ratio) have emerged from such studies. To assess the generality of these findings, the present study manipulated rats' experience in the choice situation. Sixteen rats were divided into two groups of eight rats each. Seven non-signaled food-rate ratios were arranged to occur for responses on two concurrently available levers. Group 1 experienced a different food-rate ratio every day; each ratio provided 70 food deliveries, and none of the seven ratios operated for 2 consecutive days. Group 2 experienced the same sequence of food-rate ratios, except that each food-rate ratio remained in effect for 17 consecutive days (providing 70 food deliveries per session), after which a different food-rate ratio was selected for the next 17 sessions. In all cases, preference was adjusted to changes in food-rate ratios. Estimates of sensitivity to changes in food-rate ratios increased with an increasing number of sessions (i.e., experience in the choice situation).     

Quantitative analyses of methamphetamine's effects on self-control choices: implications for elucidating behavioral mechanisms of drug action

The purpose of the present research was to utilize quantitative methods to identify behavioral mechanisms involved in the effects of stimulant drugs on choice in a self-control procedure. A logarithmic equation based upon a combination of the matching law and hyperbolic discounting was used to separate drug-induced changes in sensitivity to reinforcement delay from drug-induced changes in sensitivity to reinforcement amount. Pigeons responded under a concurrent-chains schedule. In the initial link, two keys were illuminated simultaneously and access to the terminal link was controlled by a single random-interval (RI) schedule; pecks on one or the other key lead to its terminal link with a 0.5 probability. In the terminal links, one alternative provided 1-s access to food (the smaller reinforcer) and the other alternative provided 4-s access to food (the larger reinforcer). The signaled delay to the smaller reinforcer always was 2s, whereas the signaled delay to the larger reinforcer increased from 2 to 40s within each session, across 10-min blocks. In general, intermediate doses of methamphetamine increased preference for the larger more delayed reinforcer. Quantitative analyses indicated that, in most cases, methamphetamine decreased sensitivity to reinforcement delay. In a few instances, concomitant decreases in sensitivity to reinforcement amount also occurred. These results suggest that a reduced sensitivity to reinforcement delay may be important behavioral mechanism of the effects of stimulants on self-control choices, and that this effect sometimes can be accompanied by a decreased sensitivity to reinforcement amount.     

The matching law and effects of reinforcer rate and magnitude on choice in transition

Four pigeons responded in a concurrent-schedule procedure in which reinforcer rates and magnitudes changed unpredictably across sessions according to independent random series. Programmed relative reinforcement rates and magnitudes were always either 2:1 or 1:2. Pigeons' response allocation tended to stabilize within sessions and multiple regression analyses showed that it was determined by rates and magnitudes from the current session. Sensitivity coefficients were positive and statistically significant for current-session reinforcement and magnitude ratios. Although there were individual differences in sensitivity to rate and magnitude, their interaction was not significant across subjects. Rate and magnitude both controlled responding in single sessions and individual interreinforcer intervals. Analyses of responding within sessions showed that preference was more extreme when the richer rate and larger magnitude were associated with the same alternative than when they were associated with different alternatives. Overall, results support the concatenated generalized matching law's assumptions of additivity and independence as applied to choice in transition.     

Choice in the bluegill (Lepomis macrochirus)

To study matching in a species distantly related to mammals and birds, seven bluegill were trained to break a photobeam using a nose-poke response for access to pelleted food in their home aquaria during one-h sessions. Reinforcer ratios available from the two response alternatives varied among the following: 16:1, 8:1, 4:1, 1:1, 1:4, 1:8, and 1:16. The overall reinforcement rate was held at 0.8/min. All experiments were conducted in a closed economy, i.e., the fish's daily food ration was available only during experimental sessions. Matching functions are reported for each fish using all combinations of scheduled and obtained reinforcer ratios as the independent variables and response and time ratios as the dependent variables. All matching functions had slopes less than 1.0 and r² values above 0.70. Overall response rates were unrelated to the reinforcer ratios but, as with other species studied, changeover rates were highest for the 1:1 condition and lowest for the 16:1 conditions. These results are consistent with data obtained from more traditionally studied taxa (e.g., birds, mammals, and primates), and similar previous studies with fish, suggesting that matching has been conserved since fish, birds, and mammals evolved from a common ancestor over 400 million years ago.     

Within-session discrimination between times of reinforcers in the minutes range by pigeons

This experiment tested whether pigeons could discriminate between a large reinforcer delivered at 6 min (early) vs. 16 min (late) within a 20 min session. A within subject design was used in which an early reinforcer was delivered in one context, and a late reinforcer in another. Rate of responding on the first link of a chain schedule was higher in the early reinforcer condition. Furthermore, in probe sessions during which no large reinforcer was delivered, the discrimination was maintained. Implications for foraging are discussed.     

Need probability effects in animal short-term memory

Five pigeons performed in a delayed matching-to-sample (DMTS) procedure with five delay durations (0.5, 2.5, 5, 10 and 20 s) mixed within sessions. Contrary to the predictions of need probability theory, discriminability decreased when fewer short than long delays were included in each session. To test whether the decrease in discriminability was due to a decrease in obtained reinforcement at short delays, the number of trials at each delay was held constant and reinforcer probability was increased with increasing delay. This manipulation produced a similar decrease in discriminability as when the frequency of delays was manipulated. It was concluded that the effect of delay frequency on the forgetting function is mediated by the effect of the reinforcer distribution, which influences discriminability by weakening stimulus control.     

Chromatographic determination of arylsulfatases A and B in human gastric mucosa]

In continuation of a previous work, we have confirmed the occurrence of arylsulfatase A in 4 samples of human gastric mucosa analysed by the chromatographic procedure described by Stevens et all. By using the chromatographic method we have also evidentiated the occurrence of arylsulfatase B, which was not detected by using the method of Baum et all. The B form was lower than the A form in 3 samples while it was higher in another sample. In the latter sample of gastric mucosa it was also detected the unusual form Bm of arylsulfatase. It was concluded that both forms A and B of arylsulfatase are present in human gastric mucosa, in variable amounts and that the simple procedure developed by Baum et all., although suitable for the analysis of these enzymes in the urine, is not useful for the determination of arylsulfate B in the gastric mucosa.     

Chromosomal diversity and morphological dimorphism in Moroccan wild oat, Avena agadiriana

Chromosomal diversity and morphological dimorphism were examined by breeding the intraspecific hybrids among six accessions of Avena agadiriana Baum et Fedak. The accession M55 occasionally showed a quadrivalent, which indicated that it was heterogeneous for a reciprocal translocation. The chromosome pairings in the intra-early-flowering ecotype hybrids were almost normal with high chiasma frequency at metaphase I. However, the intra-late-flowering ecotype hybrids showed a quadrivalent or a trivalent with a univalent, similar to the inter-ecotype hybrids. The marginal population of the northeastern end, M74, always showed a quadrivalent or a trivalent in all the hybrids due to a unique large reciprocal translocation. This result was consistent with the late-flowering ecotype. There was a genocline of the chiasma frequency resulting from chromosomal rearrangements between adjacent populations. There was also a significant negative correlation between the mean chiasma frequency and the annual rainfall in each collection site (r = ?0.880). The two distinct ecotypes were characterized by the different magnitude and number of chromosomal rearrangements, reciprocal translocation and loss of satellite chromosomes, and they were adapted to the wide range of environments along the Atlantic coast of Morocco.     

Influence of escalating alternative reinforcer values on cigarette choice

The availability of alternative reinforcers reduces drug taking. Escalating alternative reinforcer values have been used to initiate and maintain abstinence from drug use. A reset in reinforcer value has been added to the schedule of alternative reinforcer presentation to discourage relapse. The purpose of this preliminary study was to test the influence of escalating and escalating and resetting alternative reinforcer value on cigarette choice in the human laboratory. Fourteen daily cigarette smokers completed this experiment, which required one practice and three experimental sessions. During each experimental session, subjects made six choices between smoking a cigarette and receiving money, available under Constant, Escalating or Escalating and Resetting conditions. The total number of cigarettes chosen and puffs taken, but not the maximum consecutive number of cigarettes choices, was decreased in the Escalating condition relative to the Constant condition. The maximum number of consecutive cigarettes chosen was decreased in the Escalating and Resetting condition relative to the Constant condition. The proportion of money earned was increased in the Escalating condition relative to the Constant and Escalating and Resetting conditions. These initial findings indicate that whereas an escalating alternative reinforcer schedule reduces cigarette smoking overall, an escalating and resetting alternative reinforcer schedule may reduce repeated cigarette smoking (i.e., relapse).