Intertrial interval as a contextual stimulus

Four experiments with rats investigated whether the time between appetitive conditioning trials can serve as a discriminative cue for responding during the next conditional stimulus (CS). In Experiment 1, rats that received extinction trials with a 4-min intertrial interval (ITI) showed spontaneous recovery after a retention interval of 16 min, whereas rats that received extinction with a 16-min ITI did not. Experiments 2 and 3 investigated more explicit discriminations between the 4- and 16-min ITIs. When a 16-min ITI signaled that the CS would be reinforced and a 4-min ITI signaled that it would not, the ITIs modulated responding to the CS. But when the 4-min ITI signaled reinforcement and the 16-min ITI did not, there was less evidence of modulation by the ITIs. This asymmetry was due at least partly to a difficulty in performance rather than learning. Experiment 4 investigated similar discriminations with 1- and 4-min ITIs. Here the results took a different form: time in the reinforced ITI elicited responding directly, but did not modulate responding to the CS. ITI can function as a contextual cue, and the results suggest new similarities between the processes behind interval timing and associative learning.     

Investigating fear in rainbow trout (Oncorhynchus mykiss) using the conditioned-suppression paradigm

Trout learned the operant task of pendulum-pressing for a food-reward in a mean of 4.3 sessions lasting 1 hr. In a separate phase, fish also learned—through classical conditioning—to associate a neutral light cue with an aversive stimulus. When again allowed to pendulum-press for food, after aversive classical conditioning, there was a drop in the rate of responding. The mean rate dropped from 3.6-2.9 responses per min. Most important, when the light-stimulus was superimposed on a steady bout of pendulum-pressing, trout ceased to press the pendulum and did not resume activity until termination of the light-stimulus (mean number of responses during a 3-min interval immediately prior to light-stimulus = 14.3 vs. during 3-min light-stimulus = 0.1). Psychologists have used this decrease in operant responding, or “conditioned emotional response,” as a tool to examine the psychological nature of this type of aversive conditioning. In this study, the fish demonstrated various results under this paradigm similar to those shown by “higher” nonhuman animals, therefore challenging the view of fish as unconscious, nonsentient animals.     

Investigating Fear in Rainbow Trout (Oncorhynchus mykiss) Using the Conditioned-Suppression Paradigm

Trout learned the operant task of pendulum-pressing for a food-reward in a mean of 4.3 sessions lasting 1 hr. In a separate phase, fish also learned—through classical conditioning—to associate a neutral light cue with an aversive stimulus. When again allowed to pendulum-press for food, after aversive classical conditioning, there was a drop in the rate of responding. The mean rate dropped from 3.6–2.9 responses per min. Most important, when the light-stimulus was superimposed on a steady bout of pendulum-pressing, trout ceased to press the pendulum and did not resume activity until termination of the light-stimulus (mean number of responses during a 3-min interval immediately prior to light-stimulus = 14.3 vs. during 3-min light-stimulus = 0.1). Psychologists have used this decrease in operant responding, or “conditioned emotional response,” as a tool to examine the psychological nature of this type of aversive conditioning. In this study, the fish demonstrated various results under this paradigm similar to those shown by “higher” nonhuman animals, therefore challenging the view of fish as unconscious, nonsentient animals.     

Conditional Inference Following Group Sequential Testing

The work of Fisher (1959) and Buehler (1959) discuss the importance of conditioning on recognizable subsets of the sample space. The stopping time yields an easily identifiable partition of the sample space when considering group sequential testing. We first present confidence intervals that are correct when conditioning on the subset of data for which a trial stopped at a particular analysis. These intervals have very desirable properties for observations that are highly unusual (given any value of the mean). In addition, they provide insight into how information about the mean is distributed between the two sufficient statistics. We then use conditional coverage probabilities to compare the sample mean, stagewise, and repeated confidence intervals. We find that none of these intervals outperforms the others when conditioning on stopping time, and no interval is a uniformly acceptable performer.     

Percentage reward in an operant analogue to foraging

Pigeons (Columba livia) responding on an operant, conditioning analogue to foraging could either accept or reject a variable-interval 20-s schedule which always led to food or a variable-interval 5-s schedule which led to food on only a percentage of trials. The probability of accepting the certain alternative increased as the percentage of food trials for the uncertain alternative decreased. The probability of accepting the uncertain alternative increased with the percentage of food trials for this alternative. Subjects receiving all of their food in the experiment (‘closed economy’) and those requiring supplementation (‘open economy’) preferred whichever alternative provided the higher overall mean rate of reinforcement.     

Normal frailty probit model for clustered interval‐censored failure time data

Clustered interval‐censored data commonly arise in many studies of biomedical research where the failure time of interest is subject to interval‐censoring and subjects are correlated for being in the same cluster. A new semiparametric frailty probit regression model is proposed to study covariate effects on the failure time by accounting for the intracluster dependence. Under the proposed normal frailty probit model, the marginal distribution of the failure time is a semiparametric probit model, the regression parameters can be interpreted as both the conditional covariate effects given frailty and the marginal covariate effects up to a multiplicative constant, and the intracluster association can be summarized by two nonparametric measures in simple and explicit form. A fully Bayesian estimation approach is developed based on the use of monotone splines for the unknown nondecreasing function and a data augmentation using normal latent variables. The proposed Gibbs sampler is straightforward to implement since all unknowns have standard form in their full conditional distributions. The proposed method performs very well in estimating the regression parameters as well as the intracluster association, and the method is robust to frailty distribution misspecifications as shown in our simulation studies. Two real‐life data sets are analyzed for illustration.     

Do rats time filled and empty intervals of equal duration differently?

The goal was to determine whether rats time filled and empty intervals of equal duration differently. Each of five rats was trained for 50 sessions on an instrumental appetitive head entry procedure in which food was available (primed) every 120 s. On "empty" cycles, 30s prior to the next food prime, a 0.5-s pulse of white noise was presented. On "filled" cycles, 30s prior to the next food prime, white noise came on and stayed on until food was delivered. The two types of cycles were presented with equal probability. The results showed that the rats timed both the food-to-food interval and the stimulus-to-food interval. A comparison of the response gradients on filled and empty cycles following stimulus presentation showed better temporal discrimination on filled cycles. The results were modeled using a Packet theory of timing, with a linear averaging rule to combine the temporal information provided by the stimulus and food. The model fits to the individual response gradients were evaluated with a Turing test.     

Stepping outside the box in considering the C/T ratio

Rate expectancy theory (RET) predicts that in Pavlovian procedures conditioned responding will be directly related to the ratio of time spent in the experimental context (C) relative to the trial time (T) or duration of the conditioned stimulus (CS). This prediction was discussed in the context of three experiments. The first and third experiments involved sexual conditioning in quail [Learn Motiv 31 (2000) 211; J Exp Psychol Anim Behav Processes 27 (2001) 269]; the second experiment involved conditioning rats with food as the unconditioned stimulus (US) [Learn Motiv 28(1997) 465]. In each experiment, one type of conditioned response was directly related to the C/T ratio (as predicted by RET) but another conditioned response was inversely related. In addition, the conditioned behavior that occurred with low C/T ratios was controlled by contextual cues rather than the putative CS. The implications of these findings for possible boundary conditions of RET were discussed. The discussion revealed serious shortcomings in the characterization of context conditioning by RET.     

The inotropic memory of amphibian myocardium. I.-Identification of two stimultaneous mechanisms and statement of a model.

(1) The effects of previous contractions on the actual contractile strength is studied in strips of toad ventricle. The inotropic effect is quantified by superposing a conditioning contraction to a rhythm of definite frequency, its measure being the difference in strength between a rhythm contraction in the presence and in the absence of the conditioning one. (2) The inotropic effect is studied as a function of the interval between the actual and conditioning contractions. Depressed sections of the curve, associated to shortened action potentials, are detected and excluded. (3) The inotropic effect is always positive at low frequencies, but at higher frequencies and long intervals it becomes negative. (4)In high calcium concentration the inotropic effect is always negative and does not depend on frequency. Morever, the joint effect of two previous contractions is equal to the sum of the individual effects of each one. (5) The results are interpreted in terms of two independent elementary processes, one of which potentiates whereaas the other inhibits the strength of contraction. The former disappears in high calcium. Assuming some simple properties for these processes a mathematical expression has been achieved. This expression describes the inotropic effect of any sequence of contractions as a function of intervals involved.     

The role of contextual conditioning in the effect of reinforcer devaluation on instrumental performance by rats

Different groups of rats received different amounts of training to lever press for a food reinforcer before an aversion was conditioned to the food. This devaluation of the reinforcer reduced responding in both subsequent extinction and reinforced tests of responding to a degree that was independent of the amount of instrumental training. Moreover, interpolating context extinction between aversion conditioning and the extinction test reduced the magnitude of the devaluation effect, thereby indicating that Pavlovian contextual conditioning may play a role in the instrumental devaluation effect.     

Effects of d-amphetamine on the behavior of pigeons exposed to the peak procedure

The effects of d-amphetamine on pigeons' key-pecking under the peak interval (PI) procedure were investigated in two experiments. In experiment I the effects of doses of d-amphetamine from 0.75 to 3.0 mg/kg on responding under PI 30 and 45 s were studied for 10 successive days. Reductions in peak time and wait time were observed at both PI values and an increase in the width was found at PI 30 s. There was no evidence of tolerance. In experiment II, pigeons exposed to a PI 45 s schedule were administered doses of D-amphetamine of 1.5 and 3.0 mg/kg for 30 successive days. Reductions in peak time and wait time were found here. Evidence of tolerance was found in wait time, peak time and width of the distribution at the higher dose. In both experiments a rate-dependent effect of the drug was found in the portion of each peak trial before the time that food was delivered on reinforced trials; this effect was weaker after the customary time of food delivery. The rate-dependent effect for responses before food time, combined with little effect of the drug on responses after food time, is shown by simulation to be sufficient to account for the reduction in peak time, without the need to appeal to an internal clock mechanism.     

A rapid and sensitive method for measuring the conditional emotional response. II: On-the-baseline excitatory conditioning and extinction

The present study outlines a rapid and sensitive on-the-baseline conditional emotional response (CER) procedure. Using rats as the experimental subject, the method detects delay conditioning, incubation, extinction and spontaneous recovery. In addition, the method detects conditional responding using electric shock ranging from 0.23 to 0.50 mA as the unconditional stimulus. Because of its speed and sensitivity, the method shelters the subject from unnecessary long-term deprivation and pain.     

60 Hz electric fields and incandescent light as aversive stimuli controlling the behavior of rats responding under concurrent schedules of reinforcement

Several reports have shown that animals will sometimes engage in behaviors that reduce their exposure to a 60 Hz electric field (E-field). The field, therefore, can function as an aversive stimulus. In other studies, the E-field at equivalent strengths failed to function as an aversive stimulus. The present experiment, using rats, demonstrates how factors other than field strength can influence whether a subject engages in behavior that reduces field exposure. The general design consisted of giving the rat a choice between two alternatives, one of which sometimes included an added stimulus. Each subject was trained to press each of two levers to obtain food. Pressing one lever was reinforced intermittently under a variable interval 2 min schedule (VI 2); pressing the other lever was reinforced by a second VI 2 schedule operating independently of the first. Under this concurrent schedule the rat spent 50% of the daily 50 min session responding to each of the levers, indicating that they were equally “valued.” Next, while the schedules remained in effect, the first response to one of the levers turned on a 100 kV/m E-field which remained on until the rat pressed the other lever. The time spent responding under the schedule associated with the field was reduced by about 5–10%. When the procedure was changed so that no lever presses produced food, i.e., extinction, but the added stimulus contingency remained, the rats spent even less time in the presence of the field. Similar outcomes were observed during both the concurrent food or extinction schedules when incandescent light was used. Thus, both an E-field and incandescent light functioned as aversive stimuli, but the magnitude of the aversiveness was small. Aversiveness depended not only on stimulus intensity, but also on behavioral factors. Bioelectromagnetics 19:210–221, 1998. © 1998 Wiley-Liss, Inc.     

Directly parameterized regression conditioning on being alive: analysis of longitudinal data truncated by deaths

For observational longitudinal studies of geriatric populations, outcomes such as disability or cognitive functioning are often censored by death. Statistical analysis of such data may explicitly condition on either vital status or survival time when summarizing the longitudinal response. For example a pattern-mixture model characterizes the mean response at time t conditional on death at time S = s (for s > t), and thus uses future status as a predictor for the time t response. As an alternative, we define regression conditioning on being alive as a regression model that conditions on survival status, rather than a specific survival time. Such models may be referred to as partly conditional since the mean at time t is specified conditional on being alive (S > t), rather than using finer stratification (S = s for s > t). We show that naive use of standard likelihood-based longitudinal methods and generalized estimating equations with non-independence weights may lead to biased estimation of the partly conditional mean model. We develop a taxonomy for accommodation of both dropout and death, and describe estimation for binary longitudinal data that applies selection weights to estimating equations with independence working correlation. Simulation studies and an analysis of monthly disability status illustrate potential bias in regression methods that do not explicitly condition on survival.     

Effect of unsignaled delays between stimuli in a chain schedule on responding and resistance to change

Behavioral momentum theory is an evolving theoretical account of the strength of behavior. One challenge for the theory is determining the role of signal stimuli in determining response strength. This study evaluated the effect of an unsignaled delay between the initial link and terminal link of a two-link chain schedule on resistance to change using a multiple schedule of reinforcement. Pigeons were presented two different signaled delay to reinforcement schedules. Both schedules employed a two-link chain schedule with a variable interval 120-s initial link followed by a 5-s fixed time terminal link schedule. One of the schedules included a 5-s unsignaled delay between the initial link and the terminal link. Resistance to change was assessed with two separate disruption procedures: extinction and adding a variable time 20-s schedule of reinforcement to the inter-component interval. Baseline responding was lower in the schedule with the unsignaled delay but resistance to change for the initial link was unaffected by the unsignaled delay. The results suggest that not all unsignaled delays are equal in their effect on resistance to change.     

Amphetamine affects the start of responding in the peak interval timing task

In this paper we investigate how amphetamine affects performance in a PI task by comparing two analyses of responding during peak trials. After training on 24 s fixed interval (FI-24) with 96 s peak trials, rats were given amphetamine for 4 consecutive days at doses of .5 and 1.0 mg/kg. Responses during peak trials were fitted with a Gaussian distribution to estimate the expected time of reinforcement from the peak time. A single trials analysis was also performed to determine the start time and stop time of the transition into and out of a high rate of responding on each peak trial. Amphetamine significantly decreased peak times as measured with the Gaussian curve fitting. However, in the single trials analysis, animals initiated responding significantly earlier, but did not stop responding earlier. Thus, fitting a Gaussian to the average performance across trials sometimes provides a different characterization of the timing process than does analyzing the start and stop of responding on individual trials. In the current experiment, the latter approach provided a more precise characterization of the effects of amphetamine on response timing.     

Hippocampal State-Dependent Behavioral Reflex to an Identical Sensory Input in Rats

We examined the local field potential of the hippocampus to monitor brain states during a conditional discrimination task, in order to elucidate the relationship between ongoing brain states and a conditioned motor reflex. Five 10-week-old Wistar/ST male rats underwent a serial feature positive conditional discrimination task in eyeblink conditioning using a preceding light stimulus as a conditional cue for reinforced trials. In this task, a 2-s light stimulus signaled that the following 350-ms tone (conditioned stimulus) was reinforced with a co-terminating 100-ms periorbital electrical shock. The interval between the end of conditional cue and the onset of the conditioned stimulus was 4±1 s. The conditioned stimulus was not reinforced when the light was not presented. Animals successfully utilized the light stimulus as a conditional cue to drive differential responses to the identical conditioned stimulus. We found that presentation of the conditional cue elicited hippocampal theta oscillations, which persisted during the interval of conditional cue and the conditioned stimulus. Moreover, expression of the conditioned response to the tone (conditioned stimulus) was correlated with the appearance of theta oscillations immediately before the conditioned stimulus. These data support hippocampal involvement in the network underlying a conditional discrimination task in eyeblink conditioning. They also suggest that the preceding hippocampal activity can determine information processing of the tone stimulus in the cerebellum and its associated circuits.     

Populations in variable environments: the effect of variability in a species' primary resource

Mechanistic models for herbivore populations responding to rainfall-driven pasture are used to explore the effect of temporal variability in a primary resource on the abundance and distribution of a species. If the numerical response of the herbivore to pasture is a convex function, then gains made over time intervals with above average rainfall do not compensate for losses incurred when rainfall is below average. Populations therefore fare worse when rainfall is variable compared with when rainfall is reliable. It is demonstrated that this result is independent of the distribution of rainfall. Sensitivity of a species to variability, and hence the limit to its distribution in variable environments, is directly proportional to the difference between population growth rate under ideal conditions and the estimated rate of decline as the species' resource tends to zero. When density dependence is included in the numerical response, the average abundance of a species declines with increasing variability in its primary resource. However, a model for the dynamics of pasture and rabbits (Oryctolagus cuniculus) and red foxes (Vulpes vulpes) in southern Australia, is used to illustrate that trophic interactions can reverse the effect of variability: in the absence of foxes, the mean abundance of rabbits declines with variability as expected, but in the full model the mean abundance of rabbits increases.     

How rats combine temporal cues

The procedures for classical and operant conditioning, and for many timing procedures, involve the delivery of reinforcers that may be related to the time of previous reinforcers and responses, and to the time of onsets and terminations of stimuli. The behavior resulting from such procedures can be described as bouts of responding that occur in some pattern at some rate. A packet theory of timing and conditioning is described that accounts for such behavior under a wide range of procedures. Applications include the food searching by rats in Skinner boxes under conditions of fixed and random reinforcement, brief and sustained stimuli, and several response-food contingencies. The approach is used to describe how multiple cues from reinforcers and stimuli combine to determine the rate and pattern of response bouts.     

Optimal properties of the conditional mean as a selection criterion

Summary Rules for selection that maximize the expected merit of selected candidates are discussed. When the proportion selected is constant, selection based on conditional means of merit given the observations is optimum in the above sense, regardless of the distribution. This does not hold if the proportion selected is random. When the expected value of the observations is a linear function of a set of unknown parameters, selection can be based on a vector of corrected records, w. It is shown that under normality, the conditional mean of merit given w is the best linear unbiased predictor (BLUP), provided that the expected value of the merit function is the same in all candidates. A Bayesian argument is given to justify the use of BLUP as a selection rule when the expected merit differs from candidate to candidate.